-- Logs begin at Wed 2022-09-07 08:59:45 UTC, end at Wed 2022-09-07 11:25:50 UTC. -- Sep 07 09:33:22.998474 n-d-836830-16 systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 09:33:23.006198 n-d-836830-16 devstack@n-api.service[112943]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 09:33:23 2022] *** Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: nodename: n-d-836830-16 Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: machine: x86_64 Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: clock source: unix Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: pcre jit disabled Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: detected number of CPU cores: 4 Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: current working directory: / Sep 07 09:33:23.008213 n-d-836830-16 devstack@n-api.service[112943]: detected binary path: /usr/bin/uwsgi-core Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: your processes number limit is 47680 Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: your memory page size is 4096 bytes Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: detected max file descriptor number: 2048 Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: lock engine: pthread robust mutexes Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: thunder lock: enabled Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 09:33:23.008915 n-d-836830-16 devstack@n-api.service[112943]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 09:33:23.048485 n-d-836830-16 devstack@n-api.service[112943]: Python main interpreter initialized at 0x563c0aaef9c0 Sep 07 09:33:23.048485 n-d-836830-16 devstack@n-api.service[112943]: python threads support enabled Sep 07 09:33:23.048485 n-d-836830-16 devstack@n-api.service[112943]: your server socket listen backlog is limited to 100 connections Sep 07 09:33:23.048485 n-d-836830-16 devstack@n-api.service[112943]: your mercy for graceful operations on workers is 90 seconds Sep 07 09:33:23.048873 n-d-836830-16 devstack@n-api.service[112943]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 09:33:23.048950 n-d-836830-16 devstack@n-api.service[112943]: *** Operational MODE: preforking *** Sep 07 09:33:23.049197 n-d-836830-16 devstack@n-api.service[112943]: *** uWSGI is running in multiple interpreter mode *** Sep 07 09:33:23.049197 n-d-836830-16 devstack@n-api.service[112943]: spawned uWSGI master process (pid: 112943) Sep 07 09:33:23.049396 n-d-836830-16 systemd[1]: Started Devstack devstack@n-api.service. Sep 07 09:33:23.049930 n-d-836830-16 devstack@n-api.service[112943]: spawned uWSGI worker 1 (pid: 112944, cores: 1) Sep 07 09:33:23.050267 n-d-836830-16 devstack@n-api.service[112943]: spawned uWSGI worker 2 (pid: 112945, cores: 1) Sep 07 09:33:23.050446 n-d-836830-16 devstack@n-api.service[112943]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 09:33:23.713797 n-d-836830-16 devstack@n-api.service[112945]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 09:33:23.745257 n-d-836830-16 devstack@n-api.service[112944]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 09:33:24.807977 n-d-836830-16 devstack@n-api.service[112945]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:33:24.807977 n-d-836830-16 devstack@n-api.service[112945]: from cryptography.utils import int_from_bytes Sep 07 09:33:24.808601 n-d-836830-16 devstack@n-api.service[112945]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:33:24.808601 n-d-836830-16 devstack@n-api.service[112945]: from cryptography.utils import int_from_bytes Sep 07 09:33:24.831709 n-d-836830-16 devstack@n-api.service[112944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:33:24.831709 n-d-836830-16 devstack@n-api.service[112944]: from cryptography.utils import int_from_bytes Sep 07 09:33:24.832205 n-d-836830-16 devstack@n-api.service[112944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:33:24.832205 n-d-836830-16 devstack@n-api.service[112944]: from cryptography.utils import int_from_bytes Sep 07 09:33:27.296997 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 09:33:27.297600 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 09:33:27.297796 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 09:33:27.298159 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 09:33:27.298416 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 09:33:27.298810 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.299138 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.299337 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 09:33:27.299727 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.299809 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 09:33:27.299885 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.300087 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.300182 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 09:33:27.300400 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.300496 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 09:33:27.300767 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 09:33:27.300922 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.301205 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.301309 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.301542 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.301635 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.301808 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.301957 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.302126 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.302286 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.302455 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-16 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.302624 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.302780 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.302942 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.303090 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.303271 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.303404 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.303597 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.303729 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.303931 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.304042 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.304215 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.304343 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.304526 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.304630 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.304856 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-16 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.305124 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.305262 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.305510 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.305601 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.305830 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.305920 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.306157 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.306249 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.306468 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.306605 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.306799 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.306897 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.307109 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.307190 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.307433 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.307613 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.307747 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.307938 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.308072 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.308250 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.308383 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.308567 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.308792 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-16 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.308909 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.309114 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.309262 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.309478 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.309582 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.309796 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.309909 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.310213 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.310308 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.310784 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.310873 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.311095 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.311178 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.311418 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.311509 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-16 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.311745 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.311848 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.312056 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.312184 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.312403 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.312502 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.312705 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.312799 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313025 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313217 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313372 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313467 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313685 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313770 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.313997 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.314080 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.314312 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.314442 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.314635 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.314731 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.314944 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315063 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315251 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315350 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315504 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315626 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315816 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.315936 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.316142 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.316245 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.317083 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.317242 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.317498 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.317670 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.317765 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.317987 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.318079 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.318312 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.318445 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.318638 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.318732 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.318953 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319038 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319265 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319348 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319577 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319674 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319890 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.319974 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.320161 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.320245 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.320419 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.320511 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.320744 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.320830 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.321073 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.321162 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.321418 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.321507 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.321734 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.321890 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322047 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322136 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322356 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322439 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322666 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322757 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.322978 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.323061 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.323293 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.323378 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.323605 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.323692 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.323929 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324025 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324251 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324354 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324559 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324652 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324882 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.324974 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.325228 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.325337 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.325544 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.325638 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.325855 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.325963 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.326166 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.326257 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.326488 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.326580 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.326821 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.326921 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327128 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327225 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327408 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327516 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327685 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327806 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.327993 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.328077 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.328313 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.328396 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.328623 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.328707 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.328930 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329013 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329261 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329345 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329569 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329658 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329871 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.329953 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.330177 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.330260 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.330485 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.330568 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.330794 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.330877 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.331103 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.331186 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.331413 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.331498 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.331716 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.331798 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.332069 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.332203 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.332378 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.332499 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.332684 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.332775 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.333002 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.333095 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.333346 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.333465 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.334173 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.334265 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.334518 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.334621 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.334795 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.334880 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.335103 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.335200 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.335422 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.335526 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.335727 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.335819 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336037 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336120 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336363 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336491 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336667 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336765 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.336974 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.337076 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.337314 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.337423 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.337626 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.337721 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.337934 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338038 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338256 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338361 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338559 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338654 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338867 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.338961 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.339183 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.339286 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.339492 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.339599 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.339798 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.339892 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.340102 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.340197 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.340409 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.340504 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.340716 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.340883 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.341024 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.341352 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.341473 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.341658 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.341963 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.342062 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.342282 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.342547 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.342640 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.342876 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.342971 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.343199 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.343307 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.343512 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.343608 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.343826 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.343911 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.344143 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.344268 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.344459 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.344542 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.344775 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.344860 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.345117 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.345239 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.345479 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.345752 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.345837 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.346125 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.346339 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.346447 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.346751 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.346943 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.347081 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.347399 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.347544 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.347803 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.348031 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.348130 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.348370 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.348483 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.348704 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:33:27.348797 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.349060 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.349269 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.349433 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.349582 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.349745 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.349829 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350016 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350104 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350333 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350429 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350653 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350739 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.350985 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.351086 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.351309 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.351401 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.351624 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.351710 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.351970 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.352100 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.352317 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.352413 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.352638 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.352728 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.352961 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.353045 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.353306 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.353409 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.353631 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.353731 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.353945 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354029 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354313 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354406 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354593 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354677 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354906 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.354989 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.355224 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.355308 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.355547 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.355661 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.355865 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.355962 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.356190 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.356293 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.356506 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.356598 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.356820 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.356911 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.357134 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.357259 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.357472 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.357564 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.357787 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.357893 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.358128 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.358219 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.358447 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.358539 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.358773 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.358875 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.359090 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.359180 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.359403 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.359500 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.359724 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.359827 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360038 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360130 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360352 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360452 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360666 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360800 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.360973 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.361073 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.361302 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.361396 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.361612 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.361705 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.361925 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.362026 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.362232 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.362324 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.362553 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.362642 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.362961 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.363076 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.363193 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.363800 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.364044 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.364232 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.364368 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.364549 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.364689 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.364866 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.365015 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.365212 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.365363 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.365521 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.365687 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.365837 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366004 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366154 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366319 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366471 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366632 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366780 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.366945 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.367105 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.367263 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.367423 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.367576 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.367731 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.367904 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368058 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368240 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368367 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368555 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368677 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368899 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.368990 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.369237 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.369326 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.369560 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.369662 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.369878 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.369964 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.370199 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.370284 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.370514 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.370599 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.370834 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.370926 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.371146 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.371229 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.371459 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.371554 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.371791 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.371875 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.372098 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.372227 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.372409 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.372494 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.372739 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.372832 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.373055 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.373146 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.373385 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.373478 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.373699 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.373783 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374012 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374108 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374319 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374404 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374628 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374711 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.374939 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375035 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375245 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375333 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375551 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375670 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375858 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.375964 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.376162 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.376247 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.376467 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.376550 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.376790 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.376921 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.377101 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.377216 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.377431 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.377532 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.377737 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.377832 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.378041 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.378133 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.378387 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.378479 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.378694 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.378778 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.379590 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.379730 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.379929 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.380014 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.380262 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.380382 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.380574 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.380710 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.380889 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.381030 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.381222 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.381374 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.381539 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.381689 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.381850 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382006 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382182 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382309 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382499 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382618 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382810 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.382942 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.383121 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.383258 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.383431 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.383580 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.383781 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.383878 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.384094 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.384209 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.384442 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.384526 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.384786 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.384945 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.385112 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.385217 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.385456 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.385540 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.385790 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.385888 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.386117 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.386214 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.386431 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.386521 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.386749 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.386834 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.387059 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.387141 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.387375 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.387468 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.387688 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.387780 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388001 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388085 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388313 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388400 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388624 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388708 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.388942 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389026 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389276 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389405 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389597 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389683 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389908 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.389990 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.390227 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.390318 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.390536 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.390619 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.390856 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.390939 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.391161 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.391258 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.391474 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.391560 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.391805 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.391887 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.392125 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.392216 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.392436 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.392534 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.392749 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.392840 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.393064 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.393155 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.393399 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.393484 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.393711 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.393803 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.394029 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.394124 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.394333 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.394422 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.394682 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.394763 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395012 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395096 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395333 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395497 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395657 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395769 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.395971 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.396101 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.396278 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.396388 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.396613 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.396726 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.396954 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.397067 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.397295 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.397411 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.397600 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.397733 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.397916 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398025 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398233 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398342 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398545 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398663 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398860 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.398970 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.399171 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.399301 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.399478 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.399601 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.399787 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.399898 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.400103 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.400220 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.400413 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.400532 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.400721 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.400832 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401029 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401125 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401359 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401446 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401685 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401768 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.401997 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.402081 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.402299 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.402383 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.402615 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.402700 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.402935 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403018 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403247 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403336 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403560 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403652 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403871 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.403956 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.404180 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.404265 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.404493 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.404576 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.404804 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.404894 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.405113 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.405236 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.405451 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.405536 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.405762 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.405889 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.406071 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.406154 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.406381 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.406476 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.406702 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.406795 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407010 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407094 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407321 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407413 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407633 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407784 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.407938 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.408049 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.408250 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.408359 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.408569 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.408690 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.408884 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.409148 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.409293 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.409510 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.409629 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.409833 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.409943 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.410208 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.410371 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.410529 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.410656 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.410849 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.410969 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.411165 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.411284 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.411493 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.411603 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.411807 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.411921 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.412124 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.412236 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.412850 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.412945 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413025 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413102 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413198 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413279 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413357 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413452 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413668 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.413932 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.414022 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.414276 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.414377 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.414585 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.414669 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.414890 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415004 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415199 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415298 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415504 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415605 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415810 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.415901 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.416125 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.416212 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.416435 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.416550 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.416750 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.416846 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.417055 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.417148 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.417402 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.417505 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.417713 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.417805 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418017 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418110 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418322 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418415 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418627 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418719 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.418950 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419047 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419260 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419351 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419568 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419658 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419880 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.419983 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.420190 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.420289 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.420499 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.420597 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.420820 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.420920 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.421132 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.421249 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.421459 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.421550 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.421766 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.421868 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.422093 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.422412 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.422721 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423025 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423131 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423357 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423453 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423673 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423769 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.423982 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.424086 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.424297 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.424394 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.424611 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.424715 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.424930 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.425035 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.425264 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.425370 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.425572 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.425657 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.426405 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.426541 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.426711 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.426808 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.427057 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.427165 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.427368 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.427479 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.427685 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.427776 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428000 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428085 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428311 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428396 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428628 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428714 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.428951 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429035 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429286 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429412 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429593 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429691 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429900 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.429983 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.430204 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.430297 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.430510 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.430602 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.430812 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.430895 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.431123 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.431209 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.431429 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.431589 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.431730 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.431828 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432042 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432134 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432352 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432434 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432660 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432761 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.432962 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433045 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433293 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433379 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433598 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433692 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433902 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.433987 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.434208 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.434291 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.434519 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.434617 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.434832 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.434923 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.435134 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.435217 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.435693 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.435788 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436000 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436083 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436305 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436388 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436611 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436695 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.436919 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437013 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437238 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437326 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437549 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437635 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437855 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.437938 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.438158 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.438241 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.438462 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.438547 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.438783 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.438868 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.439092 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.439253 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.439396 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.439480 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.439700 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.439827 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440000 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440093 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440305 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440393 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440618 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440702 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.440925 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.441017 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.441257 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.441403 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.442249 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.442563 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.442776 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.442885 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.442974 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443060 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443184 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443268 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443500 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443585 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443806 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.443891 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.444115 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.444199 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.444424 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.444508 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.444736 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.444827 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.445043 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.445135 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.445373 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.445508 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.445695 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.445780 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446016 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446100 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446331 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446416 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446654 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446738 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.446974 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447101 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447295 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447392 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447595 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447679 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447905 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.447999 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.448217 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.448302 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.448529 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.448612 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.448840 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.448938 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.449145 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.449267 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.449482 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.449565 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.449798 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.449895 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.450108 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.450192 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.450421 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.450504 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.450734 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.450819 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451040 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451123 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451351 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451442 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451662 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451747 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.451965 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452047 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452276 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452360 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452589 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452673 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452897 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.452989 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.453226 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.453327 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.453536 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.453622 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.453849 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.453933 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.454156 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.454248 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.454471 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.454588 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.454784 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.454904 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.455100 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.455218 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.455415 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.455525 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.455832 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.455964 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.456068 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.456162 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.456354 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.456440 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.456665 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.456749 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.457019 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.457160 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.457456 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.457597 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.457737 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.457918 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.458048 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.458232 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.458447 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.458531 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.458843 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.458926 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.459148 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.459232 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.459462 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.459553 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.459781 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.459864 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.460086 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.460176 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.460395 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.460478 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.460702 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.460786 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.461011 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.461094 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.461341 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.461465 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.461667 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.461789 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.462082 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.462166 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.462395 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.462478 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.462704 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.462800 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463011 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463121 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463329 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463435 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463662 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463759 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.463974 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.464067 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.464285 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.464369 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.464598 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.464689 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.464927 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.465010 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.465259 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.465588 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.465732 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466012 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466106 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466328 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466413 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466641 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466763 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.466972 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.467056 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.467293 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.467378 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.467603 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.467688 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.467929 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468027 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468257 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468341 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468574 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468657 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468898 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.468991 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.469259 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.469357 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.469580 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.469664 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.469912 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470006 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470244 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470340 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470566 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470650 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470872 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.470956 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.471181 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.471265 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.471494 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.471577 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.471801 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.471947 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.472108 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.472193 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.472431 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.472516 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.472865 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473054 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473204 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473293 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473526 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473613 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473840 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.473930 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.474151 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.474268 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.474458 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.474584 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.474787 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.474897 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.475097 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.475215 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.475422 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.475515 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.475740 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.475825 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.476064 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.476150 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.476394 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.476487 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.476702 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.476787 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477027 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477110 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477364 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477462 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477674 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477760 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.477983 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.478075 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.478289 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.478381 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.478617 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.478708 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.478929 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479013 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479251 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479337 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479576 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479660 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479904 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.479988 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.480217 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.480304 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.480545 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.480630 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.480861 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.480945 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.481171 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.481350 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.481505 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.481590 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.481815 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.481912 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.482140 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.482225 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.482451 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.482536 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.482761 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.482860 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.483081 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.483219 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.483389 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.483474 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.483700 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.483798 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484010 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484094 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484323 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484409 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484631 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484730 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.484938 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485024 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485276 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485364 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485604 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485690 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485913 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.485998 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.486235 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.486318 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.486546 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.486630 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.486854 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.486984 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.487160 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.487243 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.487465 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.487549 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.487780 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.487864 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.488092 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.488177 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.488929 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.489028 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.489267 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.489361 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.489599 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.489699 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.489923 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490010 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490244 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490336 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490565 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490658 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490873 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.490958 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.491186 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.491270 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.491495 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.491588 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.491811 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.491894 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.492123 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.492209 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.492443 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.492536 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.492760 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.492844 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.493080 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.493233 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.493431 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.493650 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.493760 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.493984 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.494088 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.494300 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.494394 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.494616 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.494723 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.494932 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.495051 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.495250 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.495376 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.495566 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.495696 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.495878 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.496024 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.496193 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.496351 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.496510 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.496677 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.496822 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.497151 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.497298 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.497501 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.497594 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.497828 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.497914 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.498163 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.498257 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.498485 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.498571 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.498800 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.498884 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.499115 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.499213 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.499431 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.499518 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.499750 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.499833 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.500072 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.500159 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.500389 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.500473 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.500704 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.500788 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501021 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501106 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501359 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501445 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501675 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501772 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.501988 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.502079 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.502302 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.502386 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.502616 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.502709 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.502928 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.503013 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.503244 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.503366 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.503559 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.503643 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.503960 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.504059 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.504289 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.504375 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.504617 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.504710 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.504940 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.505025 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.505283 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.505372 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.505603 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.505699 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.505924 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.506011 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.506245 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.506486 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.506580 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.506807 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.506893 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.507145 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.507237 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.507475 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.507607 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.507802 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.507886 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.508117 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.508202 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.508439 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.508525 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.508764 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.508847 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.509072 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.509155 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.509416 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.509503 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.509731 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.509945 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.510030 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.510266 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.510354 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.510606 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.510691 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.510938 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511023 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511245 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511330 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511567 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511651 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511879 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.511964 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.512209 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.512409 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.512525 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.512760 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.512844 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.513080 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.513174 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.513446 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.513536 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.513768 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.513851 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.514085 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.514170 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.514395 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.514488 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.514703 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.514787 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515019 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515180 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515328 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515421 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515645 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515865 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.515960 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.516221 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.516307 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.516542 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.516635 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.516851 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.516944 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.517165 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.517309 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.517495 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.517580 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.517808 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.517897 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.518112 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.518197 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.518441 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.518526 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.518750 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.518835 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.519055 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.519139 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.519364 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.519453 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.520193 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.520310 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.520506 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.520632 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.520823 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.520942 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.521140 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.521278 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.521476 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.521562 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.521796 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.521899 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.522107 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.522191 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.522441 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.522527 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.522755 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.522851 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.523065 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.523147 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.523381 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.523495 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.523701 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.523822 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524015 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524106 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524327 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524428 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524632 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524725 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.524939 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525023 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525275 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525363 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525589 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525676 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525905 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.525989 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.526216 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.526352 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.526532 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.526618 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.526885 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.526969 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.527202 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.527286 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.527514 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.527733 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.527862 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.528068 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.528154 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.528391 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.528486 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.528725 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.528810 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529046 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529129 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529380 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529466 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529689 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529773 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.529995 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.530080 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.530323 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.530415 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.530636 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.530721 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.530952 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.531194 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.531330 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.531536 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.531620 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.531863 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.531947 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.532176 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.532270 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.532486 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.532571 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.532798 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.532885 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.533111 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.533224 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.533473 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.533577 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.533759 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.533843 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.534071 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.534157 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.534383 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.534476 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.534693 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.534780 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.535009 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.535145 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.535398 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.535491 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.535731 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.535825 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.536096 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.536197 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.536413 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.536505 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.536732 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.536827 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.537049 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.537141 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.537388 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.537530 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.537702 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.537801 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538013 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538108 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538329 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538420 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538651 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538737 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.538963 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.539048 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.539270 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.539355 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.539630 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.539955 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.540045 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.540277 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.540369 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.540594 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.540753 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.540912 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541008 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541245 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541369 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541562 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541648 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541888 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.541973 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.542203 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.542289 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.542528 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.542613 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.542838 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.542921 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.543165 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.543505 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.543663 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.543833 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.543918 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.544158 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.544242 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.544469 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.544555 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.544778 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.544869 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.545086 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.545200 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.545423 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.545511 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.545743 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.545827 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546056 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546141 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546364 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546451 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546670 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546754 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.546986 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.547115 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.547291 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.547378 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.547596 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.547680 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.547900 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548037 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548204 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548288 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548514 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548598 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548821 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.548920 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.549128 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.549234 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.549458 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.549544 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.549767 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.549861 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.550072 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.550156 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.550376 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.550460 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.550687 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.551286 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.551544 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.551723 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.551865 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.551953 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.552099 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.552193 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.552404 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.552489 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.552709 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.552800 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553017 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553103 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553354 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553443 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553667 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553751 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.553977 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554064 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554287 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554372 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554604 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554698 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554913 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.554999 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.555224 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.555310 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.555534 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.555628 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.555844 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.555932 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.556153 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.556236 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.556487 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.556580 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.556796 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.556880 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.557110 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.557215 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.557453 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.557556 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.557767 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.557855 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.558082 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.558174 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.558393 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.558479 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.558721 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.558805 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559048 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559132 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559352 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559443 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559673 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559756 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.559989 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.560083 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.560312 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.560649 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.560883 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.560974 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.561210 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.561311 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.561532 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.561667 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.561847 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.561932 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.562162 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.562256 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.562471 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.562556 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.562784 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.562876 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.563097 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.563191 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.563416 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.563500 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.563728 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.563813 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.564043 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.564128 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.564365 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.564448 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.564680 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.564764 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565008 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565093 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565349 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565434 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565672 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565768 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.565991 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.566077 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.566310 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.566938 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.567169 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.567255 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.567497 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.567584 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.567817 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.567912 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.568137 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.568276 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.568460 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.568553 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.568772 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.568857 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.569079 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.569172 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.569347 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 09:33:27.569456 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.569781 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.570114 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.570448 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.570801 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.571123 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.571473 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.571811 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.572131 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.572451 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.572764 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:33:27.573013 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 09:33:27.721620 n-d-836830-16 devstack@n-api.service[112945]: INFO dbcounter [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Registered counter for database nova_api Sep 07 09:33:27.727408 n-d-836830-16 devstack@n-api.service[112944]: INFO dbcounter [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Registered counter for database nova_api Sep 07 09:33:27.742890 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_db.sqlalchemy.engines [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:27.747171 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:27.749819 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writer thread running {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:27.754923 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writer thread running {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:27.806702 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.context [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=112945) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 09:33:27.810777 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:33:27.811257 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:33:27.812459 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.context [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=112944) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 09:33:27.812812 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:33:27.813553 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:33:27.814007 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:33:27.815962 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:33:27.816901 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_concurrency.lockutils [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:33:27.818631 n-d-836830-16 devstack@n-api.service[112945]: INFO dbcounter [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Registered counter for database nova_cell0 Sep 07 09:33:27.819379 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_concurrency.lockutils [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=112944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:33:27.820966 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_concurrency.lockutils [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:33:27.821710 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_concurrency.lockutils [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:33:27.822184 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_concurrency.lockutils [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:33:27.822713 n-d-836830-16 devstack@n-api.service[112945]: INFO dbcounter [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Registered counter for database nova_cell1 Sep 07 09:33:27.824155 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_concurrency.lockutils [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:33:27.826174 n-d-836830-16 devstack@n-api.service[112944]: INFO dbcounter [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Registered counter for database nova_cell0 Sep 07 09:33:27.830737 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_db.sqlalchemy.engines [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:27.830904 n-d-836830-16 devstack@n-api.service[112944]: INFO dbcounter [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Registered counter for database nova_cell1 Sep 07 09:33:27.831572 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_db.sqlalchemy.engines [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:27.837483 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writer thread running {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:27.837790 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:27.840906 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writer thread running {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:27.841220 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:27.843631 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writer thread running {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:27.985852 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writer thread running {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:27.992975 n-d-836830-16 devstack@n-api.service[112945]: INFO dbcounter [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Registered counter for database nova_cell0 Sep 07 09:33:27.994957 n-d-836830-16 devstack@n-api.service[112944]: INFO dbcounter [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Registered counter for database nova_cell0 Sep 07 09:33:27.999884 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_db.sqlalchemy.engines [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:28.003469 n-d-836830-16 devstack@n-api.service[112944]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:33:28.004731 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writer thread running {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:28.008440 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writer thread running {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:33:28.343969 n-d-836830-16 devstack@n-api.service[112945]: WARNING keystonemiddleware.auth_token [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:33:28.347740 n-d-836830-16 devstack@n-api.service[112944]: WARNING keystonemiddleware.auth_token [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:33:28.351581 n-d-836830-16 devstack@n-api.service[112945]: WARNING keystonemiddleware.auth_token [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:33:28.355107 n-d-836830-16 devstack@n-api.service[112944]: WARNING keystonemiddleware.auth_token [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:33:28.693849 n-d-836830-16 devstack@n-api.service[112945]: WARNING keystonemiddleware.auth_token [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:33:28.698728 n-d-836830-16 devstack@n-api.service[112944]: WARNING keystonemiddleware.auth_token [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:33:28.699648 n-d-836830-16 devstack@n-api.service[112945]: WARNING keystonemiddleware.auth_token [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:33:28.704777 n-d-836830-16 devstack@n-api.service[112944]: WARNING keystonemiddleware.auth_token [None req-aa7eb4eb-cd41-479b-832b-33b92b5e30e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:33:28.704913 n-d-836830-16 devstack@n-api.service[112945]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c0aaef9c0 pid: 112945 (default app) Sep 07 09:33:28.706853 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:33:28.708630 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002217 Sep 07 09:33:28.709049 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Sep 7 09:33:28 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:33:28.710083 n-d-836830-16 devstack@n-api.service[112944]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c0aaef9c0 pid: 112944 (default app) Sep 07 09:34:50.888839 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:34:50.889914 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 07 09:34:50.890315 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:34:50.907494 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_api:SELECT=3 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:50.909597 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_cell0:SELECT=3 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:50.910672 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_cell1:SELECT=3 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:50.911555 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:51.805826 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-10ce2bb0-efdf-4b11-95b6-445ff2fd310c admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:34:51.841018 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-10ce2bb0-efdf-4b11-95b6-445ff2fd310c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.943951 Sep 07 09:34:51.845240 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:34:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:34:54.489399 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:34:54.490415 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-edb88e03-3837-4aea-9484-210c260c4ae2 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 07 09:34:54.490986 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:34:54.962373 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-42da967b-51b1-44fe-b4d0-09b45d98b11d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "id": "c1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:34:55.008587 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-42da967b-51b1-44fe-b4d0-09b45d98b11d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511360 Sep 07 09:34:55.009140 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:34:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:34:55.024376 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_api:SELECT=3 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:55.025205 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_cell0:SELECT=3 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:55.025925 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_cell1:SELECT=3 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:55.028462 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:34:55.238421 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-c491f807-4c62-4f91-981b-c9fed307d682 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:34:55.304639 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-c491f807-4c62-4f91-981b-c9fed307d682 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287212 Sep 07 09:34:55.305288 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 7 09:34:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:34:58.011059 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-42da967b-51b1-44fe-b4d0-09b45d98b11d admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:34:58.012164 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-42da967b-51b1-44fe-b4d0-09b45d98b11d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 07 09:34:58.012609 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:34:58.800313 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-af827b41-cf3d-4564-a591-1ccb491938c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:34:58.860442 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-af827b41-cf3d-4564-a591-1ccb491938c8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.840969 Sep 07 09:34:58.861666 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:34:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:34:58.878910 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-b9eb18e2-c42a-4cc4-a265-46e2c321b0fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:34:58.928639 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-b9eb18e2-c42a-4cc4-a265-46e2c321b0fb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053778 Sep 07 09:34:58.929546 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 7 09:34:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:01.853987 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-af827b41-cf3d-4564-a591-1ccb491938c8 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:01.855050 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-af827b41-cf3d-4564-a591-1ccb491938c8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 07 09:35:01.855716 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:02.371925 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-c99f0c39-d30f-4a6e-85b9-7d8f45371b2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:02.390624 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-c99f0c39-d30f-4a6e-85b9-7d8f45371b2e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528752 Sep 07 09:35:02.391308 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:02.404545 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-514b2ddf-9299-478f-a436-59732379a2fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:02.430742 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-514b2ddf-9299-478f-a436-59732379a2fa admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029778 Sep 07 09:35:02.431559 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 7 09:35:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:05.150036 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-c99f0c39-d30f-4a6e-85b9-7d8f45371b2e admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:05.151065 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-c99f0c39-d30f-4a6e-85b9-7d8f45371b2e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 07 09:35:05.151641 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:05.636455 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-7e5a2121-5bf3-47cd-a943-3f3d69e784e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:05.659264 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-7e5a2121-5bf3-47cd-a943-3f3d69e784e1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500746 Sep 07 09:35:05.660468 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:05.672849 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-8a45893b-0867-4bc2-9ed4-a756a7a2ade4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:05.700610 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-8a45893b-0867-4bc2-9ed4-a756a7a2ade4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031481 Sep 07 09:35:05.701598 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 7 09:35:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:08.446806 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-7e5a2121-5bf3-47cd-a943-3f3d69e784e1 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:08.448433 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-7e5a2121-5bf3-47cd-a943-3f3d69e784e1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Sep 07 09:35:08.460008 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:08.888767 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-dc150d4e-8901-47d5-95c1-bb3c27da41de admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:08.909634 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-dc150d4e-8901-47d5-95c1-bb3c27da41de admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452994 Sep 07 09:35:08.917551 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:08.922447 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-fb119c77-3faa-4ece-b6e0-ce90a59034ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:08.947605 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-fb119c77-3faa-4ece-b6e0-ce90a59034ee admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028800 Sep 07 09:35:08.949533 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 7 09:35:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:11.699537 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-dc150d4e-8901-47d5-95c1-bb3c27da41de admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:11.701082 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-dc150d4e-8901-47d5-95c1-bb3c27da41de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Sep 07 09:35:11.701818 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:12.186937 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-ee6d903b-097a-40d9-af63-7b51c48eb023 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:12.222325 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-ee6d903b-097a-40d9-af63-7b51c48eb023 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.512781 Sep 07 09:35:12.223062 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:35:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:35:15.336598 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-dc150d4e-8901-47d5-95c1-bb3c27da41de admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:15.338017 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-dc150d4e-8901-47d5-95c1-bb3c27da41de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Sep 07 09:35:15.338561 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:15.843144 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d360b823-4cc9-478d-812e-7bf291e88800 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:15.870412 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-d360b823-4cc9-478d-812e-7bf291e88800 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.525283 Sep 07 09:35:15.871130 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 09:35:15.885815 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-fabd44c3-8e2d-4d1e-99b1-b28ac147821e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:15.917543 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-fabd44c3-8e2d-4d1e-99b1-b28ac147821e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036998 Sep 07 09:35:15.918132 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 7 09:35:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:18.619733 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d360b823-4cc9-478d-812e-7bf291e88800 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:18.620799 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-d360b823-4cc9-478d-812e-7bf291e88800 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 07 09:35:18.621223 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:19.062058 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-724722a0-7589-435d-8ec8-4213e9205c85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:19.082485 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-724722a0-7589-435d-8ec8-4213e9205c85 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454993 Sep 07 09:35:19.083041 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 09:35:19.098471 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-e5534b69-98d1-4b65-a9b4-793502394978 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:19.125520 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-e5534b69-98d1-4b65-a9b4-793502394978 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032169 Sep 07 09:35:19.126424 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 7 09:35:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:21.795379 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-724722a0-7589-435d-8ec8-4213e9205c85 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:21.796514 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-724722a0-7589-435d-8ec8-4213e9205c85 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 07 09:35:21.797005 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:22.189453 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-e44cb745-55d8-4a25-bf7f-abdd1e992327 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "name": "m1.medium", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:22.211015 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-e44cb745-55d8-4a25-bf7f-abdd1e992327 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.407376 Sep 07 09:35:22.211770 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:22.223898 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-28b5289d-f53f-40b0-8bdc-dcb1ee1ff338 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:22.228687 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:35:22.255664 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-28b5289d-f53f-40b0-8bdc-dcb1ee1ff338 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035499 Sep 07 09:35:22.257014 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 7 09:35:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:35:25.059032 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-e44cb745-55d8-4a25-bf7f-abdd1e992327 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:25.060291 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-e44cb745-55d8-4a25-bf7f-abdd1e992327 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Sep 07 09:35:25.060791 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:25.502765 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-0910bac8-d725-4b18-96b8-d4d23d37acb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:25.523525 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-0910bac8-d725-4b18-96b8-d4d23d37acb6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455261 Sep 07 09:35:25.524391 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:25.536876 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-5b19004d-604e-49ae-a9da-a91213e94b44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:25.544990 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:35:25.565174 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-5b19004d-604e-49ae-a9da-a91213e94b44 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032580 Sep 07 09:35:25.566041 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 7 09:35:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:28.231733 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-0910bac8-d725-4b18-96b8-d4d23d37acb6 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:28.232760 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-0910bac8-d725-4b18-96b8-d4d23d37acb6 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 07 09:35:28.233164 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:28.757532 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-0bcb44e7-4255-47a8-b016-5505c08fbd53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:28.782365 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-0bcb44e7-4255-47a8-b016-5505c08fbd53 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.542369 Sep 07 09:35:28.783173 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 7 09:35:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:28.800480 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-2f0bbbe7-8a04-4d69-881f-ead9851d16d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:28.832958 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-2f0bbbe7-8a04-4d69-881f-ead9851d16d8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037901 Sep 07 09:35:28.835512 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 7 09:35:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:35:50.302841 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-0bcb44e7-4255-47a8-b016-5505c08fbd53 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:50.303782 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-0bcb44e7-4255-47a8-b016-5505c08fbd53 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 07 09:35:50.304194 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:35:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:50.315368 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:35:50.725707 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-4038a553-29b5-4d92-98a4-b07b3614d90c admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:50.746319 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-4038a553-29b5-4d92-98a4-b07b3614d90c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.435873 Sep 07 09:35:50.746912 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:35:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:35:52.118092 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-0bcb44e7-4255-47a8-b016-5505c08fbd53 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:52.119117 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-0bcb44e7-4255-47a8-b016-5505c08fbd53 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 07 09:35:52.119543 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:35:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:52.704476 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-851ab3c2-9184-4895-a5b8-5a91e530cbce admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:52.711273 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.wsgi [None req-851ab3c2-9184-4895-a5b8-5a91e530cbce admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-851ab3c2-9184-4895-a5b8-5a91e530cbce admin admin] Request method failure captured: Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Accept: application/json Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Accept-Encoding: gzip, deflate Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Connection: keep-alive Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Content-Length: 0 Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Host: 10.222.0.60 Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Openstack-Api-Version: compute 2.92 Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: Openstack-System-Scope: None Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: User-Agent: python-novaclient Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Auth-Token: gAAAAABjGGX42KduN8fd5z-BP08rIJ_Jjp6IqWv3hPaTonqD7gzX4pZDFG1ha6foJ1kuL7lX8FIaUJxnynLAZ-Yqe2qOSS2Y0qS3ZlhEhXNZlBltjRSUaRTfWVKqDDnKy3v0BeeRJxtfG-PkdjXSqf9pQqb7u4JJPFYaNJdmkLahHCUZF1sZG4g Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Domain-Id: None Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Domain-Name: None Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Identity-Status: Confirmed Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Is-Admin-Project: True Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Domain-Id: default Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Domain-Name: Default Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Name: admin Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Role: member,admin,reader Sep 07 09:35:52.714568 n-d-836830-16 devstack@n-api.service[112944]: X-Roles: member,admin,reader Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fdb032329434c808dfc7fe6bfb6cb9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant: admin Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant-Name: admin Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-User: admin Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-User-Domain-Id: default Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-User-Domain-Name: Default Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-User-Id: 5b7fc6c50989460c8e3971583c2bd824 Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: X-User-Name: admin Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: method: > Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: exception: Flavor 42 could not be found. Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: action_args: {'id': '42'} Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:35:52.716017 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:52.717067 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.718667 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-851ab3c2-9184-4895-a5b8-5a91e530cbce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:35:52.719983 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-851ab3c2-9184-4895-a5b8-5a91e530cbce admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.414596 Sep 07 09:35:52.719983 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:35:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:35:52.727083 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-1ce651bb-288d-486a-84ec-4c0911ce5ef1 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:52.731197 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:35:52.752231 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-1ce651bb-288d-486a-84ec-4c0911ce5ef1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028733 Sep 07 09:35:52.752796 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 7 09:35:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:35:52.769365 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-3a9b9292-6276-4a51-b50b-d0677ceab414 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:52.792806 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-3a9b9292-6276-4a51-b50b-d0677ceab414 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028508 Sep 07 09:35:52.793406 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 7 09:35:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:35:52.803119 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d1385b2b-eb8c-4c6d-a4e8-422dbeab63c7 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:52.809669 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.wsgi [None req-d1385b2b-eb8c-4c6d-a4e8-422dbeab63c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d1385b2b-eb8c-4c6d-a4e8-422dbeab63c7 admin admin] Request method failure captured: Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Accept: application/json Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Accept-Encoding: gzip, deflate Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Connection: keep-alive Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Content-Length: 0 Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Host: 10.222.0.60 Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Openstack-Api-Version: compute 2.92 Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: Openstack-System-Scope: None Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: User-Agent: python-novaclient Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Auth-Token: gAAAAABjGGX42KduN8fd5z-BP08rIJ_Jjp6IqWv3hPaTonqD7gzX4pZDFG1ha6foJ1kuL7lX8FIaUJxnynLAZ-Yqe2qOSS2Y0qS3ZlhEhXNZlBltjRSUaRTfWVKqDDnKy3v0BeeRJxtfG-PkdjXSqf9pQqb7u4JJPFYaNJdmkLahHCUZF1sZG4g Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Domain-Id: None Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Domain-Name: None Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Identity-Status: Confirmed Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Is-Admin-Project: True Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Domain-Id: default Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Domain-Name: Default Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Name: admin Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Role: member,admin,reader Sep 07 09:35:52.813229 n-d-836830-16 devstack@n-api.service[112945]: X-Roles: member,admin,reader Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fdb032329434c808dfc7fe6bfb6cb9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant: admin Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant-Name: admin Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-User: admin Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-User-Domain-Id: default Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-User-Domain-Name: Default Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-User-Id: 5b7fc6c50989460c8e3971583c2bd824 Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: X-User-Name: admin Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: method: > Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: exception: Flavor 42 could not be found. Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: action_args: {'id': '42'} Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:35:52.815019 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:52.816350 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:52.817958 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d1385b2b-eb8c-4c6d-a4e8-422dbeab63c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:35:52.819300 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-d1385b2b-eb8c-4c6d-a4e8-422dbeab63c7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015355 Sep 07 09:35:52.819300 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:35:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:35:54.082582 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-3a9b9292-6276-4a51-b50b-d0677ceab414 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:54.084196 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-3a9b9292-6276-4a51-b50b-d0677ceab414 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 07 09:35:54.084196 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:54.634755 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-fd17f76c-1828-480d-956f-8379633971de admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:54.640288 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.wsgi [None req-fd17f76c-1828-480d-956f-8379633971de admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-fd17f76c-1828-480d-956f-8379633971de admin admin] Request method failure captured: Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Accept: application/json Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Accept-Encoding: gzip, deflate Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Connection: keep-alive Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Content-Length: 0 Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Host: 10.222.0.60 Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Openstack-Api-Version: compute 2.92 Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: Openstack-System-Scope: None Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: User-Agent: python-novaclient Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Auth-Token: gAAAAABjGGX5pVukf_by_8OKL4Bin1UnQrMldNc5C9ZyoBFmrTxtF6JAtr9rGPh0FZzStaJ57ywznawQ8_dRaGJ-iSBM0kxPB2pkl52kR64G6TbN0iX_2LKNVWMddPJ8CYozk0m5EcBcegxFF-0uAe5vOAHOaspnLgUIqT0bpNTAggvQA3sW-mQ Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Domain-Id: None Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Domain-Name: None Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Identity-Status: Confirmed Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Is-Admin-Project: True Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Domain-Id: default Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Domain-Name: Default Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Name: admin Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Role: member,admin,reader Sep 07 09:35:54.641913 n-d-836830-16 devstack@n-api.service[112945]: X-Roles: member,admin,reader Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fdb032329434c808dfc7fe6bfb6cb9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant: admin Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant-Name: admin Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-User: admin Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-User-Domain-Id: default Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-User-Domain-Name: Default Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-User-Id: 5b7fc6c50989460c8e3971583c2bd824 Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: X-User-Name: admin Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: method: > Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: exception: Flavor 84 could not be found. Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: action_args: {'id': '84'} Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:35:54.644334 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:54.645435 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.646842 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-fd17f76c-1828-480d-956f-8379633971de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:35:54.648070 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-fd17f76c-1828-480d-956f-8379633971de admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.419564 Sep 07 09:35:54.648070 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:35:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:35:54.653792 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-fd3b9242-7123-4cd8-955a-1a6584153c75 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:54.668501 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-fd3b9242-7123-4cd8-955a-1a6584153c75 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018293 Sep 07 09:35:54.669023 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 7 09:35:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:35:54.678553 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d0690249-daf8-4a92-93f1-392405080d4a admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:54.694330 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-d0690249-daf8-4a92-93f1-392405080d4a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019299 Sep 07 09:35:54.694853 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 7 09:35:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:35:54.703877 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-05c8a638-02ae-41d4-bc98-285dc496b007 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:54.709861 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.wsgi [None req-05c8a638-02ae-41d4-bc98-285dc496b007 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-05c8a638-02ae-41d4-bc98-285dc496b007 admin admin] Request method failure captured: Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Accept: application/json Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Accept-Encoding: gzip, deflate Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Connection: keep-alive Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Content-Length: 0 Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Host: 10.222.0.60 Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Openstack-Api-Version: compute 2.92 Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: Openstack-System-Scope: None Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: User-Agent: python-novaclient Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Auth-Token: gAAAAABjGGX5pVukf_by_8OKL4Bin1UnQrMldNc5C9ZyoBFmrTxtF6JAtr9rGPh0FZzStaJ57ywznawQ8_dRaGJ-iSBM0kxPB2pkl52kR64G6TbN0iX_2LKNVWMddPJ8CYozk0m5EcBcegxFF-0uAe5vOAHOaspnLgUIqT0bpNTAggvQA3sW-mQ Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Domain-Id: None Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Domain-Name: None Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Identity-Status: Confirmed Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Is-Admin-Project: True Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Domain-Id: default Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Domain-Name: Default Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Name: admin Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Role: member,admin,reader Sep 07 09:35:54.711372 n-d-836830-16 devstack@n-api.service[112944]: X-Roles: member,admin,reader Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fdb032329434c808dfc7fe6bfb6cb9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant: admin Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant-Name: admin Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-User: admin Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-User-Domain-Id: default Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-User-Domain-Name: Default Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-User-Id: 5b7fc6c50989460c8e3971583c2bd824 Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: X-User-Name: admin Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: method: > Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: exception: Flavor 84 could not be found. Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: action_args: {'id': '84'} Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:35:54.712973 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:54.713962 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:54.715075 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-05c8a638-02ae-41d4-bc98-285dc496b007 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:35:54.716095 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-05c8a638-02ae-41d4-bc98-285dc496b007 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012359 Sep 07 09:35:54.716095 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:35:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:35:55.960504 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-d0690249-daf8-4a92-93f1-392405080d4a admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:55.961560 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-d0690249-daf8-4a92-93f1-392405080d4a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Sep 07 09:35:55.961970 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:56.515239 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-f81e31ba-72a8-4bf9-b0e2-d31104aa1859 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:56.521161 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.wsgi [None req-f81e31ba-72a8-4bf9-b0e2-d31104aa1859 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-f81e31ba-72a8-4bf9-b0e2-d31104aa1859 admin admin] Request method failure captured: Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Accept: application/json Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Accept-Encoding: gzip, deflate Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Connection: keep-alive Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Content-Length: 0 Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Host: 10.222.0.60 Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Openstack-Api-Version: compute 2.92 Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: Openstack-System-Scope: None Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: User-Agent: python-novaclient Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Auth-Token: gAAAAABjGGX7ylWrZBtCR-IeJbgkv22fucfeXr95IcJGtG1jNCX3klyO1_EPcoEEJi4qtF7RhLiHrJohFNPgEoLgz-PpLBf90ySrHIWORfj8glNSO4XqOLtWgrFXsYxemM-SFRFTcsFMI1Eh22Zv4tTb2k2sPEoEONq0exu5WkW-nxS0puawxhc Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Domain-Id: None Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Domain-Name: None Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Identity-Status: Confirmed Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Is-Admin-Project: True Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Domain-Id: default Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Domain-Name: Default Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Project-Name: admin Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Role: member,admin,reader Sep 07 09:35:56.522709 n-d-836830-16 devstack@n-api.service[112944]: X-Roles: member,admin,reader Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fdb032329434c808dfc7fe6bfb6cb9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant: admin Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-Tenant-Name: admin Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-User: admin Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-User-Domain-Id: default Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-User-Domain-Name: Default Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-User-Id: 5b7fc6c50989460c8e3971583c2bd824 Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: X-User-Name: admin Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: method: > Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: exception: Flavor 451 could not be found. Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: action_args: {'id': '451'} Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:35:56.524302 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:56.525469 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.526545 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-f81e31ba-72a8-4bf9-b0e2-d31104aa1859 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:35:56.527590 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-f81e31ba-72a8-4bf9-b0e2-d31104aa1859 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.416753 Sep 07 09:35:56.527590 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:35:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:35:56.533899 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-1d54cbd7-b6ad-4566-b291-588f8b2a8ca2 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:56.549158 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-1d54cbd7-b6ad-4566-b291-588f8b2a8ca2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018237 Sep 07 09:35:56.549743 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 7 09:35:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:35:56.559365 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:56.575441 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019609 Sep 07 09:35:56.576023 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 7 09:35:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:35:56.585554 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-27a101a6-f2c4-423e-a878-ef86eee076a7 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:56.591041 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.wsgi [None req-27a101a6-f2c4-423e-a878-ef86eee076a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-27a101a6-f2c4-423e-a878-ef86eee076a7 admin admin] Request method failure captured: Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Accept: application/json Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Accept-Encoding: gzip, deflate Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Connection: keep-alive Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Content-Length: 0 Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Host: 10.222.0.60 Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Openstack-Api-Version: compute 2.92 Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: Openstack-System-Scope: None Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: User-Agent: python-novaclient Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Auth-Token: gAAAAABjGGX7ylWrZBtCR-IeJbgkv22fucfeXr95IcJGtG1jNCX3klyO1_EPcoEEJi4qtF7RhLiHrJohFNPgEoLgz-PpLBf90ySrHIWORfj8glNSO4XqOLtWgrFXsYxemM-SFRFTcsFMI1Eh22Zv4tTb2k2sPEoEONq0exu5WkW-nxS0puawxhc Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Domain-Id: None Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Domain-Name: None Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Identity-Status: Confirmed Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Is-Admin-Project: True Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Domain-Id: default Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Domain-Name: Default Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Project-Name: admin Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Role: member,admin,reader Sep 07 09:35:56.592545 n-d-836830-16 devstack@n-api.service[112945]: X-Roles: member,admin,reader Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fdb032329434c808dfc7fe6bfb6cb9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fdb032329434c808dfc7fe6bfb6cb9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant: admin Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant-Id: 0fdb032329434c808dfc7fe6bfb6cb9f Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-Tenant-Name: admin Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-User: admin Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-User-Domain-Id: default Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-User-Domain-Name: Default Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-User-Id: 5b7fc6c50989460c8e3971583c2bd824 Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: X-User-Name: admin Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: method: > Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: exception: Flavor 451 could not be found. Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: action_args: {'id': '451'} Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:35:56.594238 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:56.595129 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: ERROR nova.api.openstack.wsgi Sep 07 09:35:56.596457 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-27a101a6-f2c4-423e-a878-ef86eee076a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:35:56.597569 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-27a101a6-f2c4-423e-a878-ef86eee076a7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012042 Sep 07 09:35:56.597569 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:35:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:35:57.853907 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:57.854968 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Sep 07 09:35:57.855372 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:35:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:35:58.401743 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-69b02c5e-93c6-4c4c-ab20-7468a0dc2b31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:35:58.423211 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-69b02c5e-93c6-4c4c-ab20-7468a0dc2b31 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.428347 Sep 07 09:35:58.424542 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 7 09:35:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:35:59.699050 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:35:59.700074 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 07 09:35:59.700480 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:36:00.230949 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-ec5710d4-1964-4b6c-a498-96a7a7c79363 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:36:00.249459 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-ec5710d4-1964-4b6c-a498-96a7a7c79363 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405694 Sep 07 09:36:00.249936 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 7 09:35:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:36:01.492326 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:36:01.493409 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 07 09:36:01.493813 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:36:02.013432 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-7aa44e04-2852-4207-96f4-6c7e3c2ea66b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:36:02.032042 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-7aa44e04-2852-4207-96f4-6c7e3c2ea66b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401611 Sep 07 09:36:02.032588 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 7 09:36:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:36:03.272979 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:36:03.274060 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 07 09:36:03.274446 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:36:03.803128 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-5e2fd45b-5969-4d5e-8fd5-41bd00a18c45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:36:03.821521 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-5e2fd45b-5969-4d5e-8fd5-41bd00a18c45 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.408460 Sep 07 09:36:03.822063 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 7 09:36:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:36:05.057828 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:36:05.058856 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 07 09:36:05.059264 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:36:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:36:05.590264 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-1b78371c-e174-43bf-8b85-e950a892d1b7 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:36:05.615989 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-1b78371c-e174-43bf-8b85-e950a892d1b7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.417147 Sep 07 09:36:05.616530 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 7 09:36:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:37:04.029758 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:37:04.030731 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-aa83b186-33bc-4861-a159-d3a6fdbdd538 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 07 09:37:04.031120 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 7 09:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:37:04.041662 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:37:04.441852 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-a80e6c64-201c-4784-8841-95f20903bac8 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:37:04.462673 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-a80e6c64-201c-4784-8841-95f20903bac8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425414 Sep 07 09:37:04.463226 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:37:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:37:04.484368 n-d-836830-16 devstack@n-api.service[112944]: DEBUG dbcounter [-] [112944] Writing DB stats nova_api:SELECT=14 {{(pid=112944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:37:04.488935 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-ebe30740-cf22-4849-80a2-ed9cf95ab728 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:37:04.496674 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-ebe30740-cf22-4849-80a2-ed9cf95ab728 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013744 Sep 07 09:37:04.497217 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 7 09:37:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:37:04.508826 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-5ce66ab7-34fc-4f5c-979c-241464e77e96 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:37:04.516690 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-5ce66ab7-34fc-4f5c-979c-241464e77e96 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011163 Sep 07 09:37:04.517077 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 7 09:37:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:37:04.528326 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-c12db3b9-9b8d-4974-b21a-33bd5bf74b29 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:37:04.536273 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-c12db3b9-9b8d-4974-b21a-33bd5bf74b29 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011462 Sep 07 09:37:04.536788 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 7 09:37:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:37:04.548554 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-9efe99b8-8080-4136-9e29-427d04b527b8 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:37:04.556117 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-9efe99b8-8080-4136-9e29-427d04b527b8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011705 Sep 07 09:37:04.556647 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 7 09:37:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:42:35.645815 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-c12db3b9-9b8d-4974-b21a-33bd5bf74b29 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:42:35.646832 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-c12db3b9-9b8d-4974-b21a-33bd5bf74b29 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 07 09:42:35.647229 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:42:35.793494 n-d-836830-16 devstack@n-api.service[112945]: DEBUG dbcounter [-] [112945] Writing DB stats nova_api:SELECT=6 {{(pid=112945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:42:35.934542 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:42:35.938042 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:42:35.938530 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:42:35.939546 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:42:35.940680 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:42:35.941136 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:42:35.941578 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:42:35.982029 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-54ae3d41-c688-45c4-9f3f-ae79505e3d46 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.189954 Sep 07 09:42:35.982587 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:42:35 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:42:37.075573 n-d-836830-16 devstack@n-api.service[112944]: DEBUG nova.api.openstack.wsgi [None req-c12db3b9-9b8d-4974-b21a-33bd5bf74b29 admin admin] Calling method '>' {{(pid=112944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:42:37.076589 n-d-836830-16 devstack@n-api.service[112944]: INFO nova.api.openstack.requestlog [None req-c12db3b9-9b8d-4974-b21a-33bd5bf74b29 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 07 09:42:37.077011 n-d-836830-16 devstack@n-api.service[112944]: [pid: 112944|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 7 09:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:42:37.270540 n-d-836830-16 devstack@n-api.service[112945]: DEBUG nova.api.openstack.wsgi [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Calling method '>' {{(pid=112945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:42:37.273994 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:42:37.274491 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:42:37.274896 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:42:37.276925 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:42:37.277422 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:42:37.277846 n-d-836830-16 devstack@n-api.service[112945]: DEBUG oslo_concurrency.lockutils [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:42:37.300261 n-d-836830-16 devstack@n-api.service[112945]: INFO nova.api.openstack.requestlog [None req-6c9b8eeb-2b8d-4fc5-ab2b-4a9d53b2d09a admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.082017 Sep 07 09:42:37.300809 n-d-836830-16 devstack@n-api.service[112945]: [pid: 112945|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:42:37 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:43:26.775826 n-d-836830-16 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 09:43:26.776533 n-d-836830-16 devstack@n-api.service[112943]: Wed Sep 7 09:43:26 2022 - graceful shutdown triggered... Sep 07 09:43:26.777050 n-d-836830-16 devstack@n-api.service[112945]: Gracefully killing worker 2 (pid: 112945)... Sep 07 09:43:26.777535 n-d-836830-16 devstack@n-api.service[112944]: Gracefully killing worker 1 (pid: 112944)... Sep 07 09:43:27.777037 n-d-836830-16 devstack@n-api.service[112943]: worker 1 buried after 1 seconds Sep 07 09:43:27.777037 n-d-836830-16 devstack@n-api.service[112943]: worker 2 buried after 1 seconds Sep 07 09:43:27.777728 n-d-836830-16 devstack@n-api.service[112943]: goodbye to uWSGI. Sep 07 09:43:27.778793 n-d-836830-16 systemd[1]: devstack@n-api.service: Succeeded. Sep 07 09:43:27.779705 n-d-836830-16 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 09:43:27.784020 n-d-836830-16 systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 09:43:27.802765 n-d-836830-16 devstack@n-api.service[128817]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 09:43:27.818359 n-d-836830-16 devstack@n-api.service[128817]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 09:43:27 2022] *** Sep 07 09:43:27.818611 n-d-836830-16 devstack@n-api.service[128817]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 09:43:27.818787 n-d-836830-16 devstack@n-api.service[128817]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 09:43:27.818936 n-d-836830-16 devstack@n-api.service[128817]: nodename: n-d-836830-16 Sep 07 09:43:27.819094 n-d-836830-16 devstack@n-api.service[128817]: machine: x86_64 Sep 07 09:43:27.819247 n-d-836830-16 devstack@n-api.service[128817]: clock source: unix Sep 07 09:43:27.819390 n-d-836830-16 devstack@n-api.service[128817]: pcre jit disabled Sep 07 09:43:27.819533 n-d-836830-16 devstack@n-api.service[128817]: detected number of CPU cores: 4 Sep 07 09:43:27.819684 n-d-836830-16 devstack@n-api.service[128817]: current working directory: / Sep 07 09:43:27.819827 n-d-836830-16 devstack@n-api.service[128817]: detected binary path: /usr/bin/uwsgi-core Sep 07 09:43:27.819975 n-d-836830-16 devstack@n-api.service[128817]: your processes number limit is 47680 Sep 07 09:43:27.820733 n-d-836830-16 devstack@n-api.service[128817]: your memory page size is 4096 bytes Sep 07 09:43:27.820936 n-d-836830-16 devstack@n-api.service[128817]: detected max file descriptor number: 2048 Sep 07 09:43:27.821103 n-d-836830-16 devstack@n-api.service[128817]: lock engine: pthread robust mutexes Sep 07 09:43:27.821462 n-d-836830-16 devstack@n-api.service[128817]: thunder lock: enabled Sep 07 09:43:27.821857 n-d-836830-16 devstack@n-api.service[128817]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 09:43:27.822104 n-d-836830-16 devstack@n-api.service[128817]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 09:43:27.861215 n-d-836830-16 devstack@n-api.service[128817]: Python main interpreter initialized at 0x5596754229c0 Sep 07 09:43:27.861215 n-d-836830-16 devstack@n-api.service[128817]: python threads support enabled Sep 07 09:43:27.861215 n-d-836830-16 devstack@n-api.service[128817]: your server socket listen backlog is limited to 100 connections Sep 07 09:43:27.861215 n-d-836830-16 devstack@n-api.service[128817]: your mercy for graceful operations on workers is 90 seconds Sep 07 09:43:27.862235 n-d-836830-16 devstack@n-api.service[128817]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 09:43:27.862235 n-d-836830-16 devstack@n-api.service[128817]: *** Operational MODE: preforking *** Sep 07 09:43:27.862464 n-d-836830-16 devstack@n-api.service[128817]: *** uWSGI is running in multiple interpreter mode *** Sep 07 09:43:27.862464 n-d-836830-16 devstack@n-api.service[128817]: spawned uWSGI master process (pid: 128817) Sep 07 09:43:27.862660 n-d-836830-16 systemd[1]: Started Devstack devstack@n-api.service. Sep 07 09:43:27.863294 n-d-836830-16 devstack@n-api.service[128817]: spawned uWSGI worker 1 (pid: 128832, cores: 1) Sep 07 09:43:27.863653 n-d-836830-16 devstack@n-api.service[128817]: spawned uWSGI worker 2 (pid: 128833, cores: 1) Sep 07 09:43:27.863912 n-d-836830-16 devstack@n-api.service[128817]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 09:43:28.531739 n-d-836830-16 devstack@n-api.service[128832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 09:43:28.543088 n-d-836830-16 devstack@n-api.service[128833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 09:43:29.706117 n-d-836830-16 devstack@n-api.service[128832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:43:29.706117 n-d-836830-16 devstack@n-api.service[128832]: from cryptography.utils import int_from_bytes Sep 07 09:43:29.706703 n-d-836830-16 devstack@n-api.service[128832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:43:29.706703 n-d-836830-16 devstack@n-api.service[128832]: from cryptography.utils import int_from_bytes Sep 07 09:43:29.735007 n-d-836830-16 devstack@n-api.service[128833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:43:29.735007 n-d-836830-16 devstack@n-api.service[128833]: from cryptography.utils import int_from_bytes Sep 07 09:43:29.735857 n-d-836830-16 devstack@n-api.service[128833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 09:43:29.735857 n-d-836830-16 devstack@n-api.service[128833]: from cryptography.utils import int_from_bytes Sep 07 09:43:32.208912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 09:43:32.209521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 09:43:32.209685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 09:43:32.210060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 09:43:32.210322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 09:43:32.210721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.211061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.211414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.211885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.212231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.212560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.212899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.213257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.213601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.213871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.214202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.214539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-16 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.214873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.215191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.215513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.215845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.216158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.216494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.216810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.217434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.218536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.218536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.218536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.218913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.219171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.219513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.219827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.220144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.220482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.220900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.221454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-16 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.221838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.222195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.222520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.222965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.223288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.223609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.223943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.224277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.224598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.224949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.225306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.225641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.225974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.226287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.226606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.226928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.227258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.227573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.227888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.228145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.228463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.228796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.229125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.229489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.229747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.230004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.230333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.230662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.230983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.231301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.231622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.231939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.232254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.232566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.232883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.233212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.233544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.233868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.234199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.234516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.234844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.235265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.235525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.235847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.236198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.237062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.237417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.237815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.238276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.238598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.238914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.239236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.239568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.239915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.240233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.240493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.240803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.241115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.241471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.241792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.242109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.242425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.242736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.243054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.243367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.243684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.244002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.244319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.244636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.244951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.245291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.245608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.245919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.246248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.246583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.246899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.247216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.247534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.247851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.248176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.248494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.248812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.249142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.249488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.249810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.250134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.250451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.250767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.251092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.251402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.251562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 09:43:32.252072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.252710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 09:43:32.252853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.252951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.253151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 09:43:32.253301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.253587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.253693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 09:43:32.253849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 09:43:32.253954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.254201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.254304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.254515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.254609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.254826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.254918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.255137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.255333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.255433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.255678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.255778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.256977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.257081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.257275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.257382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.257604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.257696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.257942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-16 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.258080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.258270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.258362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.258581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.258680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.258898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.258997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.259223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.259320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.259534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.259625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.259866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.259968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.260176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.260268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.260537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.260689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.260857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.261011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.261185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.261347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.261523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.261664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.261849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.262006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.262176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.262327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.262516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.262640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.262844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.262964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.263167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.263272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.263497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.263613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.263814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.263905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.264141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.264281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-16 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.264477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.264605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.264811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.264909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.265132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.265278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.265508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.265656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.265862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.265977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.266184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.266288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.266517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.266614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.266847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.266946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.267168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.267266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.267488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.267820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.267924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.268107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.268220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.268901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.269011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.269109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.269223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.269323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.269423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.269508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.269591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.269762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.269876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.270089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.270277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.270401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.270499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.270710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.270810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.270973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.271079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.271291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.271389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.271621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.271728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.271951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.272055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.272281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.272382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.272535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.272625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.272789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.272910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.273116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.273258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.273489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.273583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.273788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.273879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.274103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.274200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.274416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.274516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.274731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.274829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.276865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.276978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.277080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.277220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.277309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.277394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.277477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.277573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.277666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.277760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.277852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.277936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.278102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.278310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.278480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.278645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.278810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.278992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.278992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.279143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.279239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.279332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.279416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.279497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.280875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.281005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.281109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.281220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.281319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.281405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.281405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.281568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.281661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.281751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.281751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.281921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.282002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.282085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.282180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.282272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.282272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.282444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.282544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.282641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.282733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.282830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.285247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.285393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.285491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.285580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.285580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.285752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.285843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.285926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.286010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.286099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.286192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.286285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.286376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.286466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.286561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.286652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.286748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.286832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.286915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.287004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.287088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.287185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.287284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.287375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.287466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.287549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.287639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.287729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.287825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.287914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.288006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.288149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.288281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.288417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.288558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.288696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.288825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.288948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.289072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.289278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.289468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.289600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.289743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.289859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.289953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.290154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.290288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.290513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.290636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.290786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.290944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.291105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.291996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.292147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.292292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.292392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.292472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.292472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.292701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.292851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.293057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.293243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.293411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.293584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.293789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.293945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.294103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.294256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.294864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.295029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.295167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.295274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.295396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.295589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.295767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.296399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.296516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.296621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.296738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.296926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.296926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.297074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.297395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.297488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.297572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.299889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.300056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.300190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.300339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.300514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.300658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.300829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.300947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.301108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 09:43:32.301337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.301922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.302947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.303994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.304081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.304235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.304396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.304535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.304865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.305238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.305365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.305544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.305644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.305863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.305962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.306183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.306275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.306511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.306612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.306829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.306926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.307151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.307242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.307471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.307575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.307786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.307883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.308101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.308191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.308421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.308525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.308748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.308839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.309067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.309166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.309424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.309524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.309745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.309845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.310062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.310209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.310379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.310477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.310694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.310786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.311973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.312071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.312294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.312392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.312612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.312710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.312925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.313027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.313265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.313358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.313584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.313685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.313902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.314010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.314214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.314326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.314602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.315211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.315504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.315691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.316091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.316279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.316374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.316614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.316712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.316940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.317033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.317287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.317393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.317612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.317717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.317925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.318963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.319185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.319284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.319498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.319596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.319823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.319921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.320136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.320272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.320451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.320552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.320769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.320865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.321092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.321231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.321432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.321531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.321748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.321845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.322996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.323092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.323326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.323591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.323681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.323932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.324029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.324258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.324362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.324574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.324700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.324890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.325964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.326192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.326373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.326524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.326660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.326878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.327887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.328889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.329027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.329216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.329370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.329637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.329782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.329949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.330131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.330375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.330554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.330708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.331127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.331461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.331742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.331846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.332055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.332186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.337947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.338950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.339930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.340939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.341265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.341401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.341539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.341635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.341855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.341945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.342166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.342318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.342484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.342576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.342795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.342912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.343122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.343247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.343436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.343577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.343747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.343915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.344058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.344242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.344375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.344577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.344695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.344982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.345123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.345327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.345461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.345604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.345790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.346037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.346176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.346475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.346645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.346827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.346997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.347139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.347326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.347453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.347678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.347818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.348955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.349096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.349294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.349426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.349598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.349731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.349911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.350991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.351163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.351308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.351504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.351641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.351772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.351967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.352100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.352238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.352394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.352536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.352705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.352845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.353018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.353158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.353356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.353501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.353710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.353843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.354024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.354300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.354442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.354645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.354783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.354913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.355158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.355300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.355427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.355569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.355699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.355880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.356196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.356588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.356798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.356946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.357090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.357293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.357444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.357598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.357753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.357898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.358939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.359081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.359231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.359373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.359528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.359671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.359950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.360099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.360265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.360415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.360600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.360757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.360901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.361058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.362032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.362632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.362758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.362758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.362925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.363166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.363166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.363356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.363473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.363719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.363950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.364136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.364318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.364513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.364713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.364713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.365047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.365290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.365491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.365491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.365797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.365947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.366092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.366193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.366290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.366377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.368867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.369915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.370948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.371995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.372240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.372341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.372576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.372715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.372904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.373043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.373254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.373477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.373611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.373713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.373942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.374187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.374279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.374508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.374600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.374824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.374916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.375148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.375251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.375482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.375617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.375799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.375898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.376110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.376204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.376422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.376525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.376748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.376880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.377705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.377887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.377994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.378226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.378400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.378648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.378842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.378979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.379067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.379270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.379448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.379586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.379796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.379916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.380099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.380217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.380433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.380605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.380865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.381943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.382144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.382259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.382460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.382572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.382769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.382916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.383109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.383201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.383424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.383537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.383741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.383841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.384073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.384172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.384409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.384500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.384726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.384830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.385058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.385157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.385398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.385493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.385715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.385868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.386976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.387127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.387287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.387427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.387605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.387747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.387924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.388062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.388246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.388399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.388554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.388697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.388865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.389011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.389235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.389380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.389518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.389704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.389843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.390990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.391106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.391317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.391471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.391640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.391733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.391966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.392057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.392301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.392400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.392666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.392799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.392983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.393223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.393521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.393795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.394119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.394529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.394851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.395166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.395721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.396063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.396168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.396439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.396756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.397078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.397475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.398017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.398312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.398424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.398647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.398759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.398975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.399074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.399288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.399386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.399603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.399750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.400128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.400385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.400492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.400713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.401028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.401389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.401727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.402020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.402382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.402497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.402636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.402780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.403137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.403240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.403495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.403593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.403823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.403918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.404162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.404286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.404527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.404628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.404786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.404890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.405143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.405338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.405497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.405684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.405852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.406009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.406163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.406315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.406459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.406693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.406856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.407013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.407261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.407421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.407577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.407781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.407972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.408275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.408446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.408592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.408898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.409048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.409259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.409414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.409559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.409747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.409899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.410068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.410254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.410405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.410560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.410730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.410885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.411030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.411175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.411329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.411476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.411634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.411964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.412117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.412272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.412427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.412582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.412811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.413082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.413264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.413417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.413573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.413885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.414934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.415092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.415237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.415381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.415538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.415681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.415852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.416949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.417102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.417341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.417499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.417651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.417811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.417958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.418897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.419178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.419290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.419499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.419604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.419821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.419971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.420115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.420267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.420442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.420563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.420765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.420930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.421077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.421316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.421425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.421649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.421757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.422027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.422146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.422397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.422488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.422729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.422821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.423078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.423172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.423393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.423497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.423703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.423799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.424565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.424666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.424897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.425156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.425295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.425502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.425591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.425840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.425943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.426135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.426236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.426467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.426565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.426784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.426881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.427117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.427209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.427441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.427630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.427855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.427960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.428213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.428361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.428545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.428690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.428905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.429136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.429270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.429348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.429588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.429694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.429925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.430040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.430214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.430529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.430637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.430853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.431235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.431332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.431419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.431503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.431707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.431811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.451906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.452230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.452445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.452822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.453009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.453772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.453772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.454206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.454509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.454822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.455407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.456033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.456450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.458343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.458620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.459037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.459293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.459565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.459953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.460295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.460692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.460919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.461190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.461330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.461455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.461590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.461839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.462011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.462218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.462558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.463129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.463129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.464099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.464271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.464449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.464654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.464784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.464948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.465930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.466977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.467942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.468967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.469953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.470982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.471829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.472982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.473874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.474957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.475958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.476975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.477957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.478958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.479965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.480091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.480408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.480482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.480730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.480813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.481045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.481119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.481400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.481477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.481717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.481804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.482982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.483156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.483303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.483500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.483618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.483789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.483931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.484106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.484242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.484422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.484561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.484752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.484874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.485072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.485203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.485411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.485674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.485750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.486021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.486105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.486899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.487476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.487572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.487765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.487855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.488083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.488149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.488449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.488544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.488754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.489248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.489449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.489699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.489780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.490040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.490105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.490365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.490441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.490705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.490779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.491030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.491095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.491351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.491416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.491742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.492008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.492332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.492547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.492652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.492882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.492956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.493331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.493469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.493691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.493825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.493951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.494926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.495110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.495243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.495457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.495589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.495776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.495909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.496092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.496224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.496409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.496540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.496731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.496865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.497045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.497221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.497387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.497519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.497705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.497838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.498975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.499107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.499288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.499430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.499626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.499791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.499922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.500046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.500282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.500425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.500630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.500767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.500908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.501036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.501171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.501341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.501505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.501639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.501836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.502064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.502776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.502957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.503125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.503256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.503436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.503757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 09:43:32.503902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.504053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.504426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.504759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.505369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.505711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.506045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.506397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.506737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.507058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.507378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.507696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.508031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.508351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.508674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.508993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.509511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.509806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.510136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.510454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.510774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.511093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.511410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.511731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.512050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.512368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.512687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.513017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.513393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.513721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.514048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.514370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.514694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.515010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.515394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.515642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.515957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.516282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.516619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.516939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.517276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.517921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.518521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.518871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.519226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.519651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.519989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.520324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.520647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.520977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.521320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.521661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.522015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.522352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.522683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.522996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.523308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.523623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.524009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.524261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.524578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.524887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.525375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.525623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.525833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.526127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.526435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.526746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.527059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.527368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.527677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.527987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.528296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.528603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.528912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.529250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.529770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.529923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.530194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.530506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.530820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.531160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.531501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.531821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.532150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.532498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.532829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.534284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.534284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.534730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.535065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.535400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.535714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.536032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.536352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.536671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.536988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.537367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.537644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.537978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.538313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.538626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.538958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.539283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.539770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.540042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.540246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.540580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.540900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.541240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.541558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.541878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.542198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.542521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.542839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.543155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.543480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.543801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.544134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.544518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.544773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.545104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.545508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.545832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.546134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.546485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.546822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.547145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.547466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.547781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 09:43:32.548030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 09:43:32.566719 n-d-836830-16 devstack@n-api.service[128832]: INFO dbcounter [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Registered counter for database nova_api Sep 07 09:43:32.587810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_db.sqlalchemy.engines [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.595453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writer thread running {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.613254 n-d-836830-16 devstack@n-api.service[128833]: INFO dbcounter [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Registered counter for database nova_api Sep 07 09:43:32.635970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_db.sqlalchemy.engines [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.643362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writer thread running {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.660943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.context [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=128832) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 09:43:32.665319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:43:32.666041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:43:32.668108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:43:32.669063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:43:32.669643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:43:32.671837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:43:32.674346 n-d-836830-16 devstack@n-api.service[128832]: INFO dbcounter [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Registered counter for database nova_cell0 Sep 07 09:43:32.679213 n-d-836830-16 devstack@n-api.service[128832]: INFO dbcounter [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Registered counter for database nova_cell1 Sep 07 09:43:32.687727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_db.sqlalchemy.engines [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.690562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_db.sqlalchemy.engines [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.699063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writer thread running {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.699410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writer thread running {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.701824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.context [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=128833) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 09:43:32.706679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:43:32.707165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:43:32.708771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:43:32.709533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:43:32.709985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:43:32.711964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:43:32.714024 n-d-836830-16 devstack@n-api.service[128833]: INFO dbcounter [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Registered counter for database nova_cell0 Sep 07 09:43:32.718085 n-d-836830-16 devstack@n-api.service[128833]: INFO dbcounter [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Registered counter for database nova_cell1 Sep 07 09:43:32.725712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_db.sqlalchemy.engines [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.730220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_db.sqlalchemy.engines [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.731773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writer thread running {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.853661 n-d-836830-16 devstack@n-api.service[128832]: INFO dbcounter [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Registered counter for database nova_cell0 Sep 07 09:43:32.860498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_db.sqlalchemy.engines [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.866431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writer thread running {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.882831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writer thread running {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:32.891656 n-d-836830-16 devstack@n-api.service[128833]: INFO dbcounter [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Registered counter for database nova_cell0 Sep 07 09:43:32.899020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_db.sqlalchemy.engines [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 09:43:32.903674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writer thread running {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 09:43:33.194167 n-d-836830-16 devstack@n-api.service[128832]: WARNING keystonemiddleware.auth_token [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:43:33.201509 n-d-836830-16 devstack@n-api.service[128832]: WARNING keystonemiddleware.auth_token [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:43:33.232437 n-d-836830-16 devstack@n-api.service[128833]: WARNING keystonemiddleware.auth_token [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:43:33.240508 n-d-836830-16 devstack@n-api.service[128833]: WARNING keystonemiddleware.auth_token [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:43:33.549072 n-d-836830-16 devstack@n-api.service[128832]: WARNING keystonemiddleware.auth_token [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:43:33.555109 n-d-836830-16 devstack@n-api.service[128832]: WARNING keystonemiddleware.auth_token [None req-087e341a-e3df-4e77-a449-46c9bbcfcec7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:43:33.560464 n-d-836830-16 devstack@n-api.service[128832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596754229c0 pid: 128832 (default app) Sep 07 09:43:33.602478 n-d-836830-16 devstack@n-api.service[128833]: WARNING keystonemiddleware.auth_token [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 09:43:33.608708 n-d-836830-16 devstack@n-api.service[128833]: WARNING keystonemiddleware.auth_token [None req-65a004b3-c544-41e9-85d9-bcfb375b5476 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 09:43:33.615724 n-d-836830-16 devstack@n-api.service[128833]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596754229c0 pid: 128833 (default app) Sep 07 09:44:15.636149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:15.640442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:15.644319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:15.646612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:16.185859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:16.187561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:16.188548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:16.191308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:17.140559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:17.145844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:17.146170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:17.146781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:17.147707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:17.148303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:17.148721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:17.226217 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-988ac8a5-e568-4afc-afd4-7928c1db96ac tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.603160 Sep 07 09:44:17.227403 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:44:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:17.840642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b3587af0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:17.844513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:17.846263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:17.846927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:17.847831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:17.848451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:17.849289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:17.878108 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84baff32-a0d1-4ece-9bb6-e98196e09a0e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.649442 Sep 07 09:44:17.879478 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 7 09:44:17 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:17.884551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aab3d424-dd94-4935-917d-fee6dad40192 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-324971467"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:17.907595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-aab3d424-dd94-4935-917d-fee6dad40192 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid 6b4c6b5a-3f24-43bf-a16e-de75457d8186 for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:17.979187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Calling method '.version_select at 0x7f14b36c6e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:17.999736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=128833) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 07 09:44:18.000704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.001569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.001999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.012724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aab3d424-dd94-4935-917d-fee6dad40192 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.132023 Sep 07 09:44:18.014086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:18.020706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b34e3e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:18.025054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.025761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.026348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.027223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.027779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.028295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.031212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.031869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.032524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.046602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.048531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.048969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.055751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-56dc69a7-2123-4c80-8a9d-58192c02afa4 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.875474 Sep 07 09:44:18.056011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-22a6c88b-7018-47b6-a462-5702f2aeac59 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.040611 Sep 07 09:44:18.056352 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1/4] 10.222.0.60 () {60 vars in 1208 bytes} [Wed Sep 7 09:44:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:44:18.057057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 4/5] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Sep 7 09:44:18 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:18.071964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9818afa8-63e3-455f-b55d-f31a6a4ea768 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:18.090300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9818afa8-63e3-455f-b55d-f31a6a4ea768 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.091158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9818afa8-63e3-455f-b55d-f31a6a4ea768 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.091620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9818afa8-63e3-455f-b55d-f31a6a4ea768 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.422300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-557a5cee-87d0-453d-a6cb-dd9e3a54c71a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1149069661", "id": 2070466295, "os-flavor-access:is_public": "True"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:18.489030 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-557a5cee-87d0-453d-a6cb-dd9e3a54c71a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.425089 Sep 07 09:44:18.489576 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2/6] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:18 2022] POST /compute/v2.1/flavors => generated 430 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:18.493975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b3579b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:18.497434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.498064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.499035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.500075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:18.501403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:18.502004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:18.547451 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-216f4a9b-7076-42e3-a46e-8089c675438e tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.056689 Sep 07 09:44:18.554484 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1145 bytes} [Wed Sep 7 09:44:18 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:18.852698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9818afa8-63e3-455f-b55d-f31a6a4ea768 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.794039 Sep 07 09:44:18.861082 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 5/8] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:18.873307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-504653132", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.047078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '.version_select at 0x7f14b2c7a3a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:19.054608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=128832) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 07 09:44:19.055332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:19.055811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:19.056237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:19.073766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:19.074571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:19.075301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:19.087912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:19.088594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:19.089234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:19.096681 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46701c20-ef26-4a05-91ff-4f7d2511607e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.241921 Sep 07 09:44:19.109629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 6/9] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 7 09:44:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:19.115043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98eae4d7-60b9-4851-9ae2-578c2c1f69e6 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:19.158260 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98eae4d7-60b9-4851-9ae2-578c2c1f69e6 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2070466295" status: 202 len: 0 microversion: 2.1 time: 0.045316 Sep 07 09:44:19.160781 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 7/10] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:19 2022] DELETE /compute/v2.1/flavors/2070466295 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:19.169041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.186981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:19.187519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:19.188101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:19.247537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-836830-16. Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 40 Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:19.270856 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: {"add_host": {"host": "n-h1-836830-16"}} Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:19.272095 n-d-836830-16 devstack@n-api.service[128832]: exception: Aggregate 1 already has host n-h1-836830-16. Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-836830-16'}}} Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result.read() Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 09:44:19.273169 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-836830-16-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi session.flush() Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 09:44:19.274575 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 09:44:19.276118 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 09:44:19.278071 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result.read() Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-836830-16-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 7, 9, 44, 19, 217067), 'updated_at': None, 'host': 'n-h1-836830-16', 'aggregate_id': 1}] Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.279948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-836830-16. Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.281862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-836830-16. Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:19.286422 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:19.288623 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-836830-16. Sep 07 09:44:19.288623 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.288623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-836830-16. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:19.288623 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2aa9dd3-8cad-47de-8a62-5abcb19605b7 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.117604 Sep 07 09:44:19.288623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 8/11] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 07 09:44:19.449646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:44:19.459953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bf6e8254-36a0-4c2f-a0bf-e96206ce75d2 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1711316969", "id": 2116655990, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.498664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bf6e8254-36a0-4c2f-a0bf-e96206ce75d2 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.214860 Sep 07 09:44:19.499298 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 9/12] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/flavors => generated 439 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:19.504832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78446c4d-081b-4ef0-8574-bb3a8f9be52a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:19.541673 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78446c4d-081b-4ef0-8574-bb3a8f9be52a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041183 Sep 07 09:44:19.555492 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 10/13] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:19.555492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b60aee5-197c-41e7-a790-ae92507d526c tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.557632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b60aee5-197c-41e7-a790-ae92507d526c tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:19.558333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b60aee5-197c-41e7-a790-ae92507d526c tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:19.558983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b60aee5-197c-41e7-a790-ae92507d526c tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:19.691393 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1b60aee5-197c-41e7-a790-ae92507d526c tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.147403 Sep 07 09:44:19.692257 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 11/14] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:19.697057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e76a6ec5-a35c-41b2-a61d-67e96381d22f tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.788641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e76a6ec5-a35c-41b2-a61d-67e96381d22f tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2116655990/action" status: 200 len: 97 microversion: 2.1 time: 0.094686 Sep 07 09:44:19.793549 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 12/15] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/flavors/2116655990/action => generated 97 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:19.799004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd3fc04a-8588-40a7-992e-4ac32106dc25 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1759621874", "id": 1583870424, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.819629 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd3fc04a-8588-40a7-992e-4ac32106dc25 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.024333 Sep 07 09:44:19.820234 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 13/16] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/flavors => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:19.824541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36bdf45e-a18b-46df-923f-5f60bab45ebe tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:19.850272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36bdf45e-a18b-46df-923f-5f60bab45ebe tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.028947 Sep 07 09:44:19.851394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 14/17] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:19 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:19.855801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37ca49a3-6022-4f3e-baac-682e651da82b tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.926244 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-37ca49a3-6022-4f3e-baac-682e651da82b tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project dbf520d4dca849f4a4bd08557537a8b9 combination. Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37ca49a3-6022-4f3e-baac-682e651da82b tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Request method failure captured: Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/flavors/2116655990/action HTTP/1.1 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 67 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfxpEhXW-6OgTIe_16-i8r80ZO6h3Aw_VDZwlZkh08WdGr5ttrIqH8c_ofVFFXPU2C2XGy3Mz_ZgVHKDHysK-oJ0i8D6U7JiPdTRrRCVlBlEKNZW07Abjc395WyOJ34qrxvOV6g5NSQ74oBew-W3mzBbMXzoF23p2_9tbQ4ejV23F4 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 03914c23c68543b59cf5ce65c5154629 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:19.931417 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03914c23c68543b59cf5ce65c5154629", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 03914c23c68543b59cf5ce65c5154629 Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 00e707af09004ad8816d7ce3cc2cd460 Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: {"addTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} Sep 07 09:44:19.932636 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: exception: Flavor access already exists for flavor 16 and project dbf520d4dca849f4a4bd08557537a8b9 combination. Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2116655990', 'body': {'addTenantAccess': {'tenant': 'dbf520d4dca849f4a4bd08557537a8b9'}}} Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result.read() Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 09:44:19.933705 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-dbf520d4dca849f4a4bd08557537a8b9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi session.flush() Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 09:44:19.934980 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 09:44:19.936027 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 09:44:19.937135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result.read() Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-dbf520d4dca849f4a4bd08557537a8b9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 7, 9, 44, 19, 922685), 'updated_at': None, 'flavor_id': 16, 'project_id': 'dbf520d4dca849f4a4bd08557537a8b9'}] Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:19.938944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project dbf520d4dca849f4a4bd08557537a8b9 combination. Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:19.940078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project dbf520d4dca849f4a4bd08557537a8b9 combination. Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:19.944886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:19.946321 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project dbf520d4dca849f4a4bd08557537a8b9 combination. Sep 07 09:44:19.946321 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:19.946321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37ca49a3-6022-4f3e-baac-682e651da82b tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project dbf520d4dca849f4a4bd08557537a8b9 combination. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:19.946321 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37ca49a3-6022-4f3e-baac-682e651da82b tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2116655990/action" status: 409 len: 152 microversion: 2.1 time: 0.080815 Sep 07 09:44:19.946321 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 15/18] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/flavors/2116655990/action => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:44:19.949816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af37a9dc-84f3-4878-9b78-04ac69cb3891 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:19.974553 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-af37a9dc-84f3-4878-9b78-04ac69cb3891 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.031278 Sep 07 09:44:19.975754 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 16/19] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:19 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:19.980942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98875a3d-8513-4206-82b2-d24ee2e1e1ef tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1043711504"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:19.984323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-98875a3d-8513-4206-82b2-d24ee2e1e1ef tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid 39844cd8-4e6c-4194-a957-6ce3d2fc188b for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:20.009036 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98875a3d-8513-4206-82b2-d24ee2e1e1ef tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.032220 Sep 07 09:44:20.009935 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 17/20] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:20.019288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60fc40ce-8404-4035-bd38-e35b34ddbdd7 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1430053826", "name": "tempest-test_aggregate-1652383093"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:20.023353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:44:20.025048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:44:20.025578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:44:20.026256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:44:20.026691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:44:20.045487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:20.046095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:20.046557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:20.047879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:20.048874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:20.049972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:20.050309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-60fc40ce-8404-4035-bd38-e35b34ddbdd7 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid db17f02f-8b49-434e-9917-cb86972e3810 for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:20.086563 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60fc40ce-8404-4035-bd38-e35b34ddbdd7 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.075391 Sep 07 09:44:20.087694 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 18/21] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 7 09:44:20 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:20.099600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e90bc64-1440-4883-9bec-3c37f262df95 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:20.101454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Getting quotas for project 359cbb65f5314ea88e9d55f8a9c50e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:44:20.109435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Getting quotas for user 6dc8442ea8c54bc699cc9c95b397fa18 and project 359cbb65f5314ea88e9d55f8a9c50e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:44:20.131077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:44:20.134394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:44:20.199897 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e90bc64-1440-4883-9bec-3c37f262df95 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2116655990/action" status: 200 len: 21 microversion: 2.1 time: 0.105083 Sep 07 09:44:20.201263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 19/22] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:20 2022] POST /compute/v2.1/flavors/2116655990/action => generated 21 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:20.216317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56334d29-37dd-443f-b54c-132848a8592c tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.228136 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ac8ba68-ffa0-409c-ad90-5cf013ce9453 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677877 Sep 07 09:44:20.229042 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 4/23] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:44:20.253508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:DELETE=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:20.261580 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56334d29-37dd-443f-b54c-132848a8592c tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1583870424" status: 202 len: 0 microversion: 2.1 time: 0.058510 Sep 07 09:44:20.263449 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 20/24] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:20 2022] DELETE /compute/v2.1/flavors/1583870424 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:20.270720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec5fbd58-1968-4948-993f-c63d73f5ef49 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.313167 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ec5fbd58-1968-4948-993f-c63d73f5ef49 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.048087 Sep 07 09:44:20.315081 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 21/25] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:44:20 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:20.338513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-661cea64-f8d5-4c9a-b632-22fba0959c6d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.370384 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-661cea64-f8d5-4c9a-b632-22fba0959c6d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2116655990" status: 202 len: 0 microversion: 2.1 time: 0.053389 Sep 07 09:44:20.374406 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 22/26] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:20 2022] DELETE /compute/v2.1/flavors/2116655990 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:20.378543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-463cc941-7746-4a20-81a0-17fa139d7310 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.379491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-463cc941-7746-4a20-81a0-17fa139d7310 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:20.436174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5026686f-9f2a-4314-b6e7-1269a6bc45e4 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:20.440382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5026686f-9f2a-4314-b6e7-1269a6bc45e4 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c15463c4fc3b4daba1f3e66306e238fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748f3ce32234960869132a33d10d5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5026686f-9f2a-4314-b6e7-1269a6bc45e4 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Request method failure captured: Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 40 Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfsOglBW_E1tucxURZSe6f3ac8FTSBem35PKcdGpPUmZuKJZaxJY5vtt2sEbTe6qsWH5JpMemsyHgl18_p434tZ-LXxecKDVEI_svzyAYAKQ4WzlSyAS2KY3fdH8HvbtKYnwKZD6knmoTu1U9AyDfqae66_il4KaK2WAqSKQa1uGqA Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:44:20.445120 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7748f3ce32234960869132a33d10d5ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: c15463c4fc3b4daba1f3e66306e238fa Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: {"add_host": {"host": "n-h1-836830-16"}} Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:20.446405 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-836830-16'}}} Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:20.447076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 07 09:44:20.448112 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:20.453661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5026686f-9f2a-4314-b6e7-1269a6bc45e4 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:20.456491 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5026686f-9f2a-4314-b6e7-1269a6bc45e4 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.224626 Sep 07 09:44:20.458007 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 5/27] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 228 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:20.467674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9163bb20-f3d5-4d6b-9524-04e5e108ca76 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.543817 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9163bb20-f3d5-4d6b-9524-04e5e108ca76 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084409 Sep 07 09:44:20.547011 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 6/28] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:20.562414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6bfff89-b70d-45fb-b1db-48cbefc25aa6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:20.609939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6bfff89-b70d-45fb-b1db-48cbefc25aa6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:20.612025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6bfff89-b70d-45fb-b1db-48cbefc25aa6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:20.616065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6bfff89-b70d-45fb-b1db-48cbefc25aa6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:20.731279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-463cc941-7746-4a20-81a0-17fa139d7310 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:20.799641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-463cc941-7746-4a20-81a0-17fa139d7310 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1219 microversion: 2.1 time: 0.423442 Sep 07 09:44:20.800832 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 23/29] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:20 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1219 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:20.813728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36c5d95c-691e-4ac2-87ee-cc391f739f55 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.850708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36c5d95c-691e-4ac2-87ee-cc391f739f55 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048321 Sep 07 09:44:20.868094 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 24/30] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:20.880192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fedb284a-69d4-4942-981f-8cbf64f19e0d tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:20.921163 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fedb284a-69d4-4942-981f-8cbf64f19e0d tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.048163 Sep 07 09:44:20.926967 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 25/31] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:20 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:20.932288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5374f795-25ba-48b8-885c-d1afbbcf409a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2125497440", "id": 181080844, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:20.967247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5374f795-25ba-48b8-885c-d1afbbcf409a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.038904 Sep 07 09:44:20.969150 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 26/32] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:20 2022] POST /compute/v2.1/flavors => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:20.976751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4ab70b7-e519-47b5-b362-b75e7a014a0c tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-236511801", "id": 479379044, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.002577 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4ab70b7-e519-47b5-b362-b75e7a014a0c tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.031359 Sep 07 09:44:21.009321 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 27/33] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:20 2022] POST /compute/v2.1/flavors => generated 434 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:21.040436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eafafc6d-03d9-46f1-a1d2-31e4bf665246 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1686779379"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.062919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-eafafc6d-03d9-46f1-a1d2-31e4bf665246 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid bc02d3bb-995e-4b94-b3ee-43904137348f for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:21.106751 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eafafc6d-03d9-46f1-a1d2-31e4bf665246 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076170 Sep 07 09:44:21.107867 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 28/34] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:21.114787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42be4baa-5c58-4106-9c70-a636688c0dd6 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.165788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-42be4baa-5c58-4106-9c70-a636688c0dd6 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/181080844" status: 202 len: 0 microversion: 2.1 time: 0.056514 Sep 07 09:44:21.166570 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 29/35] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:21 2022] DELETE /compute/v2.1/flavors/181080844 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:21.184705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1aec2447-4c13-4c53-8426-134a0369102a tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.196315 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-1aec2447-4c13-4c53-8426-134a0369102a tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1aec2447-4c13-4c53-8426-134a0369102a tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Request method failure captured: Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/flavors/479379044/os-flavor-access HTTP/1.1 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfxpEhXW-6OgTIe_16-i8r80ZO6h3Aw_VDZwlZkh08WdGr5ttrIqH8c_ofVFFXPU2C2XGy3Mz_ZgVHKDHysK-oJ0i8D6U7JiPdTRrRCVlBlEKNZW07Abjc395WyOJ34qrxvOV6g5NSQ74oBew-W3mzBbMXzoF23p2_9tbQ4ejV23F4 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 03914c23c68543b59cf5ce65c5154629 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:21.199894 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03914c23c68543b59cf5ce65c5154629", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 03914c23c68543b59cf5ce65c5154629 Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 00e707af09004ad8816d7ce3cc2cd460 Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: exception: Access list not available for public flavors. Sep 07 09:44:21.201204 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'flavor_id': '479379044'} Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 07 09:44:21.203534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.205957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1aec2447-4c13-4c53-8426-134a0369102a tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:21.205957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1aec2447-4c13-4c53-8426-134a0369102a tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/479379044/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034754 Sep 07 09:44:21.205957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 30/36] 10.222.0.60 () {58 vars in 1206 bytes} [Wed Sep 7 09:44:21 2022] GET /compute/v2.1/flavors/479379044/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:44:21.212107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2044256915"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.226307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:21.226799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:21.227287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:21.238403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:21.238916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:21.239454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:21.252008 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2044256915 could not be found. Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 58 Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:21.267171 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: {"add_host": {"host": "tempest-nonexist_host-2044256915"}} Sep 07 09:44:21.268326 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: exception: Compute host tempest-nonexist_host-2044256915 could not be found. Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2044256915'}}} Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2044256915' is not mapped to any cell Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.268906 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 07 09:44:21.269879 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2044256915 could not be found. Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2044256915 could not be found. Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.270837 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2044256915 could not be found. Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2044256915 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:21.271820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b362374e-3345-4a06-88aa-78a4fea841a8 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.063075 Sep 07 09:44:21.272508 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 31/37] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:21.283255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d4dbd05-e523-461d-b2e0-31bd1265981b tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.285781 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6bfff89-b70d-45fb-b1db-48cbefc25aa6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 316 microversion: 2.1 time: 0.736443 Sep 07 09:44:21.288109 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 7/38] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:20 2022] POST /compute/v2.1/os-aggregates/3/action => generated 316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:21.298738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1bebaa1f-35e3-4e18-927d-32343ecd1844 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.377683 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d4dbd05-e523-461d-b2e0-31bd1265981b tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5415 microversion: 2.1 time: 0.104643 Sep 07 09:44:21.382624 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 32/39] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:21 2022] GET /compute/v2.1/flavors/detail => generated 5415 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:21.388737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37ee55e5-e513-4299-8f66-badd7f63e050 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.436173 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37ee55e5-e513-4299-8f66-badd7f63e050 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.052193 Sep 07 09:44:21.438830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 33/40] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:21 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:21.451428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e726e709-6818-4fac-bcc6-4b8ea0bbde47 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1786104171", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.457464 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1bebaa1f-35e3-4e18-927d-32343ecd1844 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/479379044" status: 202 len: 0 microversion: 2.1 time: 0.167783 Sep 07 09:44:21.461106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 8/41] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:21 2022] DELETE /compute/v2.1/flavors/479379044 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:21.464802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11dd1364-e440-4767-9adc-ac2231ebdf1b tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11dd1364-e440-4767-9adc-ac2231ebdf1b tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 283 Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:44:21.487270 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:21.488690 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:44:21.489213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:21.489786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.490618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.491430 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:44:21.491430 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:44:21.491430 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:44:21.491430 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.491657 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e726e709-6818-4fac-bcc6-4b8ea0bbde47 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.047523 Sep 07 09:44:21.493287 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 34/42] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/flavors => generated 507 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:21.496359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11dd1364-e440-4767-9adc-ac2231ebdf1b tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:21.497467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11dd1364-e440-4767-9adc-ac2231ebdf1b tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.038086 Sep 07 09:44:21.501313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06148655-2a4c-4d5d-9dd3-b7887178ebf3 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.505040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 9/43] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:44:21.522230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f4de1d5-fa08-4de9-8690-e7a7fc6e213d tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.549111 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06148655-2a4c-4d5d-9dd3-b7887178ebf3 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.047777 Sep 07 09:44:21.561463 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 35/44] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:21 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:21.561463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23119f18-e1f4-446d-81a8-6483ebb43e71 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23119f18-e1f4-446d-81a8-6483ebb43e71 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 27 Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:21.570311 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: {"aggregate": {"name": ""}} Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:21.571736 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi '' Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:21.572588 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 09:44:21.574370 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.575783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23119f18-e1f4-446d-81a8-6483ebb43e71 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:21.575783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23119f18-e1f4-446d-81a8-6483ebb43e71 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018863 Sep 07 09:44:21.577594 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 36/45] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:44:21.591871 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f4de1d5-fa08-4de9-8690-e7a7fc6e213d tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/cccc99ea-1e6d-4306-a810-8f937cb7edce" status: 202 len: 0 microversion: 2.1 time: 0.084265 Sep 07 09:44:21.592774 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 10/46] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:44:21 2022] DELETE /compute/v2.1/flavors/cccc99ea-1e6d-4306-a810-8f937cb7edce => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:21.598713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dace6ec-9221-416d-aab2-b075365a0334 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-98991814"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.605244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d06e761-cccc-4ee3-a8f8-ba24d7966e78 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-662938498", "id": 556769067, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.606993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1dace6ec-9221-416d-aab2-b075365a0334 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c15463c4fc3b4daba1f3e66306e238fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748f3ce32234960869132a33d10d5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dace6ec-9221-416d-aab2-b075365a0334 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Request method failure captured: Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 58 Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfsOglBW_E1tucxURZSe6f3ac8FTSBem35PKcdGpPUmZuKJZaxJY5vtt2sEbTe6qsWH5JpMemsyHgl18_p434tZ-LXxecKDVEI_svzyAYAKQ4WzlSyAS2KY3fdH8HvbtKYnwKZD6knmoTu1U9AyDfqae66_il4KaK2WAqSKQa1uGqA Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:44:21.615818 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7748f3ce32234960869132a33d10d5ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: c15463c4fc3b4daba1f3e66306e238fa Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: {"aggregate": {"name": "tempest-test_aggregate-98991814"}} Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:21.617094 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-98991814'}}} Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:21.617887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:21.618806 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 07 09:44:21.619736 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:21.619736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dace6ec-9221-416d-aab2-b075365a0334 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:21.619736 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1dace6ec-9221-416d-aab2-b075365a0334 tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.023960 Sep 07 09:44:21.624939 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 11/47] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:21.676229 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d06e761-cccc-4ee3-a8f8-ba24d7966e78 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.094994 Sep 07 09:44:21.679820 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 37/48] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/flavors => generated 435 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:21.687522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85c0f956-c10f-482c-bcf4-7c5adebc8a6d tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:21.748847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85c0f956-c10f-482c-bcf4-7c5adebc8a6d tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066222 Sep 07 09:44:21.761206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 38/49] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:21.761206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0f55dd6-a8e8-4185-9c3d-4b1a765a83ca tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633869136"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.761206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-d0f55dd6-a8e8-4185-9c3d-4b1a765a83ca tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid 190b71fd-2c4b-42f9-a830-0b1e83976a33 for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:21.772150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1744907370", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "availability_zone": "tempest-test_az-1430053826"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:21.792067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0f55dd6-a8e8-4185-9c3d-4b1a765a83ca tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040880 Sep 07 09:44:21.794479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 39/50] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:21.799074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:21.799580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:21.804965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:21.806645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:21.807837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:21.810971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:21.950868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:44:22.037445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4442a8a1-783f-402b-b6ef-6ed7a736d275 tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.041479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4442a8a1-783f-402b-b6ef-6ed7a736d275 tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '6c51c4fb774b4a8e9700c3eac02f1975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf520d4dca849f4a4bd08557537a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4442a8a1-783f-402b-b6ef-6ed7a736d275 tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Request method failure captured: Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/flavors/556769067/action HTTP/1.1 Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 67 Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfuN8nCoBAWzzTUCSpPM8Ag5cOvfNEE-ppELUfz8qy4sCw1V0JCI5MkM0rIKKa9vRcV5eqWhAioISJ82hRb4poEOcStRtGajFVTicxcMOh8B8xvR5d4xvJKP-jIbHX3IZrxKDl5WDSjtM4smNV4UdPy27TgM7ci19KTBCq76ziSZgQ Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: dbf520d4dca849f4a4bd08557537a8b9 Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1392710623 Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:44:22.045121 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dbf520d4dca849f4a4bd08557537a8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dbf520d4dca849f4a4bd08557537a8b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dbf520d4dca849f4a4bd08557537a8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dbf520d4dca849f4a4bd08557537a8b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1392710623 Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: dbf520d4dca849f4a4bd08557537a8b9 Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1392710623 Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FlavorsAccessNegativeTestJSON-1392710623-project Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6c51c4fb774b4a8e9700c3eac02f1975 Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1392710623-project Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: {"addTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} Sep 07 09:44:22.046254 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '556769067', 'body': {'addTenantAccess': {'tenant': 'dbf520d4dca849f4a4bd08557537a8b9'}}} Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:22.047101 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 07 09:44:22.048221 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.051035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4442a8a1-783f-402b-b6ef-6ed7a736d275 tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:22.053006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4442a8a1-783f-402b-b6ef-6ed7a736d275 tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] 10.222.0.60 "POST /compute/v2.1/flavors/556769067/action" status: 403 len: 130 microversion: 2.1 time: 0.257349 Sep 07 09:44:22.053847 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 40/51] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/flavors/556769067/action => generated 130 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:22.059589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf760110-b8c9-48ae-b66e-e05e40cab998 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-116930468", "id": "2d962d1c-74ce-4481-999a-2b84a8c70df8", "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.112375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf760110-b8c9-48ae-b66e-e05e40cab998 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.056867 Sep 07 09:44:22.113335 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 41/52] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:22 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:22.127205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6e61358-2e3f-4d66-89e8-ea668dcd54db tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633869136"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.137501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-b6e61358-2e3f-4d66-89e8-ea668dcd54db tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid aacc0462-39a8-4bc4-8e4b-4fc14268abaa for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:22.161035 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b6e61358-2e3f-4d66-89e8-ea668dcd54db tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1633869136 already exists. Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6e61358-2e3f-4d66-89e8-ea668dcd54db tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 60 Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:22.165771 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: {"aggregate": {"name": "tempest-test_aggregate-1633869136"}} Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:22.166970 n-d-836830-16 devstack@n-api.service[128832]: exception: Aggregate tempest-test_aggregate-1633869136 already exists. Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1633869136'}}} Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 07 09:44:22.167614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1633869136 already exists. Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:22.168518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1633869136 already exists. Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1633869136 already exists. Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6e61358-2e3f-4d66-89e8-ea668dcd54db tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1633869136 already exists. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:22.171025 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6e61358-2e3f-4d66-89e8-ea668dcd54db tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.045528 Sep 07 09:44:22.171769 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 42/53] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:22 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:44:22.177647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.178402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:22.207617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:22.208864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:22.209547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:22.211101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:22.211692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:22.212433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:22.295933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:44:22.296351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:44:22.297021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:44:22.297760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:44:22.298311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:44:22.308411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:22.309163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:22.309846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:22.311364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:22.312189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:22.312762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:22.345086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Getting quotas for project c73ebce290c447758845265a00ecff90. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:44:22.351995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Getting quotas for user 68c6273cfbea45ffa55d49947a84924f and project c73ebce290c447758845265a00ecff90. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:44:22.368202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:44:22.371788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:44:22.458260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d7f79f8-2851-494d-a970-690f1317bac3 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834285 Sep 07 09:44:22.459958 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 12/54] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:44:22.474115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:22.487221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b45e10f2-8b57-42f3-b991-7ef2828f5543 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.513510 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c36e30a-6596-44f2-a048-55a66af4fc67 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1223 microversion: 2.1 time: 0.344602 Sep 07 09:44:22.519839 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 43/55] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:22 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1223 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:22.536998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2eaa2fb7-37bb-4728-a9ab-ee17f87f1952 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.576754 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b45e10f2-8b57-42f3-b991-7ef2828f5543 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/556769067" status: 202 len: 0 microversion: 2.1 time: 0.107877 Sep 07 09:44:22.579953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 13/56] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:22 2022] DELETE /compute/v2.1/flavors/556769067 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:22.596128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9c50fca-7736-407a-a031-bb2bb563d65e tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.615302 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2eaa2fb7-37bb-4728-a9ab-ee17f87f1952 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2d962d1c-74ce-4481-999a-2b84a8c70df8" status: 202 len: 0 microversion: 2.1 time: 0.086367 Sep 07 09:44:22.616456 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 44/57] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:44:22 2022] DELETE /compute/v2.1/flavors/2d962d1c-74ce-4481-999a-2b84a8c70df8 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:22.622627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30a0cadc-8936-477d-83a3-566453e6bff2 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.626776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-30a0cadc-8936-477d-83a3-566453e6bff2 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:22.685121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9c50fca-7736-407a-a031-bb2bb563d65e tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.095269 Sep 07 09:44:22.687897 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 14/58] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:22 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:22.699072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cceb225-1b8a-4327-8770-59b31f7613af tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.714493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-30a0cadc-8936-477d-83a3-566453e6bff2 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:22.727644 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30a0cadc-8936-477d-83a3-566453e6bff2 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1243 microversion: 2.1 time: 0.109977 Sep 07 09:44:22.733524 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 45/59] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:22 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1243 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:22.740990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-47710491-25d5-4bb7-adee-c3c232fdf5b4 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.750431 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cceb225-1b8a-4327-8770-59b31f7613af tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059555 Sep 07 09:44:22.759953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 15/60] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:22.781938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a244122-c4f6-4e67-8b84-fc8ad3de5dc5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-103277950"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.789250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-7a244122-c4f6-4e67-8b84-fc8ad3de5dc5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid 9668b92d-8241-4056-8ed3-a034deb43822 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:22.795947 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-47710491-25d5-4bb7-adee-c3c232fdf5b4 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060846 Sep 07 09:44:22.799852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 46/61] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:22.806162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30072541-2515-46f8-9305-5139b803973d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-855466938", "id": 1993145188, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.848460 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30072541-2515-46f8-9305-5139b803973d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.047396 Sep 07 09:44:22.850353 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 47/62] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:22 2022] POST /compute/v2.1/flavors => generated 438 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:22.852640 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a244122-c4f6-4e67-8b84-fc8ad3de5dc5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.091410 Sep 07 09:44:22.865850 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 16/63] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:22.870445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0718a25f-1116-4df1-88ec-89883975045f tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.880786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5669ac7d-b916-4d74-9008-9cead714fd45 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-675305261", "id": 250317899, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:22.902478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:22.936395 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5669ac7d-b916-4d74-9008-9cead714fd45 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.063361 Sep 07 09:44:22.938979 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 48/64] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:22 2022] POST /compute/v2.1/flavors => generated 410 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:22.947187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7077f658-065d-40b2-a904-b3f1d5c1e1ec tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.948757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7077f658-065d-40b2-a904-b3f1d5c1e1ec tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c15463c4fc3b4daba1f3e66306e238fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748f3ce32234960869132a33d10d5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7077f658-065d-40b2-a904-b3f1d5c1e1ec tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Request method failure captured: Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfsOglBW_E1tucxURZSe6f3ac8FTSBem35PKcdGpPUmZuKJZaxJY5vtt2sEbTe6qsWH5JpMemsyHgl18_p434tZ-LXxecKDVEI_svzyAYAKQ4WzlSyAS2KY3fdH8HvbtKYnwKZD6knmoTu1U9AyDfqae66_il4KaK2WAqSKQa1uGqA Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:44:22.958396 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7748f3ce32234960869132a33d10d5ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: c15463c4fc3b4daba1f3e66306e238fa Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 07 09:44:22.959496 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6'} Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:22.960307 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:22.961238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7077f658-065d-40b2-a904-b3f1d5c1e1ec tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:22.962160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7077f658-065d-40b2-a904-b3f1d5c1e1ec tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.020480 Sep 07 09:44:22.966399 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 49/65] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:22.977234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-43ed741f-4b94-4ab0-82f9-bd520f3e4a06 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:22.995686 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-43ed741f-4b94-4ab0-82f9-bd520f3e4a06 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/250317899" status: 200 len: 410 microversion: 2.1 time: 0.031305 Sep 07 09:44:22.996766 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 50/66] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:44:22 2022] GET /compute/v2.1/flavors/250317899 => generated 410 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:23.008550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10,nova_api:DELETE=11 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:23.012860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebc3aba9-d02a-4ed7-ba3e-2f609d56008d tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.029990 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0718a25f-1116-4df1-88ec-89883975045f tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1993145188/action" status: 200 len: 97 microversion: 2.1 time: 0.170074 Sep 07 09:44:23.030781 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 17/67] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:22 2022] POST /compute/v2.1/flavors/1993145188/action => generated 97 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:23.055756 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebc3aba9-d02a-4ed7-ba3e-2f609d56008d tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.057845 Sep 07 09:44:23.056938 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 51/68] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:23.061764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87dd82b3-b4ce-467a-afd9-37ce90caeb6f tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.069453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87dd82b3-b4ce-467a-afd9-37ce90caeb6f tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '6c51c4fb774b4a8e9700c3eac02f1975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf520d4dca849f4a4bd08557537a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87dd82b3-b4ce-467a-afd9-37ce90caeb6f tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Request method failure captured: Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/flavors/1993145188/action HTTP/1.1 Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 70 Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfuN8nCoBAWzzTUCSpPM8Ag5cOvfNEE-ppELUfz8qy4sCw1V0JCI5MkM0rIKKa9vRcV5eqWhAioISJ82hRb4poEOcStRtGajFVTicxcMOh8B8xvR5d4xvJKP-jIbHX3IZrxKDl5WDSjtM4smNV4UdPy27TgM7ci19KTBCq76ziSZgQ Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: dbf520d4dca849f4a4bd08557537a8b9 Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1392710623 Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:44:23.071088 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dbf520d4dca849f4a4bd08557537a8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dbf520d4dca849f4a4bd08557537a8b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dbf520d4dca849f4a4bd08557537a8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dbf520d4dca849f4a4bd08557537a8b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1392710623 Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: dbf520d4dca849f4a4bd08557537a8b9 Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1392710623 Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FlavorsAccessNegativeTestJSON-1392710623-project Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6c51c4fb774b4a8e9700c3eac02f1975 Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1392710623-project Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: {"removeTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} Sep 07 09:44:23.072205 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1993145188', 'body': {'removeTenantAccess': {'tenant': 'dbf520d4dca849f4a4bd08557537a8b9'}}} Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can( Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:23.072811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 07 09:44:23.073795 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.076247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87dd82b3-b4ce-467a-afd9-37ce90caeb6f tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.076247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87dd82b3-b4ce-467a-afd9-37ce90caeb6f tempest-FlavorsAccessNegativeTestJSON-1392710623 tempest-FlavorsAccessNegativeTestJSON-1392710623-project] 10.222.0.60 "POST /compute/v2.1/flavors/1993145188/action" status: 403 len: 133 microversion: 2.1 time: 0.014426 Sep 07 09:44:23.092239 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 52/69] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/flavors/1993145188/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:23.104761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd42ac14-276d-4ad8-9c58-0c5af9c76e76 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.124228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-dd42ac14-276d-4ad8-9c58-0c5af9c76e76 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd42ac14-276d-4ad8-9c58-0c5af9c76e76 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:23.127265 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: exception: Aggregate -1 could not be found. Sep 07 09:44:23.128646 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '-1'} Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 09:44:23.129469 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.130664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.131876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.131876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.131876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:23.131876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:23.131876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 07 09:44:23.131876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.145338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd42ac14-276d-4ad8-9c58-0c5af9c76e76 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.149057 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd42ac14-276d-4ad8-9c58-0c5af9c76e76 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053463 Sep 07 09:44:23.151645 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 53/70] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:44:23 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:44:23.164011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-43bca358-5dcc-4e1c-ac3f-ea2329243341 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dbf520d4dca849f4a4bd08557537a8b9"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.302354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e4ad32f3-56b6-41c4-bc16-1ff77c605181 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.317918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-43bca358-5dcc-4e1c-ac3f-ea2329243341 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1993145188/action" status: 200 len: 21 microversion: 2.1 time: 0.164904 Sep 07 09:44:23.325628 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 54/71] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/flavors/1993145188/action => generated 21 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:23.332630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9da137cf-7905-4a8f-8df8-afaa791cca46 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-979714206"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.337124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-9da137cf-7905-4a8f-8df8-afaa791cca46 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid 2fae1bad-1ac7-49d8-b7e3-b368d8d78cb7 for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:23.378493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e4ad32f3-56b6-41c4-bc16-1ff77c605181 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.346644 Sep 07 09:44:23.379160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9da137cf-7905-4a8f-8df8-afaa791cca46 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050404 Sep 07 09:44:23.379580 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 18/72] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:23.380555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 55/73] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:23.393859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b6c43da-3128-4540-ab98-15b12223524c tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.395097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c5e987e-0be4-4a93-a247-7798fe249955 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.396068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b6c43da-3128-4540-ab98-15b12223524c tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c15463c4fc3b4daba1f3e66306e238fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748f3ce32234960869132a33d10d5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b6c43da-3128-4540-ab98-15b12223524c tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Request method failure captured: Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfsOglBW_E1tucxURZSe6f3ac8FTSBem35PKcdGpPUmZuKJZaxJY5vtt2sEbTe6qsWH5JpMemsyHgl18_p434tZ-LXxecKDVEI_svzyAYAKQ4WzlSyAS2KY3fdH8HvbtKYnwKZD6knmoTu1U9AyDfqae66_il4KaK2WAqSKQa1uGqA Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:44:23.397828 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7748f3ce32234960869132a33d10d5ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: c15463c4fc3b4daba1f3e66306e238fa Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 07 09:44:23.399191 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '7'} Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:23.399950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 07 09:44:23.401089 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.402771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b6c43da-3128-4540-ab98-15b12223524c tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.403790 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b6c43da-3128-4540-ab98-15b12223524c tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.015462 Sep 07 09:44:23.404822 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 19/74] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:23.411206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f7837bf-9c8e-47d6-8324-e1e858734366 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.447783 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f7837bf-9c8e-47d6-8324-e1e858734366 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/250317899" status: 202 len: 0 microversion: 2.1 time: 0.041470 Sep 07 09:44:23.448692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 20/75] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:23 2022] DELETE /compute/v2.1/flavors/250317899 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:23.458572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc24e58f-323a-4d48-9669-a7d22338f146 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.466610 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1c5e987e-0be4-4a93-a247-7798fe249955 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1993145188" status: 202 len: 0 microversion: 2.1 time: 0.084744 Sep 07 09:44:23.467217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 56/76] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:23 2022] DELETE /compute/v2.1/flavors/1993145188 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:23.476925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f2545da7-761f-4ef1-849d-facbf0f119d2 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.504325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc24e58f-323a-4d48-9669-a7d22338f146 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.050413 Sep 07 09:44:23.507844 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 21/77] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:23 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:23.512522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5647b7a7-3d04-4b78-bfa9-f84704b98350 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.524601 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f2545da7-761f-4ef1-849d-facbf0f119d2 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051932 Sep 07 09:44:23.525221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 57/78] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:23.542942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4b5a868-d7a5-4289-b140-49494228f9c1 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.555605 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-c4b5a868-d7a5-4289-b140-49494228f9c1 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4b5a868-d7a5-4289-b140-49494228f9c1 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:44:23.560094 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: exception: Aggregate -1 could not be found. Sep 07 09:44:23.561930 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '-1'} Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.563113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 07 09:44:23.564371 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.572064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4b5a868-d7a5-4289-b140-49494228f9c1 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.572064 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4b5a868-d7a5-4289-b140-49494228f9c1 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036630 Sep 07 09:44:23.572064 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 58/79] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:44:23.572999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5647b7a7-3d04-4b78-bfa9-f84704b98350 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055942 Sep 07 09:44:23.572999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 22/80] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:23.587427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.588947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:23.589867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4a2e24d-c0c5-4898-826f-9fe09ca1f2a5 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1348925189", "id": 2113345008, "os-flavor-access:is_public": "False"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.605920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:23.607561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:23.608345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:23.609587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:23.610845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:23.611813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:23.633499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4a2e24d-c0c5-4898-826f-9fe09ca1f2a5 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.052037 Sep 07 09:44:23.635751 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 23/81] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/flavors => generated 430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:23.655605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-729dee20-d43d-4bfe-9273-0475c1a6defa tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.658109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-729dee20-d43d-4bfe-9273-0475c1a6defa tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c15463c4fc3b4daba1f3e66306e238fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748f3ce32234960869132a33d10d5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-729dee20-d43d-4bfe-9273-0475c1a6defa tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Request method failure captured: Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfsOglBW_E1tucxURZSe6f3ac8FTSBem35PKcdGpPUmZuKJZaxJY5vtt2sEbTe6qsWH5JpMemsyHgl18_p434tZ-LXxecKDVEI_svzyAYAKQ4WzlSyAS2KY3fdH8HvbtKYnwKZD6knmoTu1U9AyDfqae66_il4KaK2WAqSKQa1uGqA Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:44:23.660456 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7748f3ce32234960869132a33d10d5ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: c15463c4fc3b4daba1f3e66306e238fa Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 07 09:44:23.662163 n-d-836830-16 devstack@n-api.service[128833]: action_args: {} Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:44:23.662910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 07 09:44:23.664048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.665004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-729dee20-d43d-4bfe-9273-0475c1a6defa tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.666099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-729dee20-d43d-4bfe-9273-0475c1a6defa tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.028376 Sep 07 09:44:23.666737 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 24/82] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:23.671717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-287ddf17-93d8-4216-83c0-9d6ce32d6317 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2146035699", "id": 1114570940, "os-flavor-access:is_public": "False"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.706050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-287ddf17-93d8-4216-83c0-9d6ce32d6317 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036011 Sep 07 09:44:23.716634 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 25/83] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/flavors => generated 439 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:23.723950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a198b87-2154-4689-b38d-1f8505eb7dd4 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "2113345008"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.760637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:23.769088 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-1a198b87-2154-4689-b38d-1f8505eb7dd4 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] HTTP exception thrown: Flavor 2113345008 could not be found. Sep 07 09:44:23.771095 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c71a0efe-5bc7-42e8-95dd-9f6adefb706d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1271 microversion: 2.1 time: 0.203335 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a198b87-2154-4689-b38d-1f8505eb7dd4 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] Request method failure captured: Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 107 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuI22CfnHYS7sGa16HC7uUh965eUZhC33WNQtuXCVlgQRRNKkoB_i9dfo15CihWlJrDzWgAQOuyl92yBpKU1POqGHyesM5nbpyIk7JwdiRyQx4DG7TxglLkadhdPoK4wzsailgzaA3GVwMD8jULxdWKqadjw5-FOxpFftgjBqthPc Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 942a3f74a5f846eab64833142df61b11 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsAdminTestJSON-1301290463 Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:44:23.774147 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/942a3f74a5f846eab64833142df61b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/942a3f74a5f846eab64833142df61b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/942a3f74a5f846eab64833142df61b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_942a3f74a5f846eab64833142df61b11", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsAdminTestJSON-1301290463 Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 942a3f74a5f846eab64833142df61b11 Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1301290463 Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsAdminTestJSON-1301290463-project Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2e97fd4760a94ced9fd473cdf95f9164 Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsAdminTestJSON-1301290463-project Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "test", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "2113345008"}} Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:23.775261 n-d-836830-16 devstack@n-api.service[128833]: exception: Flavor 2113345008 could not be found. Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '2113345008'}}} Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2113345008 could not be found. Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.775934 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2113345008 could not be found. Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.776911 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.779474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.779474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:23.779474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:23.779474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2113345008 could not be found. Sep 07 09:44:23.779474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.781343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a198b87-2154-4689-b38d-1f8505eb7dd4 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] Returning 400 to user: Flavor 2113345008 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.783137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a198b87-2154-4689-b38d-1f8505eb7dd4 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.064445 Sep 07 09:44:23.784488 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 26/84] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/servers => generated 81 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:44:23.789470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a33b85e-b302-45c7-a06d-7ee2f734b31d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a77d072b7bf2426794f08a3e9b45f391"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:23.789764 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 59/85] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:23.803364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23cc215c-13b5-4030-a53f-a81458f37891 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.803974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23cc215c-13b5-4030-a53f-a81458f37891 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:23.944138 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5a33b85e-b302-45c7-a06d-7ee2f734b31d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] HTTP exception thrown: Flavor access not found for 26 / a77d072b7bf2426794f08a3e9b45f391 combination. Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a33b85e-b302-45c7-a06d-7ee2f734b31d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Request method failure captured: Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/flavors/1114570940/action HTTP/1.1 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 70 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfxpEhXW-6OgTIe_16-i8r80ZO6h3Aw_VDZwlZkh08WdGr5ttrIqH8c_ofVFFXPU2C2XGy3Mz_ZgVHKDHysK-oJ0i8D6U7JiPdTRrRCVlBlEKNZW07Abjc395WyOJ34qrxvOV6g5NSQ74oBew-W3mzBbMXzoF23p2_9tbQ4ejV23F4 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 03914c23c68543b59cf5ce65c5154629 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:44:23.947127 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/03914c23c68543b59cf5ce65c5154629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_03914c23c68543b59cf5ce65c5154629", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 03914c23c68543b59cf5ce65c5154629 Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-349054851 Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 00e707af09004ad8816d7ce3cc2cd460 Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: {"removeTenantAccess": {"tenant": "a77d072b7bf2426794f08a3e9b45f391"}} Sep 07 09:44:23.948222 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: exception: Flavor access not found for 26 / a77d072b7bf2426794f08a3e9b45f391 combination. Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1114570940', 'body': {'removeTenantAccess': {'tenant': 'a77d072b7bf2426794f08a3e9b45f391'}}} Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 07 09:44:23.948819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 26 / a77d072b7bf2426794f08a3e9b45f391 combination. Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 26 / a77d072b7bf2426794f08a3e9b45f391 combination. Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.949763 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:23.950767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:23.950767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:23.950767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:23.950767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:23.950767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 26 / a77d072b7bf2426794f08a3e9b45f391 combination. Sep 07 09:44:23.950767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:23.953575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a33b85e-b302-45c7-a06d-7ee2f734b31d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Returning 404 to user: Flavor access not found for 26 / a77d072b7bf2426794f08a3e9b45f391 combination. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:23.954910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a33b85e-b302-45c7-a06d-7ee2f734b31d tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1114570940/action" status: 404 len: 124 microversion: 2.1 time: 0.169257 Sep 07 09:44:23.956353 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 27/86] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 7 09:44:23 2022] POST /compute/v2.1/flavors/1114570940/action => generated 124 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:23.961517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33cd4fd2-f92d-4fba-9af8-334258938a0a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:23.984255 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33cd4fd2-f92d-4fba-9af8-334258938a0a tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2113345008" status: 202 len: 0 microversion: 2.1 time: 0.026434 Sep 07 09:44:23.987793 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 28/87] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:23 2022] DELETE /compute/v2.1/flavors/2113345008 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:24.008917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d7b2ac54-16ec-488a-9641-d95953439260 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.068717 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d7b2ac54-16ec-488a-9641-d95953439260 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1114570940" status: 202 len: 0 microversion: 2.1 time: 0.075811 Sep 07 09:44:24.069658 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 29/88] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:23 2022] DELETE /compute/v2.1/flavors/1114570940 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:24.081647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0adc815e-cf58-4443-a1d2-8d8fcdb52612 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.087902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23cc215c-13b5-4030-a53f-a81458f37891 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:24.097717 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23cc215c-13b5-4030-a53f-a81458f37891 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1243 microversion: 2.1 time: 0.305863 Sep 07 09:44:24.099666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 60/89] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:23 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1243 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.112834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-134f4c20-cc52-4dfd-a465-ff2adb8b32c3 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.159248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-134f4c20-cc52-4dfd-a465-ff2adb8b32c3 tempest-FlavorsAccessNegativeTestJSON-349054851 tempest-FlavorsAccessNegativeTestJSON-349054851-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058049 Sep 07 09:44:24.165302 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 61/90] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.166215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0adc815e-cf58-4443-a1d2-8d8fcdb52612 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075585 Sep 07 09:44:24.173952 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 30/91] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.200976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a309b873-0abd-4e1a-906c-aeb2dfcfcb23 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-34032918", "id": 189831525, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:24.265381 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a309b873-0abd-4e1a-906c-aeb2dfcfcb23 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.069305 Sep 07 09:44:24.271028 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 62/92] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:24 2022] POST /compute/v2.1/flavors => generated 410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:24.285530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a71a84f-9a3e-4a4b-8f70-6e8adc0ece5f tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-123375587", "id": 2050093153, "os-flavor-access:is_public": "True"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:24.368355 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a71a84f-9a3e-4a4b-8f70-6e8adc0ece5f tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.087743 Sep 07 09:44:24.371940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 31/93] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:24 2022] POST /compute/v2.1/flavors => generated 413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:24.385580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3018471-a0cb-4f66-a188-f777a9549cd8 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.463395 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3018471-a0cb-4f66-a188-f777a9549cd8 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.082499 Sep 07 09:44:24.463996 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 63/94] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:24.480844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cdccd98-7703-4b6b-ba13-c9dae8846eea tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.523513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cdccd98-7703-4b6b-ba13-c9dae8846eea tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.049028 Sep 07 09:44:24.541347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9e19cd2-9c6c-4a5d-a1da-ec45e3701389 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.544056 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 32/95] 10.222.0.60 () {58 vars in 1177 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:24.562687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9e19cd2-9c6c-4a5d-a1da-ec45e3701389 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.028816 Sep 07 09:44:24.565667 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 64/96] 10.222.0.60 () {58 vars in 1171 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:24.581965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c3adb23-b8df-4610-9673-28a642be5816 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.600636 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c3adb23-b8df-4610-9673-28a642be5816 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.025543 Sep 07 09:44:24.606515 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 33/97] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:24.620626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5b944e1-b900-452b-a947-5edb11310bf0 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.693515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5b944e1-b900-452b-a947-5edb11310bf0 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.077519 Sep 07 09:44:24.699502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 65/98] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.722790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7626ce13-aaaa-40a6-9cae-f87753536389 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.780899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7626ce13-aaaa-40a6-9cae-f87753536389 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.064963 Sep 07 09:44:24.791812 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 34/99] 10.222.0.60 () {58 vars in 1175 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.800912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.801884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:24.804316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-292ffcef-ee6c-476e-bbc5-401dafb50c90 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.812058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:24.812749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:24.813591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:24.814505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:24.815205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:24.815923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:24.874780 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-292ffcef-ee6c-476e-bbc5-401dafb50c90 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.073536 Sep 07 09:44:24.885543 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 35/100] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.895022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6419d634-f68e-45b6-8651-cc938a1b4e99 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:24.955250 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6419d634-f68e-45b6-8651-cc938a1b4e99 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.065151 Sep 07 09:44:24.955863 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 36/101] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:24.981855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50739f70-752b-40cf-b73d-1d1f20694e84 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.022131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:25.034311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-50739f70-752b-40cf-b73d-1d1f20694e84 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2050093153" status: 202 len: 0 microversion: 2.1 time: 0.058882 Sep 07 09:44:25.041161 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 37/102] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:44:24 2022] DELETE /compute/v2.1/flavors/2050093153 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:44:25.052858 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85590c1f-7449-42b3-bcef-832aaf17f702 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1277 microversion: 2.1 time: 0.250191 Sep 07 09:44:25.055970 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 66/103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:24 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.058556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cbd51d53-f970-47f0-8838-d29fc205d737 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.086119 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cbd51d53-f970-47f0-8838-d29fc205d737 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041157 Sep 07 09:44:25.097829 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 38/104] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.112920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c551288-cca3-4c5d-aaa1-95f186f3dd3b tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.126560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.127147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:25.161222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c551288-cca3-4c5d-aaa1-95f186f3dd3b tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/189831525" status: 202 len: 0 microversion: 2.1 time: 0.054464 Sep 07 09:44:25.165734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 67/105] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:25 2022] DELETE /compute/v2.1/flavors/189831525 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:25.171045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b9ac59c-90c4-4613-8517-be9369124580 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.171373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:25.176170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:25.176633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:25.182693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:25.183285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:25.183710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:25.234688 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b9ac59c-90c4-4613-8517-be9369124580 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067644 Sep 07 09:44:25.262042 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 68/106] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.281057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6b20e38-3cd1-4ccd-9430-a8ecd9a5479e tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2079452614", "id": 166089306, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:25.337261 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6b20e38-3cd1-4ccd-9430-a8ecd9a5479e tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.073623 Sep 07 09:44:25.346101 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 69/107] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:25 2022] POST /compute/v2.1/flavors => generated 412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:25.358723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-101a881c-cd11-4bb4-ac9f-0257d593dbd6 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.426721 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-101a881c-cd11-4bb4-ac9f-0257d593dbd6 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079144 Sep 07 09:44:25.449205 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 70/108] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.456276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b06567c6-9e8d-43dd-8b58-f29efe183583 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.586933 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b06567c6-9e8d-43dd-8b58-f29efe183583 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.135159 Sep 07 09:44:25.587542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 71/109] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.615880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9058baf5-fc6b-4708-ad46-876b7f1e427c tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.680579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9058baf5-fc6b-4708-ad46-876b7f1e427c tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/166089306" status: 202 len: 0 microversion: 2.1 time: 0.069101 Sep 07 09:44:25.681777 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 72/110] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:25 2022] DELETE /compute/v2.1/flavors/166089306 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:25.690799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9e128dd0-5f66-4aa2-a3fa-b459b3b19439 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.743943 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9e128dd0-5f66-4aa2-a3fa-b459b3b19439 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057350 Sep 07 09:44:25.745888 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 73/111] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.780926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74ca97b5-705d-488c-986d-d3691f183667 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1243183062", "id": 522445535, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:25.815077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74ca97b5-705d-488c-986d-d3691f183667 tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.037215 Sep 07 09:44:25.815077 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 74/112] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:25 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:25.836119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-834bd6dd-6837-4a34-af5a-bd1ad6f87243 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:25.890254 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-834bd6dd-6837-4a34-af5a-bd1ad6f87243 tempest-FlavorsAdminTestJSON-1301290463 tempest-FlavorsAdminTestJSON-1301290463-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.065183 Sep 07 09:44:25.891519 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 75/113] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:25.930824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b46f6e9c-7f90-4531-b185-13c1a06733af tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:26.004009 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b46f6e9c-7f90-4531-b185-13c1a06733af tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/522445535" status: 202 len: 0 microversion: 2.1 time: 0.085840 Sep 07 09:44:26.004883 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 76/114] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:44:25 2022] DELETE /compute/v2.1/flavors/522445535 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:44:26.036333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c73b55bd-8115-4694-93f1-4c06263eb4cb tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:26.114432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c73b55bd-8115-4694-93f1-4c06263eb4cb tempest-FlavorsAdminTestJSON-2067759327 tempest-FlavorsAdminTestJSON-2067759327-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101313 Sep 07 09:44:26.147349 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 77/115] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:44:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:26.160422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:26.163386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:26.177441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:26.182801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:26.183455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:26.183755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:26.185844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:26.186523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:26.187267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:26.220485 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eebe4689-bfd1-45d0-b7df-c053efb1f93e tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1291 microversion: 2.1 time: 1.099873 Sep 07 09:44:26.224547 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 39/116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:25 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1291 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:26.367252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:26.379201 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1a61a1b-25e7-4c70-8a43-0eb49fc0c6ff tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1277 microversion: 2.1 time: 0.227185 Sep 07 09:44:26.382171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 78/117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:26 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:27.253609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:27.255442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:27.283143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:27.288006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:27.291380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:27.293696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:27.300835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:27.303057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:27.426142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:27.426919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:27.445171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:27.448578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:27.449043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:27.450079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:27.450551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:27.452285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:27.619329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:27.638306 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a28d3662-8ee8-45c5-952f-e0c28a23b47a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1297 microversion: 2.1 time: 0.391940 Sep 07 09:44:27.638926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 40/118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:27 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1297 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:28.043007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:28.052210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4cb2c21f-6909-474a-ad1d-ce03648bf61d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.640425 Sep 07 09:44:28.058213 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 79/119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:27 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:28.668858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:28.669596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:28.676140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:28.685220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:28.685998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:28.688540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:28.689151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:28.690207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:28.831932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:28.845066 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ed4b3d9-ba17-4b01-a832-665c9f88f37a tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1297 microversion: 2.1 time: 0.179324 Sep 07 09:44:28.852442 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 41/120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:28 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1297 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:29.083194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:29.083712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:29.094199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:29.114180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:29.114692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:29.115451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:29.115920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:29.116340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:29.645956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:29.660755 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3631c152-8f06-4996-b534-ee3191ed50b5 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.582270 Sep 07 09:44:29.684727 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 80/121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:29 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:29.880598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:29.881549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:29.891091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:29.894692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:29.895208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:29.895949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:29.896426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:29.896852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:30.569211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:30.577609 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49b2d86a-e73c-43be-91a2-cfd05cba4864 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.701355 Sep 07 09:44:30.578187 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 42/122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:29 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:30.689134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:30.690019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:30.702301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2acf4d2b-f9e5-45ed-b3dd-4356fece5e63 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:30.706432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:30.713096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:30.723939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:30.724635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:30.725542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:30.728414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:30.729038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:30.779039 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2acf4d2b-f9e5-45ed-b3dd-4356fece5e63 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.673963 Sep 07 09:44:30.780950 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 81/123] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:44:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:31.165288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0b7fd4c-256b-42a1-b3f0-e33c3937da3b tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1360332372", "id": 1893678355, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:31.222280 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0b7fd4c-256b-42a1-b3f0-e33c3937da3b tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.425136 Sep 07 09:44:31.246602 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 82/124] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:30 2022] POST /compute/v2.1/flavors => generated 425 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:31.259415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84e625d4-46a6-4c25-9133-4d8931151017 tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:31.277817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:31.281149 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84e625d4-46a6-4c25-9133-4d8931151017 tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028594 Sep 07 09:44:31.282895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 83/125] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 7 09:44:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:31.299015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a9b63ef-07d1-459c-9b43-5eabc111fc6d tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-100621850", "id": 1450913426, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:31.334329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a9b63ef-07d1-459c-9b43-5eabc111fc6d tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.041940 Sep 07 09:44:31.335149 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 84/126] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:31 2022] POST /compute/v2.1/flavors => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:31.361732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4c3617f-9e59-455d-9521-03dd3675e93c tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:31.374116 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4c3617f-9e59-455d-9521-03dd3675e93c tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027641 Sep 07 09:44:31.375217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 85/127] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 7 09:44:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:44:31.389922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5dd3baa8-d7c2-4a8b-97a5-e24b4eee0230 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Action: 'create', calling method: .version_select at 0x7f14b27bd8b0>, body: {"keypair": {"name": "tempest-keypair-1509564207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTziHvvuUCBiktW3Ji3zo2Bfntu6WTeDU/rQ44K03MsheSYnqLsGgyLD9So8sjXt8MQjtNUz0vxzKCcLQKfzgdLl69k34ICBK9u5F7OrwWBDcZYczVRo7XXx3w7ValVZA=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:31.441643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:31.456708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5dd3baa8-d7c2-4a8b-97a5-e24b4eee0230 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Getting quotas for project c90fba56c62e4660ae559b2649e2c801. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:44:31.460745 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58bdb767-3882-499d-bd18-39c1f90644cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.771413 Sep 07 09:44:31.473555 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 43/128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:30 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:31.478330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5dd3baa8-d7c2-4a8b-97a5-e24b4eee0230 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Getting quotas for user ce0e6192cec344439361da0019175b24 and project c90fba56c62e4660ae559b2649e2c801. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:44:31.566952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5dd3baa8-d7c2-4a8b-97a5-e24b4eee0230 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180815 Sep 07 09:44:31.572569 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 86/129] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:44:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:31.609095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:31.613901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:31.629335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:31.630363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:31.631210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:31.632724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:31.633822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:31.634507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:31.943335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:31.960519 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3475a4e3-65c5-473d-b1a1-25b540b09660 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.356999 Sep 07 09:44:31.973209 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 44/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:31 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:32.490452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:32.491726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:32.505416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:32.506838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:32.507521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:32.510228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:32.510758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:32.511186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:32.990561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:32.991186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:33.010098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:33.018619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:33.026235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:33.040002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:33.040002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:33.040002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:33.040002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:33.040655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:33.923241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:33.935520 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-073bbe9e-7fbd-4577-a109-a35b1b7fa943 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.949004 Sep 07 09:44:33.939973 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 45/131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:32 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:34.265212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:34.294499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d149cfb6-9e20-473c-8c44-47ffb0d8d2cc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 1.808412 Sep 07 09:44:34.310414 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 87/132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:32 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:34.310547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3033c013-aee0-4d0c-9235-930e2a3e37b5", "tag": "014170bb-db5f-4a4a-928c-161a75d30e36"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:34.354388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:34.354912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:34.358939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:34.461532 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Creating event network-changed:014170bb-db5f-4a4a-928c-161a75d30e36 for instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 on n-h2-836830-16 Sep 07 09:44:34.484150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:44:34.484817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66c68dc6-795e-47eb-bbf3-0bda5357502f req-b24c8774-5e35-44a1-b691-f41eb1e9a05e service nova] Acquired lock "compute-rpcapi-router" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:44:34.488398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:34.494218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:34.500187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:34.502194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:34.504333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:34.509809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:34.531438 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.rpcapi [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 09:44:34.546247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] Releasing lock "compute-rpcapi-router" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:44:34.579885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f248c696-c302-4c8f-976c-4f4f572f851a None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.630829 Sep 07 09:44:34.581231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 46/133] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:34.880388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8627af93-01f7-4811-b60b-e4ef4b20bfaf", "tag": "a2e48394-f469-49f6-bccf-11b50889356e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:34.904403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:34.907788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:34.909805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:34.971414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:34.971998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:34.977024 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Creating event network-changed:a2e48394-f469-49f6-bccf-11b50889356e for instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf on n-h1-836830-16 Sep 07 09:44:34.981913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:44:34.982438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-35a09c72-4c80-4ecd-92a2-e3256a24db94 req-1a304c6f-a55e-413a-ba11-e5dac5efa002 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:44:34.985555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:34.991607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:34.992539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:34.997881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:34.998374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:34.998813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:34.999535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:35.001785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:35.002255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:35.002697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:35.004560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:35.006684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:35.049154 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.rpcapi [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 09:44:35.052196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] Releasing lock "compute-rpcapi-router" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:44:35.107901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b1d3b85-285e-4e6c-8705-3fe4b2506739 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.803480 Sep 07 09:44:35.109109 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 88/134] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:35.323503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:35.324219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:35.342760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:35.343496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:35.347060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:35.349475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:35.351993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:35.352572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:35.593786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:35.631690 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e3860a57-2b40-4a6e-a648-db7ddc24cf3b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.662926 Sep 07 09:44:35.649797 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 47/135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:34 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:35.997417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:36.006813 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-47264459-abfd-496e-936c-5c870122ddf9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.687801 Sep 07 09:44:36.012675 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 89/136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:35 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:36.663755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:36.665026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:36.675490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:36.678486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:36.681268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:36.683978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:36.685851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:36.687122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.106511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:37.121751 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96fb3f05-f2e2-4a10-a814-e35aad75579b tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.462490 Sep 07 09:44:37.139726 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 90/137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:36 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:37.246506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f625e4e-58f4-4d3a-bcfe-ff98ad9f4a0a tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1967956886", "id": 2051435906, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:37.274406 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f625e4e-58f4-4d3a-bcfe-ff98ad9f4a0a tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.132994 Sep 07 09:44:37.276180 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 91/138] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:44:37 2022] POST /compute/v2.1/flavors => generated 449 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:44:37.284486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:37.286837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:37.294258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Calling method '.version_select at 0x7f14b297e040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:37.302415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.304860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.306895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.319596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.321732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.322962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.327530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.329959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.332614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.346032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.352515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.353297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.430432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.431145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.431779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.455173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.463609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.464328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.499880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.500417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.501872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.510562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa72e8d5-74df-4b42-9579-8934431f12b0 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.902087 Sep 07 09:44:37.511607 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 48/139] 10.222.0.60 () {60 vars in 1243 bytes} [Wed Sep 7 09:44:36 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:44:37.682576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc99569c-d017-4500-80e4-1984f9d22a87 tempest-FlavorsV255TestJSON-641569038 tempest-FlavorsV255TestJSON-641569038-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:37.713103 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc99569c-d017-4500-80e4-1984f9d22a87 tempest-FlavorsV255TestJSON-641569038 tempest-FlavorsV255TestJSON-641569038-project] 10.222.0.60 "GET /compute/v2.1/flavors/2051435906" status: 200 len: 449 microversion: 2.55 time: 0.198603 Sep 07 09:44:37.715804 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 49/140] 10.222.0.60 () {60 vars in 1199 bytes} [Wed Sep 7 09:44:37 2022] GET /compute/v2.1/flavors/2051435906 => generated 449 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:44:37.736578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Calling method '.version_select at 0x7f14b2909dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:37.749440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.749953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.750451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.761718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:37.776101 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9dc8f4b4-db9b-493c-b2fe-8d70c8fb615a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.498374 Sep 07 09:44:37.777045 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 92/141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:37 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:37.786531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe3f198f-7eff-4551-bc32-f014981e9021 tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] Action: 'update', calling method: .version_select at 0x7f14b3a90550>, body: {"flavor": {"description": "new"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:37.801063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=15,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:37.804812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.806416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.810029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.860317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.861682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.862314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.870945 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe3f198f-7eff-4551-bc32-f014981e9021 tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/2051435906" status: 200 len: 450 microversion: 2.55 time: 0.092497 Sep 07 09:44:37.873968 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 93/142] 10.222.0.60 () {62 vars in 1219 bytes} [Wed Sep 7 09:44:37 2022] PUT /compute/v2.1/flavors/2051435906 => generated 450 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:44:37.891152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b39e81d-675e-4f02-b899-a1f0628c8b32 tempest-FlavorsV255TestJSON-641569038 tempest-FlavorsV255TestJSON-641569038-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:37.895963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.896480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.897210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.929664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b39e81d-675e-4f02-b899-a1f0628c8b32 tempest-FlavorsV255TestJSON-641569038 tempest-FlavorsV255TestJSON-641569038-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6596 microversion: 2.55 time: 0.044272 Sep 07 09:44:37.930574 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 94/143] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 09:44:37 2022] GET /compute/v2.1/flavors/detail => generated 6596 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:44:37.942878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-474913789", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "1450913426", "adminPass": "***", "networks": [{"uuid": "75603bbf-d70d-46c6-b38e-3838df43a5ba"}], "security_groups": [{"name": "tempest-securitygroup--307234388"}], "key_name": "tempest-keypair-1509564207", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:37.946362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:37.947737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:37.948419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:37.966516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76895580-21e4-448d-bc53-07ad407e4394 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.248662 Sep 07 09:44:37.967823 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 50/144] 10.222.0.60 () {60 vars in 1222 bytes} [Wed Sep 7 09:44:37 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:44:37.973497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c9c45a9-9b18-4f9e-b69c-72f624957744 tempest-FlavorsV255TestJSON-641569038 tempest-FlavorsV255TestJSON-641569038-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:37.995466 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c9c45a9-9b18-4f9e-b69c-72f624957744 tempest-FlavorsV255TestJSON-641569038 tempest-FlavorsV255TestJSON-641569038-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.55 time: 0.026328 Sep 07 09:44:37.996842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 51/145] 10.222.0.60 () {60 vars in 1166 bytes} [Wed Sep 7 09:44:37 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:44:38.005562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Calling method '.version_select at 0x7f14b297ec10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:38.009557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:38.010339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:38.011095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:38.029439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:38.038400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:38.038884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:38.039309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:38.051567 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70129cb0-c343-4de3-b981-2cda626310b3 tempest-HypervisorAdminV253TestBase-1114481493 tempest-HypervisorAdminV253TestBase-1114481493-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/6291a70b-03b9-4fb9-81dd-4b8167058686" status: 200 len: 794 microversion: 2.53 time: 0.053286 Sep 07 09:44:38.052486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 52/146] 10.222.0.60 () {60 vars in 1298 bytes} [Wed Sep 7 09:44:37 2022] GET /compute/v2.1/os-hypervisors/6291a70b-03b9-4fb9-81dd-4b8167058686 => generated 794 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:44:38.057488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8fb0a1b5-32ec-4f8a-9219-da453066e46d tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:38.089016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8fb0a1b5-32ec-4f8a-9219-da453066e46d tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2051435906" status: 202 len: 0 microversion: 2.55 time: 0.034268 Sep 07 09:44:38.090209 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 53/147] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 7 09:44:38 2022] DELETE /compute/v2.1/flavors/2051435906 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:44:38.099226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76af23b8-cfa7-42c1-a673-a6405e14f60b tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:38.126228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76af23b8-cfa7-42c1-a673-a6405e14f60b tempest-FlavorsV255TestJSON-1656869779 tempest-FlavorsV255TestJSON-1656869779-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.030427 Sep 07 09:44:38.127458 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 54/148] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 09:44:38 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:44:38.161441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:38.162006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:38.169395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:38.169945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:38.170454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:38.171170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:38.171616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:38.172034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:38.473270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:38.483265 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52afc624-ae26-4e90-9e2b-114869c3af40 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.334416 Sep 07 09:44:38.489291 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 55/149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:38 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:38.596622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] validate_networks() for [('75603bbf-d70d-46c6-b38e-3838df43a5ba', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:44:38.804421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:38.805037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:38.835358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:38.835862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:38.845012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:38.845901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:38.846391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:38.846843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:39.274302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:39.287590 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9055df08-92f3-4dd1-aefb-f0330d2d7fe9 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.487562 Sep 07 09:44:39.288552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 56/150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:38 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:39.509789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:39.510656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:39.524224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:39.524917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:39.525516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:39.526856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:39.530416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:39.532718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:39.736503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:44:39.737203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:44:39.737445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:44:39.737862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:44:39.738274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:44:39.757692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:39.758204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:39.758663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:39.759397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:39.760038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:39.762295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:39.815024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Getting quotas for project c90fba56c62e4660ae559b2649e2c801. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:44:39.822698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:39.834253 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c64f15d9-10a7-4718-867b-e8b09bda66c0 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.329418 Sep 07 09:44:39.835083 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 57/151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:39 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:39.837630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Getting quotas for user ce0e6192cec344439361da0019175b24 and project c90fba56c62e4660ae559b2649e2c801. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:44:39.868381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:44:39.872106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:44:39.971035 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-840a2dc5-2f73-4c20-a9ff-aac6b8fd720c tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.035553 Sep 07 09:44:39.971677 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 95/152] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:44:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:44:39.983740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-856b0440-d121-4367-8d9b-e7dd721294df tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:39.984536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-856b0440-d121-4367-8d9b-e7dd721294df tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:40.067089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-856b0440-d121-4367-8d9b-e7dd721294df tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:40.120413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-856b0440-d121-4367-8d9b-e7dd721294df tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1264 microversion: 2.1 time: 0.140816 Sep 07 09:44:40.124380 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 58/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:39 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:40.312608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:40.314107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:40.323399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:40.324075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:40.327792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:40.329570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:40.330455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:40.331281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:40.561076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:40.575683 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-542bc4bd-6724-4b61-a131-7da0d5b5701f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.267215 Sep 07 09:44:40.576275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 96/154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:40 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:40.870309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:40.871008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:40.877727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:40.878215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:40.878649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:40.879510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:40.880119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:40.880547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:41.102928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:41.113680 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a5494a2-8bb9-4288-ae16-02be40cfae34 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.247342 Sep 07 09:44:41.115002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 59/155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:40 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:41.145984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:41.146608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:41.152900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:41.153424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:41.154157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:41.154854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:41.155477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:41.156008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:41.179662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:41.251508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:41.261671 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2df39c4-d303-486e-9a52-38ca6822175f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1268 microversion: 2.1 time: 0.121116 Sep 07 09:44:41.262253 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 97/156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:41 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1268 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:41.604831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:41.605759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:41.616571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:41.617654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:41.618409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:41.619717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:41.620462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:41.621422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:41.782677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:41.796567 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e4555008-3aa7-4339-baef-a5926ffef8e4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.197727 Sep 07 09:44:41.806661 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 60/157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:41 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:42.145107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:42.146151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:42.155851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:42.157331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:42.158011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:42.158807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:42.159274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:42.159858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:42.294305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:42.294996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:42.307316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:42.308050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:42.309576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:42.310305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:42.310771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:42.311186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:42.438977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:42.459936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eac0069a-54e5-43ff-886a-ea34ede847dc tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1268 microversion: 2.1 time: 0.179330 Sep 07 09:44:42.461537 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 61/158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:42 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:42.466762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:42.489264 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e35fe4d4-a134-48a3-880b-db513374b49f tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.352040 Sep 07 09:44:42.491684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 98/159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:42 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:42.823989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:42.825313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:42.843311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:42.844443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:42.851126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:42.852037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:42.854359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:42.855125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:43.235903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:43.250967 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-688fc6d6-43bf-4afc-b2b8-8849c1d06afb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.430698 Sep 07 09:44:43.259776 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 62/160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:42 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:43.484431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:43.486958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:43.495274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:43.496087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:43.498308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:43.499613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:43.500304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:43.501434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:43.515206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:43.517602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:43.528771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:43.530773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:43.535046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:43.536037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:43.536662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:43.537740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:43.835095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:43.850055 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-51bcc4eb-6c0a-4a12-949f-9f340dc923e1 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1268 microversion: 2.1 time: 0.369424 Sep 07 09:44:43.867827 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 99/161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:43 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1268 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:44.068953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:44.082691 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb92eea9-05f4-428c-b2fa-e3d9d01921f8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.571678 Sep 07 09:44:44.083491 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 63/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:43 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:44.286488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:44.288659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:44.302501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:44.306960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:44.307610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:44.308489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:44.311968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:44.312581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:44.679240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:44.688531 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e321a6d4-a3b9-43cb-b86c-1ce12b2e3ed8 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.409384 Sep 07 09:44:44.694845 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 100/163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:44 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:44.883002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:44.885049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:44.891705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:44.895949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:44.897292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:44.897904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:44.898819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:44.899900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:44.900648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:44.998957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:45.010721 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7483fcf-361d-41eb-a402-5cd4e1fbcea7 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1268 microversion: 2.1 time: 0.136167 Sep 07 09:44:45.012552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 64/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:44 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1268 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:45.113325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:45.114207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:45.121303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:45.122033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:45.122715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:45.123586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:45.124195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:45.124762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:45.714272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:45.715764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:45.725011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:45.725770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:45.726392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:45.727180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:45.727645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:45.728771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:45.958634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:45.967008 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72d705fe-8351-4686-bace-67d3268611a7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.858464 Sep 07 09:44:45.967796 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 101/165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:45 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:46.042262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e0047c11-7571-4859-b73c-835705b83a89 req-a82df38a-2f33-4700-b55f-67938eb9ac9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8627af93-01f7-4811-b60b-e4ef4b20bfaf", "name": "network-vif-plugged", "status": "completed", "tag": "a2e48394-f469-49f6-bccf-11b50889356e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:46.053401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e0047c11-7571-4859-b73c-835705b83a89 req-a82df38a-2f33-4700-b55f-67938eb9ac9b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:46.053890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e0047c11-7571-4859-b73c-835705b83a89 req-a82df38a-2f33-4700-b55f-67938eb9ac9b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:46.054321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e0047c11-7571-4859-b73c-835705b83a89 req-a82df38a-2f33-4700-b55f-67938eb9ac9b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:46.076771 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e0047c11-7571-4859-b73c-835705b83a89 req-a82df38a-2f33-4700-b55f-67938eb9ac9b service nova] Creating event network-vif-plugged:a2e48394-f469-49f6-bccf-11b50889356e for instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf on n-h1-836830-16 Sep 07 09:44:46.090258 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e0047c11-7571-4859-b73c-835705b83a89 req-a82df38a-2f33-4700-b55f-67938eb9ac9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120998 Sep 07 09:44:46.091711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 102/166] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:46.100077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:46.101320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:46.118849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:46.119681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:46.120528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:46.121503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:46.122168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:46.126501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:46.268675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:46.283123 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-02b742ad-2708-4f6a-8142-3f1a84dbae33 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1316 microversion: 2.1 time: 0.189714 Sep 07 09:44:46.284310 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 103/167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:46 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:46.315193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:46.329116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03c5fe84-6567-465e-8f05-57f605fa3653 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.618953 Sep 07 09:44:46.341775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 65/168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:45 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:46.991573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:46.992946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:47.007207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:47.009416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:47.012117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:47.014290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:47.018284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:47.019001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:47.308359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:47.309415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:47.320095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:47.324733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:47.329007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:47.329932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:47.331178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:47.332547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:47.494842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:47.511284 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68f72907-58d1-44a5-94d4-6c367572dc45 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1324 microversion: 2.1 time: 0.206560 Sep 07 09:44:47.516281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 66/169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:47 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:47.527449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:47.536564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:47.558516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:47.563494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:47.564524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:47.565472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:47.568093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:47.575849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:47.592040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:47.618020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad7f4a05-7eeb-4745-b2c4-655374e0e4d4 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.626506 Sep 07 09:44:47.635946 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 104/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:46 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:48.484358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:48.498303 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d4200749-a59c-451e-91da-f91f500031ab tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.980367 Sep 07 09:44:48.498907 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 67/171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:47 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:48.537477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:48.538333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:48.545110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:48.546873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:48.548237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:48.552048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:48.558987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:48.559584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:48.647804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:48.648616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:48.658823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:48.666109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:48.666572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:48.667299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:48.669131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:48.670857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:48.988919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:49.002464 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a6c185c-c743-4ef0-bfab-221f0f239155 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1322 microversion: 2.1 time: 0.469333 Sep 07 09:44:49.006819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 105/172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:48 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:49.277009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:49.296515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-887f3f5d-1d4d-4db5-8a5a-ab1109ad4842 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1339 microversion: 2.1 time: 0.656055 Sep 07 09:44:49.299434 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 68/173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:48 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1339 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:49.522800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:49.523835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:49.531279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:49.550247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:49.553705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:49.557743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:49.558496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:49.561836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:49.790905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:49.857308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:50.029223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:50.029996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:50.049104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:50.053611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:50.059118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:50.060046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:50.060549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:50.060999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:50.120054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:50.396264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:50.429680 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-18787ac0-d11e-438e-9982-f146c58526cb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.910688 Sep 07 09:44:50.430958 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 106/174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:49 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:50.451998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:50.452794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:50.471484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:50.471969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:50.477966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:50.479110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:50.479745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:50.480171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:50.522645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:50.544809 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6207ab1-d5d0-444a-8613-b049088db8a4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.519655 Sep 07 09:44:50.555589 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 69/175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:50 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:50.980138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:50.991798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9eac4eb-14ef-430d-934a-d7da9932f259 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1489 microversion: 2.1 time: 0.559481 Sep 07 09:44:50.992397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 107/176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:50 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1489 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:51.020823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:51.021475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:51.036822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:51.037522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:51.037817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:51.044947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:51.045489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:51.045948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:51.460902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:51.461561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:51.479437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:51.480099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:51.481659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:51.485792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:51.486295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:51.486739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:51.907649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:51.919862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8a6786f-c528-4774-8c55-8ab0f1543e4e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.466271 Sep 07 09:44:51.921700 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 108/177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:51 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:51.935975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:51.937130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:51.959277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:51.961384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:51.963693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:51.966367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:51.968539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:51.970140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:52.456425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ebbf781b-efc3-41d0-be56-cfebcf513230 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1642 microversion: 2.1 time: 1.439226 Sep 07 09:44:52.474232 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 70/178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:51 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1642 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:52.503269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:52.509552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:52.515005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:52.533265 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c725d75-fc5e-4712-96ce-6801e4f523dd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.606239 Sep 07 09:44:52.534289 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 109/179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:51 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:52.540381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:52.541220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:52.541875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:52.542812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:52.543981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:52.544632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:52.577120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:44:52.680992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:52.942713 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4ba1b93-4e27-43ae-be16-f647a54badae tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 204 len: 0 microversion: 2.1 time: 0.453191 Sep 07 09:44:52.947444 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 71/180] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:44:52 2022] DELETE /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:44:52.948271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:52.949052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:52.963944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:52.965111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:52.975839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:52.986184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:52.986983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:52.989269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:52.991277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:52.993577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:52.994089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:52.994533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:52.997096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:52.999913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:53.000478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:53.000930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:53.926503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:53.938764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-112f4f2e-501c-4c95-b29d-9ca9158802a0 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.995577 Sep 07 09:44:53.942409 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 110/181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:52 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:53.988976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-36177636-ce57-4543-9088-14f4b6582f06 req-1c434e5b-890c-43a8-9c3c-a24c224518cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69eab25-a71c-4dc7-96d1-a63e4174a056", "tag": "7c8afa77-b537-4e28-b5c7-81b3d3cc3906"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:54.019414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:54.024154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-36177636-ce57-4543-9088-14f4b6582f06 req-1c434e5b-890c-43a8-9c3c-a24c224518cb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:54.024641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-36177636-ce57-4543-9088-14f4b6582f06 req-1c434e5b-890c-43a8-9c3c-a24c224518cb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:54.025069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-36177636-ce57-4543-9088-14f4b6582f06 req-1c434e5b-890c-43a8-9c3c-a24c224518cb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:54.035603 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4964f97e-013d-4b9a-b72a-1c4e6b09d45d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1495 microversion: 2.1 time: 1.083379 Sep 07 09:44:54.039039 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 72/182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:52 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1495 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:54.067112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:54.068091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:54.073448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-36177636-ce57-4543-9088-14f4b6582f06 req-1c434e5b-890c-43a8-9c3c-a24c224518cb service nova] Creating event network-changed:7c8afa77-b537-4e28-b5c7-81b3d3cc3906 for instance d69eab25-a71c-4dc7-96d1-a63e4174a056 on n-h2-836830-16 Sep 07 09:44:54.086050 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-36177636-ce57-4543-9088-14f4b6582f06 req-1c434e5b-890c-43a8-9c3c-a24c224518cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140404 Sep 07 09:44:54.087401 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 111/183] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:54.091326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:54.099353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:54.102687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:54.103600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:54.107776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:54.111464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:54.971282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:54.972182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:54.978496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:54.993237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:54.994093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:55.002078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:55.004655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:55.006860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:55.009685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:55.119367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:55.131356 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8a04810-78be-4a7c-84f0-e8b0b44693cb tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 1.090913 Sep 07 09:44:55.134824 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 73/184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:54 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:55.155780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:55.159799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:55.182934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:55.186272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:55.188763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:55.191032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:55.196122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:55.197946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:55.462821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:55.479557 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e21bba8-0482-4391-8cae-488751d7261b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.513495 Sep 07 09:44:55.482109 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 112/185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:54 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:55.774216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:55.797747 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53542a35-c2f9-4a2a-b27f-a06ddb74a2e8 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1495 microversion: 2.1 time: 0.656539 Sep 07 09:44:55.799380 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 74/186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:55 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1495 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:56.161674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:56.162300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:56.180279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:56.180792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:56.182408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:56.192201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:56.192710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:56.193147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:56.508951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:56.516992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:56.534058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:56.535505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:56.538257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:56.540010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:56.542980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:56.543812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:57.238288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:57.247609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5ba1aad-c651-4b3c-923c-b6535d6e0024 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 1.089658 Sep 07 09:44:57.263480 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 113/187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:56 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:57.267836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c093b769-f8d1-4da6-bae0-d74c0db34aec req-def5b579-47b3-4e9e-a9f9-133c4e07c336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8627af93-01f7-4811-b60b-e4ef4b20bfaf", "name": "network-vif-deleted", "tag": "a2e48394-f469-49f6-bccf-11b50889356e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:57.288216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c093b769-f8d1-4da6-bae0-d74c0db34aec req-def5b579-47b3-4e9e-a9f9-133c4e07c336 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:57.293662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c093b769-f8d1-4da6-bae0-d74c0db34aec req-def5b579-47b3-4e9e-a9f9-133c4e07c336 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:57.294544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c093b769-f8d1-4da6-bae0-d74c0db34aec req-def5b579-47b3-4e9e-a9f9-133c4e07c336 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:57.322977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:57.331741 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c093b769-f8d1-4da6-bae0-d74c0db34aec req-def5b579-47b3-4e9e-a9f9-133c4e07c336 service nova] Creating event network-vif-deleted:a2e48394-f469-49f6-bccf-11b50889356e for instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf on n-h1-836830-16 Sep 07 09:44:57.337516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68b742e9-07a0-4562-b74a-df858ee79ecc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.830249 Sep 07 09:44:57.357814 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 75/188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:56 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:44:57.369913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:57.370860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:57.387605 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c093b769-f8d1-4da6-bae0-d74c0db34aec req-def5b579-47b3-4e9e-a9f9-133c4e07c336 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129057 Sep 07 09:44:57.388178 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 114/189] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:57.391932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:57.392454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:57.392903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:57.402514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:57.403218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:57.403672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:57.471215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:57.471760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:57.472201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:57.472673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lazy-loading 'fault' on Instance uuid 8627af93-01f7-4811-b60b-e4ef4b20bfaf {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:44:57.592641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c6273cfbea45ffa55d49947a84924f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73ebce290c447758845265a00ecff90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:57.608157 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ca05dcd-41a3-41b9-a183-f2e59a005d20 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 200 len: 1329 microversion: 2.1 time: 0.247111 Sep 07 09:44:57.612703 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 76/190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:57 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 1329 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:57.882750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-667628bd-8ee9-424c-8986-912c6a6c3a96 req-75c96848-7144-445d-9081-306860c88ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3033c013-aee0-4d0c-9235-930e2a3e37b5", "name": "network-vif-plugged", "status": "completed", "tag": "014170bb-db5f-4a4a-928c-161a75d30e36"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:57.896289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-667628bd-8ee9-424c-8986-912c6a6c3a96 req-75c96848-7144-445d-9081-306860c88ffc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:57.896777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-667628bd-8ee9-424c-8986-912c6a6c3a96 req-75c96848-7144-445d-9081-306860c88ffc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:57.907011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-667628bd-8ee9-424c-8986-912c6a6c3a96 req-75c96848-7144-445d-9081-306860c88ffc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:57.922799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-667628bd-8ee9-424c-8986-912c6a6c3a96 req-75c96848-7144-445d-9081-306860c88ffc service nova] Creating event network-vif-plugged:014170bb-db5f-4a4a-928c-161a75d30e36 for instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 on n-h2-836830-16 Sep 07 09:44:57.929639 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-667628bd-8ee9-424c-8986-912c6a6c3a96 req-75c96848-7144-445d-9081-306860c88ffc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050640 Sep 07 09:44:57.930675 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 115/191] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:58.276855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:58.277517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:58.290207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.290722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.291170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:58.291901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.292388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.296942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:58.398711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:58.400027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:58.436608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.439898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.440722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:58.444421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.445494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.449530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:58.812599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:58.826559 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cc43f81-9a63-4682-8c96-3f0a83401f8d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.553891 Sep 07 09:44:58.842705 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 77/192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:58 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:58.850046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:58.850929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:58.860009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.860745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.861650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:58.863145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.864422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.865106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:58.887987 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] HTTP exception thrown: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Request method failure captured: Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf HTTP/1.1 Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuzwX8jqQUFirtaXWwRu1uUwvz-XBrWEuMoD3-wmFfU-wxH6NyMyZnrom-nvJPpWjY_d2YJJGUWrTkxMmLNg2PIMmk6FSvGRfJA0laSPtBMvTAQhVOmFc971qkQd38i_KopWMAFPBhRs_JPy00mBxtLOWJngaq6qeRZwqZ0hon7aU Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c73ebce290c447758845265a00ecff90 Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:44:58.896214 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c73ebce290c447758845265a00ecff90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73ebce290c447758845265a00ecff90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73ebce290c447758845265a00ecff90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c73ebce290c447758845265a00ecff90", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c73ebce290c447758845265a00ecff90 Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminTestJSON-1392973359-project Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 68c6273cfbea45ffa55d49947a84924f Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminTestJSON-1392973359-project Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:44:58.897821 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '8627af93-01f7-4811-b60b-e4ef4b20bfaf'} Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:44:58.898667 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:44:58.899831 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:44:58.903183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Returning 404 to user: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:44:58.904514 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf671f6d-5e6d-4f73-95ec-063e171d18e7 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 404 len: 111 microversion: 2.1 time: 0.060327 Sep 07 09:44:58.905352 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 78/193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:58 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:44:58.917888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20be2aab-caa4-4528-94ac-bd85ffcaa805 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:58.935624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20be2aab-caa4-4528-94ac-bd85ffcaa805 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:58.936749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20be2aab-caa4-4528-94ac-bd85ffcaa805 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:58.937793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20be2aab-caa4-4528-94ac-bd85ffcaa805 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:59.049793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:44:59.053362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:44:59.096428 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81c69e0f-fdf5-415d-8d9c-98af95223c92 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1319 microversion: 2.1 time: 0.709185 Sep 07 09:44:59.115666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 116/194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:58 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1319 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:44:59.196934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20be2aab-caa4-4528-94ac-bd85ffcaa805 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.283178 Sep 07 09:44:59.206551 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 79/195] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:59.211735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87e8800f-ec27-43a6-b0ba-59deb67fcb32 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:59.284265 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87e8800f-ec27-43a6-b0ba-59deb67fcb32 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.077753 Sep 07 09:44:59.293536 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 117/196] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:59 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:44:59.302397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a8b9e161-30d8-4378-873f-627408ed821a tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-741084504"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:59.309447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-a8b9e161-30d8-4378-873f-627408ed821a tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid 5f210619-9f9c-4e2f-ab26-e41d89fedcb6 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:44:59.365953 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a8b9e161-30d8-4378-873f-627408ed821a tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067875 Sep 07 09:44:59.367199 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 80/197] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:44:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:59.379621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85f5ce2a-2126-48d8-922f-3cfad07e2f83 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:59.392095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85f5ce2a-2126-48d8-922f-3cfad07e2f83 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:59.392676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85f5ce2a-2126-48d8-922f-3cfad07e2f83 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:59.393198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85f5ce2a-2126-48d8-922f-3cfad07e2f83 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:59.647325 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85f5ce2a-2126-48d8-922f-3cfad07e2f83 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.272790 Sep 07 09:44:59.648961 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 118/198] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:59 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:59.660953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fe87684-6c33-467e-b192-c4cbefa18085 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:59.677923 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7fe87684-6c33-467e-b192-c4cbefa18085 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.021570 Sep 07 09:44:59.690251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 81/199] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:44:59 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:44:59.700062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ef55b2a9-9ba4-4b04-bc39-757d0dc5f6a4 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:44:59.718529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef55b2a9-9ba4-4b04-bc39-757d0dc5f6a4 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:59.720073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef55b2a9-9ba4-4b04-bc39-757d0dc5f6a4 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:59.720625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef55b2a9-9ba4-4b04-bc39-757d0dc5f6a4 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:59.857941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:44:59.858687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:44:59.870692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:59.871183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:59.871615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:59.872320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:44:59.872777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:44:59.873230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:44:59.965457 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ef55b2a9-9ba4-4b04-bc39-757d0dc5f6a4 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.270273 Sep 07 09:44:59.967218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 119/200] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:44:59 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:44:59.983867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b11a9e39-07c2-4147-81f4-ecf686b3d1b8 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:00.046426 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b11a9e39-07c2-4147-81f4-ecf686b3d1b8 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.068277 Sep 07 09:45:00.048481 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 120/201] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:44:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:00.060643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c5f69e8-2f64-4616-91c9-bd5ba41d9e7e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1087184223"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:00.065367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-6c5f69e8-2f64-4616-91c9-bd5ba41d9e7e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid c3c97be6-bf03-411e-9360-793a104fb5a2 for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:00.104670 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c5f69e8-2f64-4616-91c9-bd5ba41d9e7e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047508 Sep 07 09:45:00.105926 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 121/202] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:00.131860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89c7f5b6-418d-44ca-acc9-2dffc4b48673 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:00.200001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89c7f5b6-418d-44ca-acc9-2dffc4b48673 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:00.200584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89c7f5b6-418d-44ca-acc9-2dffc4b48673 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:00.200931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89c7f5b6-418d-44ca-acc9-2dffc4b48673 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:00.496133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:00.496862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89c7f5b6-418d-44ca-acc9-2dffc4b48673 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.382241 Sep 07 09:45:00.498035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 122/203] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:45:00 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:00.505138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:00.506189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:00.514256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:00.515043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:00.516469 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-407ecf12-84e6-4c01-8389-8ab714e18d3b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.662510 Sep 07 09:45:00.517468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:00.518459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:00.519340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:00.519968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:00.535263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 82/204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:44:59 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:00.535263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c88ae77b-3868-4633-8a70-0e39fcdd3c44 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:00.570501 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c88ae77b-3868-4633-8a70-0e39fcdd3c44 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.046739 Sep 07 09:45:00.573775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 83/205] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:45:00 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:00.583845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2bc2afad-7995-4124-99ee-83135aa01b96 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:00.595500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:00.600281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bc2afad-7995-4124-99ee-83135aa01b96 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:00.600788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bc2afad-7995-4124-99ee-83135aa01b96 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:00.601269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bc2afad-7995-4124-99ee-83135aa01b96 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:00.826416 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2bc2afad-7995-4124-99ee-83135aa01b96 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.246071 Sep 07 09:45:00.834898 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 84/206] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 7 09:45:00 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:00.846027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-383a20d2-7db2-49ab-9407-ebc47b861d38 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:00.893312 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-383a20d2-7db2-49ab-9407-ebc47b861d38 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.053645 Sep 07 09:45:00.894241 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 85/207] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:00 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:00.936178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a85bf94c-36bd-4b6f-968f-f7a99f958095 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-214878336"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:00.944262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-a85bf94c-36bd-4b6f-968f-f7a99f958095 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid eaecb7f2-3766-47f5-8210-61045f4bc05d for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:00.961825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:00.977619 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe134b9b-c4b9-4037-9cb5-8df2b72b4b99 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1468 microversion: 2.1 time: 0.475982 Sep 07 09:45:00.981545 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a85bf94c-36bd-4b6f-968f-f7a99f958095 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059334 Sep 07 09:45:00.982446 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 86/208] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:00.991328 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 123/209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:00 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1468 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:00.996484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e67dff5-f2e1-4b8e-ab5d-e20f2ea349fc tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:01.025269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e67dff5-f2e1-4b8e-ab5d-e20f2ea349fc tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.026349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e67dff5-f2e1-4b8e-ab5d-e20f2ea349fc tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.026805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e67dff5-f2e1-4b8e-ab5d-e20f2ea349fc tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.243808 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e67dff5-f2e1-4b8e-ab5d-e20f2ea349fc tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.252800 Sep 07 09:45:01.251726 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 87/210] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:00 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:01.257219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d5308f7-688d-42a5-8f58-9d1b3a77a804 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:01.269811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:01.271196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:01.277954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.278625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.279155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.279957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.280783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.281424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.293997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d5308f7-688d-42a5-8f58-9d1b3a77a804 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.294503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d5308f7-688d-42a5-8f58-9d1b3a77a804 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.294946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d5308f7-688d-42a5-8f58-9d1b3a77a804 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.392635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:45:01.536047 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d5308f7-688d-42a5-8f58-9d1b3a77a804 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.282847 Sep 07 09:45:01.537318 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 88/211] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:01.542675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:01.548099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:01.560765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.561562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.565386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.566592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.567217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.567899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.670814 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82f47b86-e7e1-4bdf-9e9f-ae6e4f451472 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 204 len: 0 microversion: 2.1 time: 0.670971 Sep 07 09:45:01.675515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 124/212] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:45:00 2022] DELETE /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:45:01.678292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-51fa13df-d776-4043-a7e2-02627b90c148 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:01.732275 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-51fa13df-d776-4043-a7e2-02627b90c148 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.058320 Sep 07 09:45:01.733346 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 125/213] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:01 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:01.745441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:01.746369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:01.759902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.761469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.764915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.766396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:01.766977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:01.767520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:01.916602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:01.928346 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2a8a0cfa-841e-4a69-9cb7-a92ff7719ba4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.387566 Sep 07 09:45:01.930860 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 89/214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:01 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:01.941899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41cbaa31-2bdb-403d-85a5-86fb80052e67 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-231739607"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:01.949565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-41cbaa31-2bdb-403d-85a5-86fb80052e67 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid 9b2aeb34-1742-48d1-bab3-03c0caef6179 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:01.993830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41cbaa31-2bdb-403d-85a5-86fb80052e67 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059851 Sep 07 09:45:01.994792 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 90/215] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.002616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b26c0820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.011281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.014199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.014919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.022341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.023091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.024849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.095671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-14270404-4d14-4e35-ade8-646a8bdf75e2 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.099126 Sep 07 09:45:02.102355 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 91/216] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 7 09:45:01 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.116344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5e4e02d2-ba11-40f3-8afc-75398a520941 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.169159 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5e4e02d2-ba11-40f3-8afc-75398a520941 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.070465 Sep 07 09:45:02.170137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 92/217] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:02 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:02.178142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b28f9280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.188283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.189013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.190174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.193687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.194348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.196204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.270383 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-334ad112-bfc6-4daf-befc-bfe80e2eb28b tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.096511 Sep 07 09:45:02.271448 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 93/218] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.280501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c51c6af1-c1ca-4b30-b59c-ceadad8b0930 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.283156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:02.298801 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc777eda-a05e-4e0b-9c1d-2cb70b5971f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1474 microversion: 2.1 time: 0.564155 Sep 07 09:45:02.299849 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c51c6af1-c1ca-4b30-b59c-ceadad8b0930 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 07 09:45:02.301164 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 126/219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:01 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1474 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c51c6af1-c1ca-4b30-b59c-ceadad8b0930 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Request method failure captured: Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfyKfVYM6jAABVqUqkk7Pf2tIiHxXUwPv-ZrJmsrnSSeTuq-t8YGNu0pIxhW8VNEMhWMBhKVV_1tFn4zZhORFq9kK0exg3JEF3096HRpvI5A_3iz14hPpYqjRhk-6j1N4PabMfFgibQDxqqUi4NlxkInRMsGmjvYEKdKkUMvUx7bK8 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:45:02.301791 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f88c227e5914fe78dc37b03f3471375", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f55c7cb0df554f82b230715aaf67a77b Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: exception: Aggregate 11 could not be found. Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '11'} Sep 07 09:45:02.302973 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.303746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 07 09:45:02.304835 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.306001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c51c6af1-c1ca-4b30-b59c-ceadad8b0930 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:02.306001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c51c6af1-c1ca-4b30-b59c-ceadad8b0930 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.030777 Sep 07 09:45:02.308671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 94/220] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:02.324693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37f7e94d-add9-4e8d-8bfb-f66577d41ac6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.341144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b25ea0d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.345493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.345988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.346433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.353646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.354145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.354590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.384319 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-37f7e94d-add9-4e8d-8bfb-f66577d41ac6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37f7e94d-add9-4e8d-8bfb-f66577d41ac6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Request method failure captured: Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfyKfVYM6jAABVqUqkk7Pf2tIiHxXUwPv-ZrJmsrnSSeTuq-t8YGNu0pIxhW8VNEMhWMBhKVV_1tFn4zZhORFq9kK0exg3JEF3096HRpvI5A_3iz14hPpYqjRhk-6j1N4PabMfFgibQDxqqUi4NlxkInRMsGmjvYEKdKkUMvUx7bK8 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:45:02.386796 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f88c227e5914fe78dc37b03f3471375", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f55c7cb0df554f82b230715aaf67a77b Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: exception: Aggregate 11 could not be found. Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '11'} Sep 07 09:45:02.388287 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:45:02.389129 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.390948 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37f7e94d-add9-4e8d-8bfb-f66577d41ac6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:02.392312 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37f7e94d-add9-4e8d-8bfb-f66577d41ac6 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.078643 Sep 07 09:45:02.394828 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 95/221] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:02 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:02.409119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a183433c-5b34-40c3-b8cf-489b61aaa388 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1181701858"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:02.416582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-a183433c-5b34-40c3-b8cf-489b61aaa388 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Generated uuid 25e32abb-8062-4f87-a96d-8fd0238284e7 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:02.457224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a8e615b-ecf3-4497-b8fb-72914c474200 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.129990 Sep 07 09:45:02.458254 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 127/222] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.472342 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a183433c-5b34-40c3-b8cf-489b61aaa388 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.075587 Sep 07 09:45:02.479492 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 96/223] 10.222.0.60 () {62 vars in 1205 bytes} [Wed Sep 7 09:45:02 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:02.479492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b287b670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.481977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a5d3771-c8a9-481b-a57b-da0d11bfc7dd tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-944424372", "name": "tempest-test_aggregate-1983737402"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:02.489093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-6a5d3771-c8a9-481b-a57b-da0d11bfc7dd tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid 89950f83-e19e-45b4-bad3-f8e1265863d9 for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:02.489972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.490477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.490918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.507964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.508454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.508894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.521422 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a40b7d7-92f5-4221-a75b-f05ffc8e2ca3 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h1-836830-16" status: 200 len: 335 microversion: 2.1 time: 0.046536 Sep 07 09:45:02.522029 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 97/224] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-hosts/n-h1-836830-16 => generated 335 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.533762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-12d68775-456f-4988-8ecd-4a457f6a9230 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1976984627"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:02.554874 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a5d3771-c8a9-481b-a57b-da0d11bfc7dd tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.091673 Sep 07 09:45:02.556391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 128/225] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 7 09:45:02 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.561813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Calling method '.version_select at 0x7f14b24f1940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.691045 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-12d68775-456f-4988-8ecd-4a457f6a9230 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.161906 Sep 07 09:45:02.692559 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 98/226] 10.222.0.60 () {62 vars in 1213 bytes} [Wed Sep 7 09:45:02 2022] PUT /compute/v2.1/os-aggregates/12 => generated 300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:02.698643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5276c33-719a-4dc1-a2ba-1768584b4ace tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.739364 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5276c33-719a-4dc1-a2ba-1768584b4ace tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.044411 Sep 07 09:45:02.739963 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 99/227] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:02 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:02.756261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-234030f9-130c-478d-974e-c2e552f7b057 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.780226 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-234030f9-130c-478d-974e-c2e552f7b057 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.034612 Sep 07 09:45:02.782246 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 100/228] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-aggregates/12 => generated 300 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:02.787831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02f8d051-cf5f-4218-98dd-4c071b929d16 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.802140 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-02f8d051-cf5f-4218-98dd-4c071b929d16 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02f8d051-cf5f-4218-98dd-4c071b929d16 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Request method failure captured: Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfyKfVYM6jAABVqUqkk7Pf2tIiHxXUwPv-ZrJmsrnSSeTuq-t8YGNu0pIxhW8VNEMhWMBhKVV_1tFn4zZhORFq9kK0exg3JEF3096HRpvI5A_3iz14hPpYqjRhk-6j1N4PabMfFgibQDxqqUi4NlxkInRMsGmjvYEKdKkUMvUx7bK8 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:45:02.803975 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f88c227e5914fe78dc37b03f3471375", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f55c7cb0df554f82b230715aaf67a77b Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: exception: Aggregate 13 could not be found. Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '13'} Sep 07 09:45:02.805111 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.806441 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 07 09:45:02.807823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.808819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02f8d051-cf5f-4218-98dd-4c071b929d16 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:02.808819 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02f8d051-cf5f-4218-98dd-4c071b929d16 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.022246 Sep 07 09:45:02.809897 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 101/229] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:02.815928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9a54275-dffa-4d88-93ff-3616df5ccd21 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:02.821912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.822751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.823402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.835995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9a54275-dffa-4d88-93ff-3616df5ccd21 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.836635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9a54275-dffa-4d88-93ff-3616df5ccd21 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.837298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9a54275-dffa-4d88-93ff-3616df5ccd21 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.862012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.863096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.863753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.915499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a002bfc5-0026-4408-a241-f9285e5128c8 tempest-HostsAdminTestJSON-533222546 tempest-HostsAdminTestJSON-533222546-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h2-836830-16" status: 200 len: 603 microversion: 2.1 time: 0.357518 Sep 07 09:45:02.916156 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 129/230] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/os-hosts/n-h2-836830-16 => generated 603 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:02.923530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee320ee2-8d01-4c4d-8baa-a255bcfd93c3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.941133 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ee320ee2-8d01-4c4d-8baa-a255bcfd93c3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee320ee2-8d01-4c4d-8baa-a255bcfd93c3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Request method failure captured: Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfyKfVYM6jAABVqUqkk7Pf2tIiHxXUwPv-ZrJmsrnSSeTuq-t8YGNu0pIxhW8VNEMhWMBhKVV_1tFn4zZhORFq9kK0exg3JEF3096HRpvI5A_3iz14hPpYqjRhk-6j1N4PabMfFgibQDxqqUi4NlxkInRMsGmjvYEKdKkUMvUx7bK8 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:45:02.945258 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f88c227e5914fe78dc37b03f3471375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f88c227e5914fe78dc37b03f3471375", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 2f88c227e5914fe78dc37b03f3471375 Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1201785118 Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f55c7cb0df554f82b230715aaf67a77b Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AggregatesAdminTestJSON-1201785118-project-admin Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: exception: Aggregate 13 could not be found. Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '13'} Sep 07 09:45:02.946426 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:45:02.947135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:02.948081 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee320ee2-8d01-4c4d-8baa-a255bcfd93c3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee320ee2-8d01-4c4d-8baa-a255bcfd93c3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.029177 Sep 07 09:45:02.951889 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 130/231] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:02 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:02.962419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:02.963041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:02.980469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.981437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.987989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:02.989087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:02.989610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:02.990202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:03.073862 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9a54275-dffa-4d88-93ff-3616df5ccd21 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 316 microversion: 2.41 time: 0.262700 Sep 07 09:45:03.074607 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 102/232] 10.222.0.60 () {62 vars in 1235 bytes} [Wed Sep 7 09:45:02 2022] POST /compute/v2.1/os-aggregates/12/action => generated 316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:03.083476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18f2cf79-c277-41fb-97ea-d0a2be31871e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1626938511"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:03.084922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-18f2cf79-c277-41fb-97ea-d0a2be31871e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid 4a32223c-eae7-4d52-9b20-f116ea6984d5 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:03.135890 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18f2cf79-c277-41fb-97ea-d0a2be31871e tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060176 Sep 07 09:45:03.143098 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 103/233] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:03.143098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89dc42d9-3e7f-4990-aca8-1cff08baa856 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:03.154008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89dc42d9-3e7f-4990-aca8-1cff08baa856 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:03.154499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89dc42d9-3e7f-4990-aca8-1cff08baa856 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:03.154930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89dc42d9-3e7f-4990-aca8-1cff08baa856 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:03.401121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89dc42d9-3e7f-4990-aca8-1cff08baa856 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 300 microversion: 2.41 time: 0.262915 Sep 07 09:45:03.402456 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 104/234] 10.222.0.60 () {62 vars in 1235 bytes} [Wed Sep 7 09:45:03 2022] POST /compute/v2.1/os-aggregates/12/action => generated 300 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:03.411229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0939efaf-c3c6-438f-8a12-afe8d731bf59 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:03.429396 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0939efaf-c3c6-438f-8a12-afe8d731bf59 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.025514 Sep 07 09:45:03.434262 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 105/235] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:03 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:03.441905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:03.447435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:03.458630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:03.464710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:03.466483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:03.470094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:03.471202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:03.472789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:03.473472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:04.117332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:04.133517 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00e0d0c8-951e-4329-bf2a-54474837cb1d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 1.175994 Sep 07 09:45:04.136241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 131/236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:02 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:04.161101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0dd35c4-79ca-45e9-bf91-e6278e966476 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:04.217049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0dd35c4-79ca-45e9-bf91-e6278e966476 tempest-AggregatesAdminTestV241-704686971 tempest-AggregatesAdminTestV241-704686971-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.075332 Sep 07 09:45:04.218219 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 132/237] 10.222.0.60 () {60 vars in 1196 bytes} [Wed Sep 7 09:45:04 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:04.232543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0a05bca5-225d-45d4-a6ad-8354be7ebcc3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.285278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:04.310495 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6152f1d9-c406-4260-a31d-42d23d2702f6 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1474 microversion: 2.1 time: 0.865805 Sep 07 09:45:04.311174 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 106/238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:03 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1474 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:04.319962 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0a05bca5-225d-45d4-a6ad-8354be7ebcc3 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.099408 Sep 07 09:45:04.326251 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 133/239] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:04.335224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c6b564d4-03b5-4771-8d5f-3a1801fea27f tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:04.347338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d55f3959-cec3-4426-8333-c00b21d68e02 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1090426357"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.352210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-d55f3959-cec3-4426-8333-c00b21d68e02 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid 6a51a26f-0cbb-45d1-bb1a-ab4e32fd1943 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:04.372781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c6b564d4-03b5-4771-8d5f-3a1801fea27f tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.041809 Sep 07 09:45:04.377855 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 134/240] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:04 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:04.392776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c3bc7c2-5625-4322-afc2-226566f4377a tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:04.401666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d55f3959-cec3-4426-8333-c00b21d68e02 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062892 Sep 07 09:45:04.403023 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 107/241] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:04.416439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-357436e7-8fea-4670-8336-0010bc4e45ee tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.435689 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c3bc7c2-5625-4322-afc2-226566f4377a tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050195 Sep 07 09:45:04.436362 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 135/242] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:04 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 07 09:45:04.454277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-77db0ff2-d467-465c-8531-de84a24a9842 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2115329061", "availability_zone": "tempest-test_az-1246583951"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.465921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.aggregate [None req-77db0ff2-d467-465c-8531-de84a24a9842 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid 94478112-b08c-4360-a0f2-0587ea9d737c for aggregate {{(pid=128832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:04.467639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-357436e7-8fea-4670-8336-0010bc4e45ee tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:04.468150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-357436e7-8fea-4670-8336-0010bc4e45ee tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:04.471544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-357436e7-8fea-4670-8336-0010bc4e45ee tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:04.491167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:04.497927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=11,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:04.554930 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-77db0ff2-d467-465c-8531-de84a24a9842 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.110625 Sep 07 09:45:04.556161 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 136/243] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:04.571238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d12455fa-d344-4497-9352-bb1ef25145fa tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2115329061_new", "availability_zone": "tempest-test_az-1246583951_new"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.698866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12455fa-d344-4497-9352-bb1ef25145fa tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:04.699415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12455fa-d344-4497-9352-bb1ef25145fa tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:04.699955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12455fa-d344-4497-9352-bb1ef25145fa tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:04.754009 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-357436e7-8fea-4670-8336-0010bc4e45ee tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 244 microversion: 2.1 time: 0.341732 Sep 07 09:45:04.762553 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 108/244] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates/15/action => generated 244 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:04.763019 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d12455fa-d344-4497-9352-bb1ef25145fa tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.197295 Sep 07 09:45:04.763762 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 137/245] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 7 09:45:04 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:04.775020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01211e42-a7cf-49a3-9012-1f75b7e114da tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.779283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8b9595c6-a592-4193-bdc8-68c4e483c84b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:04.784698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01211e42-a7cf-49a3-9012-1f75b7e114da tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c15463c4fc3b4daba1f3e66306e238fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748f3ce32234960869132a33d10d5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01211e42-a7cf-49a3-9012-1f75b7e114da tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Request method failure captured: Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 43 Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfsOglBW_E1tucxURZSe6f3ac8FTSBem35PKcdGpPUmZuKJZaxJY5vtt2sEbTe6qsWH5JpMemsyHgl18_p434tZ-LXxecKDVEI_svzyAYAKQ4WzlSyAS2KY3fdH8HvbtKYnwKZD6knmoTu1U9AyDfqae66_il4KaK2WAqSKQa1uGqA Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:04.786818 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7748f3ce32234960869132a33d10d5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7748f3ce32234960869132a33d10d5ac", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7748f3ce32234960869132a33d10d5ac Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-477763937 Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: c15463c4fc3b4daba1f3e66306e238fa Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-477763937-project Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: {"remove_host": {"host": "n-h1-836830-16"}} Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:04.788121 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h1-836830-16'}}} Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:04.788884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 07 09:45:04.790027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:04.792744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01211e42-a7cf-49a3-9012-1f75b7e114da tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:04.795148 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01211e42-a7cf-49a3-9012-1f75b7e114da tempest-AggregatesAdminNegativeTestJSON-477763937 tempest-AggregatesAdminNegativeTestJSON-477763937-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.023680 Sep 07 09:45:04.797514 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8b9595c6-a592-4193-bdc8-68c4e483c84b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 571 microversion: 2.1 time: 0.021089 Sep 07 09:45:04.798368 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 138/247] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:45:04 2022] GET /compute/v2.1/os-aggregates => generated 571 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:04.798752 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 109/247] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:04.805927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e3c1508-a77b-4668-81b0-d205368d3106 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.829663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3c1508-a77b-4668-81b0-d205368d3106 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:04.830252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3c1508-a77b-4668-81b0-d205368d3106 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:04.830706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3c1508-a77b-4668-81b0-d205368d3106 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:04.832625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2733b646-306b-4036-839e-1fe2a7eedbb1 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:04.903151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2733b646-306b-4036-839e-1fe2a7eedbb1 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.093307 Sep 07 09:45:04.903730 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 110/248] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:04 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:04.913672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74f6f264-e073-489c-9af6-054f5deb500b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-664424614"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:04.923988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-74f6f264-e073-489c-9af6-054f5deb500b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Generated uuid 5206fdfa-9573-468b-8da3-051ae28ba998 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:04.986207 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74f6f264-e073-489c-9af6-054f5deb500b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076150 Sep 07 09:45:04.990793 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 111/249] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:05.012779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dffd3526-0e7e-4ea1-a059-e35fead18c1b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.026161 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dffd3526-0e7e-4ea1-a059-e35fead18c1b tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 461 microversion: 2.1 time: 0.019599 Sep 07 09:45:05.027197 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 112/250] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:45:05 2022] GET /compute/v2.1/os-aggregates => generated 461 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:05.046214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9344843-f027-4291-a66a-953fc87c47f7 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.100773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e3c1508-a77b-4668-81b0-d205368d3106 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 228 microversion: 2.1 time: 0.298228 Sep 07 09:45:05.109763 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 139/251] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:04 2022] POST /compute/v2.1/os-aggregates/15/action => generated 228 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:05.115567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-49df6069-70ae-4ce1-9857-4834a89f6f83 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.125291 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9344843-f027-4291-a66a-953fc87c47f7 tempest-AggregatesAdminTestJSON-1201785118 tempest-AggregatesAdminTestJSON-1201785118-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.089293 Sep 07 09:45:05.126376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 113/252] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:05 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 07 09:45:05.136289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.145878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:05.153090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.153748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.154282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.155119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.160987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.164684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.169671 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-49df6069-70ae-4ce1-9857-4834a89f6f83 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.058594 Sep 07 09:45:05.179123 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 140/253] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:05 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:05.194218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.195009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:05.195884 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] HTTP exception thrown: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.202353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Request method failure captured: Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf HTTP/1.1 Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuzwX8jqQUFirtaXWwRu1uUwvz-XBrWEuMoD3-wmFfU-wxH6NyMyZnrom-nvJPpWjY_d2YJJGUWrTkxMmLNg2PIMmk6FSvGRfJA0laSPtBMvTAQhVOmFc971qkQd38i_KopWMAFPBhRs_JPy00mBxtLOWJngaq6qeRZwqZ0hon7aU Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c73ebce290c447758845265a00ecff90 Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:05.203115 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c73ebce290c447758845265a00ecff90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73ebce290c447758845265a00ecff90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73ebce290c447758845265a00ecff90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c73ebce290c447758845265a00ecff90", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c73ebce290c447758845265a00ecff90 Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminTestJSON-1392973359-project Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 68c6273cfbea45ffa55d49947a84924f Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminTestJSON-1392973359-project Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.204422 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '8627af93-01f7-4811-b60b-e4ef4b20bfaf'} Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:05.205081 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.206174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.207212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Returning 404 to user: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:05.207212 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94dd61ea-7491-427c-9fc2-b273327d009d tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 404 len: 111 microversion: 2.1 time: 0.074221 Sep 07 09:45:05.207212 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 114/254] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:45:05 2022] DELETE /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:05.209702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.210640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.211713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.212309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.213031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.222346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-966a7eb2-8a01-4c25-acf8-058626cd700a tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1960731437"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:05.226249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-966a7eb2-8a01-4c25-acf8-058626cd700a tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Generated uuid a791a3e2-e2d0-474f-9956-973e1b5ae20d for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 09:45:05.281052 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-966a7eb2-8a01-4c25-acf8-058626cd700a tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073476 Sep 07 09:45:05.285009 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 115/255] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 09:45:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:05.292954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.301249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] [instance: 8627af93-01f7-4811-b60b-e4ef4b20bfaf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:05.317142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.317610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.318167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.319007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.319576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.320231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.340726 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] HTTP exception thrown: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Request method failure captured: Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf HTTP/1.1 Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuzwX8jqQUFirtaXWwRu1uUwvz-XBrWEuMoD3-wmFfU-wxH6NyMyZnrom-nvJPpWjY_d2YJJGUWrTkxMmLNg2PIMmk6FSvGRfJA0laSPtBMvTAQhVOmFc971qkQd38i_KopWMAFPBhRs_JPy00mBxtLOWJngaq6qeRZwqZ0hon7aU Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c73ebce290c447758845265a00ecff90 Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:05.349287 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c73ebce290c447758845265a00ecff90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73ebce290c447758845265a00ecff90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73ebce290c447758845265a00ecff90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c73ebce290c447758845265a00ecff90", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c73ebce290c447758845265a00ecff90 Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1392973359 Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminTestJSON-1392973359-project Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 68c6273cfbea45ffa55d49947a84924f Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminTestJSON-1392973359-project Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.350840 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '8627af93-01f7-4811-b60b-e4ef4b20bfaf'} Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:05.351614 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. Sep 07 09:45:05.352883 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.354754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] Returning 404 to user: Instance 8627af93-01f7-4811-b60b-e4ef4b20bfaf could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:05.355379 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a3b06da-7406-46fa-89d4-03f155a72e73 tempest-AggregatesAdminTestJSON-1392973359 tempest-AggregatesAdminTestJSON-1392973359-project] 10.222.0.60 "GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf" status: 404 len: 111 microversion: 2.1 time: 0.067931 Sep 07 09:45:05.365648 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 116/256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:05 2022] GET /compute/v2.1/servers/8627af93-01f7-4811-b60b-e4ef4b20bfaf => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:05.373023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:05.388435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.392973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.393551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.415653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.416618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.416618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.445070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.compute.aggregates [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 07 09:45:05.445788 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Request method failure captured: Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 42 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfvjKdYXZLGsQ56rmj4Hs5fpWN60XGbMYDtwhmgCFEw04dVM3Fp7OcYG39zU5SbjWZn_sLWJfAN0qxYDS8eYj_KY69dxIbw5sNVuECxPpUKM3UKeCMMDVmWiXdwkqooqiFS7stZUi8UXOWjisuEAOddhvd_cmaLEAx5e1mbTO4-AGc Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 33d791d256104d629863377cffcca371 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:45:05.447810 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33d791d256104d629863377cffcca371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33d791d256104d629863377cffcca371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33d791d256104d629863377cffcca371", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 33d791d256104d629863377cffcca371 Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061 Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 3b33d88f46c24305ac9b327844975fbf Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: {"remove_host": {"host": "nonexist_host"}} Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:05.449342 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 07 09:45:05.450202 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 07 09:45:05.451447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.453611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:05.454995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:05.454995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:05.454995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:05.454995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:05.454995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 07 09:45:05.454995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:05.458263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:05.460307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2996f8d6-6ca5-406a-8302-e29d970c66e5 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.092129 Sep 07 09:45:05.464376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 117/257] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 09:45:05 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:05.473827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.480805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:05.496478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.497707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.506949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.507879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.508439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.508950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.706401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:05.727666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4ba3296-d84c-4b0e-ac0b-5741a4449610 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1432 microversion: 2.1 time: 0.262197 Sep 07 09:45:05.743616 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 118/258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:05 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1432 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:05.743616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c66c6d3c-6219-418f-8982-8c176116d9a3 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:05.777804 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c66c6d3c-6219-418f-8982-8c176116d9a3 tempest-AggregatesAdminNegativeTestJSON-2065871061 tempest-AggregatesAdminNegativeTestJSON-2065871061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.047969 Sep 07 09:45:05.778301 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 119/259] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 09:45:05 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:05.787049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7165cbaa-316a-457c-8036-2aa1105b2c5f req-66392a41-d58c-440d-890f-73ee21877bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69eab25-a71c-4dc7-96d1-a63e4174a056", "name": "network-vif-plugged", "status": "completed", "tag": "7c8afa77-b537-4e28-b5c7-81b3d3cc3906"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:05.801846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7165cbaa-316a-457c-8036-2aa1105b2c5f req-66392a41-d58c-440d-890f-73ee21877bf6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:05.802387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7165cbaa-316a-457c-8036-2aa1105b2c5f req-66392a41-d58c-440d-890f-73ee21877bf6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:05.802814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7165cbaa-316a-457c-8036-2aa1105b2c5f req-66392a41-d58c-440d-890f-73ee21877bf6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:05.829163 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7165cbaa-316a-457c-8036-2aa1105b2c5f req-66392a41-d58c-440d-890f-73ee21877bf6 service nova] Creating event network-vif-plugged:7c8afa77-b537-4e28-b5c7-81b3d3cc3906 for instance d69eab25-a71c-4dc7-96d1-a63e4174a056 on n-h2-836830-16 Sep 07 09:45:05.838252 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7165cbaa-316a-457c-8036-2aa1105b2c5f req-66392a41-d58c-440d-890f-73ee21877bf6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058531 Sep 07 09:45:05.840227 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 120/260] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:06.088063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:06.101163 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e5fd787d-071d-4690-9940-8c72b62c172b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.919967 Sep 07 09:45:06.105499 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 141/261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:05 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:06.178238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9f2dfb8d-56b1-40b5-b57f-d37189b2d283 req-b965ec89-9aea-440c-8977-a6976cbbfaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3033c013-aee0-4d0c-9235-930e2a3e37b5", "name": "network-vif-deleted", "tag": "014170bb-db5f-4a4a-928c-161a75d30e36"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:06.230384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9f2dfb8d-56b1-40b5-b57f-d37189b2d283 req-b965ec89-9aea-440c-8977-a6976cbbfaf9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:06.239269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9f2dfb8d-56b1-40b5-b57f-d37189b2d283 req-b965ec89-9aea-440c-8977-a6976cbbfaf9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:06.239991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9f2dfb8d-56b1-40b5-b57f-d37189b2d283 req-b965ec89-9aea-440c-8977-a6976cbbfaf9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:06.278164 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9f2dfb8d-56b1-40b5-b57f-d37189b2d283 req-b965ec89-9aea-440c-8977-a6976cbbfaf9 service nova] Creating event network-vif-deleted:014170bb-db5f-4a4a-928c-161a75d30e36 for instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 on n-h2-836830-16 Sep 07 09:45:06.299321 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9f2dfb8d-56b1-40b5-b57f-d37189b2d283 req-b965ec89-9aea-440c-8977-a6976cbbfaf9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128437 Sep 07 09:45:06.307992 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 121/262] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:06.755887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:06.764631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:06.783861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:06.795185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:06.795806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:06.798164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:06.798638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:06.799070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:06.912656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:06.917618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:06.920157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:06.920849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lazy-loading 'fault' on Instance uuid 3033c013-aee0-4d0c-9235-930e2a3e37b5 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:07.064701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:07.089656 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f23b6ab-fa7a-45f2-8eeb-8de7a32ffcfb tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 200 len: 1309 microversion: 2.1 time: 0.341454 Sep 07 09:45:07.090801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 142/263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:06 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 1309 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:07.130563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:07.131750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:07.141773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:07.142863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:07.143445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:07.144475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:07.145640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:07.146643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:07.374732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:07.382777 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d4c9651-166b-4569-b733-a9666ff99b67 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1389 microversion: 2.1 time: 0.258996 Sep 07 09:45:07.387217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 143/264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:07 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1389 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:07.878861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1334872894", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "6eb86d04-a25b-47cd-8f75-34e1365a0fe3"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:08.019331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] validate_networks() for [('6eb86d04-a25b-47cd-8f75-34e1365a0fe3', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:08.121424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:08.122810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:08.139417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:08.143723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:08.145359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:08.149436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:08.150745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:08.151269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:08.221338 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] HTTP exception thrown: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Request method failure captured: Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 HTTP/1.1 Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfuciMZPOwO2ohvsFh9G_XPKcjX3LYDusr2ct5cQP2vMdJcyyh8ChP29Cy-Afn892hJa5q1w5IG1ClFRWzn_JvQF-WitKbQzUCU7SQrswpLsPvn7ThV7cqcGghVXNVKASl1vfLSNLQjAPs5_nDcla8XLpHqzLRS_6KTZ6zWTk4fOWk Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:08.237270 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_359cbb65f5314ea88e9d55f8a9c50e2a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6dc8442ea8c54bc699cc9c95b397fa18 Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:08.238515 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3033c013-aee0-4d0c-9235-930e2a3e37b5'} Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:08.239222 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:08.240248 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:08.241284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Returning 404 to user: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:08.241284 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f8274ff-22e3-4002-ae9c-bc3e65233d0b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 404 len: 111 microversion: 2.1 time: 0.124764 Sep 07 09:45:08.241284 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 144/265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:08 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:08.412764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:08.413425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:08.436708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:08.439658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:08.440510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:08.442237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:08.447095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:08.447862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:09.286748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:09.294762 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a8056d9-ca23-41ba-bb3e-382bb5d829da tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1589 microversion: 2.1 time: 0.887109 Sep 07 09:45:09.302180 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 145/266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:08 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1589 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:09.307256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-226509067", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:09.421702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:10.406863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:10.409020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:10.409764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:10.410451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:10.411166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:10.443976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:10.444539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:10.444985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:10.445886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:10.446419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:10.446848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:10.464561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:10.465624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:10.467969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:10.473216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:10.473985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:10.511191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:10.513283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:10.513731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:10.515554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:10.517480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:10.518133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:10.525224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:10.532964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for user 224142a6fa7e4702b1780f4aaeb3f93f and project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:10.560522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Getting quotas for project 359cbb65f5314ea88e9d55f8a9c50e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:10.570702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:10.574079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Getting quotas for user 6dc8442ea8c54bc699cc9c95b397fa18 and project 359cbb65f5314ea88e9d55f8a9c50e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:10.579818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:10.634112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:10.645386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:10.742905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-120d59cd-f136-417f-8111-9fe668b0e566 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.796751 Sep 07 09:45:10.746670 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 122/267] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:10.760912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-043f2240-b546-4c71-9702-838b19d9f11d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457438 Sep 07 09:45:10.761468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:10.762231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:10.770179 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 146/268] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:10.775287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f97c71a0-dbef-4818-86db-77080d75487c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:10.781962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:10.782859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:10.784815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:10.787449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:10.788737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f97c71a0-dbef-4818-86db-77080d75487c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:10.790629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:10.791712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:11.042528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f97c71a0-dbef-4818-86db-77080d75487c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:11.052317 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f97c71a0-dbef-4818-86db-77080d75487c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1211 microversion: 2.1 time: 0.280993 Sep 07 09:45:11.055364 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 147/269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:10 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1211 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:11.076216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f7d6a65-d874-4cad-bd8b-7bb180fa35bf tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:11.076951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f7d6a65-d874-4cad-bd8b-7bb180fa35bf tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:11.948250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f7d6a65-d874-4cad-bd8b-7bb180fa35bf tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:11.960402 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f7d6a65-d874-4cad-bd8b-7bb180fa35bf tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1219 microversion: 2.1 time: 0.903897 Sep 07 09:45:11.973301 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 148/270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:11 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1219 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:12.053622 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7b834f77-bbb2-45c8-b16b-687662b405e8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.304595 Sep 07 09:45:12.054455 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 123/271] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:45:10 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056/os-interface => generated 285 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:12.083588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:12.084653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:12.095298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:12.097060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:12.099590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:12.100808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:12.101810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:12.104480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:12.492080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:12.505328 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f1553c2-4413-4a34-9020-008961320370 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1207 microversion: 2.1 time: 0.424512 Sep 07 09:45:12.518430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 149/272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:12 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1207 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:12.992798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:12.993501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:13.014084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:13.014770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:13.021831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:13.023058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:13.023820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:13.024408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:13.059619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:13.194293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04579d07-0925-442d-86ed-a9d4a574aece tempest-InstanceUsageAuditLogTestJSON-2047683419 tempest-InstanceUsageAuditLogTestJSON-2047683419-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:13.240252 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04579d07-0925-442d-86ed-a9d4a574aece tempest-InstanceUsageAuditLogTestJSON-2047683419 tempest-InstanceUsageAuditLogTestJSON-2047683419-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07 09:45:12" status: 200 len: 318 microversion: 2.1 time: 0.631503 Sep 07 09:45:13.246713 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 124/273] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 09:45:12 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07%2009%3A45%3A12 => generated 318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:13.260703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97893e21-e96d-4aca-833c-1041ebfc3e27 tempest-InstanceUsageAuditLogTestJSON-2047683419 tempest-InstanceUsageAuditLogTestJSON-2047683419-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:13.290489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97893e21-e96d-4aca-833c-1041ebfc3e27 tempest-InstanceUsageAuditLogTestJSON-2047683419 tempest-InstanceUsageAuditLogTestJSON-2047683419-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034100 Sep 07 09:45:13.296257 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 125/274] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 09:45:13 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:13.411733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:13.422196 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d17e0c94-6f13-4dd3-b143-c1755a46f755 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1215 microversion: 2.1 time: 0.432131 Sep 07 09:45:13.422791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 150/275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:12 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1215 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:13.531851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:13.533054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:13.544902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:13.553633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:13.554408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:13.555057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:13.555528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:13.555952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:13.954469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:13.987271 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6a34bcda-93f3-4375-b35b-5754347b7376 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1271 microversion: 2.1 time: 0.460601 Sep 07 09:45:13.990024 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 126/276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:13 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1271 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:14.451400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:14.455165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:14.472379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:14.477885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:14.479681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:14.481205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:14.483411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:14.488279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.016697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:15.017259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:15.026466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:15.027790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:15.028235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.028960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:15.029447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:15.029871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.109418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:15.124088 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2936e53-50fb-42e1-9d8d-6c94a1baef3f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1277 microversion: 2.1 time: 0.678053 Sep 07 09:45:15.126442 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 151/277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:14 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1277 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:15.254236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:15.273299 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3205d03b-7fcb-4fbd-83b4-13fb59f9a883 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1269 microversion: 2.1 time: 0.260413 Sep 07 09:45:15.274400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 127/278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:15 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1269 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:15.819147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:15.826345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:15.830329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:15.831559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.833825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:15.836458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:15.837193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.901561 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13292204-1543-4b5b-ad0a-f519450d3e91 tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.662507 Sep 07 09:45:15.902182 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 152/279] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 7 09:45:15 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:15.914415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:15.916388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:15.917083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:15.917761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.918660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:15.919361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:15.920058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:15.986650 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6d1c28b-c11f-4934-94ac-69b0d99fea9e tempest-AZAdminV2TestJSON-595327687 tempest-AZAdminV2TestJSON-595327687-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.072551 Sep 07 09:45:15.987683 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 128/280] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 09:45:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:16.150138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:16.150836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:16.182166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.182713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.183594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:16.184290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:16.185873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.189246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.193693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.194431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.199908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.205733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.206758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.210839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.211569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.212218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.450225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:16.476577 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf108b5f-b05e-4324-9b02-6b169d29e5ca tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1277 microversion: 2.1 time: 0.326208 Sep 07 09:45:16.479551 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 153/281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:16 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1277 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:16.506869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-dae458e2-bfe9-4b5e-9122-f92ded14af14 req-21b494ff-7fa0-4e51-8bb0-8077e7a8ab25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69eab25-a71c-4dc7-96d1-a63e4174a056", "tag": "7c8afa77-b537-4e28-b5c7-81b3d3cc3906"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:16.543878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dae458e2-bfe9-4b5e-9122-f92ded14af14 req-21b494ff-7fa0-4e51-8bb0-8077e7a8ab25 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.544379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dae458e2-bfe9-4b5e-9122-f92ded14af14 req-21b494ff-7fa0-4e51-8bb0-8077e7a8ab25 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.544944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dae458e2-bfe9-4b5e-9122-f92ded14af14 req-21b494ff-7fa0-4e51-8bb0-8077e7a8ab25 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.568524 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-dae458e2-bfe9-4b5e-9122-f92ded14af14 req-21b494ff-7fa0-4e51-8bb0-8077e7a8ab25 service nova] Creating event network-changed:7c8afa77-b537-4e28-b5c7-81b3d3cc3906 for instance d69eab25-a71c-4dc7-96d1-a63e4174a056 on n-h2-836830-16 Sep 07 09:45:16.578560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-dae458e2-bfe9-4b5e-9122-f92ded14af14 req-21b494ff-7fa0-4e51-8bb0-8077e7a8ab25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094869 Sep 07 09:45:16.580527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 154/282] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:16.610411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:16.612618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:16.624548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.625438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.626640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.627960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:16.628583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:16.629967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:16.654936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:16.663869 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-518d30ee-02e9-4e77-ae5b-96bf9dda572b tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 200 len: 1589 microversion: 2.1 time: 0.484983 Sep 07 09:45:16.675942 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 129/283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:16 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 1589 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:17.112444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:17.132450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1dc93b1e-0d7e-4f77-9a47-84af76629b0a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.542089 Sep 07 09:45:17.137868 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 155/284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:16 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:17.187770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf06cf89-7ddb-47ca-9086-2c79bb3cd705 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Calling method '.version_select at 0x7f14b26c0ca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:17.189863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf06cf89-7ddb-47ca-9086-2c79bb3cd705 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6a4a06b232c04170818fdd553bd5fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66211a57a6245c7adecdcf159824db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf06cf89-7ddb-47ca-9086-2c79bb3cd705 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Request method failure captured: Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgqj7l9wnaqS0HUI_hq3PmysvW75JHYCUSgHk1kSl0hGWKY1IpFa6faOBFsxJBj8pfEKjs19nnZDrB94-ch2JcRM0lySN4-qSB9kb6dzGgD07QqoV9BQLDuokuUdhuUalaowoJQJGr0VE54ppCs1r8KHXMovPSYOQYS5HAXdhKj8JY Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:17.192281 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a66211a57a6245c7adecdcf159824db8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a4a06b232c04170818fdd553bd5fc5c Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: action_args: {} Sep 07 09:45:17.193873 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:17.194873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 07 09:45:17.196306 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.204256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf06cf89-7ddb-47ca-9086-2c79bb3cd705 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:17.206090 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf06cf89-7ddb-47ca-9086-2c79bb3cd705 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.537224 Sep 07 09:45:17.209801 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 130/285] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 7 09:45:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 542 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:17.217757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7882dfe-af55-4a21-8ca9-9614ae529769 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Calling method '.version_select at 0x7f14b2503c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:17.221330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a7882dfe-af55-4a21-8ca9-9614ae529769 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6a4a06b232c04170818fdd553bd5fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66211a57a6245c7adecdcf159824db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7882dfe-af55-4a21-8ca9-9614ae529769 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Request method failure captured: Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgqj7l9wnaqS0HUI_hq3PmysvW75JHYCUSgHk1kSl0hGWKY1IpFa6faOBFsxJBj8pfEKjs19nnZDrB94-ch2JcRM0lySN4-qSB9kb6dzGgD07QqoV9BQLDuokuUdhuUalaowoJQJGr0VE54ppCs1r8KHXMovPSYOQYS5HAXdhKj8JY Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:17.223519 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a66211a57a6245c7adecdcf159824db8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6a4a06b232c04170818fdd553bd5fc5c Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 09:45:17.224813 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:17.225725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 07 09:45:17.226964 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.228877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7882dfe-af55-4a21-8ca9-9614ae529769 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:17.230952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a7882dfe-af55-4a21-8ca9-9614ae529769 tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017512 Sep 07 09:45:17.233046 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 156/286] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:17 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:17.243420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-027fd0c6-6b4d-4326-a50f-d69e8e531f1b tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Calling method '.version_select at 0x7f14b27988b0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:17.245903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-027fd0c6-6b4d-4326-a50f-d69e8e531f1b tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6a4a06b232c04170818fdd553bd5fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66211a57a6245c7adecdcf159824db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-027fd0c6-6b4d-4326-a50f-d69e8e531f1b tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Request method failure captured: Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgqj7l9wnaqS0HUI_hq3PmysvW75JHYCUSgHk1kSl0hGWKY1IpFa6faOBFsxJBj8pfEKjs19nnZDrB94-ch2JcRM0lySN4-qSB9kb6dzGgD07QqoV9BQLDuokuUdhuUalaowoJQJGr0VE54ppCs1r8KHXMovPSYOQYS5HAXdhKj8JY Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:17.247623 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a66211a57a6245c7adecdcf159824db8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a4a06b232c04170818fdd553bd5fc5c Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: action_args: {} Sep 07 09:45:17.248780 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:17.249568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 07 09:45:17.250547 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:17.251525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-027fd0c6-6b4d-4326-a50f-d69e8e531f1b tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:17.251525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-027fd0c6-6b4d-4326-a50f-d69e8e531f1b tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010588 Sep 07 09:45:17.260628 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 131/287] 10.222.0.60 () {58 vars in 1179 bytes} [Wed Sep 7 09:45:17 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:17.504535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:17.505651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:17.518716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:17.519509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:17.524451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:17.525947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:17.526732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:17.527450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.139056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Calling method '.version_select at 0x7f14b2461a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.142364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.143260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.143995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.196754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.200338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.202319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.221309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:18.230836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44010091-b80c-461d-bc0b-57bce5e38db2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.731501 Sep 07 09:45:18.236582 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 132/288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:17 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:18.240606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.241360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.242002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.247114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.249255 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e0d13085-dbbb-41dc-9ec5-85c07629aaf6 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.994056 Sep 07 09:45:18.250141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:18.251558 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 157/289] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:18.264507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.265289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.265901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.266904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.267519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.267893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9892e032-d4a5-4250-85d6-45b5084bd07f tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Calling method '.version_select at 0x7f14b25039d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.268824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.269990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9892e032-d4a5-4250-85d6-45b5084bd07f tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6a4a06b232c04170818fdd553bd5fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66211a57a6245c7adecdcf159824db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9892e032-d4a5-4250-85d6-45b5084bd07f tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Request method failure captured: Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgqj7l9wnaqS0HUI_hq3PmysvW75JHYCUSgHk1kSl0hGWKY1IpFa6faOBFsxJBj8pfEKjs19nnZDrB94-ch2JcRM0lySN4-qSB9kb6dzGgD07QqoV9BQLDuokuUdhuUalaowoJQJGr0VE54ppCs1r8KHXMovPSYOQYS5HAXdhKj8JY Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:18.273941 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a66211a57a6245c7adecdcf159824db8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6a4a06b232c04170818fdd553bd5fc5c Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1'} Sep 07 09:45:18.275506 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:18.276369 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 07 09:45:18.277659 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.282190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9892e032-d4a5-4250-85d6-45b5084bd07f tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:18.284433 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9892e032-d4a5-4250-85d6-45b5084bd07f tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021396 Sep 07 09:45:18.285442 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 158/290] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 7 09:45:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:45:18.304626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c3a3e37-9116-491c-81ec-30a2f34e0a63 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Calling method '.version_select at 0x7f14b2461160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.306442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2c3a3e37-9116-491c-81ec-30a2f34e0a63 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] HTTP exception thrown: Hypervisor with ID '8d3d67e4-b13f-41ea-bb3e-c22292134b00' could not be found. Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c3a3e37-9116-491c-81ec-30a2f34e0a63 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Request method failure captured: Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hypervisors/8d3d67e4-b13f-41ea-bb3e-c22292134b00/uptime HTTP/1.1 Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgs9XuFlA3T75ja7etOhZEBaefJa9Blo0v-7UkMtrp-QdQt6e0u33Tr1Ct_DR5hFoABX8TJ6l1a_jgpeugNX7PB7u3wDlYYbmnLn8w0PerjwCssvpx3XXs0wV4Ic1KxYUYIhljqia_fVEEd38deaiFRCLA8g8M8txoXjQwpxydKUEY Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 896c4512c12f4c65852b384d2855290d Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-305187444 Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:45:18.314880 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/896c4512c12f4c65852b384d2855290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/896c4512c12f4c65852b384d2855290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/896c4512c12f4c65852b384d2855290d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_896c4512c12f4c65852b384d2855290d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-305187444 Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 896c4512c12f4c65852b384d2855290d Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-305187444 Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8fabd0cf90514dee8e36a696dc042be8 Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: exception: Hypervisor with ID '8d3d67e4-b13f-41ea-bb3e-c22292134b00' could not be found. Sep 07 09:45:18.316712 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '8d3d67e4-b13f-41ea-bb3e-c22292134b00'} Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8d3d67e4-b13f-41ea-bb3e-c22292134b00' Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 07 09:45:18.317605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8d3d67e4-b13f-41ea-bb3e-c22292134b00' could not be found. Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.318839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8d3d67e4-b13f-41ea-bb3e-c22292134b00' could not be found. Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.319931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c3a3e37-9116-491c-81ec-30a2f34e0a63 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Returning 404 to user: Hypervisor with ID '8d3d67e4-b13f-41ea-bb3e-c22292134b00' could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:18.320367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c3a3e37-9116-491c-81ec-30a2f34e0a63 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/8d3d67e4-b13f-41ea-bb3e-c22292134b00/uptime" status: 404 len: 123 microversion: 2.1 time: 0.027224 Sep 07 09:45:18.326820 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 159/291] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 7 09:45:18 2022] GET /compute/v2.1/os-hypervisors/8d3d67e4-b13f-41ea-bb3e-c22292134b00/uptime => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:18.338294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Calling method '.version_select at 0x7f14b268fa60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.340101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.340780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.341633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.361474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.363472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.364262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.382225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:18.382802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:18.383294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:18.393477 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d31b1470-14a7-4c12-a641-7d75499d6b77 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.062480 Sep 07 09:45:18.394852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 160/292] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:18.411302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-738047c5-728a-420d-bfef-5ebc918477dd tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Calling method '.version_select at 0x7f14b261b670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.413476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-738047c5-728a-420d-bfef-5ebc918477dd tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6a4a06b232c04170818fdd553bd5fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66211a57a6245c7adecdcf159824db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-738047c5-728a-420d-bfef-5ebc918477dd tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Request method failure captured: Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgqj7l9wnaqS0HUI_hq3PmysvW75JHYCUSgHk1kSl0hGWKY1IpFa6faOBFsxJBj8pfEKjs19nnZDrB94-ch2JcRM0lySN4-qSB9kb6dzGgD07QqoV9BQLDuokuUdhuUalaowoJQJGr0VE54ppCs1r8KHXMovPSYOQYS5HAXdhKj8JY Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:18.416040 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a66211a57a6245c7adecdcf159824db8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a66211a57a6245c7adecdcf159824db8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: a66211a57a6245c7adecdcf159824db8 Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731 Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6a4a06b232c04170818fdd553bd5fc5c Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2055733731-project Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1'} Sep 07 09:45:18.417486 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:18.418424 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 07 09:45:18.419751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.426580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-738047c5-728a-420d-bfef-5ebc918477dd tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:18.430739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-738047c5-728a-420d-bfef-5ebc918477dd tempest-HypervisorAdminNegativeTestJSON-2055733731 tempest-HypervisorAdminNegativeTestJSON-2055733731-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.029176 Sep 07 09:45:18.432489 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 161/293] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:45:18.441871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd92960d-3a07-4238-8cd7-163c4fe79336 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Calling method '.version_select at 0x7f14b24b2040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:18.448372 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-dd92960d-3a07-4238-8cd7-163c4fe79336 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] HTTP exception thrown: Hypervisor with ID '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6' could not be found. Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd92960d-3a07-4238-8cd7-163c4fe79336 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Request method failure captured: Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hypervisors/4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6 HTTP/1.1 Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgs9XuFlA3T75ja7etOhZEBaefJa9Blo0v-7UkMtrp-QdQt6e0u33Tr1Ct_DR5hFoABX8TJ6l1a_jgpeugNX7PB7u3wDlYYbmnLn8w0PerjwCssvpx3XXs0wV4Ic1KxYUYIhljqia_fVEEd38deaiFRCLA8g8M8txoXjQwpxydKUEY Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 896c4512c12f4c65852b384d2855290d Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-305187444 Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:45:18.451441 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/896c4512c12f4c65852b384d2855290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/896c4512c12f4c65852b384d2855290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/896c4512c12f4c65852b384d2855290d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_896c4512c12f4c65852b384d2855290d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-305187444 Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 896c4512c12f4c65852b384d2855290d Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-305187444 Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8fabd0cf90514dee8e36a696dc042be8 Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: exception: Hypervisor with ID '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6' could not be found. Sep 07 09:45:18.453012 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6'} Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6' Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 07 09:45:18.454091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:45:18.455548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6' could not be found. Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6' could not be found. Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd92960d-3a07-4238-8cd7-163c4fe79336 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] Returning 404 to user: Hypervisor with ID '4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6' could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:18.456941 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd92960d-3a07-4238-8cd7-163c4fe79336 tempest-HypervisorAdminNegativeTestJSON-305187444 tempest-HypervisorAdminNegativeTestJSON-305187444-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6" status: 404 len: 123 microversion: 2.1 time: 0.018654 Sep 07 09:45:18.460376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 162/294] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 7 09:45:18 2022] GET /compute/v2.1/os-hypervisors/4ad9eb0c-45ad-4fd3-856a-edaf5cddbfc6 => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:45:18.816924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:18.830263 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-436b730e-e103-4c04-ad7f-30af3c46b92f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.588900 Sep 07 09:45:18.837892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 133/295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:18 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:19.266667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:19.267286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:19.283254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:19.293040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:19.293584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:19.294346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:19.294823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:19.295251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:19.575860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-92f076ca-43bf-4599-aba3-0260a1b5d154 req-0401ee17-0b93-415f-8813-7bca8c987483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3597056-9689-447d-be91-becbca131e60", "tag": "a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:19.597731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-92f076ca-43bf-4599-aba3-0260a1b5d154 req-0401ee17-0b93-415f-8813-7bca8c987483 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:19.598511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-92f076ca-43bf-4599-aba3-0260a1b5d154 req-0401ee17-0b93-415f-8813-7bca8c987483 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:19.599112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-92f076ca-43bf-4599-aba3-0260a1b5d154 req-0401ee17-0b93-415f-8813-7bca8c987483 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:19.631729 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-92f076ca-43bf-4599-aba3-0260a1b5d154 req-0401ee17-0b93-415f-8813-7bca8c987483 service nova] Creating event network-changed:a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89 for instance d3597056-9689-447d-be91-becbca131e60 on n-h1-836830-16 Sep 07 09:45:19.644971 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-92f076ca-43bf-4599-aba3-0260a1b5d154 req-0401ee17-0b93-415f-8813-7bca8c987483 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070624 Sep 07 09:45:19.645892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 134/296] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:19.700406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:19.722531 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae711a88-64dd-441d-a53d-394edff91839 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.458981 Sep 07 09:45:19.725144 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 163/297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:19 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:19.864005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:19.865193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:19.873695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:19.875010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:19.875805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:19.876539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:19.877487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:19.878109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:20.087607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:20.097457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-28a0ba48-f98c-4017-b4be-9a303c8cb62f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.239582 Sep 07 09:45:20.126346 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 135/298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:19 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:20.748033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:20.749497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:20.755985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:20.756792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:20.757466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:20.758372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:20.759098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:20.759737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:20.963480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:20.972789 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89027e97-7960-4657-8b29-15bff582e9c3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.228592 Sep 07 09:45:20.973689 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 164/299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:20 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:21.124040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:21.125619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:21.136575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:21.137573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:21.138167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:21.139004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:21.140431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:21.141005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:21.316186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:21.324768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7adabf8-2af0-4a55-8d08-85da5c9ee244 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.204289 Sep 07 09:45:21.325681 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 136/300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:21 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:21.673336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4271df9b-beef-4a47-a6f2-734159eea6e4 req-68ba2707-c89e-40f5-9455-d721bbe06f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f4354b-69e9-4ffa-8834-66f4d0f62e68", "tag": "bb3527f2-44b0-43dc-b00f-eb63a6ee7f10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:21.685474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4271df9b-beef-4a47-a6f2-734159eea6e4 req-68ba2707-c89e-40f5-9455-d721bbe06f7a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:21.686182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4271df9b-beef-4a47-a6f2-734159eea6e4 req-68ba2707-c89e-40f5-9455-d721bbe06f7a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:21.686864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4271df9b-beef-4a47-a6f2-734159eea6e4 req-68ba2707-c89e-40f5-9455-d721bbe06f7a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:21.703986 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4271df9b-beef-4a47-a6f2-734159eea6e4 req-68ba2707-c89e-40f5-9455-d721bbe06f7a service nova] Creating event network-changed:bb3527f2-44b0-43dc-b00f-eb63a6ee7f10 for instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 on n-h1-836830-16 Sep 07 09:45:21.710570 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4271df9b-beef-4a47-a6f2-734159eea6e4 req-68ba2707-c89e-40f5-9455-d721bbe06f7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042837 Sep 07 09:45:21.711611 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 165/301] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:21.995723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:21.996518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:22.003903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:22.004380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:22.004970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:22.005830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:22.006426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:22.007215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:22.164125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:22.174042 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-72a0210d-36f8-4e7e-8ffc-84a17d19d5f4 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.182097 Sep 07 09:45:22.187399 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 137/302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:21 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:22.353614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:22.353614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:22.354158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:22.359801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:22.360288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:22.360723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:22.361450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:22.361930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:22.362517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:22.511092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:22.520424 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d65056f2-f707-4dca-a1d1-ce4650d57450 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.174614 Sep 07 09:45:22.520916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 166/303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:22 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:23.113519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b3ea23a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.116258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.117599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.119071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.150514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.151016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.151451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.164076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.164788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.166081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.182931 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4278e5fa-4fbe-41eb-a823-bce50989b45f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.437487 Sep 07 09:45:23.184649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 138/304] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:23.197606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b28fe040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.199749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.200471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.201056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.208227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.219703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:23.230536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.231617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:23.232080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.233070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.235420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.236395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.237075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.237714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.240831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.241529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.274377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.275209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.275835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.281292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:23.300564 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c9a8691-58f4-48d4-85b8-c2e729e51815 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.103866 Sep 07 09:45:23.301236 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 167/305] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:23.339808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b2503f70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.341560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.342049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.342498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.379901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.380543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.380801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.408577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.413373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.414030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.428676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c1a4fb6-65c9-414c-814c-6f8abb47002f tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.110775 Sep 07 09:45:23.432528 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 168/306] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:23.442574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b261b8b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.444098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.444583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.445020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.481795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.482283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.482709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.509291 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ff0303a-badb-4d0c-904c-81e00482821a tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.067393 Sep 07 09:45:23.510331 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 169/307] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:23.533325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd91a263-e946-476f-844e-f73dd2428aac tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b261bf70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.536166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd91a263-e946-476f-844e-f73dd2428aac tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.539552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd91a263-e946-476f-844e-f73dd2428aac tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.540083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd91a263-e946-476f-844e-f73dd2428aac tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.542276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:23.558167 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f940f97f-86dd-45d1-ba76-b6bfad177994 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.353768 Sep 07 09:45:23.559119 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 139/308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:23.564228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd91a263-e946-476f-844e-f73dd2428aac tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.041173 Sep 07 09:45:23.572538 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 170/309] 10.222.0.60 () {58 vars in 1179 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:23.578641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.580091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:23.586876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.587576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.588108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.588812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.589440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.590025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.804477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:23.816922 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78a22666-ca66-4cce-bd31-f64ec24ba70d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.242214 Sep 07 09:45:23.817949 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 171/310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:23.832566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b2461a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.835043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.835528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.835966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.852264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.852984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.853587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.868797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.869532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.870123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.876799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4aa88cce-94f5-4728-bdd2-1bf4a1d2d459 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.056954 Sep 07 09:45:23.877906 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 172/311] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:23.888512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b261b9d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.890659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.891369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.891879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.904957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.906591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.907288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.916711 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e180d8c0-67b5-46bf-bb12-807689e7a802 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.031762 Sep 07 09:45:23.928468 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 173/312] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:23.933397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b24610d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:23.935400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.936043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.936831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.952240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:23.953787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:23.954384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:23.961318 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70884c7e-af34-4fe8-b666-a19b4321f9d6 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.031372 Sep 07 09:45:23.973450 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 174/313] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:24.017568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7377185e-8a9c-4e1f-bc4d-0bf0dc0c34b9 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:24.022525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7377185e-8a9c-4e1f-bc4d-0bf0dc0c34b9 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7377185e-8a9c-4e1f-bc4d-0bf0dc0c34b9 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin] Request method failure captured: Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgzk6M2hPUi6hTsjkHAUvlLQgbEKiv60FJgyL1Bl6aHkkVr8ZXzecg2WCHZMgIKoyYyninlvNHBCyZGYOjHfLxZtszBQnKVTn7CidJlFx-GpFNBLZDgBzV_kmsV2xk7x8nfTthTAcNYlnX4XW8BVeZCuO-gMFODDppgzeVtxr9Uirw Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 17681fd9a6c644128fe4a88361768e1d Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:45:24.031658 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17681fd9a6c644128fe4a88361768e1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17681fd9a6c644128fe4a88361768e1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17681fd9a6c644128fe4a88361768e1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17681fd9a6c644128fe4a88361768e1d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 17681fd9a6c644128fe4a88361768e1d Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 09dc779887934f25ad598e8b52affe22 Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:24.033214 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid timestamp for date invalid_time Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'invalid_time'} Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:24.033970 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7377185e-8a9c-4e1f-bc4d-0bf0dc0c34b9 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:24.035412 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7377185e-8a9c-4e1f-bc4d-0bf0dc0c34b9 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148 tempest-InstanceUsageAuditLogNegativeTestJSON-528000148-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.471746 Sep 07 09:45:24.036382 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 140/314] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 7 09:45:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 473 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:45:24.042359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Calling method '.version_select at 0x7f14b2798b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:24.044440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.045270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.045786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.067506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.068268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.068925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.078613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:24.083536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.084424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.084948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.116239 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00f4642d-0a50-47b7-9cd5-0490df0e4601 tempest-HypervisorAdminTestJSON-474542459 tempest-HypervisorAdminTestJSON-474542459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.077655 Sep 07 09:45:24.117438 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 141/315] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 7 09:45:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:24.275363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Action: 'update', calling method: .version_select at 0x7f14b261bd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:24.390925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc2b6b8d-a9f2-4d48-8858-ba64265afb41 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:24.393517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cc2b6b8d-a9f2-4d48-8858-ba64265afb41 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '558c867e2e9243178f1c1054b09e33f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e8bc0cfba47c795df644a0368617e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc2b6b8d-a9f2-4d48-8858-ba64265afb41 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Request method failure captured: Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgxAqO6sjdilfYVBhP1jcGKjE6k1NSWsWR_uLzSrJuMEAMXw6V0tEwHhdYP_M-UNon63AcN0Nvdf7212h1aKsFD3kAmnDtxSys4xXkhQi7s-nAOGHqynh_i_kxztOi8T433QYIWNzBGWLnK5VOX6MQh_h2Ofs4TU7_Nz0fXvFalF1k Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f93e8bc0cfba47c795df644a0368617e Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:24.395348 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f93e8bc0cfba47c795df644a0368617e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f93e8bc0cfba47c795df644a0368617e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f93e8bc0cfba47c795df644a0368617e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f93e8bc0cfba47c795df644a0368617e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f93e8bc0cfba47c795df644a0368617e Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 558c867e2e9243178f1c1054b09e33f0 Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project Sep 07 09:45:24.396931 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: action_args: {} Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:24.397632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 07 09:45:24.398987 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.400127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc2b6b8d-a9f2-4d48-8858-ba64265afb41 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:24.400440 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc2b6b8d-a9f2-4d48-8858-ba64265afb41 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.280789 Sep 07 09:45:24.404727 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 142/316] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 09:45:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:24.413798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-387807d6-faed-4022-97fc-a336109527e8 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:24.416677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-387807d6-faed-4022-97fc-a336109527e8 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '558c867e2e9243178f1c1054b09e33f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e8bc0cfba47c795df644a0368617e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-387807d6-faed-4022-97fc-a336109527e8 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Request method failure captured: Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07%2009:45:24 HTTP/1.1 Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgxAqO6sjdilfYVBhP1jcGKjE6k1NSWsWR_uLzSrJuMEAMXw6V0tEwHhdYP_M-UNon63AcN0Nvdf7212h1aKsFD3kAmnDtxSys4xXkhQi7s-nAOGHqynh_i_kxztOi8T433QYIWNzBGWLnK5VOX6MQh_h2Ofs4TU7_Nz0fXvFalF1k Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f93e8bc0cfba47c795df644a0368617e Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:24.418488 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f93e8bc0cfba47c795df644a0368617e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f93e8bc0cfba47c795df644a0368617e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f93e8bc0cfba47c795df644a0368617e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f93e8bc0cfba47c795df644a0368617e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f93e8bc0cfba47c795df644a0368617e Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 558c867e2e9243178f1c1054b09e33f0 Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project Sep 07 09:45:24.419866 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2022-09-07 09:45:24'} Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:24.420495 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 07 09:45:24.422109 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:24.424592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-387807d6-faed-4022-97fc-a336109527e8 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:24.425644 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-387807d6-faed-4022-97fc-a336109527e8 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488 tempest-InstanceUsageAuditLogNegativeTestJSON-607139488-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07 09:45:24" status: 403 len: 128 microversion: 2.1 time: 0.019294 Sep 07 09:45:24.426176 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 143/317] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 09:45:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07%2009%3A45%3A24 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:24.585555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:24.586781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:24.594997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.595480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.595934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.596656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.597104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.597569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.747710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:24.752400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:24.759140 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a89fb2b7-3c8f-48fc-a1a8-d44b95856c0a tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.178345 Sep 07 09:45:24.760299 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 144/318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:24 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:24.815114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.817110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.818624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.821025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.821689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.822759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.895702 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca84e74a-7620-4ce3-9797-ff61de99b977 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c" status: 200 len: 148 microversion: 2.57 time: 0.920767 Sep 07 09:45:24.897097 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 175/319] 10.222.0.60 () {62 vars in 1303 bytes} [Wed Sep 7 09:45:23 2022] PUT /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c => generated 148 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:24.900826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:24.901467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:24.911661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.912342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.912909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.913752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:24.914282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:24.914870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:24.936058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:25.069100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:25.079429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d69d3dfd-43e9-40de-99de-9608c5c2f42c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.181807 Sep 07 09:45:25.090746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 176/320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:24 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:25.106341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Calling method '.version_select at 0x7f14b2423e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:25.205157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2110f7d9-9f22-4241-bac2-7ad571821ffd tempest-AZAdminNegativeTestJSON-1810683531 tempest-AZAdminNegativeTestJSON-1810683531-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:25.206703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2110f7d9-9f22-4241-bac2-7ad571821ffd tempest-AZAdminNegativeTestJSON-1810683531 tempest-AZAdminNegativeTestJSON-1810683531-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '668a4ff09a4a4f95a39eabdffd776e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16551b505bf84581b92c8874cff6665c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2110f7d9-9f22-4241-bac2-7ad571821ffd tempest-AZAdminNegativeTestJSON-1810683531 tempest-AZAdminNegativeTestJSON-1810683531-project] Request method failure captured: Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgyWwqxMO2Hy56NlMDK3jopH7kZS2sA1UVi6cNaopzTo2L2OLG9q6tek-0vtJ6sutp1ExIkELKhx6rTugbrxfW3O6u-viLnTI_ykW6HSVhn-BG1gbfeunrsGnwdGCs9fbVbr0uqboY0xhv8g-WqDx00OV_VwlcN5MvmJUqnlYMmf4c Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 16551b505bf84581b92c8874cff6665c Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1810683531 Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:25.209385 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16551b505bf84581b92c8874cff6665c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16551b505bf84581b92c8874cff6665c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16551b505bf84581b92c8874cff6665c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16551b505bf84581b92c8874cff6665c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AZAdminNegativeTestJSON-1810683531 Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 16551b505bf84581b92c8874cff6665c Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1810683531 Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AZAdminNegativeTestJSON-1810683531-project Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 668a4ff09a4a4f95a39eabdffd776e8e Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AZAdminNegativeTestJSON-1810683531-project Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 07 09:45:25.210595 n-d-836830-16 devstack@n-api.service[128833]: action_args: {} Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:45:25.211958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 07 09:45:25.213802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:25.216494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2110f7d9-9f22-4241-bac2-7ad571821ffd tempest-AZAdminNegativeTestJSON-1810683531 tempest-AZAdminNegativeTestJSON-1810683531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:25.217708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2110f7d9-9f22-4241-bac2-7ad571821ffd tempest-AZAdminNegativeTestJSON-1810683531 tempest-AZAdminNegativeTestJSON-1810683531-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.418929 Sep 07 09:45:25.219444 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 145/321] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 09:45:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:45:25.486435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:25.486867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:25.487444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:25.488885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:25.489752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:25.490326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:25.514327 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1120f087-bff5-4a51-b7ba-7268d455362a tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c/detail" status: 200 len: 463 microversion: 2.57 time: 0.421459 Sep 07 09:45:25.525691 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 177/322] 10.222.0.60 () {60 vars in 1304 bytes} [Wed Sep 7 09:45:25 2022] GET /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c/detail => generated 463 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:25.776981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c544a16d-336e-42a9-9162-1b5d23a233d9 req-c5ddb70e-6d04-47d1-9e06-4aab8a2b23dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3597056-9689-447d-be91-becbca131e60", "name": "network-vif-plugged", "status": "completed", "tag": "a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:25.785503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:25.787942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:25.809433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:25.810052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:25.813331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:25.815235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:25.816291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:25.818425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:25.823659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c544a16d-336e-42a9-9162-1b5d23a233d9 req-c5ddb70e-6d04-47d1-9e06-4aab8a2b23dc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:25.824793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c544a16d-336e-42a9-9162-1b5d23a233d9 req-c5ddb70e-6d04-47d1-9e06-4aab8a2b23dc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:25.825464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c544a16d-336e-42a9-9162-1b5d23a233d9 req-c5ddb70e-6d04-47d1-9e06-4aab8a2b23dc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:25.856386 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c544a16d-336e-42a9-9162-1b5d23a233d9 req-c5ddb70e-6d04-47d1-9e06-4aab8a2b23dc service nova] Creating event network-vif-plugged:a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89 for instance d3597056-9689-447d-be91-becbca131e60 on n-h1-836830-16 Sep 07 09:45:25.870548 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c544a16d-336e-42a9-9162-1b5d23a233d9 req-c5ddb70e-6d04-47d1-9e06-4aab8a2b23dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095783 Sep 07 09:45:25.871057 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 146/323] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:26.010553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:26.060016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:26.073761 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9613519d-057a-41e9-ab40-15d499b8ea0d tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.294397 Sep 07 09:45:26.085206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 178/324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:25 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:26.105606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:26.106568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:26.114567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:26.115051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:26.115795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:26.116405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:26.116813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:26.117235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:26.276444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:26.287760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f295514-069d-4ea5-9faf-3e89f52c5be2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1311 microversion: 2.1 time: 0.186333 Sep 07 09:45:26.301810 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 179/325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:26 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:26.556538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1096814134", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:26.642660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:26.785568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Action: 'update', calling method: .version_select at 0x7f14b25b4a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:27.208031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:27.208534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:27.209393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:27.209928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:27.210341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:27.220994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.221504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.221933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.222915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.223919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.224505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.244837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Getting quotas for project 98fddf9336df4df884fbd1d79f4736cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:27.250930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Getting quotas for user a45a5949bf834f569db07ad668f99a82 and project 98fddf9336df4df884fbd1d79f4736cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:27.267180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:27.270472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:27.337807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.338995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.341859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.345033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.345625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.348242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.382283 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2068db89-e093-4b02-a9f8-3ce214ad11d3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376638 Sep 07 09:45:27.385749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 147/326] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:27.410175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:27.411287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:27.446608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.448031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.449278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.451334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.452169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.454093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.471895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.472392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.472824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.478398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.479083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.480552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.636652 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bbc14521-9629-4009-b757-91462c6150a6 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c?user_id=ca75f4ff164b4d70b7a23ee32b2563e8" status: 200 len: 148 microversion: 2.57 time: 0.861962 Sep 07 09:45:27.641448 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 180/327] 10.222.0.60 () {62 vars in 1384 bytes} [Wed Sep 7 09:45:26 2022] PUT /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c?user_id=ca75f4ff164b4d70b7a23ee32b2563e8 => generated 148 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:27.642613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:27.643255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:27.661960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.662540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.662992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.663718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:27.664169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:27.673697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:27.968210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:27.979471 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-af91498f-9c91-44d0-80b4-a473285cf24f tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.590944 Sep 07 09:45:27.981538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 148/328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:27 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:27.988499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-acc0fb8f-d5d9-4775-a223-a286d6f5be98 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] Calling method '.version_select at 0x7f14b25ef1f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:27.991765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:28.002067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34a3e307-2383-4554-b560-06b069fc805e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1495 microversion: 2.1 time: 0.363564 Sep 07 09:45:28.012778 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 181/329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:27 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:28.018996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1161980761", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:28.085079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:28.327882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:28.328301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:28.328822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:28.329353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:28.329927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:28.340478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:28.341104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:28.341464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:28.342231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:28.342724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:28.343954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:28.364425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Getting quotas for project 98fddf9336df4df884fbd1d79f4736cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:28.368709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Getting quotas for user a45a5949bf834f569db07ad668f99a82 and project 98fddf9336df4df884fbd1d79f4736cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:28.382478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:28.385004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:28.442796 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb4f792c-70bd-448f-b690-3fd99f4a561b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428633 Sep 07 09:45:28.443399 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 182/330] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:28.448688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a3423908-7193-4ff1-b2ff-2dab10183d8b req-da3c2741-b6ee-4f63-82eb-1c14b6b79666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f4354b-69e9-4ffa-8834-66f4d0f62e68", "name": "network-vif-plugged", "status": "completed", "tag": "bb3527f2-44b0-43dc-b00f-eb63a6ee7f10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:28.461423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a3423908-7193-4ff1-b2ff-2dab10183d8b req-da3c2741-b6ee-4f63-82eb-1c14b6b79666 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:28.462077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a3423908-7193-4ff1-b2ff-2dab10183d8b req-da3c2741-b6ee-4f63-82eb-1c14b6b79666 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:28.462836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a3423908-7193-4ff1-b2ff-2dab10183d8b req-da3c2741-b6ee-4f63-82eb-1c14b6b79666 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:28.477131 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a3423908-7193-4ff1-b2ff-2dab10183d8b req-da3c2741-b6ee-4f63-82eb-1c14b6b79666 service nova] Creating event network-vif-plugged:bb3527f2-44b0-43dc-b00f-eb63a6ee7f10 for instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 on n-h1-836830-16 Sep 07 09:45:28.482421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a3423908-7193-4ff1-b2ff-2dab10183d8b req-da3c2741-b6ee-4f63-82eb-1c14b6b79666 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037262 Sep 07 09:45:28.483384 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 183/331] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:28.602438 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-acc0fb8f-d5d9-4775-a223-a286d6f5be98 tempest-QuotasAdminTestV257-939579035 tempest-QuotasAdminTestV257-939579035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c?user_id=ca75f4ff164b4d70b7a23ee32b2563e8" status: 200 len: 190 microversion: 2.57 time: 0.619157 Sep 07 09:45:28.611417 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 149/332] 10.222.0.60 () {60 vars in 1364 bytes} [Wed Sep 7 09:45:27 2022] GET /compute/v2.1/os-quota-sets/1c70c533b7ff49a3af9ea64a9da3632c?user_id=ca75f4ff164b4d70b7a23ee32b2563e8 => generated 190 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:28.618990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e11878f-85c6-4d39-a408-b53b85993fb8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:28.619703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1e11878f-85c6-4d39-a408-b53b85993fb8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:28.747168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e11878f-85c6-4d39-a408-b53b85993fb8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:28.757680 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e11878f-85c6-4d39-a408-b53b85993fb8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1214 microversion: 2.1 time: 0.145123 Sep 07 09:45:28.759929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 150/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:28 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:28.833597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:28.834677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:28.844704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:28.845228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:28.845709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:28.846415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:28.846953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:28.847452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.008794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:29.009541 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93524c17-7bc8-470c-b0b2-bd36349073ab tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1648 microversion: 2.1 time: 0.524576 Sep 07 09:45:29.011040 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 184/334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:28 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1648 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:29.022088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:29.035625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.036574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.037797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.038787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.039642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:29.039917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.040495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:29.040769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.052674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.053210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.053655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.054362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.054826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.055833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.416604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:29.425104 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d84d5dec-3507-4475-a623-9367fabe23b2 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1319 microversion: 2.1 time: 0.420935 Sep 07 09:45:29.428766 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 151/335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:29 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:29.480411 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-11123a72-66c5-4b3e-a2c9-279419351454 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1648 microversion: 2.1 time: 0.448972 Sep 07 09:45:29.481725 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 185/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:29 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1648 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:29.503270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:29.508068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.508713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.509478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.510362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.511134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.511706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.537774 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7c6b119-d81f-4c4d-8143-6685f1206783 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.037876 Sep 07 09:45:29.538386 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 152/337] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:45:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:29.552158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:29.556346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:29.563396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.564078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.564547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.565261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.565970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.576420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.706222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lazy-loading 'flavor' on Instance uuid d3597056-9689-447d-be91-becbca131e60 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:29.785398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:29.786711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:29.801457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: d3597056-9689-447d-be91-becbca131e60] Going to try to live migrate instance to n-h2-836830-16 {{(pid=128832) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:45:29.806122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.807485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.808252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.809283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:29.809950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:29.810574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:29.926371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:29.939777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ee63318-5f6b-45e8-bd2d-b7dcd88d46c9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1266 microversion: 2.1 time: 0.160827 Sep 07 09:45:29.942701 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 153/338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:29 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:30.452344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:30.453853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:30.460999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:30.461710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:30.462431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:30.463465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:30.464130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:30.464875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:30.834128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:30.850750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d626d510-8a8f-47c8-a7b3-71e79a569440 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1469 microversion: 2.1 time: 0.402258 Sep 07 09:45:30.853436 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 154/339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:30 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1469 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:30.880333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:30.884840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:30.896600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:30.897510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:30.898202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:30.899180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:30.900075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:30.900763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:31.125488 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cc4b55b-dca0-4d09-8cc5-346b335c0426 tempest-DeleteServersAdminTestJSON-84839901 tempest-DeleteServersAdminTestJSON-84839901-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68/action" status: 202 len: 0 microversion: 2.1 time: 0.252407 Sep 07 09:45:31.126771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 155/340] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:45:30 2022] POST /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:45:31.135561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:31.136277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:31.144801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:31.146061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:31.146722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:31.147439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:31.147905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:31.148527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:31.243389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:31.253474 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5f83a04-fa60-411d-8ddc-95410e424a71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1272 microversion: 2.1 time: 0.125211 Sep 07 09:45:31.254055 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 156/341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:31 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:31.274074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:31.274707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:31.282580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:31.286199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:31.286847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:31.289043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:31.290977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:31.291675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:31.361980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:31.362613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:31.363216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:31.363818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lazy-loading 'fault' on Instance uuid 56f4354b-69e9-4ffa-8834-66f4d0f62e68 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:31.730536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:31.745138 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aabe9769-3e72-4cd8-b428-15b5758f60ee tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1452 microversion: 2.1 time: 0.481895 Sep 07 09:45:31.758066 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 157/342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:31 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1452 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:32.072743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Calling method '.version_select at 0x7f14b277c310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:32.074879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.078400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.079612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.110262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.111104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.111758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.123944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.124707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.125892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.133649 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ab4bd12-1cd8-45d0-a7a9-8b06eb6ce429 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.382438 Sep 07 09:45:32.135044 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 158/343] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 09:45:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:32.480779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f8f4efd-c209-4d8a-908d-04560ec6d977 tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] Calling method '.version_select at 0x7f14b26c0d30>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:32.494673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f8f4efd-c209-4d8a-908d-04560ec6d977 tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.358336 Sep 07 09:45:32.503776 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 159/344] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 09:45:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:32.508815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:32.509593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:32.517511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.518120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.518812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.519620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.520292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.520911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.556838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:45:32.714067 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1dd579ab-745a-47c7-a713-012f68624fe3 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 204 len: 0 microversion: 2.1 time: 0.208574 Sep 07 09:45:32.715490 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 160/345] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:45:32 2022] DELETE /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:45:32.724800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Calling method '.version_select at 0x7f14b26c0310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:32.727878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.728868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.729600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.745678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.747103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.747862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.757423 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e13d4ab9-8cc9-4c6b-8558-096217370229 tempest-HypervisorAdminV228Test-1252278842 tempest-HypervisorAdminV228Test-1252278842-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.038223 Sep 07 09:45:32.758889 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 161/346] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:45:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:32.765920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:32.767458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:32.775705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.776572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.777639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:32.778738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:32.779685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:32.781540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:33.388040 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b52f9c7-08fa-4f02-893e-c56a17cb674a tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60/action" status: 202 len: 0 microversion: 2.1 time: 3.840765 Sep 07 09:45:33.388916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 186/347] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:45:29 2022] POST /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60/action => generated 0 bytes in 3842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:45:33.396098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54710653-fc08-43fc-9779-fb417f22c94e tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] Action: 'update', calling method: .version_select at 0x7f14b3f2ff70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:33.435956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:33.473924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:33.489986 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-540af500-4f2b-40ac-9680-a3628764e228 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.729622 Sep 07 09:45:33.491491 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 162/348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:32 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:33.498474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:33.500413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:33.507269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:33.508062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:33.508854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:33.509877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:33.510780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:33.511466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:33.560197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:33.560854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:33.561504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:33.562927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lazy-loading 'fault' on Instance uuid 56f4354b-69e9-4ffa-8834-66f4d0f62e68 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:33.892933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:33.905034 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2789c3b-d7db-4526-b73b-e45def913f0e tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1458 microversion: 2.1 time: 0.412159 Sep 07 09:45:33.907652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 163/349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:33 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1458 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:33.952695 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54710653-fc08-43fc-9779-fb417f22c94e tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.561172 Sep 07 09:45:33.953888 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 187/350] 10.222.0.60 () {60 vars in 1206 bytes} [Wed Sep 7 09:45:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:33.967795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-01568a2e-bdfc-442a-9ad8-bd093e625373 req-fa286b17-7414-4b4e-9833-892d86eadb11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a1035a-aea9-42e8-a35d-1eb6768c666d", "tag": "494a8253-cb34-4c7c-a5e6-93a8372fb872"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:33.982451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-01568a2e-bdfc-442a-9ad8-bd093e625373 req-fa286b17-7414-4b4e-9833-892d86eadb11 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:33.984220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-01568a2e-bdfc-442a-9ad8-bd093e625373 req-fa286b17-7414-4b4e-9833-892d86eadb11 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:33.984941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-01568a2e-bdfc-442a-9ad8-bd093e625373 req-fa286b17-7414-4b4e-9833-892d86eadb11 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:34.002618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-01568a2e-bdfc-442a-9ad8-bd093e625373 req-fa286b17-7414-4b4e-9833-892d86eadb11 service nova] Creating event network-changed:494a8253-cb34-4c7c-a5e6-93a8372fb872 for instance f7a1035a-aea9-42e8-a35d-1eb6768c666d on n-h2-836830-16 Sep 07 09:45:34.012142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-01568a2e-bdfc-442a-9ad8-bd093e625373 req-fa286b17-7414-4b4e-9833-892d86eadb11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056173 Sep 07 09:45:34.014118 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 188/351] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:34.021357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:34.022955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:34.031356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:34.032397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:34.032872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:34.033745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:34.034422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:34.034942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:34.213795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15cf0cda-3bd0-44e3-baf8-7511631616cc tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-298875745", "ram": 512, "vcpus": 1, "disk": 10, "id": 2039072629, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:34.247270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15cf0cda-3bd0-44e3-baf8-7511631616cc tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.322192 Sep 07 09:45:34.247872 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 164/352] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:33 2022] POST /compute/v2.1/flavors => generated 415 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:34.254895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5301b225-f431-4493-9a2f-3d5af92d00f5 tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] Calling method '.version_select at 0x7f14b25200d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:34.274027 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5301b225-f431-4493-9a2f-3d5af92d00f5 tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.025069 Sep 07 09:45:34.275152 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 165/353] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 09:45:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:34.280829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce786c26-1db9-4bb3-ba27-aa3b62ff0c17 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:34.315170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:34.333527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fec3ea70-4a89-4464-b0f2-e31b3df57f86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.315477 Sep 07 09:45:34.335639 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 189/354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:34 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:34.341602 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce786c26-1db9-4bb3-ba27-aa3b62ff0c17 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065361 Sep 07 09:45:34.350622 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 166/355] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 7 09:45:34 2022] POST /compute/v2.1/flavors/2039072629/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:34.351445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-33907edf-63ae-4713-bca4-6687133d2437 tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] Action: 'update', calling method: .version_select at 0x7f14b22c69d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:34.571102 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-33907edf-63ae-4713-bca4-6687133d2437 tempest-QuotaClassesAdminTestJSON-939850467 tempest-QuotaClassesAdminTestJSON-939850467-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.231193 Sep 07 09:45:34.573701 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 190/356] 10.222.0.60 () {60 vars in 1206 bytes} [Wed Sep 7 09:45:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:34.586040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:34.586658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:34.601407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:34.603377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:34.603821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:34.605785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:34.606069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:34.606501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:34.687989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74f76491-b730-40c4-82f7-d94425928563 tempest-FlavorsExtraSpecsTestJSON-206401633 tempest-FlavorsExtraSpecsTestJSON-206401633-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:34.698949 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74f76491-b730-40c4-82f7-d94425928563 tempest-FlavorsExtraSpecsTestJSON-206401633 tempest-FlavorsExtraSpecsTestJSON-206401633-project] 10.222.0.60 "GET /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.343135 Sep 07 09:45:34.706456 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 167/357] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 7 09:45:34 2022] GET /compute/v2.1/flavors/2039072629/os-extra_specs => generated 66 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:34.913523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-185250e8-ea16-4052-bdc4-c2c025363f22 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:34.925792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:34.929657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-185250e8-ea16-4052-bdc4-c2c025363f22 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.228390 Sep 07 09:45:34.930867 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 168/358] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:34.944629 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-496ddb71-c4d1-4c86-bb1f-8e7206daf299 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.369801 Sep 07 09:45:34.945639 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 191/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:34 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:34.951016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-37f572d4-873e-4e3f-b3a4-937a60f264a9 req-783f95b4-fba3-462d-9d6e-fa827eb6779b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f4354b-69e9-4ffa-8834-66f4d0f62e68", "name": "network-vif-deleted", "tag": "bb3527f2-44b0-43dc-b00f-eb63a6ee7f10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:34.956059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd64d877-1e61-4209-9ff1-b2e919324ed5 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:34.973001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-37f572d4-873e-4e3f-b3a4-937a60f264a9 req-783f95b4-fba3-462d-9d6e-fa827eb6779b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:34.973773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-37f572d4-873e-4e3f-b3a4-937a60f264a9 req-783f95b4-fba3-462d-9d6e-fa827eb6779b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:34.974384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-37f572d4-873e-4e3f-b3a4-937a60f264a9 req-783f95b4-fba3-462d-9d6e-fa827eb6779b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:34.988316 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-37f572d4-873e-4e3f-b3a4-937a60f264a9 req-783f95b4-fba3-462d-9d6e-fa827eb6779b service nova] Creating event network-vif-deleted:bb3527f2-44b0-43dc-b00f-eb63a6ee7f10 for instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 on n-h1-836830-16 Sep 07 09:45:34.997086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-37f572d4-873e-4e3f-b3a4-937a60f264a9 req-783f95b4-fba3-462d-9d6e-fa827eb6779b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048482 Sep 07 09:45:34.997493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=3,nova_api:RELEASE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:35.001757 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 192/360] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:35.007440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.008400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:35.017417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:35.017417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:35.017417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:35.017417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:35.017715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:35.017798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:35.025755 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd64d877-1e61-4209-9ff1-b2e919324ed5 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093447 Sep 07 09:45:35.027680 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 169/361] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 7 09:45:34 2022] POST /compute/v2.1/flavors/2039072629/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.033731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d03da5cf-188b-445f-8143-4d9425d7a351 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.067594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:35.068764 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d03da5cf-188b-445f-8143-4d9425d7a351 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3312 microversion: 2.1 time: 0.039648 Sep 07 09:45:35.068883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:35.070052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:35.070450 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 170/362] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors => generated 3312 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.071791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lazy-loading 'fault' on Instance uuid 56f4354b-69e9-4ffa-8834-66f4d0f62e68 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:35.093319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d184c27-95c5-48af-836d-035768307b24 tempest-FlavorsExtraSpecsTestJSON-206401633 tempest-FlavorsExtraSpecsTestJSON-206401633-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.111400 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d184c27-95c5-48af-836d-035768307b24 tempest-FlavorsExtraSpecsTestJSON-206401633 tempest-FlavorsExtraSpecsTestJSON-206401633-project] 10.222.0.60 "GET /compute/v2.1/flavors/2039072629/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.038857 Sep 07 09:45:35.120209 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 171/363] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/2039072629/os-extra_specs/hw:numa_nodes => generated 22 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.128194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-927d097c-0f93-45d8-9f2a-81b86af037bc tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.141855 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-927d097c-0f93-45d8-9f2a-81b86af037bc tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020319 Sep 07 09:45:35.143008 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 172/364] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:35.148306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce1baa55-d82e-4996-9667-0023810d7a16 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:35.183019 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce1baa55-d82e-4996-9667-0023810d7a16 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037949 Sep 07 09:45:35.189510 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 173/365] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 7 09:45:35 2022] POST /compute/v2.1/flavors/2039072629/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.196831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ebf4c8a5-e11a-4b90-a68a-d4406283a338 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.226392 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ebf4c8a5-e11a-4b90-a68a-d4406283a338 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035473 Sep 07 09:45:35.227985 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 174/366] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:35.251825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fff9155d-3d42-43c7-823e-2f3e3b5a8c17 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.257608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc8442ea8c54bc699cc9c95b397fa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359cbb65f5314ea88e9d55f8a9c50e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:35.274842 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e935c433-73bf-4fb7-bea4-e05e4ae32e69 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 200 len: 1309 microversion: 2.1 time: 0.271715 Sep 07 09:45:35.277693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 193/367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.289159 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fff9155d-3d42-43c7-823e-2f3e3b5a8c17 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059343 Sep 07 09:45:35.296347 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 175/368] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/2039072629/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.301116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6a740f8-3473-44eb-b221-f537a56a65f8 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.304133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-656e7302-546f-49c0-a9b3-7ea51b38fd91 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:35.344373 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-656e7302-546f-49c0-a9b3-7ea51b38fd91 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/2039072629/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.045727 Sep 07 09:45:35.351040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 176/369] 10.222.0.60 () {60 vars in 1265 bytes} [Wed Sep 7 09:45:35 2022] PUT /compute/v2.1/flavors/2039072629/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.358180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63e544ed-126b-48bf-8899-9f9458f6a320 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.367406 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6a740f8-3473-44eb-b221-f537a56a65f8 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3614 microversion: 2.1 time: 0.086831 Sep 07 09:45:35.367898 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 194/370] 10.222.0.60 () {58 vars in 1165 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.371851 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-63e544ed-126b-48bf-8899-9f9458f6a320 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019118 Sep 07 09:45:35.372554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.372995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 177/371] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/2039072629/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.373221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:35.376867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=65,nova_api:UPDATE=23 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:35.384727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84933742-8a36-4d24-b391-929f70326f99 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.388495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:35.388987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:35.389459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:35.390213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:35.390689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:35.391098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:35.451986 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84933742-8a36-4d24-b391-929f70326f99 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2039072629/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.072140 Sep 07 09:45:35.452964 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 178/372] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 09:45:35 2022] DELETE /compute/v2.1/flavors/2039072629/os-extra_specs/hw:numa_nodes => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:35.458195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b334fb15-8b12-4d4a-9162-2852a897e8af tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.468751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b334fb15-8b12-4d4a-9162-2852a897e8af tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014359 Sep 07 09:45:35.477568 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 179/373] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:35.484853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d9bfd68-52df-4712-8c3d-2ef1ad3f3299 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.518546 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d9bfd68-52df-4712-8c3d-2ef1ad3f3299 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2039072629/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.038706 Sep 07 09:45:35.520600 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 180/374] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 09:45:35 2022] DELETE /compute/v2.1/flavors/2039072629/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 09:45:35.526386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e4c43d6-6af6-4e97-bb09-e3b26b0ec3fc tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.633774 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e4c43d6-6af6-4e97-bb09-e3b26b0ec3fc tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.111623 Sep 07 09:45:35.649483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 181/375] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.656633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c64e6d0e-f771-4f64-a16d-ee9112dbfe9b tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.666743 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c64e6d0e-f771-4f64-a16d-ee9112dbfe9b tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2039072629/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015525 Sep 07 09:45:35.674050 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 182/376] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/2039072629/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:35.680775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0fd6f31e-3aa1-4a8a-9eae-1dcf588895ec tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.700179 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0fd6f31e-3aa1-4a8a-9eae-1dcf588895ec tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.024975 Sep 07 09:45:35.701599 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 183/377] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:35.708453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-64163936-ad80-4971-98c1-725a22579819 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.736017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-64163936-ad80-4971-98c1-725a22579819 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2039072629" status: 202 len: 0 microversion: 2.1 time: 0.032364 Sep 07 09:45:35.742783 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 184/378] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:45:35 2022] DELETE /compute/v2.1/flavors/2039072629 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:45:35.751230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-23c7bc39-2047-4e78-b88f-a32420fe6337 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.763103 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-23c7bc39-2047-4e78-b88f-a32420fe6337 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019130 Sep 07 09:45:35.763654 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 185/379] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:35.769849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5bf914bc-72a0-4a75-a892-6f49b77f3ae1 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.796496 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5bf914bc-72a0-4a75-a892-6f49b77f3ae1 tempest-FlavorsExtraSpecsTestJSON-480989294 tempest-FlavorsExtraSpecsTestJSON-480989294-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029008 Sep 07 09:45:35.805993 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 186/380] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.828255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d59862f-abb3-4a5d-8f15-78bd12cfcafe tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.891240 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d59862f-abb3-4a5d-8f15-78bd12cfcafe tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.083760 Sep 07 09:45:35.894595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 187/381] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.904026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:35.909322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b619d882-06eb-4e98-af79-cff634bbc914 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.918794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-014a2135-8215-411a-8734-59486448d135 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.549719 Sep 07 09:45:35.929714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b619d882-06eb-4e98-af79-cff634bbc914 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023291 Sep 07 09:45:35.929714 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 188/382] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:35.930554 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 195/383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:35.955522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dafd6c9e-8d1f-4c18-9528-1babe0436807 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.975067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:35.976070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:35.992544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:35.993522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:35.995558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:35.998025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.001643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.002944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.034643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dafd6c9e-8d1f-4c18-9528-1babe0436807 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.084874 Sep 07 09:45:36.036297 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 189/384] 10.222.0.60 () {58 vars in 1144 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:36.059470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a11fc94f-536d-4bbd-9d90-3d4a86a95b7a tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.075209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a11fc94f-536d-4bbd-9d90-3d4a86a95b7a tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024881 Sep 07 09:45:36.084897 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 190/385] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:36.090710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-727eff53-e1c3-4351-b017-19c469c603f7 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.111777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-727eff53-e1c3-4351-b017-19c469c603f7 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.024918 Sep 07 09:45:36.121597 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 191/386] 10.222.0.60 () {58 vars in 1148 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:36.127681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3a227f9e-a4b0-4644-9e93-882c514106c2 req-5b75215d-d31d-4301-b706-b6a05f75c9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e050121-8471-48dd-9127-29dffb0c37c2", "tag": "36ccbe9d-1ce8-4a89-a3b2-bd620fa8c21c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:36.140831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3a227f9e-a4b0-4644-9e93-882c514106c2 req-5b75215d-d31d-4301-b706-b6a05f75c9c6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.141599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3a227f9e-a4b0-4644-9e93-882c514106c2 req-5b75215d-d31d-4301-b706-b6a05f75c9c6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.142280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3a227f9e-a4b0-4644-9e93-882c514106c2 req-5b75215d-d31d-4301-b706-b6a05f75c9c6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.149999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:36.160541 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3a227f9e-a4b0-4644-9e93-882c514106c2 req-5b75215d-d31d-4301-b706-b6a05f75c9c6 service nova] Creating event network-changed:36ccbe9d-1ce8-4a89-a3b2-bd620fa8c21c for instance 7e050121-8471-48dd-9127-29dffb0c37c2 on n-h2-836830-16 Sep 07 09:45:36.167428 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3a227f9e-a4b0-4644-9e93-882c514106c2 req-5b75215d-d31d-4301-b706-b6a05f75c9c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043652 Sep 07 09:45:36.168123 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 192/387] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:36.174760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ee5222c-5369-4b69-8225-d538cab3491a tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.192289 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ee5222c-5369-4b69-8225-d538cab3491a tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022416 Sep 07 09:45:36.198851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 193/388] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:36.206443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1ad9d31a-e86c-4fa2-9c1a-327c9651f732 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.215740 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1ad9d31a-e86c-4fa2-9c1a-327c9651f732 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013592 Sep 07 09:45:36.217061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 194/389] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:36.229920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c533725-1a4d-4794-aba7-e919f483a71d tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.257478 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c533725-1a4d-4794-aba7-e919f483a71d tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.031043 Sep 07 09:45:36.268241 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 195/390] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:36.274132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b24c8b45-6a7d-4d7b-9380-1102f456e20b tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.322622 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b24c8b45-6a7d-4d7b-9380-1102f456e20b tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.052542 Sep 07 09:45:36.337987 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 196/391] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:36.360834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.362558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:36.374615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.375537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.376361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.377380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.378045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.378730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.396218 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] HTTP exception thrown: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Request method failure captured: Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 HTTP/1.1 Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuciMZPOwO2ohvsFh9G_XPKcjX3LYDusr2ct5cQP2vMdJcyyh8ChP29Cy-Afn892hJa5q1w5IG1ClFRWzn_JvQF-WitKbQzUCU7SQrswpLsPvn7ThV7cqcGghVXNVKASl1vfLSNLQjAPs5_nDcla8XLpHqzLRS_6KTZ6zWTk4fOWk Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:36.398274 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_359cbb65f5314ea88e9d55f8a9c50e2a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6dc8442ea8c54bc699cc9c95b397fa18 Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.399573 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '56f4354b-69e9-4ffa-8834-66f4d0f62e68'} Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:36.400233 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.401677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.404016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Returning 404 to user: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:36.404016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7fc5f35-2e83-4210-ba0b-e56242e9d4fc tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 404 len: 111 microversion: 2.1 time: 0.060456 Sep 07 09:45:36.404016 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 197/392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:36.408201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adb0c900-3335-4aa7-9520-687763dabeb7 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.423675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:36.434411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adb0c900-3335-4aa7-9520-687763dabeb7 tempest-FlavorsV2TestJSON-449108015 tempest-FlavorsV2TestJSON-449108015-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031455 Sep 07 09:45:36.438504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ff852716-0ec8-4309-a419-7c7ed0460ea8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.463542 Sep 07 09:45:36.439348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 196/393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:35 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:36.445846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.449833 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 198/394] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:36.451245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:36.464080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.464487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.465411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.466232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.466891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.467463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.488128 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] HTTP exception thrown: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Request method failure captured: Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 HTTP/1.1 Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfuciMZPOwO2ohvsFh9G_XPKcjX3LYDusr2ct5cQP2vMdJcyyh8ChP29Cy-Afn892hJa5q1w5IG1ClFRWzn_JvQF-WitKbQzUCU7SQrswpLsPvn7ThV7cqcGghVXNVKASl1vfLSNLQjAPs5_nDcla8XLpHqzLRS_6KTZ6zWTk4fOWk Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:36.490666 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_359cbb65f5314ea88e9d55f8a9c50e2a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6dc8442ea8c54bc699cc9c95b397fa18 Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.491816 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '56f4354b-69e9-4ffa-8834-66f4d0f62e68'} Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:36.492452 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.493516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.494542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Returning 404 to user: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:36.494542 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-90fc17fa-25ae-44e8-afa2-34afab325621 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 404 len: 111 microversion: 2.1 time: 0.050377 Sep 07 09:45:36.494542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 197/395] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:45:36 2022] DELETE /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:36.503243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.503961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 56f4354b-69e9-4ffa-8834-66f4d0f62e68] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:36.507038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:RELEASE=7,nova_api:SAVEPOINT=6,nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:36.517987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.518758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.519363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.520631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.521168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.521691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.543568 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] HTTP exception thrown: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Request method failure captured: Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 HTTP/1.1 Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuciMZPOwO2ohvsFh9G_XPKcjX3LYDusr2ct5cQP2vMdJcyyh8ChP29Cy-Afn892hJa5q1w5IG1ClFRWzn_JvQF-WitKbQzUCU7SQrswpLsPvn7ThV7cqcGghVXNVKASl1vfLSNLQjAPs5_nDcla8XLpHqzLRS_6KTZ6zWTk4fOWk Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:36.546833 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_359cbb65f5314ea88e9d55f8a9c50e2a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6dc8442ea8c54bc699cc9c95b397fa18 Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.548227 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '56f4354b-69e9-4ffa-8834-66f4d0f62e68'} Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:36.548870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. Sep 07 09:45:36.550939 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.552115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Returning 404 to user: Instance 56f4354b-69e9-4ffa-8834-66f4d0f62e68 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:36.552115 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b581e2e1-0db3-4594-a128-215d2e9d1974 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68" status: 404 len: 111 microversion: 2.1 time: 0.051227 Sep 07 09:45:36.552115 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 199/396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/servers/56f4354b-69e9-4ffa-8834-66f4d0f62e68 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:45:36.557104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.558540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:36.565762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.566341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.567131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.568413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.569313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.570248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.586921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:36.589243 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] HTTP exception thrown: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Request method failure captured: Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 HTTP/1.1 Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfuciMZPOwO2ohvsFh9G_XPKcjX3LYDusr2ct5cQP2vMdJcyyh8ChP29Cy-Afn892hJa5q1w5IG1ClFRWzn_JvQF-WitKbQzUCU7SQrswpLsPvn7ThV7cqcGghVXNVKASl1vfLSNLQjAPs5_nDcla8XLpHqzLRS_6KTZ6zWTk4fOWk Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:36.591521 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_359cbb65f5314ea88e9d55f8a9c50e2a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6dc8442ea8c54bc699cc9c95b397fa18 Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.593890 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3033c013-aee0-4d0c-9235-930e2a3e37b5'} Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:36.594811 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.596034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.598655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Returning 404 to user: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:36.599685 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9569c9d7-0abe-4675-a605-9202cc92a47b tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 404 len: 111 microversion: 2.1 time: 0.046323 Sep 07 09:45:36.600503 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 198/397] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:45:36 2022] DELETE /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:45:36.613842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.614554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] [instance: 3033c013-aee0-4d0c-9235-930e2a3e37b5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:36.633070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.634175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.635086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.635777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.636240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.636975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.665662 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] HTTP exception thrown: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Request method failure captured: Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 HTTP/1.1 Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfuciMZPOwO2ohvsFh9G_XPKcjX3LYDusr2ct5cQP2vMdJcyyh8ChP29Cy-Afn892hJa5q1w5IG1ClFRWzn_JvQF-WitKbQzUCU7SQrswpLsPvn7ThV7cqcGghVXNVKASl1vfLSNLQjAPs5_nDcla8XLpHqzLRS_6KTZ6zWTk4fOWk Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:36.667250 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/359cbb65f5314ea88e9d55f8a9c50e2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_359cbb65f5314ea88e9d55f8a9c50e2a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 359cbb65f5314ea88e9d55f8a9c50e2a Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-361050762 Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6dc8442ea8c54bc699cc9c95b397fa18 Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersAdminTestJSON-361050762-project Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.668458 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3033c013-aee0-4d0c-9235-930e2a3e37b5'} Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:36.669144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. Sep 07 09:45:36.670245 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:36.671766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] Returning 404 to user: Instance 3033c013-aee0-4d0c-9235-930e2a3e37b5 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:36.671766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-187f5cbc-fd67-4ffc-83ba-293391893a53 tempest-DeleteServersAdminTestJSON-361050762 tempest-DeleteServersAdminTestJSON-361050762-project] 10.222.0.60 "GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5" status: 404 len: 111 microversion: 2.1 time: 0.060766 Sep 07 09:45:36.673485 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 200/398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/servers/3033c013-aee0-4d0c-9235-930e2a3e37b5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:45:36.956632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:36.958436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:36.965618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.966377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.967036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:36.968373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:36.969196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:36.969707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:37.146237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:37.159325 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5b82059-0b03-4a8c-b0c6-2d050245de26 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.208070 Sep 07 09:45:37.165111 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 199/399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:36 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:37.470823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:37.472709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:37.481550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:37.482457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:37.483912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:37.485320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:37.487169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:37.487952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:37.728064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-91550b46-f5f1-4cc6-b88a-b43b6676c8f6 req-35f9ba13-4c8f-498b-8eb6-682150a883c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3597056-9689-447d-be91-becbca131e60", "name": "network-vif-unplugged", "status": "completed", "tag": "a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:37.744015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-91550b46-f5f1-4cc6-b88a-b43b6676c8f6 req-35f9ba13-4c8f-498b-8eb6-682150a883c7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:37.744895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-91550b46-f5f1-4cc6-b88a-b43b6676c8f6 req-35f9ba13-4c8f-498b-8eb6-682150a883c7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:37.747016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-91550b46-f5f1-4cc6-b88a-b43b6676c8f6 req-35f9ba13-4c8f-498b-8eb6-682150a883c7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:37.769238 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-91550b46-f5f1-4cc6-b88a-b43b6676c8f6 req-35f9ba13-4c8f-498b-8eb6-682150a883c7 service nova] Creating event network-vif-unplugged:a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89 for instance d3597056-9689-447d-be91-becbca131e60 on n-h1-836830-16 Sep 07 09:45:37.776907 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-91550b46-f5f1-4cc6-b88a-b43b6676c8f6 req-35f9ba13-4c8f-498b-8eb6-682150a883c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053061 Sep 07 09:45:37.778415 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 200/400] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:37.905959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:37.918645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3be6ccd2-60a9-496d-9b34-1b5e77050a94 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.454272 Sep 07 09:45:37.935641 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 201/401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:37 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:38.184391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:38.185145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:38.200454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:38.202527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:38.203980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:38.205852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:38.206616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:38.208352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:38.355331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=17 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:38.737943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-635267000", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:38.833261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:38.850439 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dca71fd0-63f7-4bf3-bbf6-686b5c4fa89c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.668200 Sep 07 09:45:38.852843 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:38 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:38.886004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:38.950765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:38.951791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:38.967464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:38.972089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:38.973884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:38.976243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:38.979150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:38.979938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:39.270183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:39.271240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:39.272164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:39.272729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:39.273169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:39.273900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:39.287234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:39.287403 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5370b2d0-a8fd-4780-9742-93b6e986e8e2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.342616 Sep 07 09:45:39.288103 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 202/403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:38 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:39.304204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:39.305167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:39.306334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:39.307021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:39.307763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:39.326396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Getting quotas for project 31b79aaa1fd84b87a90dc4eb387d728a. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:39.331617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Getting quotas for user e742bd4e77da4afbbfe6e5b83d7d1391 and project 31b79aaa1fd84b87a90dc4eb387d728a. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:39.344418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:39.346871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:39.392530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1ca8126c-0269-4d48-be20-ec419a2a2405 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903646 Sep 07 09:45:39.393546 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 202/404] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:39.408064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23e69d00-8fdb-4eda-b221-9c0d56ae4324 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:39.409092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23e69d00-8fdb-4eda-b221-9c0d56ae4324 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:39.490589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23e69d00-8fdb-4eda-b221-9c0d56ae4324 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:39.499367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23e69d00-8fdb-4eda-b221-9c0d56ae4324 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1218 microversion: 2.1 time: 0.096153 Sep 07 09:45:39.515921 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 203/405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:39 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:39.812721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-72db4838-5bb7-47fa-b8e9-f08cdea3a139 req-ebe9cae8-0e7d-4008-a203-eb2633b260a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3597056-9689-447d-be91-becbca131e60", "tag": "a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:39.836701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-72db4838-5bb7-47fa-b8e9-f08cdea3a139 req-ebe9cae8-0e7d-4008-a203-eb2633b260a5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:39.837227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-72db4838-5bb7-47fa-b8e9-f08cdea3a139 req-ebe9cae8-0e7d-4008-a203-eb2633b260a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:39.838347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-72db4838-5bb7-47fa-b8e9-f08cdea3a139 req-ebe9cae8-0e7d-4008-a203-eb2633b260a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:39.868752 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-72db4838-5bb7-47fa-b8e9-f08cdea3a139 req-ebe9cae8-0e7d-4008-a203-eb2633b260a5 service nova] Creating event network-changed:a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89 for instance d3597056-9689-447d-be91-becbca131e60 on n-h1-836830-16 Sep 07 09:45:39.883271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:39.885162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:39.895753 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-72db4838-5bb7-47fa-b8e9-f08cdea3a139 req-ebe9cae8-0e7d-4008-a203-eb2633b260a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086630 Sep 07 09:45:39.896520 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 203/406] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:39.897027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:39.898105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:39.898804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:39.899795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:39.900466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:39.901514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:40.121540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:40.131590 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-80cb6e44-40d4-4476-8661-2108b6b00a69 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.252018 Sep 07 09:45:40.133545 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:39 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:40.312394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:40.313469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:40.324436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:40.325305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:40.325953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:40.327342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:40.328002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:40.328869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:40.524353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:40.524970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:40.541398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:40.542694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:40.543887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:40.544747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:40.545408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:40.547107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:40.651906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:40.667078 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-996133d0-3744-41ce-af6d-433bd1fa7805 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.357850 Sep 07 09:45:40.669763 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 204/408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:40 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:40.688076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:40.696668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6281a4ec-7bfa-432c-9ddf-7f018cb84adc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1270 microversion: 2.1 time: 0.176130 Sep 07 09:45:40.697358 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 205/409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:40 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:41.045066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-45b7ec2a-5a68-424f-b5bc-013d45601a9f req-516f84e6-6a6d-4402-9e53-6a685df66cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a1035a-aea9-42e8-a35d-1eb6768c666d", "name": "network-vif-plugged", "status": "completed", "tag": "494a8253-cb34-4c7c-a5e6-93a8372fb872"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:41.081078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-45b7ec2a-5a68-424f-b5bc-013d45601a9f req-516f84e6-6a6d-4402-9e53-6a685df66cc3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.081807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-45b7ec2a-5a68-424f-b5bc-013d45601a9f req-516f84e6-6a6d-4402-9e53-6a685df66cc3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.082304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-45b7ec2a-5a68-424f-b5bc-013d45601a9f req-516f84e6-6a6d-4402-9e53-6a685df66cc3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:41.108027 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-45b7ec2a-5a68-424f-b5bc-013d45601a9f req-516f84e6-6a6d-4402-9e53-6a685df66cc3 service nova] Creating event network-vif-plugged:494a8253-cb34-4c7c-a5e6-93a8372fb872 for instance f7a1035a-aea9-42e8-a35d-1eb6768c666d on n-h2-836830-16 Sep 07 09:45:41.117033 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-45b7ec2a-5a68-424f-b5bc-013d45601a9f req-516f84e6-6a6d-4402-9e53-6a685df66cc3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076851 Sep 07 09:45:41.118335 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 205/410] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:41.156224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:41.157101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:41.194630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.196059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.198707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:41.199611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.200314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.203526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:41.500835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:41.509274 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a0eb5f55-704b-4121-be6d-e334fef00590 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.357547 Sep 07 09:45:41.519555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 206/411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:41 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:41.697200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:41.698735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:41.706243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.707037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.707836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:41.708955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.709659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.710291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:41.902630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:41.912496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cffc323e-884d-4aa3-8994-857f590f490a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.219483 Sep 07 09:45:41.914616 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 207/412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:41 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:41.919821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:41.920489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:41.927330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.928051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.928764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:41.929641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:41.930175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:41.930674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.012086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:42.021767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f39fd8ec-a650-406b-87fa-cb4e16125e38 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1276 microversion: 2.1 time: 0.105929 Sep 07 09:45:42.022200 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 208/413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:41 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:42.067626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bfbb5d0-b21a-447a-9bc8-415363189eba tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Calling method '.version_select at 0x7f14b24a5280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:42.103912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0bfbb5d0-b21a-447a-9bc8-415363189eba tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] HTTP exception thrown: Image not found. Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bfbb5d0-b21a-447a-9bc8-415363189eba tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Request method failure captured: Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/b93e4ec4-4105-4a7e-9b8b-f0658e62d2a5/metadata/os_distro HTTP/1.1 Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhFqsgYdJLEbFyQOtwl2D2QFkqwnFnqY1PDPEZxVo2byo6rz0Whk_OB6RVfwicJ1AvgJZ-1hRECzvnlCBcan4yDAcx428iGqSksWDOZjFc-8A4vtQxrjG1eN1-XjyuqMmuocYQw4wMZnyK6ojQwbXZTErHK_8ole0bepxI8NbS76GQ Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:42.116751 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d87db068e7494f60809c531e93896267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d87db068e7494f60809c531e93896267", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0adf53d014f0491ab9cd671b31647b6b Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'image_id': 'b93e4ec4-4105-4a7e-9b8b-f0658e62d2a5', 'id': 'os_distro'} Sep 07 09:45:42.118355 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.119174 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b93e4ec4-4105-4a7e-9b8b-f0658e62d2a5 Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.120143 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b93e4ec4-4105-4a7e-9b8b-f0658e62d2a5 could not be found. Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:42.121212 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.122225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bfbb5d0-b21a-447a-9bc8-415363189eba tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:42.124226 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0bfbb5d0-b21a-447a-9bc8-415363189eba tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] 10.222.0.60 "DELETE /compute/v2.1/images/b93e4ec4-4105-4a7e-9b8b-f0658e62d2a5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.452547 Sep 07 09:45:42.124226 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 206/414] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 7 09:45:41 2022] DELETE /compute/v2.1/images/b93e4ec4-4105-4a7e-9b8b-f0658e62d2a5/metadata/os_distro => generated 62 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:42.141858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35918caa-fc97-4dc7-896b-2f5f400cf038 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Calling method '.version_select at 0x7f14b235fe50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:42.175150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-35918caa-fc97-4dc7-896b-2f5f400cf038 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] HTTP exception thrown: Image not found. Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35918caa-fc97-4dc7-896b-2f5f400cf038 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Request method failure captured: Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/images/8cc42953-9f00-41aa-830d-542222bf0ba0/metadata/os_version HTTP/1.1 Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGhFqsgYdJLEbFyQOtwl2D2QFkqwnFnqY1PDPEZxVo2byo6rz0Whk_OB6RVfwicJ1AvgJZ-1hRECzvnlCBcan4yDAcx428iGqSksWDOZjFc-8A4vtQxrjG1eN1-XjyuqMmuocYQw4wMZnyK6ojQwbXZTErHK_8ole0bepxI8NbS76GQ Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:42.183255 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d87db068e7494f60809c531e93896267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d87db068e7494f60809c531e93896267", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0adf53d014f0491ab9cd671b31647b6b Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'image_id': '8cc42953-9f00-41aa-830d-542222bf0ba0', 'id': 'os_version'} Sep 07 09:45:42.184748 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.185559 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8cc42953-9f00-41aa-830d-542222bf0ba0 Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.186548 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cc42953-9f00-41aa-830d-542222bf0ba0 could not be found. Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:42.187887 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.191002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35918caa-fc97-4dc7-896b-2f5f400cf038 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:42.193532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35918caa-fc97-4dc7-896b-2f5f400cf038 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] 10.222.0.60 "GET /compute/v2.1/images/8cc42953-9f00-41aa-830d-542222bf0ba0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.056675 Sep 07 09:45:42.193532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 209/415] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 7 09:45:42 2022] GET /compute/v2.1/images/8cc42953-9f00-41aa-830d-542222bf0ba0/metadata/os_version => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:42.196343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-563b0639-5602-43fc-a514-ae8f83bd066b tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Calling method '.version_select at 0x7f14b2798280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:42.241889 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-563b0639-5602-43fc-a514-ae8f83bd066b tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] HTTP exception thrown: Image not found. Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-563b0639-5602-43fc-a514-ae8f83bd066b tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Request method failure captured: Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/images/4520807f-ccc4-4efb-863d-5fa1fb135eb6/metadata HTTP/1.1 Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhFqsgYdJLEbFyQOtwl2D2QFkqwnFnqY1PDPEZxVo2byo6rz0Whk_OB6RVfwicJ1AvgJZ-1hRECzvnlCBcan4yDAcx428iGqSksWDOZjFc-8A4vtQxrjG1eN1-XjyuqMmuocYQw4wMZnyK6ojQwbXZTErHK_8ole0bepxI8NbS76GQ Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:42.244419 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d87db068e7494f60809c531e93896267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d87db068e7494f60809c531e93896267", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0adf53d014f0491ab9cd671b31647b6b Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'image_id': '4520807f-ccc4-4efb-863d-5fa1fb135eb6'} Sep 07 09:45:42.245636 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.246353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4520807f-ccc4-4efb-863d-5fa1fb135eb6 Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.247329 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4520807f-ccc4-4efb-863d-5fa1fb135eb6 could not be found. Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:42.248404 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.251035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-563b0639-5602-43fc-a514-ae8f83bd066b tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:42.259813 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-563b0639-5602-43fc-a514-ae8f83bd066b tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] 10.222.0.60 "GET /compute/v2.1/images/4520807f-ccc4-4efb-863d-5fa1fb135eb6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059324 Sep 07 09:45:42.259813 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 207/416] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:45:42 2022] GET /compute/v2.1/images/4520807f-ccc4-4efb-863d-5fa1fb135eb6/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:42.262100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a5cb11d-7f03-42de-905d-09ea568295eb tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Action: 'update_all', calling method: .version_select at 0x7f14b22d6700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:42.303290 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9a5cb11d-7f03-42de-905d-09ea568295eb tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] HTTP exception thrown: Image not found. Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a5cb11d-7f03-42de-905d-09ea568295eb tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Request method failure captured: Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/images/edadd7fb-378f-487b-bd7d-3701ed12009c/metadata HTTP/1.1 Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 57 Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGhFqsgYdJLEbFyQOtwl2D2QFkqwnFnqY1PDPEZxVo2byo6rz0Whk_OB6RVfwicJ1AvgJZ-1hRECzvnlCBcan4yDAcx428iGqSksWDOZjFc-8A4vtQxrjG1eN1-XjyuqMmuocYQw4wMZnyK6ojQwbXZTErHK_8ole0bepxI8NbS76GQ Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:42.305401 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d87db068e7494f60809c531e93896267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d87db068e7494f60809c531e93896267", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0adf53d014f0491ab9cd671b31647b6b Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:42.306903 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'image_id': 'edadd7fb-378f-487b-bd7d-3701ed12009c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.307854 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID edadd7fb-378f-487b-bd7d-3701ed12009c Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.309111 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image edadd7fb-378f-487b-bd7d-3701ed12009c could not be found. Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:42.310316 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:45:42.312193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.315143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a5cb11d-7f03-42de-905d-09ea568295eb tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:42.315143 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a5cb11d-7f03-42de-905d-09ea568295eb tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] 10.222.0.60 "PUT /compute/v2.1/images/edadd7fb-378f-487b-bd7d-3701ed12009c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049153 Sep 07 09:45:42.317495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4266a7f4-f156-417b-be9b-c5ca254378db tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Action: 'update', calling method: .version_select at 0x7f14b2ae93a0>, body: {"meta": {"os_distro": "alt"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:42.321461 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 210/417] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:45:42 2022] PUT /compute/v2.1/images/edadd7fb-378f-487b-bd7d-3701ed12009c/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:42.343704 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4266a7f4-f156-417b-be9b-c5ca254378db tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] HTTP exception thrown: Image not found. Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4266a7f4-f156-417b-be9b-c5ca254378db tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Request method failure captured: Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/images/da49cb6e-a5e2-4396-b2a6-5e6edf99cf1b/metadata/os_distro HTTP/1.1 Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 30 Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhFqsgYdJLEbFyQOtwl2D2QFkqwnFnqY1PDPEZxVo2byo6rz0Whk_OB6RVfwicJ1AvgJZ-1hRECzvnlCBcan4yDAcx428iGqSksWDOZjFc-8A4vtQxrjG1eN1-XjyuqMmuocYQw4wMZnyK6ojQwbXZTErHK_8ole0bepxI8NbS76GQ Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:45:42.345842 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d87db068e7494f60809c531e93896267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d87db068e7494f60809c531e93896267", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0adf53d014f0491ab9cd671b31647b6b Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: {"meta": {"os_distro": "alt"}} Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:45:42.347025 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'image_id': 'da49cb6e-a5e2-4396-b2a6-5e6edf99cf1b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.347779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da49cb6e-a5e2-4396-b2a6-5e6edf99cf1b Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.348721 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da49cb6e-a5e2-4396-b2a6-5e6edf99cf1b could not be found. Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:42.349727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:45:42.353894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.356680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4266a7f4-f156-417b-be9b-c5ca254378db tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:42.356680 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4266a7f4-f156-417b-be9b-c5ca254378db tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] 10.222.0.60 "PUT /compute/v2.1/images/da49cb6e-a5e2-4396-b2a6-5e6edf99cf1b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.033936 Sep 07 09:45:42.356680 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 208/418] 10.222.0.60 () {60 vars in 1310 bytes} [Wed Sep 7 09:45:42 2022] PUT /compute/v2.1/images/da49cb6e-a5e2-4396-b2a6-5e6edf99cf1b/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 09:45:42.357325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c146a78-c619-43fb-abb8-a7f00cb8c476 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Action: 'create', calling method: .version_select at 0x7f14b2308c10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:42.384968 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-0c146a78-c619-43fb-abb8-a7f00cb8c476 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] HTTP exception thrown: Image not found. Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c146a78-c619-43fb-abb8-a7f00cb8c476 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Request method failure captured: Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/images/06545af0-bf0a-46e5-b6ee-07c085dd14bd/metadata HTTP/1.1 Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 57 Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGhFqsgYdJLEbFyQOtwl2D2QFkqwnFnqY1PDPEZxVo2byo6rz0Whk_OB6RVfwicJ1AvgJZ-1hRECzvnlCBcan4yDAcx428iGqSksWDOZjFc-8A4vtQxrjG1eN1-XjyuqMmuocYQw4wMZnyK6ojQwbXZTErHK_8ole0bepxI8NbS76GQ Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:45:42.387704 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d87db068e7494f60809c531e93896267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d87db068e7494f60809c531e93896267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d87db068e7494f60809c531e93896267", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d87db068e7494f60809c531e93896267 Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781 Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0adf53d014f0491ab9cd671b31647b6b Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1480268781-project Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:45:42.388879 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'image_id': '06545af0-bf0a-46e5-b6ee-07c085dd14bd', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.390310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 06545af0-bf0a-46e5-b6ee-07c085dd14bd Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:45:42.391289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06545af0-bf0a-46e5-b6ee-07c085dd14bd could not be found. Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:42.392281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:45:42.396385 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:45:42.398865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c146a78-c619-43fb-abb8-a7f00cb8c476 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:42.398865 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0c146a78-c619-43fb-abb8-a7f00cb8c476 tempest-ImagesMetadataNegativeTestJSON-1480268781 tempest-ImagesMetadataNegativeTestJSON-1480268781-project] 10.222.0.60 "POST /compute/v2.1/images/06545af0-bf0a-46e5-b6ee-07c085dd14bd/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035832 Sep 07 09:45:42.398865 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 211/419] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Sep 7 09:45:42 2022] POST /compute/v2.1/images/06545af0-bf0a-46e5-b6ee-07c085dd14bd/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:45:42.534959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:42.535938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:42.543845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:42.548275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:42.550511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.551766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:42.556220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:42.557614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.739989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-918705059", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:42.830435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:42.841213 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b5e02f0-7426-4bfe-8e48-135472eedb8e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.310027 Sep 07 09:45:42.841896 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 212/420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:42 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:42.878002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:42.878669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:42.879928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:42.880702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:42.881853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:42.895880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:42.896555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:42.908246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.909533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:42.910344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:42.911134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.937347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:42.938254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:42.946398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:42.947121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:42.947737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.948623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:42.949400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:42.950020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:42.963635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Getting quotas for project 4d912b9879b74199836cfc6599505fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:42.974754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Getting quotas for user 81b3bf03c00a4fae8f80f718a7d01303 and project 4d912b9879b74199836cfc6599505fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:43.009694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:43.012743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:43.080042 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02c4842f-6c75-414f-b9e5-2ccfda2e8ebe tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.669202 Sep 07 09:45:43.086402 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 209/421] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:45:43.098177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:43.100102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:43.126959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.130081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.130990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.131964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.132438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.132975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.315321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:43.329876 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3f7235de-6ee6-4522-ba02-0eff90944f84 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.396584 Sep 07 09:45:43.332907 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 213/422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:42 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:43.339256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-739a57a1-db3f-44c6-9923-ffc2d07f1e6e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:43.339865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-739a57a1-db3f-44c6-9923-ffc2d07f1e6e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:43.458595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-739a57a1-db3f-44c6-9923-ffc2d07f1e6e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:43.470071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-739a57a1-db3f-44c6-9923-ffc2d07f1e6e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:43.471535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-739a57a1-db3f-44c6-9923-ffc2d07f1e6e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:43.474211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:43.484326 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-739a57a1-db3f-44c6-9923-ffc2d07f1e6e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1452 microversion: 2.91 time: 0.147760 Sep 07 09:45:43.485727 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 214/423] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:43 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:43.487459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c84b4971-56d5-45a6-b00e-5227c9adb5af tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1318 microversion: 2.1 time: 0.399396 Sep 07 09:45:43.490775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-238974df-b3a8-4ed1-ac32-9415be309807 req-2329eed0-e423-4007-a492-e1bb29dd9afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e050121-8471-48dd-9127-29dffb0c37c2", "name": "network-vif-plugged", "status": "completed", "tag": "36ccbe9d-1ce8-4a89-a3b2-bd620fa8c21c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:43.501831 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 210/424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:43 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:43.503985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-238974df-b3a8-4ed1-ac32-9415be309807 req-2329eed0-e423-4007-a492-e1bb29dd9afa service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.504804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-238974df-b3a8-4ed1-ac32-9415be309807 req-2329eed0-e423-4007-a492-e1bb29dd9afa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.505789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-238974df-b3a8-4ed1-ac32-9415be309807 req-2329eed0-e423-4007-a492-e1bb29dd9afa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.533318 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-238974df-b3a8-4ed1-ac32-9415be309807 req-2329eed0-e423-4007-a492-e1bb29dd9afa service nova] Creating event network-vif-plugged:36ccbe9d-1ce8-4a89-a3b2-bd620fa8c21c for instance 7e050121-8471-48dd-9127-29dffb0c37c2 on n-h2-836830-16 Sep 07 09:45:43.542953 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-238974df-b3a8-4ed1-ac32-9415be309807 req-2329eed0-e423-4007-a492-e1bb29dd9afa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055784 Sep 07 09:45:43.547070 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 215/425] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:43.698150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c5864783-b3f4-4fb3-bdf9-f368b41cde78 req-0da65cf8-3803-4094-b166-78db7747a9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4990dbd-4309-446a-acd2-2095737e7a98", "tag": "1a84e9e8-16c3-4037-90f2-e08f2b360094"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:43.714618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c5864783-b3f4-4fb3-bdf9-f368b41cde78 req-0da65cf8-3803-4094-b166-78db7747a9fc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.717215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c5864783-b3f4-4fb3-bdf9-f368b41cde78 req-0da65cf8-3803-4094-b166-78db7747a9fc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.717722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c5864783-b3f4-4fb3-bdf9-f368b41cde78 req-0da65cf8-3803-4094-b166-78db7747a9fc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.745463 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c5864783-b3f4-4fb3-bdf9-f368b41cde78 req-0da65cf8-3803-4094-b166-78db7747a9fc service nova] Creating event network-changed:1a84e9e8-16c3-4037-90f2-e08f2b360094 for instance e4990dbd-4309-446a-acd2-2095737e7a98 on n-h1-836830-16 Sep 07 09:45:43.754954 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c5864783-b3f4-4fb3-bdf9-f368b41cde78 req-0da65cf8-3803-4094-b166-78db7747a9fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060565 Sep 07 09:45:43.755571 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 216/426] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:43.825132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Calling method '.version_select at 0x7f14b2534790>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:43.829910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.830317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.832479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.862346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.863548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.869446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.899601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.900261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.901682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.909568 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d434d87b-3991-4065-b7d8-6ad72366ffa8 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.405833 Sep 07 09:45:43.910599 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 211/427] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:43.919669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:43.920338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:43.927297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.927779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.928209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.928898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.929382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.929802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:43.956478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97b66141-1631-4ea1-905c-d107d5e6ebb9 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1639181580", "id": 666457676, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:43.979718 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-97b66141-1631-4ea1-905c-d107d5e6ebb9 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.133461 Sep 07 09:45:43.979718 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 217/428] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:43 2022] POST /compute/v2.1/flavors => generated 428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:43.992888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Calling method '.version_select at 0x7f14b226ea60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:43.994604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:43.995125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:43.995542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.025681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.026473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.027120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.052764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.053616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.054522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.061781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-abbb1802-3713-40d5-848e-481b07e16219 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h1-836830-16/servers" status: 200 len: 276 microversion: 2.1 time: 0.080772 Sep 07 09:45:44.063291 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 218/429] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 7 09:45:43 2022] GET /compute/v2.1/os-hypervisors/n-h1-836830-16/servers => generated 276 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:44.069057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c6349d4-d9cc-404a-8a9a-bd1a6ee2bdea tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3f1d97c7edf6411293bd147944b4c05d"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:44.087078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:44.099278 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8eaed49-b0cc-4095-b114-7979d298e2b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.187639 Sep 07 09:45:44.101929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 212/430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:43 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:44.109095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Calling method '.version_select at 0x7f14b27985e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.110956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.111598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.112205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.129811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.130312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.130753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.143032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.143710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.143957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.151269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e3b230f-8f5b-4a2c-9cb5-67e12f513d49 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.047851 Sep 07 09:45:44.152240 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 213/431] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:44.163140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Calling method '.version_select at 0x7f14b260d3a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.164862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.165535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.166005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.167785 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c6349d4-d9cc-404a-8a9a-bd1a6ee2bdea tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/666457676/action" status: 200 len: 96 microversion: 2.1 time: 0.102941 Sep 07 09:45:44.174752 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 219/432] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 7 09:45:44 2022] POST /compute/v2.1/flavors/666457676/action => generated 96 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:45:44.189575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.190044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.190558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.199719 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82322dac-d9dd-47ab-ac51-b5b5408ac168 tempest-HypervisorAdminUnderV252Test-1043768014 tempest-HypervisorAdminUnderV252Test-1043768014-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h1-836830-16/search" status: 200 len: 105 microversion: 2.1 time: 0.040215 Sep 07 09:45:44.208016 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 214/433] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-836830-16/search => generated 105 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:45:44.333276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-770a20ca-ef02-4dca-a394-5e471a3ca599 tempest-FlavorsAccessTestJSON-162653253 tempest-FlavorsAccessTestJSON-162653253-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.355459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.356539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:44.363640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.364723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.365418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.366544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.367215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.367903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.405730 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-770a20ca-ef02-4dca-a394-5e471a3ca599 tempest-FlavorsAccessTestJSON-162653253 tempest-FlavorsAccessTestJSON-162653253-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.228459 Sep 07 09:45:44.422201 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 220/434] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:44.433243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5a7422b-52d8-4170-bad3-17e36bba5ddc tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3f1d97c7edf6411293bd147944b4c05d"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:44.583467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:44.591141 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a80fd457-360a-4e8f-8e0c-25c152a094d4 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.239811 Sep 07 09:45:44.591711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 215/435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:44.610997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.611612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:44.618245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.618807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.619478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.620500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.620976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.621580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.650234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:45:44.752924 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1dc11083-a751-4ce3-9bf4-46a189ef7103 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 204 len: 0 microversion: 2.1 time: 0.145358 Sep 07 09:45:44.754275 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 216/436] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:45:44 2022] DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:45:44.760244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.761280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:44.770166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.771009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.771728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.772758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.773442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.774155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.894423 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5a7422b-52d8-4170-bad3-17e36bba5ddc tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/666457676/action" status: 200 len: 21 microversion: 2.1 time: 0.468286 Sep 07 09:45:44.900911 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 221/437] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 7 09:45:44 2022] POST /compute/v2.1/flavors/666457676/action => generated 21 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 09:45:44.907470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:44.908413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:44.919873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.922367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.922367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.924619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:44.925647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:44.927617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:44.966586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:44.978912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70878e4c-f416-4fec-86db-8ab0ad156146 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1318 microversion: 2.1 time: 0.222992 Sep 07 09:45:44.994128 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 217/438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:45.001147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2da488a-a28c-4b14-a94d-65d6eeb5c1e3 tempest-FlavorsAccessTestJSON-162653253 tempest-FlavorsAccessTestJSON-162653253-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.039797 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2da488a-a28c-4b14-a94d-65d6eeb5c1e3 tempest-FlavorsAccessTestJSON-162653253 tempest-FlavorsAccessTestJSON-162653253-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.044318 Sep 07 09:45:45.040729 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 218/439] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:45.048351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1278766092", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "1893678355", "adminPass": "***", "networks": [{"uuid": "75603bbf-d70d-46c6-b38e-3838df43a5ba"}], "security_groups": [{"name": "tempest-securitygroup--307234388"}], "key_name": "tempest-keypair-1509564207", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:45.083201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:45.093715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:45.095329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:45.101520 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92f607b7-4aaf-4aec-9544-e17244c52d9d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1512 microversion: 2.91 time: 0.199431 Sep 07 09:45:45.102691 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 222/440] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:44 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:45.116468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25122c80-c79c-4e08-bf71-dc618677dea8 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.159039 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25122c80-c79c-4e08-bf71-dc618677dea8 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/666457676" status: 202 len: 0 microversion: 2.1 time: 0.048025 Sep 07 09:45:45.160581 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 223/441] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:45:45 2022] DELETE /compute/v2.1/flavors/666457676 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:45:45.167273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.168341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:45.183525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:45.184557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:45.185239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:45.188764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:45.189476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:45.191310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:45.216503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] validate_networks() for [('75603bbf-d70d-46c6-b38e-3838df43a5ba', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:45.455843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:45.463781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60c5feab-7802-4fcf-a4f9-e47741be1f22 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.301219 Sep 07 09:45:45.464363 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 224/442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:45 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:45.475538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e94af028-1d18-4c92-96fe-56f4c20b35a4 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.532153 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e94af028-1d18-4c92-96fe-56f4c20b35a4 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.060091 Sep 07 09:45:45.533104 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 225/443] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:45 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:45.557383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5666b111-aafa-4204-b12c-2fb3d2963430 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-556539353", "id": 2108736878, "os-flavor-access:is_public": "False"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:45.583508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5666b111-aafa-4204-b12c-2fb3d2963430 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.030370 Sep 07 09:45:45.589247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 226/444] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:45 2022] POST /compute/v2.1/flavors => generated 430 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:45.600636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ade2914e-6a89-4d8e-9cb4-c29b71f96a5b tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.614550 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ade2914e-6a89-4d8e-9cb4-c29b71f96a5b tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2108736878/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021936 Sep 07 09:45:45.615486 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 227/445] 10.222.0.60 () {58 vars in 1209 bytes} [Wed Sep 7 09:45:45 2022] GET /compute/v2.1/flavors/2108736878/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 09:45:45.631050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.632868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:45.641712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:45.642375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:45.642697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:45.643461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:45.643921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:45.644639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:45.883978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:45.898071 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba8e0895-4df0-4802-8464-868783138408 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1314 microversion: 2.1 time: 0.279417 Sep 07 09:45:45.913209 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 228/446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:45 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:45.919425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb9b03db-87f6-4ed1-b374-42cead5d3125 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.924454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:45.924878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:45.925979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:45.926564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:45.926986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:45.941228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:45.943839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:45.944288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:45.945046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:45.945676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:45.946108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:45.952575 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb9b03db-87f6-4ed1-b374-42cead5d3125 tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2108736878" status: 202 len: 0 microversion: 2.1 time: 0.051289 Sep 07 09:45:45.962995 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 229/447] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:45:45 2022] DELETE /compute/v2.1/flavors/2108736878 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:45:45.970106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Getting quotas for project c90fba56c62e4660ae559b2649e2c801. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:45.976006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70c64dcc-d62c-4cf9-af16-2f3e3f9aa27a tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:45.977491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Getting quotas for user ce0e6192cec344439361da0019175b24 and project c90fba56c62e4660ae559b2649e2c801. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:45.995454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:45.998159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:46.006172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70c64dcc-d62c-4cf9-af16-2f3e3f9aa27a tempest-FlavorsAccessTestJSON-98584779 tempest-FlavorsAccessTestJSON-98584779-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041696 Sep 07 09:45:46.007844 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 230/448] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:45:45 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:46.012710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:46.013348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:46.017336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:46.021595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.022084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.022683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.023390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.023844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.024264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.084699 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ee13903-1444-4599-a514-65b081d6b6ca tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.042699 Sep 07 09:45:46.089359 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 219/449] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:46.098273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90a6a846-f9f3-4ebb-a056-eca3e6a9052d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:46.099178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-90a6a846-f9f3-4ebb-a056-eca3e6a9052d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:46.257703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-90a6a846-f9f3-4ebb-a056-eca3e6a9052d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:46.267738 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90a6a846-f9f3-4ebb-a056-eca3e6a9052d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1265 microversion: 2.1 time: 0.173772 Sep 07 09:45:46.282221 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 220/450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:46 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:46.290071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:46.291129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:46.318059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.318889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.319554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.320709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.321460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.322062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.417590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:46.430216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4639db20-3c8c-4283-9a31-b6afe7828db6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1318 microversion: 2.1 time: 0.421302 Sep 07 09:45:46.431191 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 231/451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:46 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:46.490915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:46.491531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:46.516306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.516793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.517258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.517965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.533966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.534830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.541880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:46.567396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:46.584188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:46.587186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:46.609080 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc9e951c-5d09-445a-b53c-8f990a19db13 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1510 microversion: 2.91 time: 0.325487 Sep 07 09:45:46.609724 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 221/452] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:46 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:46.739587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:46.762515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d6cea36-984e-4e7e-9e47-847cf43d1cbc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.276027 Sep 07 09:45:46.782809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 232/453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:46 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:45:46.925736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:46.926522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:46.937914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.938662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.939296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:46.940239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:46.940842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:46.941740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.299008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:47.300131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:47.312237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.313070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.314042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.315146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.315843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.317030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.386635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:47.398638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61d83898-5bb1-455d-a7fa-c070f9f213d9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1464 microversion: 2.1 time: 0.479206 Sep 07 09:45:47.418296 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 222/454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:46 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1464 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:47.427043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:47.428100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:47.431639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:47.440900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.442114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.442874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.443863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.444646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.445647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.476619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:47.521743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:47.543140 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d388aece-2cc8-4396-85a0-86f0be11158d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1317 microversion: 2.1 time: 0.248757 Sep 07 09:45:47.548034 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 233/455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:47 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:47.554597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:47.574292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:47.590896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.594156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.598142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.599161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.601417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.602057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.791973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:47.807405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e62031f-6c9c-46d5-84c9-32691169d250 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1464 microversion: 2.1 time: 0.379341 Sep 07 09:45:47.808560 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 223/456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:47 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1464 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:47.836473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:47.837790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:47.871253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.871760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.872200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:47.880257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:47.886384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:47.887135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:48.253083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:48.263414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:48.270786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:48.284005 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9b7f31c0-3d9a-45a4-b27b-d528215f21da tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1510 microversion: 2.91 time: 0.474086 Sep 07 09:45:48.285469 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 224/457] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:47 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:48.297356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:48.298325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:48.323223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:48.326273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:48.327671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:48.329048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:48.330031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:48.331059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:48.520461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:48.534708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d8fe585-a5e5-4d0b-b3f8-9b0359ab389a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1318 microversion: 2.1 time: 0.984921 Sep 07 09:45:48.554160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 234/458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:47 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1318 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:48.560221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-481962650", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f7a1035a-aea9-42e8-a35d-1eb6768c666d"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:48.628144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:48.858904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:48.868768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8eb03135-5042-4816-82e3-c122e594cd53 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.581140 Sep 07 09:45:48.869756 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 225/459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:48 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:48.876097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:48.876961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:48.884461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:48.885393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:48.886058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:48.886986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:48.887639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:48.888282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.018410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:49.046030 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f74996e-1604-409d-9013-c1d0dd4cf4ff tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1323 microversion: 2.1 time: 0.158255 Sep 07 09:45:49.049687 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 226/460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:48 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:49.317232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:49.318198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:49.332081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:49.332938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:49.333346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.334844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:49.335619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:49.336190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.612416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:49.613848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:49.614689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:49.615338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:49.621604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:49.662420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:49.684184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:49.689300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:49.712219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52054178-9f4a-4a1e-8d10-50f89d5b4fe1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1531 microversion: 2.91 time: 0.399107 Sep 07 09:45:49.714790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:49.717082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:49.719073 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 227/461] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:49 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1531 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:45:49.731308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:49.732107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:49.741023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.744074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:49.752122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:49.752795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.761726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:49.762371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:49.763117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.765047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:49.767172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:49.767943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:49.782618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Getting quotas for project 98fddf9336df4df884fbd1d79f4736cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:49.790643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Getting quotas for user a45a5949bf834f569db07ad668f99a82 and project 98fddf9336df4df884fbd1d79f4736cf. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:49.827997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:49.836458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:49.986452 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1edfcc07-04c8-475e-a638-2208ae4a877b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430875 Sep 07 09:45:49.990905 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 235/462] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:50.600026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:50.600844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:50.612879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:50.616022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:50.619876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:50.623245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:50.626439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:50.627150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:51.437154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:51.449154 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3da7801-aa83-4b7e-be16-3b15e95a6519 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1318 microversion: 2.1 time: 1.728750 Sep 07 09:45:51.453069 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 228/463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:49 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1318 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:51.469448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c88960ba-c42a-4f53-86b3-5eaf6839a583 req-6725632d-54ee-42d7-8921-1b114cb6c06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69eab25-a71c-4dc7-96d1-a63e4174a056", "name": "network-vif-deleted", "tag": "7c8afa77-b537-4e28-b5c7-81b3d3cc3906"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:51.512103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lazy-loading 'services' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:51.516266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c88960ba-c42a-4f53-86b3-5eaf6839a583 req-6725632d-54ee-42d7-8921-1b114cb6c06b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:51.516870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c88960ba-c42a-4f53-86b3-5eaf6839a583 req-6725632d-54ee-42d7-8921-1b114cb6c06b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:51.517720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c88960ba-c42a-4f53-86b3-5eaf6839a583 req-6725632d-54ee-42d7-8921-1b114cb6c06b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:51.556911 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c88960ba-c42a-4f53-86b3-5eaf6839a583 req-6725632d-54ee-42d7-8921-1b114cb6c06b service nova] Creating event network-vif-deleted:7c8afa77-b537-4e28-b5c7-81b3d3cc3906 for instance d69eab25-a71c-4dc7-96d1-a63e4174a056 on n-h2-836830-16 Sep 07 09:45:51.568666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c88960ba-c42a-4f53-86b3-5eaf6839a583 req-6725632d-54ee-42d7-8921-1b114cb6c06b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114014 Sep 07 09:45:51.569900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 229/464] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:51.580418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:51.584932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:51.599473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:51.599975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:51.600415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:51.601125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:51.601610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:51.602015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:51.659002 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f3e3462-cc4a-4274-aa14-d9d993137443 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1938 microversion: 2.91 time: 1.665796 Sep 07 09:45:51.685701 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 236/465] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:49 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1938 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:51.692188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:51.693443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:51.701280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:51.702202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:51.702797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:51.704126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:51.705058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:51.705671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.038212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:52.046126 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-571938d7-147d-4f2c-9156-9966d1affcdd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1265 microversion: 2.1 time: 0.358225 Sep 07 09:45:52.046853 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 237/466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:51 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:52.059704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:52.065681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:52.096611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.097304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.097768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.098693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.099812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.100548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.413255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:52.427516 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ecc19ed-c29f-40f9-b0ed-ccbafc53c4a8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1323 microversion: 2.1 time: 0.379534 Sep 07 09:45:52.430518 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 238/467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:52 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:52.442852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-bfbf684a-4d50-4549-b22a-9f731029808c req-8f7ee575-095f-4f3f-ba92-61d5a65592a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4990dbd-4309-446a-acd2-2095737e7a98", "name": "network-vif-plugged", "status": "completed", "tag": "1a84e9e8-16c3-4037-90f2-e08f2b360094"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:52.477765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfbf684a-4d50-4549-b22a-9f731029808c req-8f7ee575-095f-4f3f-ba92-61d5a65592a6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.479931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfbf684a-4d50-4549-b22a-9f731029808c req-8f7ee575-095f-4f3f-ba92-61d5a65592a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.482140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfbf684a-4d50-4549-b22a-9f731029808c req-8f7ee575-095f-4f3f-ba92-61d5a65592a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.524353 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-bfbf684a-4d50-4549-b22a-9f731029808c req-8f7ee575-095f-4f3f-ba92-61d5a65592a6 service nova] Creating event network-vif-plugged:1a84e9e8-16c3-4037-90f2-e08f2b360094 for instance e4990dbd-4309-446a-acd2-2095737e7a98 on n-h1-836830-16 Sep 07 09:45:52.535825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-bfbf684a-4d50-4549-b22a-9f731029808c req-8f7ee575-095f-4f3f-ba92-61d5a65592a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101043 Sep 07 09:45:52.536624 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 239/468] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:52.537986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:52.564222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:52.566166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:52.566288 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3217679d-da02-4ca9-a6fb-efd9adaf694a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1505 microversion: 2.1 time: 0.991912 Sep 07 09:45:52.569981 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 230/469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:51 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1505 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:52.594057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:52.594998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:52.602771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.603415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.604128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.605846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.606847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.613563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.615174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.616851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.617603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:52.658027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:52.660484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:52.661125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.113926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lazy-loading 'services' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:53.141091 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb292a22-28cb-48a4-9b2b-45dc90bba4ba tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1938 microversion: 2.91 time: 0.601152 Sep 07 09:45:53.142615 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 240/470] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:52 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1938 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:53.151440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:53.152679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:53.163110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.165824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.167497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.170223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.172340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.173008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.432976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:53.446717 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3ec06ca7-ec1f-40ad-8edf-f591a7725984 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1271 microversion: 2.1 time: 0.302407 Sep 07 09:45:53.447576 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 241/471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:53 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:53.453914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:53.458081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.458797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.459467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.460421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.461249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.462058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.499630 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5cebe4f-e3bb-411b-99b2-ccc3cdda59f8 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.050106 Sep 07 09:45:53.509457 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 242/472] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 7 09:45:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:53.617494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:53.625928 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-522998cc-403e-4ded-a18e-234430ff943a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1318 microversion: 2.1 time: 1.054195 Sep 07 09:45:53.626503 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 231/473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:52 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1318 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:53.644152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:53.647815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:53.659481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.659984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.666840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.667639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.668298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.668619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.788244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f3afefa-9275-47d3-844f-b5d4cfe5dd0e tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Action: 'create', calling method: .version_select at 0x7f14b21a6ee0>, body: {"keypair": {"name": "tempest-keypair-1718197017", "type": "ssh", "user_id": "5d556fc875a546c298d1c0284c2f308f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArZm2jTHfcbi7mRzAUaJCBHJufDizTLwxOLem9Z0/6CpYDAU/xP4KC1kS939u8YcG1CKN4kAQrHaPcwMX2WJfba3ir8TWACrPXaQ41VRNuhIwi4BdBtTgAeCtQrINtVhg=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:53.839213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=79,nova_cell0:UPDATE=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:53.843627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4f3afefa-9275-47d3-844f-b5d4cfe5dd0e tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Getting quotas for project 0fc4cb963aaa4d1f9a9130a3ca06e873. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:53.865232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4f3afefa-9275-47d3-844f-b5d4cfe5dd0e tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Getting quotas for user b6e50861e6584a878acfec8b5f91c8fe and project 0fc4cb963aaa4d1f9a9130a3ca06e873. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:53.930459 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f3afefa-9275-47d3-844f-b5d4cfe5dd0e tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.419803 Sep 07 09:45:53.931918 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 243/474] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:45:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 422 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:45:53.937279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:53.943305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:53.957676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.958171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.958608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:53.959312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:53.959765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:53.960190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:54.081989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lazy-loading 'flavor' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:54.605135 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-32339e9c-c02c-437b-9b69-118455937b27 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action" status: 202 len: 0 microversion: 2.91 time: 0.671964 Sep 07 09:45:54.606795 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 244/475] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:45:53 2022] POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:45:54.613303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:54.614259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:54.622774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:54.624225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:54.625163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:54.626652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:54.627282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:54.627860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:54.895546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:54.916568 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-426f0a63-8175-4eaf-9449-ef96e687d98a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 1.282820 Sep 07 09:45:54.922953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 232/476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:53 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:54.932870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4c0e95c1-4f54-4147-b539-19ae4e919f6c tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Action: 'create', calling method: .version_select at 0x7f14b2534b80>, body: {"keypair": {"name": "tempest-keypair-1221302223", "type": "ssh", "user_id": "5d556fc875a546c298d1c0284c2f308f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6mrgKF4BFmQ9IKCprHCEo9yhwf8BDsDYSemhJWKC93IHaI0KOpkq/W1UAh+RX1att0ezMtiZ/s90rxnwMCMNvqE4vVg/WcxAZx95Yk36BJlXceyuDK9dGme/9np3K1qQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:54.970906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=37 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:54.975264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4c0e95c1-4f54-4147-b539-19ae4e919f6c tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Getting quotas for project 0fc4cb963aaa4d1f9a9130a3ca06e873. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:54.981565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4c0e95c1-4f54-4147-b539-19ae4e919f6c tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Getting quotas for user b6e50861e6584a878acfec8b5f91c8fe and project 0fc4cb963aaa4d1f9a9130a3ca06e873. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:55.015770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4c0e95c1-4f54-4147-b539-19ae4e919f6c tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.090271 Sep 07 09:45:55.021263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 233/477] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:45:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:45:55.028608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:55.029391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:55.040240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.040796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.041484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.042301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.042996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.043560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.211385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:55.220680 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9014a15-d163-4454-b425-bbccdd136ac3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1495 microversion: 2.1 time: 0.612427 Sep 07 09:45:55.221394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 245/478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:54 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1495 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:55.226689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:55.227607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:55.234296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.235016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.235717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.236560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.237145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.237897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.281372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:55.291051 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b40fd84-514a-491b-b70e-775bcb291883 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1271 microversion: 2.1 time: 0.272431 Sep 07 09:45:55.291734 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 234/479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:55 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:55.296494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:55.297389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:55.304596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.305415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.306039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.307591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.308543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.309161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.504506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:55.520577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:55.522080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:55.534278 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f7155a39-825b-49b6-8e4f-6182e1def008 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.311339 Sep 07 09:45:55.535275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 246/480] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:55 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:55.549917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac47d1c6-b8c8-4d78-ab80-ddf39a3eb162 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Calling method '.version_select at 0x7f14b235fc10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:55.572546 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac47d1c6-b8c8-4d78-ab80-ddf39a3eb162 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1718197017?user_id=5d556fc875a546c298d1c0284c2f308f" status: 200 len: 512 microversion: 2.10 time: 0.030529 Sep 07 09:45:55.573581 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 247/481] 10.222.0.60 () {60 vars in 1340 bytes} [Wed Sep 7 09:45:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1718197017?user_id=5d556fc875a546c298d1c0284c2f308f => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:55.578868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6776eab0-ecfa-48ec-acf2-9b504c6d63b4 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '.version_select at 0x7f14b226e430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:55.582481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6776eab0-ecfa-48ec-acf2-9b504c6d63b4 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.583136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6776eab0-ecfa-48ec-acf2-9b504c6d63b4 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.584925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6776eab0-ecfa-48ec-acf2-9b504c6d63b4 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.602019 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6776eab0-ecfa-48ec-acf2-9b504c6d63b4 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.026999 Sep 07 09:45:55.603304 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 248/482] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:45:55 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:55.609570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87c66d47-e9ed-4a04-9852-a565c89b0e50 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Action: 'create', calling method: .version_select at 0x7f14b22c61f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-796862363", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+/4T05MI89hFHcvBd5Nm0gHHvB3DnOE0BOfaslx4c7jdhVIgHMuDlqB2n8LILc4kx3KFAYoY0tkGZrvUS1LKU2H5gyiX/BMZybFSXwDGAxiRLYYBLAlxYQzyQ2Q2S/PQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:55.629712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-87c66d47-e9ed-4a04-9852-a565c89b0e50 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Getting quotas for project 0fc4cb963aaa4d1f9a9130a3ca06e873. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:55.637587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-87c66d47-e9ed-4a04-9852-a565c89b0e50 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Getting quotas for user b6e50861e6584a878acfec8b5f91c8fe and project 0fc4cb963aaa4d1f9a9130a3ca06e873. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:55.667374 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87c66d47-e9ed-4a04-9852-a565c89b0e50 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.062511 Sep 07 09:45:55.674109 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 249/483] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:45:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:45:55.674417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:55.675004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:55.681904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.682750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.682959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.684104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:55.684595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:55.687624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:55.956549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:56.307361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:56.329779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0d50cf8-2825-4829-a540-5a57d0492681 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1468 microversion: 2.1 time: 1.035849 Sep 07 09:45:56.365575 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 235/484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:55 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1468 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:56.377963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0dfb2db4-5877-4d19-90ec-8abf39d74b58 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Calling method '.version_select at 0x7f14b2411430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:56.391040 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1a1f4da-8f7f-433e-877f-2e243ea87cce tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1648 microversion: 2.1 time: 0.721530 Sep 07 09:45:56.391245 n-d-836830-16 devstack@n-api.service[128833]: WARNING oslo_db.sqlalchemy.utils [None req-0dfb2db4-5877-4d19-90ec-8abf39d74b58 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 09:45:56.408704 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 250/485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:55 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1648 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:56.423707 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0dfb2db4-5877-4d19-90ec-8abf39d74b58 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs?user_id=5d556fc875a546c298d1c0284c2f308f" status: 200 len: 726 microversion: 2.10 time: 0.056916 Sep 07 09:45:56.430782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 236/486] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 7 09:45:56 2022] GET /compute/v2.1/os-keypairs?user_id=5d556fc875a546c298d1c0284c2f308f => generated 726 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:45:56.440139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:56.440347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:56.440347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:56.461166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:56.461998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:56.462652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:56.463860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:56.464485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:56.467017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:56.476629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:56.491817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:56.506399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:56.507168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:56.510310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:56.511139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:56.511746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:57.221779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:57.228985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:57.234788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:57.246777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d3ccfc88-e6f9-48fd-ab78-c9464c02546d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.814830 Sep 07 09:45:57.250689 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 237/487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:56 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:57.260711 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b38c70b0-4d09-41f2-ae99-df7d41cff4b9 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 0.837259 Sep 07 09:45:57.273868 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 251/488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:56 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:57.282085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40f55615-c558-4c70-a3b7-fc5b5e394f07 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Calling method '.version_select at 0x7f14b22d6d30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:57.330612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40f55615-c558-4c70-a3b7-fc5b5e394f07 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-796862363" status: 204 len: 0 microversion: 2.10 time: 0.064052 Sep 07 09:45:57.334075 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 252/489] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Sep 7 09:45:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-796862363 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:45:57.346354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:57.346979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:57.361595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:57.362249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:57.362832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:57.363822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:57.364385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:57.365084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:57.475071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1656397870", "block_migration": true, "disk_over_commit": false}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:57.477929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:57.485627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:57.486123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:57.486748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:57.488133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:57.488797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:57.489586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:57.546060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:57.561729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:57.563502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:57.580323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2d1255ae-8473-4c39-be9d-f53c9f0afb37 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.243918 Sep 07 09:45:57.580924 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 253/490] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:45:57 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:45:57.597097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2027027831", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "6eb86d04-a25b-47cd-8f75-34e1365a0fe3"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:57.625398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lazy-loading 'flavor' on Instance uuid e4990dbd-4309-446a-acd2-2095737e7a98 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:45:57.704167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Going to try to live migrate instance to tempest-host-1656397870 {{(pid=128833) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:45:57.706624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] validate_networks() for [('6eb86d04-a25b-47cd-8f75-34e1365a0fe3', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:45:57.723543 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] HTTP exception thrown: Compute host tempest-host-1656397870 could not be found. Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Request method failure captured: Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98/action HTTP/1.1 Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 107 Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhCMZ11tg_NzcPqh5Nf1eOQ6Qb4QHVCVXZb4B83rdrhTvZTQA8U5NzEE_TU_vQPzECq3RyOaKZXrbPCOWHBlOCXJjm1HkO_RV6ezixZdPW7X7Lc52pNziKRNgByz8EbA2YYvCbA3qw-eLlJ-WRmjorsIY3mZrH2k3gDniORyJWBffE Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8856610e50754e0e90d6c769422e961e Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveMigrationNegativeTest-1636162516 Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:45:57.734389 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8856610e50754e0e90d6c769422e961e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8856610e50754e0e90d6c769422e961e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8856610e50754e0e90d6c769422e961e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8856610e50754e0e90d6c769422e961e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveMigrationNegativeTest-1636162516 Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8856610e50754e0e90d6c769422e961e Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1636162516 Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveMigrationNegativeTest-1636162516-project-admin Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2b9c4a801b1944238fdffb5bcfff095c Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveMigrationNegativeTest-1636162516-project-admin Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: {"os-migrateLive": {"host": "tempest-host-1656397870", "block_migration": true, "disk_over_commit": false}} Sep 07 09:45:57.735832 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: exception: Compute host tempest-host-1656397870 could not be found. Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e4990dbd-4309-446a-acd2-2095737e7a98', 'body': {'os-migrateLive': {'host': 'tempest-host-1656397870', 'block_migration': True, 'disk_over_commit': False}}} Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:45:57.736552 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1656397870 could not be found. Sep 07 09:45:57.739561 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1656397870 could not be found. Sep 07 09:45:57.741999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1656397870 could not be found. Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Returning 400 to user: Compute host tempest-host-1656397870 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9e67805-9f82-4c08-bbeb-f6997cebe8d8 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98/action" status: 400 len: 100 microversion: 2.1 time: 0.484027 Sep 07 09:45:57.744871 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 238/491] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 7 09:45:57 2022] POST /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98/action => generated 100 bytes in 490 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:45:57.755944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b51fdacd-288b-4f99-96a0-7a5a8f2db050 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Calling method '.version_select at 0x7f14b24a5e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:57.799285 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b51fdacd-288b-4f99-96a0-7a5a8f2db050 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221302223?user_id=5d556fc875a546c298d1c0284c2f308f" status: 204 len: 0 microversion: 2.10 time: 0.054605 Sep 07 09:45:57.800004 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 239/492] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:45:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221302223?user_id=5d556fc875a546c298d1c0284c2f308f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:45:57.809153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:57.809975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:57.822820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:57.823186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:57.823627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:57.824584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:57.825051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:57.825777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:58.932371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:45:58.944708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ffdfe33-0e3f-46a9-bc53-5f4ddb38d387 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1468 microversion: 2.1 time: 1.143381 Sep 07 09:45:58.957746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 240/493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:57 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1468 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:45:58.969160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b40d2f01-7094-4a94-9c54-d5b054294954 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] Calling method '.version_select at 0x7f14b2357a60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:59.024647 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b40d2f01-7094-4a94-9c54-d5b054294954 tempest-KeyPairsV210TestJSON-495398477 tempest-KeyPairsV210TestJSON-495398477-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718197017?user_id=5d556fc875a546c298d1c0284c2f308f" status: 204 len: 0 microversion: 2.10 time: 0.065620 Sep 07 09:45:59.025152 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 241/494] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:45:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718197017?user_id=5d556fc875a546c298d1c0284c2f308f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:45:59.042056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7278e8fd-00db-460a-aa75-4687c0ecfeaf req-14a9b476-e898-4c1e-9647-e8a0c42316e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceffe667-57c6-4ae8-a0f3-6491b75d2353", "tag": "0ac5e1c3-5127-407e-b8fa-7afde32aea1a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:45:59.053428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7278e8fd-00db-460a-aa75-4687c0ecfeaf req-14a9b476-e898-4c1e-9647-e8a0c42316e5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.054876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7278e8fd-00db-460a-aa75-4687c0ecfeaf req-14a9b476-e898-4c1e-9647-e8a0c42316e5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.055681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7278e8fd-00db-460a-aa75-4687c0ecfeaf req-14a9b476-e898-4c1e-9647-e8a0c42316e5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:59.070013 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7278e8fd-00db-460a-aa75-4687c0ecfeaf req-14a9b476-e898-4c1e-9647-e8a0c42316e5 service nova] Creating event network-changed:0ac5e1c3-5127-407e-b8fa-7afde32aea1a for instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 on n-h2-836830-16 Sep 07 09:45:59.075459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7278e8fd-00db-460a-aa75-4687c0ecfeaf req-14a9b476-e898-4c1e-9647-e8a0c42316e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043818 Sep 07 09:45:59.076381 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 242/495] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:45:59.087645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:59.088524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:59.111189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.111692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.112129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:59.112839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.122907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.123413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:59.515383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:45:59.516592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:45:59.517266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:45:59.518209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:45:59.518994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:45:59.552886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.557826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.558548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:59.565614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.566137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.566861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:59.606689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:45:59.621908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for user 224142a6fa7e4702b1780f4aaeb3f93f and project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:45:59.648566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:45:59.666812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:45:59.681531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:45:59.804443 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b7d39a28-5bba-4b4c-850e-5b781f3d9fdd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222217 Sep 07 09:45:59.807557 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 254/496] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:45:59.822452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:45:59.824993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:45:59.867717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.868710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.869147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:45:59.870016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:45:59.870390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:45:59.870813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:00.226204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:00.238872 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9db1ce14-1df2-4656-85df-11d95ddeaea3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 1.160896 Sep 07 09:46:00.255747 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 243/497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:59 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:00.255747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:00.255747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:00.272468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:00.273310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:00.273759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:00.274756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:00.275215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:00.275641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:00.446243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:00.463170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:00.466249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:00.479780 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0cb8d1a-55fc-48ef-ac7e-206cf14e1365 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.236331 Sep 07 09:46:00.481653 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 244/498] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:00 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:00.500686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1395640330", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:00.580638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:00.590227 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-af036c72-5739-427f-9516-990ae63db24e tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 0.781374 Sep 07 09:46:00.598371 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 255/499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:45:59 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:00.613867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34a00d17-fe6f-48fc-be9d-1f517ad603e8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:00.618057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34a00d17-fe6f-48fc-be9d-1f517ad603e8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:00.634903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:46:00.765732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34a00d17-fe6f-48fc-be9d-1f517ad603e8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:00.773320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34a00d17-fe6f-48fc-be9d-1f517ad603e8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1211 microversion: 2.1 time: 0.173356 Sep 07 09:46:00.796518 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 256/500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:00 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1211 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:01.237959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d29c4aca-bdd6-437e-91c4-d2f46095f766 req-27ed86dd-0ffd-499e-9edd-eebe81cfc4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5ec95b-f8f5-4072-9f78-fd20eacfbd70", "tag": "dad07d2b-4833-4aef-a819-f3607253fd9f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:01.254073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d29c4aca-bdd6-437e-91c4-d2f46095f766 req-27ed86dd-0ffd-499e-9edd-eebe81cfc4cf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.254570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d29c4aca-bdd6-437e-91c4-d2f46095f766 req-27ed86dd-0ffd-499e-9edd-eebe81cfc4cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.254999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d29c4aca-bdd6-437e-91c4-d2f46095f766 req-27ed86dd-0ffd-499e-9edd-eebe81cfc4cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:01.321610 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d29c4aca-bdd6-437e-91c4-d2f46095f766 req-27ed86dd-0ffd-499e-9edd-eebe81cfc4cf service nova] Creating event network-changed:dad07d2b-4833-4aef-a819-f3607253fd9f for instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 on n-h2-836830-16 Sep 07 09:46:01.343471 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d29c4aca-bdd6-437e-91c4-d2f46095f766 req-27ed86dd-0ffd-499e-9edd-eebe81cfc4cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107387 Sep 07 09:46:01.344313 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 257/501] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:46:01.365679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:01.366519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:01.389557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.390318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.391296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:01.394202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.396327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.397330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:01.688853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:46:01.690230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:46:01.691165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:46:01.692045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:46:01.692951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:46:01.740010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.740692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.741069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:01.741812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.742433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.743745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:01.768603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:01.797131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Getting quotas for project 31b79aaa1fd84b87a90dc4eb387d728a. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:46:01.812185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Getting quotas for user e742bd4e77da4afbbfe6e5b83d7d1391 and project 31b79aaa1fd84b87a90dc4eb387d728a. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:46:01.831300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:46:01.835015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:46:01.918026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff14d87e-a69d-4bbb-bd76-078645727de4 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431866 Sep 07 09:46:01.921220 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 245/502] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:46:01.928539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:01.933752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:01.954727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.956208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.957052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:01.959590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:01.976484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:01.983936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:02.443746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:02.447889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:02.456814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:02.457059 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-070f43ab-c73d-48a1-bcfc-f586a7a9067c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 1.110855 Sep 07 09:46:02.459193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:02.460435 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 258/503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:01 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:02.465988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f8874a7-4a8d-47be-a00c-57386b4934a8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.543195 Sep 07 09:46:02.474036 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 246/504] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:01 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:02.475134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:02.477391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:02.484512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:02.485523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:02.494998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:02.495520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:02.496374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:02.497432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:02.498101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:02.498755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:02.501325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:02.502067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:02.502623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:02.503498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:02.504032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:02.505656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:03.260321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:03.275592 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5211bb97-0cb6-465f-804d-512a3e9dbfc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1263 microversion: 2.1 time: 0.799092 Sep 07 09:46:03.276797 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 247/505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:02 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1263 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:03.284794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:03.285730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:03.295798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:03.297050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:03.305463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:03.307632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:03.309771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:03.310622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:03.617823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:03.630022 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d619cbab-2247-489e-a63e-2a82e8e50961 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1271 microversion: 2.1 time: 0.351301 Sep 07 09:46:03.636770 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 248/506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:03 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:03.654119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:03.655051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:03.670856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:03.671847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:03.672455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:03.673306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:03.674009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:03.674646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:04.621753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:04.635272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c12eb1b0-f808-414b-8d80-35c40897f837 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 2.173713 Sep 07 09:46:04.640045 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 259/507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:02 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:04.661072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:04.662773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:04.672884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:04.675815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:04.676371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:04.677087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:04.677609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:04.678037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:04.768122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:04.780694 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b076b03d-ddeb-40ee-852f-d0489592a7ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 1.142472 Sep 07 09:46:04.785935 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 249/508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:03 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:04.798884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:04.800272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:04.818072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:04.818975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:04.820828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:04.821935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:04.822693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:04.823351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:04.966203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:04.986520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:04.994680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:05.009129 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d267b34-b486-4c77-a60c-bcc33104d253 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.365231 Sep 07 09:46:05.024829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 260/509] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:04 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:05.042904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:05.043822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:05.051844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:05.052726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:05.053438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:05.054368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:05.056203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:05.058061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:05.390629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:05.407068 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08b7d1ff-3a01-4dc6-a502-2dc49fe83b2d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1277 microversion: 2.1 time: 0.377532 Sep 07 09:46:05.409566 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 261/510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:05 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:05.571514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:05.580419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0032683-0992-405c-89f6-98a044919fe3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 0.793210 Sep 07 09:46:05.581775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 250/511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:04 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:05.669170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:05.672239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:05.707379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:05.708856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:05.709522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:05.712342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:05.712870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:05.713744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:05.808994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:05.809712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:05.820163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:05.824317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:05.825942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:05.830007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:05.830719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:05.832652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:06.448343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:06.476159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9ec4802-5a4d-4538-8440-ae97500ad05d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 0.812808 Sep 07 09:46:06.479371 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 262/512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:05 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:06.538316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:06.554657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb79baad-08cb-497a-8b10-dd0b4a410f31 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.749032 Sep 07 09:46:06.556328 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 251/513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:05 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:06.570574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:06.571384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:06.589356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:06.589845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:06.590281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:06.590984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:06.591434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:06.591858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:06.795882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:06.809654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:06.811461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:06.841678 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-420e3cf7-bda4-436c-a8de-eeeb1a579a3e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.274894 Sep 07 09:46:06.844567 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 252/514] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:06 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:06.854673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:06.855481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:06.869293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:06.872092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:06.872659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:06.875466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:06.877655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:06.878211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:06.884701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db9e9416-520b-48ab-bd66-a45abb291ee6 tempest-NetworksTest-24916152 tempest-NetworksTest-24916152-project-admin] Calling method '.version_select at 0x7f14b23109d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:07.327658 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db9e9416-520b-48ab-bd66-a45abb291ee6 tempest-NetworksTest-24916152 tempest-NetworksTest-24916152-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 6753 microversion: 2.1 time: 0.845701 Sep 07 09:46:07.329782 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 263/515] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:46:06 2022] GET /compute/v2.1/os-networks => generated 6753 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:07.346276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:07.361431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:07.364260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:07.368833 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb6282e3-3c0c-4121-be59-4c45c9974e39 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.518682 Sep 07 09:46:07.369715 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 253/516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:06 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:07.391428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-33c9c9c0-bd67-4ac4-adfe-79f452f3c8ad req-58075345-8cc2-4c27-999b-5a137f14dc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3a254c-8c21-419d-8c5d-2590f40228cb", "tag": "c1c00cd9-f1f7-4e61-a58e-1a21d22d498e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:07.393897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:07.394389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:07.394818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:07.395547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:07.406507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:07.407261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:07.421380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:07.428400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-33c9c9c0-bd67-4ac4-adfe-79f452f3c8ad req-58075345-8cc2-4c27-999b-5a137f14dc17 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:07.428881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-33c9c9c0-bd67-4ac4-adfe-79f452f3c8ad req-58075345-8cc2-4c27-999b-5a137f14dc17 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:07.431856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-33c9c9c0-bd67-4ac4-adfe-79f452f3c8ad req-58075345-8cc2-4c27-999b-5a137f14dc17 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:07.476619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-33c9c9c0-bd67-4ac4-adfe-79f452f3c8ad req-58075345-8cc2-4c27-999b-5a137f14dc17 service nova] Creating event network-changed:c1c00cd9-f1f7-4e61-a58e-1a21d22d498e for instance 5d3a254c-8c21-419d-8c5d-2590f40228cb on n-h1-836830-16 Sep 07 09:46:07.485785 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-33c9c9c0-bd67-4ac4-adfe-79f452f3c8ad req-58075345-8cc2-4c27-999b-5a137f14dc17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101805 Sep 07 09:46:07.486659 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 254/517] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:07.495363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff794ef3-753f-412f-a178-11e14f54d778 tempest-NetworksTest-24916152 tempest-NetworksTest-24916152-project-admin] Calling method '.version_select at 0x7f14b228cb80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:07.896794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:07.917217 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff794ef3-753f-412f-a178-11e14f54d778 tempest-NetworksTest-24916152 tempest-NetworksTest-24916152-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks/82bf5053-cc6d-4ef1-927d-8e55a4633a0a" status: 200 len: 652 microversion: 2.1 time: 0.426668 Sep 07 09:46:07.917937 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 255/518] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 09:46:07 2022] GET /compute/v2.1/os-networks/82bf5053-cc6d-4ef1-927d-8e55a4633a0a => generated 652 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:07.923923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:07.925704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:07.930705 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63d8f445-f5a8-4407-8f68-908bef63419b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 0.599015 Sep 07 09:46:07.931298 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 264/519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:07 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:07.938059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-80c82bf7-05d7-4dff-a115-ae715ecf969e req-0812f05a-dee2-4391-889b-f22cd3c43dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceffe667-57c6-4ae8-a0f3-6491b75d2353", "name": "network-vif-plugged", "status": "completed", "tag": "0ac5e1c3-5127-407e-b8fa-7afde32aea1a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:07.938688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:07.939293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:07.939842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:07.940689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:07.941372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:07.942161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:07.967224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-80c82bf7-05d7-4dff-a115-ae715ecf969e req-0812f05a-dee2-4391-889b-f22cd3c43dd0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:07.969711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-80c82bf7-05d7-4dff-a115-ae715ecf969e req-0812f05a-dee2-4391-889b-f22cd3c43dd0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:07.970610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-80c82bf7-05d7-4dff-a115-ae715ecf969e req-0812f05a-dee2-4391-889b-f22cd3c43dd0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:07.998932 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-80c82bf7-05d7-4dff-a115-ae715ecf969e req-0812f05a-dee2-4391-889b-f22cd3c43dd0 service nova] Creating event network-vif-plugged:0ac5e1c3-5127-407e-b8fa-7afde32aea1a for instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 on n-h2-836830-16 Sep 07 09:46:08.012094 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-80c82bf7-05d7-4dff-a115-ae715ecf969e req-0812f05a-dee2-4391-889b-f22cd3c43dd0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079166 Sep 07 09:46:08.014851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 265/520] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:08.025135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:08.026105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:08.047692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:08.048783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:08.049462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:08.050589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:08.051070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:08.051572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:08.334306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:08.337230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:08.347453 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd8897c1-8c95-44f3-8bfd-9f79d0d07f1f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.326434 Sep 07 09:46:08.361257 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 266/521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:08 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:08.366302 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3d3a328a-da65-48ec-b209-35f1a3d0fde8 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 0.446896 Sep 07 09:46:08.367752 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 256/522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:07 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:08.374140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:08.375375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:08.382385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:08.382960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:08.383477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:08.384047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:08.384503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:08.385058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:08.430138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-821238738", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "e75493cc-f51b-4860-be8d-dff35db84833"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:08.481284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:08.492584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:08.494395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:08.501494 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa170c45-890b-4648-890d-4c3be9847ca6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.132371 Sep 07 09:46:08.505509 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 257/523] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:08 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:08.507684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b89edbf-84db-49de-b773-d7e33c8f0a11 tempest-NetworksTest-24916152 tempest-NetworksTest-24916152-project-admin] Calling method '.version_select at 0x7f14b228c040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:08.548479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] validate_networks() for [('e75493cc-f51b-4860-be8d-dff35db84833', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:46:08.986328 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b89edbf-84db-49de-b773-d7e33c8f0a11 tempest-NetworksTest-24916152 tempest-NetworksTest-24916152-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 6753 microversion: 2.1 time: 0.482649 Sep 07 09:46:08.987076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 258/524] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:46:08 2022] GET /compute/v2.1/os-networks => generated 6753 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:08.991935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:09.004896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:09.028571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.034429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.036635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.038101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.038812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.039553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.310003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:09.371325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c05f3462-eab0-4534-89ae-d9ddde5b95dc tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.380619 Sep 07 09:46:09.373951 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 259/525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:08 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:09.381218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:09.382273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:09.391900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.395478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.420431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.421855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.422663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.423344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.598304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:09.871369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:09.879927 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33223dc5-ce00-4d30-8e96-24ea94cb2d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 0.504175 Sep 07 09:46:09.880501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 260/526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:09 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:09.910408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:09.913111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:09.918759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:46:09.919790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:46:09.921578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.922437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.922614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:46:09.923044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:46:09.923363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.923532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:46:09.924497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.925099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.925723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.936021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.936922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.937498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.939069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:09.939741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:09.940728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:09.975924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Getting quotas for project 65a723b7cc864419a391b3cd6ff99bd0. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:46:09.988936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Getting quotas for user 6b1b8b83621d47feaa07b94a2384171d and project 65a723b7cc864419a391b3cd6ff99bd0. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:46:10.020849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:46:10.034961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:46:10.165631 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc48ac0d-00d7-417c-baa2-db37784191e8 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814044 Sep 07 09:46:10.165766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:10.178604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c84b78a1-2109-4df9-b15d-192ef76b823e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.277424 Sep 07 09:46:10.179827 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 261/527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:09 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:10.198906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:10.200693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 267/528] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:46:10.203805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:10.210443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.212703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:10.215772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:10.219684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.220353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.221319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.224379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.225022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.234843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.235619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.236316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.238058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.253041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.253820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.460456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:10.485706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:10.489772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:10.507174 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4dc4ecb-08ea-4d84-b71d-3ddfcb18c4a2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.297643 Sep 07 09:46:10.508110 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 268/529] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:10 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:10.519865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4a3f3096-914b-49ca-8450-4b1abe1e5ccd req-7e47710e-4c2c-42d2-bd16-2332b9add18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f41b97e-f651-4d6b-bcc1-39918111adf8", "tag": "210e4b3b-59dc-41a3-bdf4-827386b28f96"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:10.538459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4a3f3096-914b-49ca-8450-4b1abe1e5ccd req-7e47710e-4c2c-42d2-bd16-2332b9add18f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.540329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4a3f3096-914b-49ca-8450-4b1abe1e5ccd req-7e47710e-4c2c-42d2-bd16-2332b9add18f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.543580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4a3f3096-914b-49ca-8450-4b1abe1e5ccd req-7e47710e-4c2c-42d2-bd16-2332b9add18f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.580307 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4a3f3096-914b-49ca-8450-4b1abe1e5ccd req-7e47710e-4c2c-42d2-bd16-2332b9add18f service nova] Creating event network-changed:210e4b3b-59dc-41a3-bdf4-827386b28f96 for instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 on n-h1-836830-16 Sep 07 09:46:10.608973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4a3f3096-914b-49ca-8450-4b1abe1e5ccd req-7e47710e-4c2c-42d2-bd16-2332b9add18f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092144 Sep 07 09:46:10.610800 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 269/530] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:10.634967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-20ed4c04-3569-41bc-a870-a82538480396 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:10.636058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-20ed4c04-3569-41bc-a870-a82538480396 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:10.708607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:10.720489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b769da4f-fd9c-46aa-a82d-e65f8e0aca0f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1390 microversion: 2.1 time: 0.539187 Sep 07 09:46:10.721796 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 262/531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:10 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:10.734084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:10.734961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:10.744868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.753421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.754160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.755140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.755980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.757145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.804237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-20ed4c04-3569-41bc-a870-a82538480396 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:10.818780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-20ed4c04-3569-41bc-a870-a82538480396 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1215 microversion: 2.1 time: 0.204133 Sep 07 09:46:10.822791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 270/532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:10 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:10.903312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:10.904160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:10.920002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.921170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.922921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:10.923717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:10.924160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:10.924917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.030963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:11.045910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c36e817-f49b-4f15-89ed-71e036ee6e3d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.322709 Sep 07 09:46:11.049307 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 263/533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:10 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:11.161868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:11.180990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a61ab399-4916-43ae-b77e-aa7a276bfa18 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 0.280317 Sep 07 09:46:11.198072 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 271/534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:10 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:11.210991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:11.212906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:11.226264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.226778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.227225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.230592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.231339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.232086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.542722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:11.543934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:11.557306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:11.565065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.570095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.571605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.574029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.577620 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3bb02bdb-06b0-4b0b-b3a1-7189e1774c56 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.370360 Sep 07 09:46:11.578112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.579025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.579926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 264/535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:11 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:46:11.745713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:11.746595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:11.758047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.761908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.762531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.763436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.764277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.765759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.769675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:11.820648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:11.826630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=9 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:11.868337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:11.885330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:11.887051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:11.900098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7428fcfd-b1d1-4293-bdf3-e19e4cbf8d32 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1558 microversion: 2.91 time: 0.363278 Sep 07 09:46:11.900919 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 272/536] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:11 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1558 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:11.913387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:11.914101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:11.923832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.924342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.924786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:11.925529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:11.925998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:11.930674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:12.079796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:12.091535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26c26efe-1975-4c48-829c-ca99eb956ff7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1267 microversion: 2.1 time: 0.189752 Sep 07 09:46:12.108771 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 273/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:11 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:12.108771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:12.108771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:12.116482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:12.119918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:12.120489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:12.121264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:12.122949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:12.125129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:12.422207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:12.437386 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04346d22-e910-4163-b6ca-caa105044437 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1589 microversion: 2.1 time: 0.692335 Sep 07 09:46:12.459546 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 265/538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:11 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1589 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:12.465090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:12.478373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:12.500218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:12.500832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:12.501308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:12.502039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:12.504503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:12.507166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:12.883757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:12.892219 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1c91eb7e-166b-44b9-bd82-a6f83f5d04a1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.798718 Sep 07 09:46:12.901029 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 274/539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:12 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:12.909038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:12.909576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:12.934805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:12.940824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:12.941509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:12.945445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:12.946645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:12.947115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:13.120180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:13.133860 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ae0ba0e7-1517-4bad-b087-13c35817a7e0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 0.672454 Sep 07 09:46:13.134611 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 266/540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:12 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:13.155011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:13.156111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:13.162549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:13.163256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:13.163881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:13.164740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:13.165650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:13.166267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:13.170077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-986ee518-6186-4376-8f7b-7573178a278d tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.267689 Sep 07 09:46:13.173981 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 275/541] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:46:12 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:13.179239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:13.180088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:13.200414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:13.203552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:13.204036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:13.205881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:13.206969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:13.207740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:13.220626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:13.526293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:13.537732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:13.539605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:13.550756 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-48bae7fb-da93-44e0-9fe7-36702fe34496 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1558 microversion: 2.91 time: 0.374960 Sep 07 09:46:13.571156 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 276/542] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:13 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:13.586750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:13.591055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:13.602929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:13.603600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:13.604359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:13.605324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:13.605943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:13.607271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:14.115353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:14.124127 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0096797-dea3-40bb-b410-d47339d1b2c8 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.972831 Sep 07 09:46:14.132721 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 267/543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:13 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:14.151361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4efe41fb-73d2-439b-a518-95519fd7839e req-d577b688-bdb7-48b5-bd99-8bfb56a087ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5ec95b-f8f5-4072-9f78-fd20eacfbd70", "name": "network-vif-plugged", "status": "completed", "tag": "dad07d2b-4833-4aef-a819-f3607253fd9f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:14.188153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4efe41fb-73d2-439b-a518-95519fd7839e req-d577b688-bdb7-48b5-bd99-8bfb56a087ea service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:14.192545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4efe41fb-73d2-439b-a518-95519fd7839e req-d577b688-bdb7-48b5-bd99-8bfb56a087ea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:14.193349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4efe41fb-73d2-439b-a518-95519fd7839e req-d577b688-bdb7-48b5-bd99-8bfb56a087ea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:14.234734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:14.237599 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4efe41fb-73d2-439b-a518-95519fd7839e req-d577b688-bdb7-48b5-bd99-8bfb56a087ea service nova] Creating event network-vif-plugged:dad07d2b-4833-4aef-a819-f3607253fd9f for instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 on n-h2-836830-16 Sep 07 09:46:14.247699 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60b03887-5764-4773-8398-563b6dd87b25 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1275 microversion: 2.1 time: 0.674154 Sep 07 09:46:14.250555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 277/544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:13 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1275 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:14.260791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:14.263153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4efe41fb-73d2-439b-a518-95519fd7839e req-d577b688-bdb7-48b5-bd99-8bfb56a087ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115061 Sep 07 09:46:14.264564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:14.266401 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 268/545] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:14.271774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:14.278172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:14.278905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:14.280162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:14.282234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:14.283638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:14.284313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:14.284903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:14.308258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:14.310070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:14.313388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:14.314267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:14.315755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:14.317786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:15.352854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:15.356157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:15.363767 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f11aa0e0-aaa7-4697-bd8f-2357535ffdd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 1.095866 Sep 07 09:46:15.368990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-417a50a3-49e0-4523-aad5-4f041df711ea tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 1.117111 Sep 07 09:46:15.370812 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 269/546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:14 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:15.377877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 278/547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:14 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:15.383318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:15.385923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:15.393433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:15.395020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:15.416491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:15.417855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:15.418563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:15.423732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:15.424557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:15.425457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:15.429969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:15.431940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:15.432560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:15.435061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:15.436160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:15.438996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:15.714582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:15.727829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:15.736953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:15.757241 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cc00c75-437a-45df-a00c-40a0631a5e7f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.384883 Sep 07 09:46:15.757820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 270/548] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:15 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:15.779202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:15.779892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:15.807325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:15.807816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:15.808441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:15.809355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:15.813256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:15.814020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:16.126673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:16.137658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:16.139545 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67b044fa-ac1e-4020-a26b-e16a26f42746 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1273 microversion: 2.1 time: 0.374014 Sep 07 09:46:16.148268 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 271/549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:15 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:16.151836 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93d87c16-0169-4c24-b353-9d8715c88d76 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1313 microversion: 2.1 time: 0.772461 Sep 07 09:46:16.173215 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 279/550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:15 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:16.382251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f68315fb-8bf9-412a-9303-ac176fc719b8 req-c47c1a38-3562-4acd-a7aa-3f8f684587c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3a254c-8c21-419d-8c5d-2590f40228cb", "name": "network-vif-plugged", "status": "completed", "tag": "c1c00cd9-f1f7-4e61-a58e-1a21d22d498e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:16.401273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f68315fb-8bf9-412a-9303-ac176fc719b8 req-c47c1a38-3562-4acd-a7aa-3f8f684587c8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:16.405103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f68315fb-8bf9-412a-9303-ac176fc719b8 req-c47c1a38-3562-4acd-a7aa-3f8f684587c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:16.414432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f68315fb-8bf9-412a-9303-ac176fc719b8 req-c47c1a38-3562-4acd-a7aa-3f8f684587c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:16.444986 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f68315fb-8bf9-412a-9303-ac176fc719b8 req-c47c1a38-3562-4acd-a7aa-3f8f684587c8 service nova] Creating event network-vif-plugged:c1c00cd9-f1f7-4e61-a58e-1a21d22d498e for instance 5d3a254c-8c21-419d-8c5d-2590f40228cb on n-h1-836830-16 Sep 07 09:46:16.458192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f68315fb-8bf9-412a-9303-ac176fc719b8 req-c47c1a38-3562-4acd-a7aa-3f8f684587c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079637 Sep 07 09:46:16.459667 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 280/551] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:16.467625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:16.483424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:16.497823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:16.498643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:16.500398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:16.502189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:16.506085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:16.511441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:16.622341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Action: 'update', calling method: .version_select at 0x7f14b2381ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:16.803864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:16.819470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:16.820215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:16.821411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:16.821972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:16.822425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:16.968639 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d16ed9a-9108-4d0e-9d40-81853becbb4c tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb" status: 200 len: 240 microversion: 2.36 time: 0.819195 Sep 07 09:46:16.983958 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 272/552] 10.222.0.60 () {62 vars in 1303 bytes} [Wed Sep 7 09:46:16 2022] PUT /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb => generated 240 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:16.992991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:16.994406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:17.013915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.014532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.015816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.016632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.017348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.017863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.459183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:17.470216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2463a7c1-f1ef-4c75-8e9a-d7e0d6fd4830 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1311 microversion: 2.1 time: 1.009142 Sep 07 09:46:17.474341 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 281/553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:16 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1311 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:17.481810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:17.483388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:17.503490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.503996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.513447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.515177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.516077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.516835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.553840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:17.570494 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-46c62c54-c87d-4930-b20e-3806af50847d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.581635 Sep 07 09:46:17.571281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 273/554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:16 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:17.584133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Calling method '.version_select at 0x7f14b22ca040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:17.713654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.714465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.714557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.715322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.715798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.725991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.777121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c3da26a-9513-4c67-b827-bf224606a96d tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb/detail" status: 200 len: 672 microversion: 2.36 time: 0.202750 Sep 07 09:46:17.789248 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 274/555] 10.222.0.60 () {60 vars in 1304 bytes} [Wed Sep 7 09:46:17 2022] GET /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb/detail => generated 672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:17.789670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:17.803561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:17.807874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:17.821868 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-396a34a1-78be-4196-8513-09bc8b65b3c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.344454 Sep 07 09:46:17.826538 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 282/556] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:17 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:17.842925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:17.845030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:17.860262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.861125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.861821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.862828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:17.863754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:17.864400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:17.917509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2107336918", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "124ad2c9-0cc2-4b52-ab23-5623958d6487"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:18.029401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] validate_networks() for [('124ad2c9-0cc2-4b52-ab23-5623958d6487', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:46:18.655935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:18.675265 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fda3cc08-936f-467b-90dd-c6a51d1a6f1a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1315 microversion: 2.1 time: 0.845962 Sep 07 09:46:18.697208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 283/557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:17 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:18.706970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:18.709741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:18.735661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:18.737883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:18.738357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:18.739123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:18.739601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:18.740044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.246974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:19.259336 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f384838e-e791-4be4-8ed7-059c48997bda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1463 microversion: 2.1 time: 0.573809 Sep 07 09:46:19.260932 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 284/558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:18 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1463 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:19.268977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1fe6b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:19.419534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.421833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.423282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.423672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.424903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.425596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.479631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:19.490473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.491347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.492029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.493128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.493842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.495050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.610149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:46:19.612014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:46:19.612745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:46:19.613463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:46:19.614155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:46:19.619432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-706de4c7-6db2-4f66-b062-3da28e388d46 tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb?user_id=364bc15197244bf78eec6455d520915d" status: 200 len: 240 microversion: 2.36 time: 0.343115 Sep 07 09:46:19.625007 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 285/559] 10.222.0.60 () {62 vars in 1384 bytes} [Wed Sep 7 09:46:19 2022] PUT /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb?user_id=364bc15197244bf78eec6455d520915d => generated 240 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:19.635602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:19.639018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.640595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:19.641363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.647016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.648377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.649084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.649768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.674758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.676106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.676919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.677940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.679672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.682256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.756302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:46:19.762793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for user 21737ade68344e3298131ce9189f5d8a and project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:46:19.784363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:46:19.791454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:46:19.874713 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-738f3af0-bfdd-4c38-ba1f-a4174f04182a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.095406 Sep 07 09:46:19.877158 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 275/560] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:46:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:46:19.885375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:19.885995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:19.913000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.913528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.913976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:19.914690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:19.915152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:19.915578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.322917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:20.338382 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8d873d75-f040-4844-81d4-62752c579358 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1494 microversion: 2.1 time: 0.711522 Sep 07 09:46:20.338976 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 286/561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:19 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1494 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:20.344398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:20.345013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:20.363195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:20.363699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:20.364141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.364853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:20.365336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:20.365765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.431833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:20.449330 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c5075d8-dd00-4270-83ec-7ecac31ba760 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.567530 Sep 07 09:46:20.450535 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 276/562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:19 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:20.479205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:20.484159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:20.494030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:20.494895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:20.496322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.497347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:20.498135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:20.498794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.666589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:20.694510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:20.705278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:20.723697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb9e43bd-7c94-4161-a411-0e47e3f61064 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.248387 Sep 07 09:46:20.728002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 277/563] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:20 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:20.735140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b995b2f4-1bb0-4244-827e-e13d1f9e575a req-9ea85741-1050-4f81-8002-787ec3d99ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceffe667-57c6-4ae8-a0f3-6491b75d2353", "tag": "0ac5e1c3-5127-407e-b8fa-7afde32aea1a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:20.759669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b995b2f4-1bb0-4244-827e-e13d1f9e575a req-9ea85741-1050-4f81-8002-787ec3d99ac8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:20.760139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b995b2f4-1bb0-4244-827e-e13d1f9e575a req-9ea85741-1050-4f81-8002-787ec3d99ac8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:20.767748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b995b2f4-1bb0-4244-827e-e13d1f9e575a req-9ea85741-1050-4f81-8002-787ec3d99ac8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.792619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b995b2f4-1bb0-4244-827e-e13d1f9e575a req-9ea85741-1050-4f81-8002-787ec3d99ac8 service nova] Creating event network-changed:0ac5e1c3-5127-407e-b8fa-7afde32aea1a for instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 on n-h2-836830-16 Sep 07 09:46:20.806999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b995b2f4-1bb0-4244-827e-e13d1f9e575a req-9ea85741-1050-4f81-8002-787ec3d99ac8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075869 Sep 07 09:46:20.807614 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 278/564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:20.823457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-518971bb-ccfb-4436-b755-d41096cfcf48 req-f450bf3f-7d6f-44ca-af26-5731a9f18eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f41b97e-f651-4d6b-bcc1-39918111adf8", "name": "network-vif-plugged", "status": "completed", "tag": "210e4b3b-59dc-41a3-bdf4-827386b28f96"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:20.834804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-518971bb-ccfb-4436-b755-d41096cfcf48 req-f450bf3f-7d6f-44ca-af26-5731a9f18eae service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:20.835279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-518971bb-ccfb-4436-b755-d41096cfcf48 req-f450bf3f-7d6f-44ca-af26-5731a9f18eae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:20.840919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-518971bb-ccfb-4436-b755-d41096cfcf48 req-f450bf3f-7d6f-44ca-af26-5731a9f18eae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:20.871738 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-518971bb-ccfb-4436-b755-d41096cfcf48 req-f450bf3f-7d6f-44ca-af26-5731a9f18eae service nova] Creating event network-vif-plugged:210e4b3b-59dc-41a3-bdf4-827386b28f96 for instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 on n-h1-836830-16 Sep 07 09:46:20.883068 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-518971bb-ccfb-4436-b755-d41096cfcf48 req-f450bf3f-7d6f-44ca-af26-5731a9f18eae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074047 Sep 07 09:46:20.884258 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 279/565] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:20.898359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:20.907737 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c583e4f-814f-41e7-ae01-424c2a3da5ce tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1589 microversion: 2.1 time: 0.567699 Sep 07 09:46:20.914994 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 287/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:20 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1589 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:20.919947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c76b3fe8-aa1f-421e-89e9-b3cc98061dbe tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] Calling method '.version_select at 0x7f14b22c6430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:21.146583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c76b3fe8-aa1f-421e-89e9-b3cc98061dbe tempest-QuotasAdminTestV236-982870724 tempest-QuotasAdminTestV236-982870724-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb?user_id=364bc15197244bf78eec6455d520915d" status: 200 len: 282 microversion: 2.36 time: 0.230161 Sep 07 09:46:21.150884 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 288/567] 10.222.0.60 () {60 vars in 1364 bytes} [Wed Sep 7 09:46:20 2022] GET /compute/v2.1/os-quota-sets/210959c32dc04c5ebfd35cbd75e5ebdb?user_id=364bc15197244bf78eec6455d520915d => generated 282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:21.168633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:21.179696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:21.210551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.212803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.213560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.215886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.218333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.219136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.257550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:21.264396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'deleted': False, 'project_id': '96839c283fda48d682c4adbebf765854'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:21.284513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.285007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.285580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.286343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.286706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.297636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.509796 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29163271-79eb-4ae7-b77b-1fa47938595a tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.624127 Sep 07 09:46:21.511085 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 280/568] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:46:20 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:46:21.517772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:21.518909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:21.526839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.527795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.528443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.529671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.530345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.533505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.710221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:21.725638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:21.728161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:21.730827 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d804e3fb-44bc-452d-bf25-739c70f06b97 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1258 microversion: 2.25 time: 0.218586 Sep 07 09:46:21.733168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 281/569] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:21 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:21.780301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:21.780999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:21.798815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.800847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.802531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.803691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.805036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.806267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.836637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:21.856044 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2d80950-79a8-49f0-b4b8-a6093e9dfd65 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1315 microversion: 2.1 time: 0.702099 Sep 07 09:46:21.877059 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 289/570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:21 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:21.904574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:21.908641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:21.923168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.923664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.924125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:21.924799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:21.925285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:21.925738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:22.489829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49d4be1b-4cdf-4b2d-a960-2b04e5e56296 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1647 microversion: 2.1 time: 0.722464 Sep 07 09:46:22.490773 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 282/571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:21 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1647 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:22.503240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:22.524128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'deleted': False} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:22.525588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:22.540579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-962f9f6b-15bc-4100-bf03-b051b298269e tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1319 microversion: 2.1 time: 0.657609 Sep 07 09:46:22.541634 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 290/572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:21 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:22.553169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:22.556559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:22.557297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:22.558356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:22.558888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:22.564020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:22.564731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:22.567237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:22.575378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:22.578968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:22.579568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:22.582242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:22.582868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:22.583735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:22.778501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:46:22.846840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:22.877565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:22.888735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:22.922097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1667e0d-a9bb-4b0a-ace7-6a504494db75 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.379072 Sep 07 09:46:22.926246 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 291/573] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:22 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:22.943909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:22.945592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:22.976416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:22.976931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:22.979766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:22.981359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:22.982484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:22.983785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:23.056328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:23.057679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:23.058774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:23.827683 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0826152e-875e-44b3-9432-e6b5d4d39d2b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1647 microversion: 2.1 time: 0.897305 Sep 07 09:46:23.828931 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 292/574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:22 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1647 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:23.848638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:23.849452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:23.864732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:23.866447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:23.868537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:23.872569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:23.879026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:23.879909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.106048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:24.124064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:24.126200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:24.129687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c52bd2b9-10de-475a-ae19-65ff6be84883 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1320 microversion: 2.25 time: 0.297639 Sep 07 09:46:24.131750 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 293/575] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:23 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:24.143480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fca33036-4005-4d7d-ae22-704232e23138 req-2a1f2c88-b85a-439f-9069-51ba9cff61f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f049d128-5144-4317-bea4-df282e452251", "tag": "2a7aef82-26cf-4f15-a7ed-33abac9d0fcb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:24.160211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fca33036-4005-4d7d-ae22-704232e23138 req-2a1f2c88-b85a-439f-9069-51ba9cff61f8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.162470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fca33036-4005-4d7d-ae22-704232e23138 req-2a1f2c88-b85a-439f-9069-51ba9cff61f8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.163662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fca33036-4005-4d7d-ae22-704232e23138 req-2a1f2c88-b85a-439f-9069-51ba9cff61f8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.186297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fca33036-4005-4d7d-ae22-704232e23138 req-2a1f2c88-b85a-439f-9069-51ba9cff61f8 service nova] Creating event network-changed:2a7aef82-26cf-4f15-a7ed-33abac9d0fcb for instance f049d128-5144-4317-bea4-df282e452251 on n-h1-836830-16 Sep 07 09:46:24.194544 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fca33036-4005-4d7d-ae22-704232e23138 req-2a1f2c88-b85a-439f-9069-51ba9cff61f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059741 Sep 07 09:46:24.195931 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 294/576] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:24.202243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:24.205102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:24.212999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.213790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.215441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.216407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.217642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.218312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.249053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:24.485351 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a047bb1-1aec-4ed5-986f-0095992b0d0d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17412 microversion: 2.1 time: 1.991673 Sep 07 09:46:24.497247 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 283/577] 10.222.0.60 () {58 vars in 1171 bytes} [Wed Sep 7 09:46:22 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17412 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:24.497247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:24.497247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:24.505607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.518124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.519247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.520393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.521396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.522198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.803045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:24.821831 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a77a9fd-87b5-43ce-891e-0c635548bde2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1315 microversion: 2.1 time: 0.624207 Sep 07 09:46:24.843152 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 295/578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:24 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:24.849864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:24.852323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:24.854890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.855773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.856516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.864434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.865353 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b38d1d68-dc5c-4368-b897-1dd5dc290fe1 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1468 microversion: 2.1 time: 0.376527 Sep 07 09:46:24.865645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.866404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.879798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 284/579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:24 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:24.901054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:24.901681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:24.909854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c42e2c8c-06d4-463d-868e-5cd9ca6c840f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.065171 Sep 07 09:46:24.910449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.911085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.911543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 296/580] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:46:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:24.920197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.921130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.921663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.923773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:24.926312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.929942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'deleted': False, 'project_id': '96839c283fda48d682c4adbebf765854'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:24.936649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.937580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.938395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:24.939346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:24.940030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:24.940682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.094128 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-514c694c-0c30-4d4d-9b3b-fb6137ffe77d tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?tenant_id=98fddf9336df4df884fbd1d79f4736cf" status: 200 len: 15 microversion: 2.1 time: 0.181282 Sep 07 09:46:25.095819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 297/581] 10.222.0.60 () {58 vars in 1231 bytes} [Wed Sep 7 09:46:24 2022] GET /compute/v2.1/servers/detail?tenant_id=98fddf9336df4df884fbd1d79f4736cf => generated 15 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:46:25.115688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:25.120174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:25.122101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:25.125743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:25.137051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:25.139587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:25.144499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.145223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:25.148267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.148995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.152747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.153445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.156073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2f154ee-55d8-4492-a3a3-022e52292a7d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.271096 Sep 07 09:46:25.156914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.175402 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 285/582] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:24 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:25.194825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:25.196491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:25.213049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lazy-loading 'flavor' on Instance uuid 4f41b97e-f651-4d6b-bcc1-39918111adf8 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:25.218425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.220938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.223028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.225107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.225866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.229242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.348189 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ec500f11-e20b-4a06-9344-671a1f658e3c tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8/action" status: 202 len: 0 microversion: 2.1 time: 0.248498 Sep 07 09:46:25.366472 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 298/583] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:25 2022] POST /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:46:25.377285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:25.383751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a24d576a-da47-4af4-9d2a-8a794408d755 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb/action" status: 202 len: 0 microversion: 2.1 time: 0.205542 Sep 07 09:46:25.395050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'tenant_id': '98fddf9336df4df884fbd1d79f4736cf', 'deleted': False} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:25.403665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.405407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.406005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.406977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.407588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.408185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.417725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 286/584] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:25 2022] POST /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:46:25.446614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:25.449387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:25.469938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.470820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.471600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.473478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.474103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.474694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:25.559599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:46:25.790806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=40 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:25.802534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:25.802948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:25.803359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.240287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.255485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.260712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.262425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-147f6008-e576-4232-9720-f47d8353c648 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.842748 Sep 07 09:46:26.264186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 287/585] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:25 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:26.275583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:26.276200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:26.313113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1728d0a6-78ca-493b-a3b7-b8f1f9558175 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=98fddf9336df4df884fbd1d79f4736cf" status: 200 len: 4833 microversion: 2.1 time: 0.942964 Sep 07 09:46:26.314759 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 299/586] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 7 09:46:25 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=98fddf9336df4df884fbd1d79f4736cf => generated 4833 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:26.316393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.318008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.319096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.320445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.330205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:26.331309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:26.337560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.338368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.352125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.352125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.352125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.355848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.356345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.359777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.693899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebabc21c-b9bf-4ac8-8ac4-efbb3b469008 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1632 microversion: 2.1 time: 0.377863 Sep 07 09:46:26.698674 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 300/587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:26 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1632 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:26.708201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:26.710646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:26.721880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.722924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.723903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.725966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.727682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.728935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.739985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.752170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31b3e9e6-f4d6-40f9-a232-91230f42bd95 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1459 microversion: 2.1 time: 0.481109 Sep 07 09:46:26.755239 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 288/588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:26 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1459 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:26.762482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:26.763095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:26.782170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.782665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.783108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.783817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.784274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.784709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.931128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.957601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.959712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:26.965913 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-321dd961-8ead-4843-9e05-213f7508bf33 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.209498 Sep 07 09:46:26.967292 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 289/589] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:26 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:26.972160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:26.980058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'tenant_id': '96839c283fda48d682c4adbebf765854', 'deleted': False} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:26.986183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.986949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.987801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:26.988613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:26.989399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:26.989888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:27.009038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:27.026370 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-972ac6d4-8903-4878-a324-7b456ba0ef7b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1315 microversion: 2.1 time: 0.326436 Sep 07 09:46:27.027479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 301/590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:26 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:27.035726 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-43a6b5cb-cbe1-4147-80dc-a5cfa70a3451 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=96839c283fda48d682c4adbebf765854" status: 200 len: 15 microversion: 2.1 time: 0.067148 Sep 07 09:46:27.036618 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 290/591] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 7 09:46:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=96839c283fda48d682c4adbebf765854 => generated 15 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:46:27.040960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:27.041723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:27.046842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:27.049219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:27.049370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:27.049917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:27.050447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:27.051244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:27.051821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:27.052589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:27.056075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:27.061054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:27.061714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:27.062489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:27.062970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:27.063405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:27.099498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lazy-loading 'flavor' on Instance uuid 5d3a254c-8c21-419d-8c5d-2590f40228cb {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:27.122474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Going to try to live migrate instance to n-h2-836830-16 {{(pid=128832) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:46:27.652742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2061b0ce-3fcd-4792-b960-d34749add1fb tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1612 microversion: 2.1 time: 0.615192 Sep 07 09:46:27.656749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 291/592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:27 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1612 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:27.661544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51aeea53-7b3c-42f1-9fb6-cd25a22794d4 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:27.686671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51aeea53-7b3c-42f1-9fb6-cd25a22794d4 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.027050 Sep 07 09:46:27.720623 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 292/593] 10.222.0.60 () {58 vars in 1189 bytes} [Wed Sep 7 09:46:27 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:46:27.753493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:27.754414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:27.774340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:27.776415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:27.776415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:27.776415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:27.776932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:27.777554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.145670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.154791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.159882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.165323 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-da8a7893-ae2a-42d1-8c94-830e1fac0dc2 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.424274 Sep 07 09:46:28.166594 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 293/594] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:27 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:28.172193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e99a7632-60e4-4247-9ae5-dcba69c7b80d req-e290c174-3c05-4295-8f6a-63815481875e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32c33bb-7f8e-4a60-8857-37805be90773", "tag": "091bfdd5-5dac-4645-a4d1-c4854d2a82e1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:28.184745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e99a7632-60e4-4247-9ae5-dcba69c7b80d req-e290c174-3c05-4295-8f6a-63815481875e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.186393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e99a7632-60e4-4247-9ae5-dcba69c7b80d req-e290c174-3c05-4295-8f6a-63815481875e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.187657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e99a7632-60e4-4247-9ae5-dcba69c7b80d req-e290c174-3c05-4295-8f6a-63815481875e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.206453 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e99a7632-60e4-4247-9ae5-dcba69c7b80d req-e290c174-3c05-4295-8f6a-63815481875e service nova] Creating event network-changed:091bfdd5-5dac-4645-a4d1-c4854d2a82e1 for instance e32c33bb-7f8e-4a60-8857-37805be90773 on n-h2-836830-16 Sep 07 09:46:28.213022 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e99a7632-60e4-4247-9ae5-dcba69c7b80d req-e290c174-3c05-4295-8f6a-63815481875e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044968 Sep 07 09:46:28.213833 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 294/595] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:28.220647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:28.222939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:28.230786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.231562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.232839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.233784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.234242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.234665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.342636 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cfb1c0b3-92ec-49bb-9df4-158a68476534 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 0 microversion: 2.1 time: 0.127324 Sep 07 09:46:28.343560 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 295/596] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:28 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:46:28.352338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:28.356189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.356727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.357483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.358970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.359943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.360575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.391235 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d730183-eb70-4343-b0eb-6d8811542ae7 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046399 Sep 07 09:46:28.392495 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 296/597] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:46:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:28.579110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:28.582713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.583392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.583853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.584575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.585024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.585465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.621215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a466205a-7ef2-4829-bae4-ba1a26b486c6 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.227397 Sep 07 09:46:28.621819 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 297/598] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:46:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:28.626987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:28.627772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:28.636952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.637725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.638388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.639264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.639718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.640138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.721339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.732910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.735813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.742000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b7f7dea-dc84-4c36-87c2-c2ea56ad06b7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.118849 Sep 07 09:46:28.742893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 298/599] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:28 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:28.747341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:28.748129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:28.755530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.755530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.755530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.756072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.756537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.756967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.912752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.921129 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ed9c504-db50-4274-ac01-5ead1f29c58b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1315 microversion: 2.1 time: 0.177220 Sep 07 09:46:28.922757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 299/600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:28 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:28.929201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0c04ba7a-5767-4380-856f-659c4ecbe571 req-dbada583-0d2b-4f4a-a87e-2091e0a5879c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f049d128-5144-4317-bea4-df282e452251", "name": "network-vif-plugged", "status": "completed", "tag": "2a7aef82-26cf-4f15-a7ed-33abac9d0fcb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:28.941524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0c04ba7a-5767-4380-856f-659c4ecbe571 req-dbada583-0d2b-4f4a-a87e-2091e0a5879c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.942395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0c04ba7a-5767-4380-856f-659c4ecbe571 req-dbada583-0d2b-4f4a-a87e-2091e0a5879c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.942827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0c04ba7a-5767-4380-856f-659c4ecbe571 req-dbada583-0d2b-4f4a-a87e-2091e0a5879c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.955258 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0c04ba7a-5767-4380-856f-659c4ecbe571 req-dbada583-0d2b-4f4a-a87e-2091e0a5879c service nova] Creating event network-vif-plugged:2a7aef82-26cf-4f15-a7ed-33abac9d0fcb for instance f049d128-5144-4317-bea4-df282e452251 on n-h1-836830-16 Sep 07 09:46:28.960119 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0c04ba7a-5767-4380-856f-659c4ecbe571 req-dbada583-0d2b-4f4a-a87e-2091e0a5879c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 Sep 07 09:46:28.960934 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 300/601] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:28.965882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:28.972329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:28.973161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '98fddf9336df4df884fbd1d79f4736cf'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:28.980051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.980526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.980955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:28.981690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:28.982271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:28.982689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.072139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:46:29.152661 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7e6c147-7c23-48c4-a660-663e4960f0a9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.190709 Sep 07 09:46:29.153577 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 301/602] 10.222.0.60 () {58 vars in 1150 bytes} [Wed Sep 7 09:46:28 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:29.159787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:29.162504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:29.168627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.169111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.169655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.170376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.170827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.171252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.203400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Lazy-loading 'flavor' on Instance uuid 4f41b97e-f651-4d6b-bcc1-39918111adf8 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:29.216158 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 while it is in vm_state suspended Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Request method failure captured: Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8/action HTTP/1.1 Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 98 Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhCMZ11tg_NzcPqh5Nf1eOQ6Qb4QHVCVXZb4B83rdrhTvZTQA8U5NzEE_TU_vQPzECq3RyOaKZXrbPCOWHBlOCXJjm1HkO_RV6ezixZdPW7X7Lc52pNziKRNgByz8EbA2YYvCbA3qw-eLlJ-WRmjorsIY3mZrH2k3gDniORyJWBffE Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8856610e50754e0e90d6c769422e961e Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveMigrationNegativeTest-1636162516 Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:46:29.218610 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8856610e50754e0e90d6c769422e961e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8856610e50754e0e90d6c769422e961e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8856610e50754e0e90d6c769422e961e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8856610e50754e0e90d6c769422e961e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveMigrationNegativeTest-1636162516 Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8856610e50754e0e90d6c769422e961e Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1636162516 Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveMigrationNegativeTest-1636162516-project-admin Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2b9c4a801b1944238fdffb5bcfff095c Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveMigrationNegativeTest-1636162516-project-admin Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: {"os-migrateLive": {"host": "n-h2-836830-16", "block_migration": true, "disk_over_commit": false}} Sep 07 09:46:29.220162 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot 'os-migrateLive' instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 while it is in vm_state suspended Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4f41b97e-f651-4d6b-bcc1-39918111adf8', 'body': {'os-migrateLive': {'host': 'n-h2-836830-16', 'block_migration': True, 'disk_over_commit': False}}} Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 07 09:46:29.221046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:29.222465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 while it is in vm_state suspended Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 while it is in vm_state suspended Sep 07 09:46:29.223690 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:29.226845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 while it is in vm_state suspended {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:29.226845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-385d4567-09bc-493d-9ee3-78a7e8c104d5 tempest-LiveMigrationNegativeTest-1636162516 tempest-LiveMigrationNegativeTest-1636162516-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8/action" status: 409 len: 155 microversion: 2.1 time: 0.064945 Sep 07 09:46:29.226845 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 302/603] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:29 2022] POST /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8/action => generated 155 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:46:29.230043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:29.234166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.234661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.235105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.235840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.236356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.236717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.261715 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ccad805d-45c4-4fba-897e-6bb301ab0290 tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-836830-16" status: 200 len: 581 microversion: 2.1 time: 0.035220 Sep 07 09:46:29.262615 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 303/604] 10.222.0.60 () {58 vars in 1174 bytes} [Wed Sep 7 09:46:29 2022] GET /compute/v2.1/os-services?host=n-d-836830-16 => generated 581 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:29.267533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:29.270333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:29.277006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.277525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.277969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.278848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.279340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.279770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.304856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:29.382120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-044c52d3-0f84-45b2-a431-d6f11d94ece3 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 0 microversion: 2.1 time: 0.118269 Sep 07 09:46:29.383237 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 304/605] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:29 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:46:29.388136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:29.389015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:29.401292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.401292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.401292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.401292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.401753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.401753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.640546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:29.656445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:29.657952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:29.659214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48569010-fe8f-48f2-951f-0c29c67defa5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.274856 Sep 07 09:46:29.659770 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 305/606] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:29 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:29.669358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:29.669888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:29.677474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.678590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.679682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.680405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.681337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.681771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.743371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:46:29.880317 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-133257ba-c239-43ea-8947-ecea7d765e55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 204 len: 0 microversion: 2.1 time: 0.214107 Sep 07 09:46:29.881164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 306/607] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:46:29 2022] DELETE /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:46:29.891358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:29.894862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.895349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.895784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:29.896519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:29.896978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:29.897433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.176642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7462e79-90c1-44c9-adfe-0f44a6134d3a tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.293339 Sep 07 09:46:30.186556 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 307/608] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:46:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:30.192015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.193082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:30.201392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.202522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.203153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.204040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.204654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.205285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.377462 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70f16367-e979-4965-8993-e4e497b29373 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1617 microversion: 2.1 time: 0.189301 Sep 07 09:46:30.382761 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 308/609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1617 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:30.386647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.387271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:30.393874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.394369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.394812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.395877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.396341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.396776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.479867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:30.491030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:30.492494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:30.498710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58b31ab3-0dde-4fb1-8604-b53c0910f80d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.119525 Sep 07 09:46:30.512232 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 309/610] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:30.517548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.518162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:30.525793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.526738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.527188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.528057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.528534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.529676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.603362 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7bdd73c-e7f1-4af5-ad5c-ef5503b234c3 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb/action" status: 202 len: 0 microversion: 2.1 time: 3.571592 Sep 07 09:46:30.608635 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 302/611] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:27 2022] POST /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb/action => generated 0 bytes in 3577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:46:30.615559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.616184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:30.625150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.628535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.629209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.630157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.630623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.631221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.704331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:30.715104 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ddc3315-c6ab-4b21-9a92-3b20e736b238 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1465 microversion: 2.1 time: 0.201660 Sep 07 09:46:30.717220 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1465 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:30.722520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.727607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.728327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.729132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.730299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.731358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.732082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.762509 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c10f5f3-f8c4-45b7-9d9b-71735869618f tempest-ServicesAdminTestJSON-1952548869 tempest-ServicesAdminTestJSON-1952548869-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.043794 Sep 07 09:46:30.766442 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 311/613] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/os-services => generated 949 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:30.777854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.778950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:30.786888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.787525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.788556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.789594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.790232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.790763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.855134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:30.868656 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a2e5f6e1-eb9a-4969-a50d-6c07099e346a tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1315 microversion: 2.1 time: 0.258357 Sep 07 09:46:30.870921 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 303/614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:30.894199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:30.894919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:30.906843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.907348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.907791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:30.908500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:30.908957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:30.912945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.010069 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc8eaea5-ee49-47a5-ada0-b4dde201a472 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1617 microversion: 2.1 time: 0.242436 Sep 07 09:46:31.010656 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 312/615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1617 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:31.018088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:31.018088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:31.035183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.036745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.040495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.040947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.041456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.041891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.208887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:31.229155 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-29ebf6ec-323c-4bb0-8b66-583b31abea02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.356368 Sep 07 09:46:31.230054 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 304/616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:30 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:31.252726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:31.259654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'host': 'n-h2-836830-16', 'deleted': False} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:31.287764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.289633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.291365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.292742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.293543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.294153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.459964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:46:31.713567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:31.729739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:31.734882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:31.736827 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-045fda8a-8368-4ba7-a582-438c33a1b013 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.725237 Sep 07 09:46:31.739802 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 313/617] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:31 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:31.751960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:31.754969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:31.770814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.772545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.773700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.775522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.777504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.778504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.860771 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55dbf844-846e-46dd-b208-2d650e45a36c tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=n-h2-836830-16&all_tenants=1" status: 200 len: 1988 microversion: 2.1 time: 0.613477 Sep 07 09:46:31.861823 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 305/618] 10.222.0.60 () {58 vars in 1192 bytes} [Wed Sep 7 09:46:31 2022] GET /compute/v2.1/servers?host=n-h2-836830-16&all_tenants=1 => generated 1988 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:31.868154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:31.868786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:31.878045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.878827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.879570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:31.880592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:31.881442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:31.882150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.002544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:32.019034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:32.020481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:32.038890 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f658ebc-c705-452b-a75f-53fec95347b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.296937 Sep 07 09:46:32.039491 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 314/619] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:31 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:32.044007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:32.054683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:46:32.072050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.072378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.072861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.075041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.076680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.077266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.221348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3740861c-f5b5-40a3-a68b-b022f742aa79 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.180559 Sep 07 09:46:32.221969 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 315/620] 10.222.0.60 () {58 vars in 1196 bytes} [Wed Sep 7 09:46:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:46:32.254381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:32.255085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:32.279490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.281784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.283103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.284645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.285386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.285909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.373547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:32.381301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e210dc8f-fa3d-45c6-b683-9acdec499c55 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1465 microversion: 2.1 time: 0.518305 Sep 07 09:46:32.381868 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 306/621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:31 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1465 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:32.386236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:32.389288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:32.409019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.409545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.409989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.410904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.411538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.411976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.485819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:32.534863 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8373e8e5-d3c3-497b-995f-3ea936f7beff tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 0 microversion: 2.1 time: 0.151902 Sep 07 09:46:32.539425 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 307/622] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:32 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:46:32.549090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:32.552256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:32.559677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.563460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.563940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.564722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.565137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.565700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.713735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:32.724446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-afac4cf3-e85f-41b5-b11c-686c2ef9f1c1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1503 microversion: 2.1 time: 0.481341 Sep 07 09:46:32.725286 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 316/623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:32 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:32.730757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:32.734922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:32.741489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.742328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.743120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.743986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.744737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.745169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.838665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:46:32.839311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:46:32.839701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:46:32.840390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:46:32.841044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:46:32.917845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:32.924951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:32.932321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.933317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.933808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-473a489a-0ab7-4933-8f1c-50c8f19e5fd9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.396290 Sep 07 09:46:32.933929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.934393 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 308/624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:32 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:32.934544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.935100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.935767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.939438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:32.939945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:32.951607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.956082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.956617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.957492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:32.958081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:32.958581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:32.977542 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21eb32b9-8672-402b-ad01-5cedc7774b64 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 1068 microversion: 2.1 time: 0.250949 Sep 07 09:46:32.978292 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 317/625] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:46:32 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 1068 bytes in 252 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 09:46:32.997274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:32.998908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:33.002197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:46:33.010365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.014753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.015409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.016337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.018555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.019022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.026409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=18 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:33.033545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:33.221064 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-239e5525-7224-4e0c-bb82-6088985cb08b tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 204 len: 0 microversion: 2.1 time: 0.284994 Sep 07 09:46:33.221692 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 309/626] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:46:32 2022] DELETE /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:46:33.246042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:33.246756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:33.258541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.259679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.260275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.261512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.262151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.262764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.545320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.568185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.571345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.573586 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-78dba1bc-0702-4a15-805f-a24dc2e1af91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.586153 Sep 07 09:46:33.576674 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 318/627] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:32 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:33.583477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:33.584214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:33.600904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.602752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.606207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.607092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.607853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.608290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.624200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.632379 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8b317218-b420-464b-a52a-78fb8b4c7555 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.409494 Sep 07 09:46:33.634102 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 310/628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:33 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:33.642316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:33.643530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:33.655699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.664701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.665437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.668882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.670245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.671292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.729470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.740470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.742061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.748954 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cde3582-dd01-4c00-b0ca-7855e5aa55b3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1535 microversion: 2.91 time: 0.171253 Sep 07 09:46:33.749692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 319/629] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:33 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1535 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:33.754091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a8fd408d-be6c-4351-a41e-71fe119f08ec req-2a301769-242b-4714-ab09-dfd3cddd2ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f41b97e-f651-4d6b-bcc1-39918111adf8", "name": "network-vif-deleted", "tag": "210e4b3b-59dc-41a3-bdf4-827386b28f96"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:33.763965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:33.772718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a8fd408d-be6c-4351-a41e-71fe119f08ec req-2a301769-242b-4714-ab09-dfd3cddd2ad8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.773362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a8fd408d-be6c-4351-a41e-71fe119f08ec req-2a301769-242b-4714-ab09-dfd3cddd2ad8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.773878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a8fd408d-be6c-4351-a41e-71fe119f08ec req-2a301769-242b-4714-ab09-dfd3cddd2ad8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.789326 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a8fd408d-be6c-4351-a41e-71fe119f08ec req-2a301769-242b-4714-ab09-dfd3cddd2ad8 service nova] Creating event network-vif-deleted:210e4b3b-59dc-41a3-bdf4-827386b28f96 for instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 on n-h1-836830-16 Sep 07 09:46:33.794870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a8fd408d-be6c-4351-a41e-71fe119f08ec req-2a301769-242b-4714-ab09-dfd3cddd2ad8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044003 Sep 07 09:46:33.795713 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 320/630] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:33.800619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:33.801417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:33.808247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.808899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.809402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.810829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.810829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.811074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.840275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.850911 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a23313ea-9c8a-4b1b-9513-0f7d1c9d7902 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1509 microversion: 2.1 time: 0.215586 Sep 07 09:46:33.861927 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 311/631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:33 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:33.906814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:33.915372 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-987a3e14-6d13-4625-8a10-6d1f74186fd5 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1423 microversion: 2.1 time: 0.118490 Sep 07 09:46:33.915832 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 321/632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:33 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:33.959874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:33.961314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:33.970856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.971598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.972286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:33.973537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:33.974231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:33.974880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:34.229984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:34.237689 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-606e3319-c4c8-4fb6-9b27-b861591e733c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.282063 Sep 07 09:46:34.238519 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 312/633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:33 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:34.603748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:34.604356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:34.612064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:34.612623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:34.613048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:34.614081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:34.614693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:34.615117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:34.656844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:34.657492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:34.672970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:34.673494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:34.673933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:34.674659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:34.675092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:34.675516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.047214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.056864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.058650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.060600 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed581fcb-0be2-4f6e-b85c-d2878c40e257 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.460886 Sep 07 09:46:35.061451 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 322/634] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:34 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:35.067331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:35.068018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:35.074725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.075724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.076384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.078041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.078714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.079386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.110429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.149532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-368d2153-8935-4768-8a44-74f5e24831ec tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.495179 Sep 07 09:46:35.150854 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 313/635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:34 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:46:35.156497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:35.157101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:35.164091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.165237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.165678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.166386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.166958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.167395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.188941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.199341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.202967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.213579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9fdb334-c667-4030-85ba-bbaf556fddb8 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1535 microversion: 2.91 time: 0.149197 Sep 07 09:46:35.214871 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 323/636] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:35 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:35.222478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:35.223190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:35.229528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.230194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.230958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.231736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.232947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.233609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.284795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.285843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.286530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.287179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lazy-loading 'fault' on Instance uuid 4f41b97e-f651-4d6b-bcc1-39918111adf8 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:35.571022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.603611 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2e80750-2ef1-4ff5-a1a7-0748fedd6b13 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1309 microversion: 2.1 time: 0.387548 Sep 07 09:46:35.605371 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 324/637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:35 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:35.612946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:35.616321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:35.625216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.626222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.626911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.627846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.629406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.631344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.683965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.700377 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-093529d7-d206-424f-9fb2-2660997db1c7 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1509 microversion: 2.1 time: 0.547976 Sep 07 09:46:35.714498 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 314/638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:35 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:35.726838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e04f6a6a-c43e-47df-a336-e5ddb6f5519b req-3c835c7c-7318-4340-8d6b-f632c2a9443f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f049d128-5144-4317-bea4-df282e452251", "name": "network-vif-deleted", "tag": "2a7aef82-26cf-4f15-a7ed-33abac9d0fcb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:35.742301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e04f6a6a-c43e-47df-a336-e5ddb6f5519b req-3c835c7c-7318-4340-8d6b-f632c2a9443f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.743220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e04f6a6a-c43e-47df-a336-e5ddb6f5519b req-3c835c7c-7318-4340-8d6b-f632c2a9443f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.743732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e04f6a6a-c43e-47df-a336-e5ddb6f5519b req-3c835c7c-7318-4340-8d6b-f632c2a9443f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.762114 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e04f6a6a-c43e-47df-a336-e5ddb6f5519b req-3c835c7c-7318-4340-8d6b-f632c2a9443f service nova] Creating event network-vif-deleted:2a7aef82-26cf-4f15-a7ed-33abac9d0fcb for instance f049d128-5144-4317-bea4-df282e452251 on n-h1-836830-16 Sep 07 09:46:35.775921 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e04f6a6a-c43e-47df-a336-e5ddb6f5519b req-3c835c7c-7318-4340-8d6b-f632c2a9443f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052655 Sep 07 09:46:35.776837 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 315/639] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:35.785365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5a2b1e74-672f-47ce-ac80-b90cea4d46d1 req-f9cead75-0cb0-4607-a567-1c3012f9ea8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c33bb-7f8e-4a60-8857-37805be90773", "name": "network-vif-plugged", "status": "completed", "tag": "091bfdd5-5dac-4645-a4d1-c4854d2a82e1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:35.799441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5a2b1e74-672f-47ce-ac80-b90cea4d46d1 req-f9cead75-0cb0-4607-a567-1c3012f9ea8f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.800226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5a2b1e74-672f-47ce-ac80-b90cea4d46d1 req-f9cead75-0cb0-4607-a567-1c3012f9ea8f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.800823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5a2b1e74-672f-47ce-ac80-b90cea4d46d1 req-f9cead75-0cb0-4607-a567-1c3012f9ea8f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.806646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:35.818745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5a2b1e74-672f-47ce-ac80-b90cea4d46d1 req-f9cead75-0cb0-4607-a567-1c3012f9ea8f service nova] Creating event network-vif-plugged:091bfdd5-5dac-4645-a4d1-c4854d2a82e1 for instance e32c33bb-7f8e-4a60-8857-37805be90773 on n-h2-836830-16 Sep 07 09:46:35.824769 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5a2b1e74-672f-47ce-ac80-b90cea4d46d1 req-f9cead75-0cb0-4607-a567-1c3012f9ea8f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044020 Sep 07 09:46:35.827842 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 316/640] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:35.834239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3a254c-8c21-419d-8c5d-2590f40228cb", "name": "network-vif-unplugged", "status": "completed", "tag": "c1c00cd9-f1f7-4e61-a58e-1a21d22d498e"}, {"name": "network-changed", "server_uuid": "5d3a254c-8c21-419d-8c5d-2590f40228cb", "tag": "c1c00cd9-f1f7-4e61-a58e-1a21d22d498e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:35.849002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:35.849798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:35.850386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:35.866805 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] Creating event network-vif-unplugged:c1c00cd9-f1f7-4e61-a58e-1a21d22d498e for instance 5d3a254c-8c21-419d-8c5d-2590f40228cb on n-h1-836830-16 Sep 07 09:46:35.867512 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] Creating event network-changed:c1c00cd9-f1f7-4e61-a58e-1a21d22d498e for instance 5d3a254c-8c21-419d-8c5d-2590f40228cb on n-h1-836830-16 Sep 07 09:46:35.875335 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fb036116-e496-4d32-a4e0-665b2f42f7c0 req-11896ba4-19b6-48a6-8b75-70145cf81e26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.045423 Sep 07 09:46:35.876505 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 317/641] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:35.878079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:35.905251 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f82ecd5d-4957-491b-9166-c29bc08736ea tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.298108 Sep 07 09:46:35.907180 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 325/642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:35 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:36.089922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:36.090632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:36.098008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.098505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.098944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.100035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.100848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.101529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.180815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:36.182084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:36.192263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.192676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.193114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.196216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.196914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.197392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.339850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.349935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.351731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.353286 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cdf92011-1d5f-4c02-a307-69a26b8dc1bf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1362 microversion: 2.25 time: 0.267806 Sep 07 09:46:36.365903 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 318/643] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:36 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:36.379945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:36.380671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:36.387263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:36.389168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.390175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.390865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.392865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.393620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.412773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.429693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.439628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99147461-82df-45b9-b693-50b05329dd68 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.262977 Sep 07 09:46:36.441570 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 326/644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:36 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:46:36.507121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.517146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.518748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.524236 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9960117c-3999-4963-9fde-db68b9321ad3 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1535 microversion: 2.91 time: 0.156802 Sep 07 09:46:36.524889 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 319/645] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:36 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1535 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:36.631387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:36.632231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:36.639911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.640939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.641613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.642701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.643495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.644078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.706139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.706899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.712767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.713640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lazy-loading 'fault' on Instance uuid 4f41b97e-f651-4d6b-bcc1-39918111adf8 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:36.730364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:36.731055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:36.741645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.742157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.742608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.743324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.743792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.744219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.788642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.798237 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cabc74c-cff9-4864-90f9-0cead7b05e1f tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 200 len: 1309 microversion: 2.1 time: 0.172450 Sep 07 09:46:36.799139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 327/646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:36 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 1309 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:36.802433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.803171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.803822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.804491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lazy-loading 'fault' on Instance uuid f049d128-5144-4317-bea4-df282e452251 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:36.855725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:36.865682 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2fceb46e-5533-4ac9-8b23-2b725af268d2 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1305 microversion: 2.1 time: 0.141322 Sep 07 09:46:36.869042 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 320/647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:36 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:46:36.932685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:36.933354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:36.942909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.943534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.943982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:36.944701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:36.945164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:36.945618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.122948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.143701 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aaea4491-c30f-4c0d-8000-705571d6e9b4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.212008 Sep 07 09:46:37.146203 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 328/648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:36 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:37.380947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:37.381604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:37.387654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.388677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.389132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.389852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.390308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.390741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.472918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:37.474440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:37.481030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.481844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.482462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.483177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.483898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.484481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.657001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.670242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.677558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.681569 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c16bf4a1-d1a2-4106-a935-aae88a888165 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1559 microversion: 2.25 time: 0.304629 Sep 07 09:46:37.684730 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 321/649] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:37 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1559 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:37.690324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:37.692942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:37.718537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.724011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.724489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.725277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.725755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.726191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.773023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.791596 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c4e9d420-583a-42c4-901c-38d1643f2c77 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.328248 Sep 07 09:46:37.792397 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 329/650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:37 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:46:37.883088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.893633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.895100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:37.912140 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27525095-ef68-48c1-bfff-f90aa651a12c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1478 microversion: 2.91 time: 0.225502 Sep 07 09:46:37.919645 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 322/651] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:37 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1478 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:37.933062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:37.934465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: 4f41b97e-f651-4d6b-bcc1-39918111adf8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:37.946934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.947682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.948433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.951670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:37.952466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:37.953256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:37.997128 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] HTTP exception thrown: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 could not be found. Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Request method failure captured: Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 HTTP/1.1 Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGhAyM1zTmmbIznWErMZrcHJpojpQZlbu3MJ8PqbyDWkX8L_smgDEXvVuTORhmu1ayls54ALvdP3NsNPbmlRkhHfdqUXVXHzrgypSRwqjZKLUS7dzIDHvnSq3KuZX6hefk9Wg60JNRsbbD2N5k21EwIG1vPABRUPxEtPK7p3kPsU9Ag Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 31b79aaa1fd84b87a90dc4eb387d728a Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-LiveMigrationNegativeTest-1768834931 Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:46:37.999526 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31b79aaa1fd84b87a90dc4eb387d728a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31b79aaa1fd84b87a90dc4eb387d728a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31b79aaa1fd84b87a90dc4eb387d728a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31b79aaa1fd84b87a90dc4eb387d728a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-LiveMigrationNegativeTest-1768834931 Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 31b79aaa1fd84b87a90dc4eb387d728a Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1768834931 Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-LiveMigrationNegativeTest-1768834931-project Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e742bd4e77da4afbbfe6e5b83d7d1391 Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-LiveMigrationNegativeTest-1768834931-project Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 could not be found. Sep 07 09:46:38.001004 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4f41b97e-f651-4d6b-bcc1-39918111adf8'} Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 could not be found. Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:38.001955 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 could not be found. Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 could not be found. Sep 07 09:46:38.003379 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:38.005165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Returning 404 to user: Instance 4f41b97e-f651-4d6b-bcc1-39918111adf8 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:38.005165 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05824c37-fecf-48d6-aa82-d7eae99fbe03 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8" status: 404 len: 111 microversion: 2.1 time: 0.082459 Sep 07 09:46:38.005165 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 323/652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:37 2022] GET /compute/v2.1/servers/4f41b97e-f651-4d6b-bcc1-39918111adf8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:38.020473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:38.021104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.029226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.030360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.031003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.031982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.033027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.033753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.055809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:38.078348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.079097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.079726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.080340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lazy-loading 'fault' on Instance uuid f049d128-5144-4317-bea4-df282e452251 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:38.133935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:38.135338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.143810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.144456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.145022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.146488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.148799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.150842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.172426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1b8b83621d47feaa07b94a2384171d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a723b7cc864419a391b3cd6ff99bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:38.184188 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df572a82-cab9-4355-bffa-2b99e5e3d1d1 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 200 len: 1305 microversion: 2.1 time: 0.179045 Sep 07 09:46:38.192224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 324/653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:38 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 1305 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:38.198800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:38.210404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.223278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.223780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.224224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.224936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.230388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.230877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.367313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-836830-16". {{(pid=128832) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 09:46:38.469925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid e32c33bb-7f8e-4a60-8857-37805be90773 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:38.540577 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4021780b-f9dc-4901-bb85-d48ad49740c6 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action" status: 202 len: 0 microversion: 2.91 time: 0.347107 Sep 07 09:46:38.542231 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 325/654] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:46:38 2022] POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:46:38.547999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:38.548825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.556426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.557146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.558114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.559083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.560350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.561655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.585579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90b40066-5d2a-418b-b08f-0141b71f1191 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 2054 microversion: 2.25 time: 0.791834 Sep 07 09:46:38.587132 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 330/655] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:37 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 2054 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:38.592842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:38.593904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.600796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.601634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.602228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.603086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.603773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.604346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.624471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:46:38.771216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e10d4d7-6327-4fde-90c9-415a79f1b0e8 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 204 len: 0 microversion: 2.1 time: 0.226972 Sep 07 09:46:38.776332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 326/656] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:46:38 2022] DELETE /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:46:38.782970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:38.785938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.793975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.794842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.796159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.799406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.800014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.800606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.817882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:38.829511 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52842bb0-2c90-4b98-83ab-3d4311faf7b3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.238641 Sep 07 09:46:38.832898 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 331/657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:38 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:38.850360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:38.851304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:38.859270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.860132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.860729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.861801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:38.862526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:38.863502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:38.956707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:38.981419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:38.987196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:39.003803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6cbb7b0c-c0f2-4b0e-a418-268724fdf626 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1486 microversion: 2.91 time: 0.227343 Sep 07 09:46:39.005862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 327/658] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:38 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1486 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:39.015929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:39.018485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.048877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.049526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.050180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.051016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.051583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.052123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.101152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid e32c33bb-7f8e-4a60-8857-37805be90773 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:39.136599 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-98d8d67f-c1f7-484b-89a0-aa9d526dd281 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 2054 microversion: 2.25 time: 0.302403 Sep 07 09:46:39.140887 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 332/659] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:38 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 2054 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:39.153991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:39.158658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.171582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.172971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.175340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.180188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.180719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.181236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.267165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:39.282327 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09d1e73d-65c8-46cc-aa6e-888ee63ebf4a tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1474 microversion: 2.1 time: 0.270386 Sep 07 09:46:39.285230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 328/660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:39 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1474 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:39.293461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:39.305619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.308058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.310610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.311799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.312695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.313351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.352525 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d3dfc07c-748c-41da-9366-74fd54ed5626 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.065934 Sep 07 09:46:39.353526 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 329/661] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 7 09:46:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:39.358665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:39.359589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.365683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.366188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.366607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.367314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.367773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.368202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.389513 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 HTTP/1.1 Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:46:39.391713 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.393575 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f049d128-5144-4317-bea4-df282e452251'} Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:39.394554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.396058 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.397477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:39.397477 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45027f55-22fb-45cd-bde4-de4e041aa265 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 404 len: 111 microversion: 2.1 time: 0.038694 Sep 07 09:46:39.397634 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 330/662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:39 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:39.404883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-16", "block_migration": "auto"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:39.407519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.414531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.415028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.415766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.416155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.416988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.417678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.450392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'flavor' on Instance uuid e32c33bb-7f8e-4a60-8857-37805be90773 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:39.469124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Going to try to live migrate instance to n-h1-836830-16 {{(pid=128832) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:46:39.525110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:39.540965 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4c1fe842-e261-4028-ac61-699d12c1bf5f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.398504 Sep 07 09:46:39.542090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 333/663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:39 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:39.558675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-802719777", "metadata": {"image_type": "test"}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:39.562394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.591665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.592399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.602191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.603539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.604005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.604516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.607744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:39.637037 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251/action HTTP/1.1 Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 111 Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:39.639197 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-802719777", "metadata": {"image_type": "test"}}} Sep 07 09:46:39.640492 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'f049d128-5144-4317-bea4-df282e452251', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-802719777', 'metadata': {'image_type': 'test'}}}} Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.641229 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.642311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.643532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.643532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:39.643532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:39.643532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.643532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.651474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:39.652464 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-465aec75-93ac-4900-a40d-41daf8847809 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "POST /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251/action" status: 404 len: 111 microversion: 2.1 time: 0.109277 Sep 07 09:46:39.653067 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 334/664] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 7 09:46:39 2022] POST /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251/action => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:39.666308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2c3ec3c-c644-4357-8995-aa8837667914 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-16585128", "metadata": {"image_type": "test"}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:39.670226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2c3ec3c-c644-4357-8995-aa8837667914 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Failed to fetch instance by id tempest-invalid-1153988022 {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 09:46:39.680108 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d2c3ec3c-c644-4357-8995-aa8837667914 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance tempest-invalid-1153988022 could not be found. Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2c3ec3c-c644-4357-8995-aa8837667914 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/tempest-invalid-1153988022/action HTTP/1.1 Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 110 Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:39.683603 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-16585128", "metadata": {"image_type": "test"}}} Sep 07 09:46:39.685388 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance tempest-invalid-1153988022 could not be found. Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'tempest-invalid-1153988022', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-16585128', 'metadata': {'image_type': 'test'}}}} Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1153988022 could not be found. Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:39.686244 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1153988022 could not be found. Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1153988022 could not be found. Sep 07 09:46:39.687631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.690335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2c3ec3c-c644-4357-8995-aa8837667914 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance tempest-invalid-1153988022 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:39.691568 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2c3ec3c-c644-4357-8995-aa8837667914 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "POST /compute/v2.1/servers/tempest-invalid-1153988022/action" status: 404 len: 101 microversion: 2.1 time: 0.030705 Sep 07 09:46:39.697934 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 335/665] 10.222.0.60 () {60 vars in 1249 bytes} [Wed Sep 7 09:46:39 2022] POST /compute/v2.1/servers/tempest-invalid-1153988022/action => generated 101 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:46:39.708622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea1b6c36-7323-44df-b853-dcd0a31fc4fe tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1861739200"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:39.723052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea1b6c36-7323-44df-b853-dcd0a31fc4fe tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 09:46:39.723975 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ea1b6c36-7323-44df-b853-dcd0a31fc4fe tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea1b6c36-7323-44df-b853-dcd0a31fc4fe tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 57 Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:39.726250 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "tempest-test-snap-1861739200"}} Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:39.727783 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1861739200'}}} Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.728712 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.730279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.733323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea1b6c36-7323-44df-b853-dcd0a31fc4fe tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:39.734489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea1b6c36-7323-44df-b853-dcd0a31fc4fe tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.031013 Sep 07 09:46:39.735235 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 336/666] 10.222.0.60 () {60 vars in 1275 bytes} [Wed Sep 7 09:46:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:46:39.745018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9f2cc8f-90d1-4067-9640-82199cff9dd9 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-655168901"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:39.748481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9f2cc8f-90d1-4067-9640-82199cff9dd9 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 09:46:39.749303 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a9f2cc8f-90d1-4067-9640-82199cff9dd9 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9f2cc8f-90d1-4067-9640-82199cff9dd9 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 56 Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:39.751010 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "tempest-test-snap-655168901"}} Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:39.752545 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-655168901'}}} Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.753522 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 09:46:39.754928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.760825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9f2cc8f-90d1-4067-9640-82199cff9dd9 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:39.760825 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9f2cc8f-90d1-4067-9640-82199cff9dd9 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013330 Sep 07 09:46:39.760825 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 337/667] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Sep 7 09:46:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:39.774935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:39.775617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.808314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.810881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.811630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.821066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.821692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.822337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.840766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 HTTP/1.1 Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:39.875197 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.876812 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'f049d128-5144-4317-bea4-df282e452251'} Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:39.877685 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:39.879038 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:39.880341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:39.880341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-edc5392b-95ee-44c2-b83d-ee875c721101 tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 404 len: 111 microversion: 2.1 time: 0.107157 Sep 07 09:46:39.880341 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 338/668] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:46:39 2022] DELETE /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:39.884850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:39.885570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:39.893882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.894747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.895240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:39.896598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:39.897519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:39.898128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.094941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:40.121628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4227ae8-73b7-490b-8d78-16eb5abbf4fb tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.239373 Sep 07 09:46:40.123503 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 339/669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:39 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:40.139108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:40.140100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] [instance: f049d128-5144-4317-bea4-df282e452251] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:40.166158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.167518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.167959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.168690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.169410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.170388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.188476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] HTTP exception thrown: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Request method failure captured: Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 HTTP/1.1 Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhffXFg6tKBFiWAptLz4nSicofjJXejXHIS6SoK07yd74wcSJIhfKRWDWLesD73oKbjaUu6dZQUiw4T6c_nxlKFrn_24nDaN55f80St_hy9DZP9OsSbcmWNkcbIHc2tgMnI2RTI1Z29iyQ4-KN1xyeCsbDEzugm60oYnQ5-d8mME9M Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:40.190607 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/65a723b7cc864419a391b3cd6ff99bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_65a723b7cc864419a391b3cd6ff99bd0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 65a723b7cc864419a391b3cd6ff99bd0 Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1960802848 Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6b1b8b83621d47feaa07b94a2384171d Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesNegativeTestJSON-1960802848-project Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:40.192119 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'f049d128-5144-4317-bea4-df282e452251'} Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:40.192817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. Sep 07 09:46:40.193992 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:40.209882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] Returning 404 to user: Instance f049d128-5144-4317-bea4-df282e452251 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:40.211686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2afd423b-41c6-4a9f-9bbd-67e4da1a83eb tempest-ImagesNegativeTestJSON-1960802848 tempest-ImagesNegativeTestJSON-1960802848-project] 10.222.0.60 "GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251" status: 404 len: 111 microversion: 2.1 time: 0.086830 Sep 07 09:46:40.216310 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 340/670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:40 2022] GET /compute/v2.1/servers/f049d128-5144-4317-bea4-df282e452251 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:40.221881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:40.223278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:40.230197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.230931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.232171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.233825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.234464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.235045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.352605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:40.375026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:40.376117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:40.393252 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e12676a8-1318-4b16-99a8-2c3768e9a908 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1486 microversion: 2.91 time: 0.175599 Sep 07 09:46:40.393940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 341/671] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:40 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1486 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:40.421030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:40.421895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:40.429433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.430360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.430957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.432233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.432979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.433601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.892736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:40.911213 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ddfbbefc-19b6-4406-9547-fb95d845d65d tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1474 microversion: 2.1 time: 0.514815 Sep 07 09:46:40.914015 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 342/672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:40 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1474 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:40.931518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:40.932734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:40.948480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.949330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.950015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:40.951834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:40.952562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:40.953284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:41.382226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:41.391589 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31d2bcd4-3809-460a-a1ef-2da1c0fb6f4e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.476122 Sep 07 09:46:41.420001 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 343/673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:40 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:41.428347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:41.428961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:41.437067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:41.437938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:41.438923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:41.439847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:41.440515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:41.441170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:41.932295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:41.949632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-af7a61c0-2522-4f29-9496-d258f0e2158d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.528717 Sep 07 09:46:41.950229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 344/674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:41 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:41.987388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:41.988026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:42.008692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.009202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.009645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.010352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.010824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.017534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.120241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=26 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:42.319459 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa88f6f4-7722-4274-8d89-c4fb0e34255b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773/action" status: 202 len: 0 microversion: 2.25 time: 2.920748 Sep 07 09:46:42.329073 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 331/675] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:46:39 2022] POST /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773/action => generated 0 bytes in 2931 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:46:42.340626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7a309953-a799-454d-86eb-4e04836e951d req-137fe876-5df0-438f-8280-3761b10d01ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4990dbd-4309-446a-acd2-2095737e7a98", "name": "network-vif-deleted", "tag": "1a84e9e8-16c3-4037-90f2-e08f2b360094"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:42.368732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.378501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.384344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.397400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7a309953-a799-454d-86eb-4e04836e951d req-137fe876-5df0-438f-8280-3761b10d01ec service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.398447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7a309953-a799-454d-86eb-4e04836e951d req-137fe876-5df0-438f-8280-3761b10d01ec service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.400499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7a309953-a799-454d-86eb-4e04836e951d req-137fe876-5df0-438f-8280-3761b10d01ec service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.406707 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67e53884-6ad6-4df9-82d6-9881ce37b89b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.436620 Sep 07 09:46:42.417841 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 345/676] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:41 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:42.431436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:42.432064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:42.443906 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7a309953-a799-454d-86eb-4e04836e951d req-137fe876-5df0-438f-8280-3761b10d01ec service nova] Creating event network-vif-deleted:1a84e9e8-16c3-4037-90f2-e08f2b360094 for instance e4990dbd-4309-446a-acd2-2095737e7a98 on n-h1-836830-16 Sep 07 09:46:42.450597 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7a309953-a799-454d-86eb-4e04836e951d req-137fe876-5df0-438f-8280-3761b10d01ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117568 Sep 07 09:46:42.453743 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 332/677] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:42.460845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.461377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.461821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.462531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.462989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.463169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:42.463415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.464397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:42.495032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.495859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.499319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.500541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.502292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.519295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.578840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.579333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.579777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.580232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lazy-loading 'fault' on Instance uuid e4990dbd-4309-446a-acd2-2095737e7a98 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:46:42.696566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e742bd4e77da4afbbfe6e5b83d7d1391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b79aaa1fd84b87a90dc4eb387d728a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.715382 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8278a42-0786-46a0-9bd3-b632c5120531 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 200 len: 1308 microversion: 2.1 time: 0.296432 Sep 07 09:46:42.729299 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 346/678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:42 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:42.730155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:42.730791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:42.741678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.742582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.743032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.743802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:42.744269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:42.744700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:42.933002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.953041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.959103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:42.963661 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-95cb5f2e-b853-451b-b460-33561f2a46e1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.507554 Sep 07 09:46:42.965255 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 333/679] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:42 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:42.980874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:42.983741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:43.011807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:43.012298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:43.013849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:43.014840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:43.015467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:43.017834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:43.524676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:43.533727 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1bceb49c-22b5-426b-9e77-8fff9403719e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.814575 Sep 07 09:46:43.545764 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 347/680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:42 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:43.551309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:43.552250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:43.563708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:43.566675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:43.569735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:43.570871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:43.571563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:43.575849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:43.746096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:43.755137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:43.775995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:43.788443 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-034499c5-a9d5-45b7-a6c5-610863fd71ad tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.241181 Sep 07 09:46:43.789354 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 348/681] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:43 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:43.802282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:43.806987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] [instance: e4990dbd-4309-446a-acd2-2095737e7a98] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:43.829782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:43.833172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:43.833940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:43.834907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:43.838585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:43.839321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:43.886645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] HTTP exception thrown: Instance e4990dbd-4309-446a-acd2-2095737e7a98 could not be found. Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Request method failure captured: Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 HTTP/1.1 Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhAyM1zTmmbIznWErMZrcHJpojpQZlbu3MJ8PqbyDWkX8L_smgDEXvVuTORhmu1ayls54ALvdP3NsNPbmlRkhHfdqUXVXHzrgypSRwqjZKLUS7dzIDHvnSq3KuZX6hefk9Wg60JNRsbbD2N5k21EwIG1vPABRUPxEtPK7p3kPsU9Ag Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 31b79aaa1fd84b87a90dc4eb387d728a Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveMigrationNegativeTest-1768834931 Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:46:43.898477 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31b79aaa1fd84b87a90dc4eb387d728a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31b79aaa1fd84b87a90dc4eb387d728a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31b79aaa1fd84b87a90dc4eb387d728a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31b79aaa1fd84b87a90dc4eb387d728a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveMigrationNegativeTest-1768834931 Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 31b79aaa1fd84b87a90dc4eb387d728a Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1768834931 Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveMigrationNegativeTest-1768834931-project Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e742bd4e77da4afbbfe6e5b83d7d1391 Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveMigrationNegativeTest-1768834931-project Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e4990dbd-4309-446a-acd2-2095737e7a98 could not be found. Sep 07 09:46:43.900232 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e4990dbd-4309-446a-acd2-2095737e7a98'} Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4990dbd-4309-446a-acd2-2095737e7a98 could not be found. Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:46:43.901040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4990dbd-4309-446a-acd2-2095737e7a98 could not be found. Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4990dbd-4309-446a-acd2-2095737e7a98 could not be found. Sep 07 09:46:43.902503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:46:43.905969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] Returning 404 to user: Instance e4990dbd-4309-446a-acd2-2095737e7a98 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:46:43.907697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5beed373-27c6-4002-8c94-5d6fe23e9aa6 tempest-LiveMigrationNegativeTest-1768834931 tempest-LiveMigrationNegativeTest-1768834931-project] 10.222.0.60 "GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98" status: 404 len: 111 microversion: 2.1 time: 0.109365 Sep 07 09:46:43.911198 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 349/682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:43 2022] GET /compute/v2.1/servers/e4990dbd-4309-446a-acd2-2095737e7a98 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:46:43.993232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:43.994218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:44.014921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:44.015426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:44.015872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:44.016600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:44.017063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:44.017525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:44.166680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:44.183634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-abcdbf9f-a357-4ba1-a0e2-8e16313470b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 1.213923 Sep 07 09:46:44.192465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 334/683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:42 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:44.570846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:44.571511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:44.581488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:44.583754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:44.584378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:44.588166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:44.588861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:44.589574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:44.606104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:44.621256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:44.642184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:44.644003 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-81d3d0cf-3ba0-4f6f-8a0f-b09df46dd1e9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.654760 Sep 07 09:46:44.645102 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 350/684] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:43 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:44.822238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:44.822952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:44.835892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:44.836603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:44.837256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:44.838104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:44.847113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:44.848823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:44.980131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:44.991332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:45.007356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:45.014113 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48270ea4-6382-4e9b-83a3-5bdb99d1ebab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.195919 Sep 07 09:46:45.014856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 351/685] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:44 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:46:45.108432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:45.116995 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-117d2530-4267-42fb-9ead-4552d3923373 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1472 microversion: 2.1 time: 0.550180 Sep 07 09:46:45.129535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 335/686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:44 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:45.218861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:45.219793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:45.231850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:45.232376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:45.238301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:45.239246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:45.239853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:45.240397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:45.677846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:45.681250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:45.701837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:45.702759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:45.703529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:45.713805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:45.714514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:45.715145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:45.912780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:45.949316 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c054086f-dc70-422d-a217-70b025709a02 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 0.733448 Sep 07 09:46:45.953848 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 352/687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:45 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:46.070801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:46.082499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:46.103176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:46.104046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:46.105391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:46.108949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:46.110276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:46.112805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:46.524500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.541306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.542851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.558364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.567718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.569196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.570470 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f087069-eb9d-435b-8683-bff624b35ed4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.897957 Sep 07 09:46:46.580771 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-367b657a-3f8f-4d97-9e8e-f97616b09406 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.529681 Sep 07 09:46:46.581855 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 353/688] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:46 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:46.583887 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 336/689] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:45 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:46.594470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:46.595086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:46.604655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:46.605152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:46.605654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:46.606314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:46.607345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:46.607782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:46.758982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e69186e8-7a69-4f53-b16b-08c1f0b77efc req-86442061-be22-455f-90d0-b65a9d0fade0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c33bb-7f8e-4a60-8857-37805be90773", "name": "network-vif-unplugged", "status": "completed", "tag": "091bfdd5-5dac-4645-a4d1-c4854d2a82e1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:46.783564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e69186e8-7a69-4f53-b16b-08c1f0b77efc req-86442061-be22-455f-90d0-b65a9d0fade0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:46.784412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e69186e8-7a69-4f53-b16b-08c1f0b77efc req-86442061-be22-455f-90d0-b65a9d0fade0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:46.785015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e69186e8-7a69-4f53-b16b-08c1f0b77efc req-86442061-be22-455f-90d0-b65a9d0fade0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:46.812051 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e69186e8-7a69-4f53-b16b-08c1f0b77efc req-86442061-be22-455f-90d0-b65a9d0fade0 service nova] Creating event network-vif-unplugged:091bfdd5-5dac-4645-a4d1-c4854d2a82e1 for instance e32c33bb-7f8e-4a60-8857-37805be90773 on n-h2-836830-16 Sep 07 09:46:46.827508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e69186e8-7a69-4f53-b16b-08c1f0b77efc req-86442061-be22-455f-90d0-b65a9d0fade0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072896 Sep 07 09:46:46.832575 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 337/690] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:46:46.953843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:46.965447 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-db4745c7-140e-4527-98c2-6317f0ba96a5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1478 microversion: 2.1 time: 0.379934 Sep 07 09:46:46.969340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 354/691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:46 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1478 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:46.986209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:46.986920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:47.003817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:47.004315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:47.004754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:47.005499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:47.006011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:47.007684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:47.086420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:47.626799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:47.627680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:47.648798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:47.649336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:47.649848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:47.650669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:47.651134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:47.651592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:48.056206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.068343 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34fb769a-b59d-47fb-83ee-b497e9ed17c0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 1.094028 Sep 07 09:46:48.070408 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 338/692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:46 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:48.082231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:48.083277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:48.098821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:48.102341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:48.104150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:48.106306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:48.109026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:48.119168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:48.315105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.330294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.333997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.406827 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81e020df-d362-434f-8eab-3a8fa16121a9 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.333436 Sep 07 09:46:48.464934 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 339/693] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:48 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:48.478497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:48.479134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:48.491390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:48.491889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:48.492330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:48.493045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:48.507030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.521068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.522350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:48.522860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:48.534931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:48.536304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8562464a-b71e-406a-b6bb-0ad6c3ebe030 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.914414 Sep 07 09:46:48.536918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 355/694] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:47 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:48.874192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-29195bb0-16b7-4d86-badb-b6e9f875ad8c req-5ac932a0-eefe-4aef-9991-cc663c1d0ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32c33bb-7f8e-4a60-8857-37805be90773", "tag": "091bfdd5-5dac-4645-a4d1-c4854d2a82e1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:48.897653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-29195bb0-16b7-4d86-badb-b6e9f875ad8c req-5ac932a0-eefe-4aef-9991-cc663c1d0ba7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:48.898615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-29195bb0-16b7-4d86-badb-b6e9f875ad8c req-5ac932a0-eefe-4aef-9991-cc663c1d0ba7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:48.899516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-29195bb0-16b7-4d86-badb-b6e9f875ad8c req-5ac932a0-eefe-4aef-9991-cc663c1d0ba7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:48.904692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:48.934483 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-29195bb0-16b7-4d86-badb-b6e9f875ad8c req-5ac932a0-eefe-4aef-9991-cc663c1d0ba7 service nova] Creating event network-changed:091bfdd5-5dac-4645-a4d1-c4854d2a82e1 for instance e32c33bb-7f8e-4a60-8857-37805be90773 on n-h2-836830-16 Sep 07 09:46:48.962705 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-29195bb0-16b7-4d86-badb-b6e9f875ad8c req-5ac932a0-eefe-4aef-9991-cc663c1d0ba7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085753 Sep 07 09:46:48.964034 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 356/695] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:46:49.098860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:49.099981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:49.118098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:49.120135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:49.120843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:49.128786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:49.129764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:49.131197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:49.323061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=17 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:50.738532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:50.749365 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-340a56c8-65d5-45fa-a5f7-e3afb9376d2c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1478 microversion: 2.1 time: 2.282962 Sep 07 09:46:50.760776 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 340/696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:48 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1478 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:50.776156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:50.777134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:50.791249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:50.797932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:50.805816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:50.806760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:50.807356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:50.807862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:51.365146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:51.375293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:51.384246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:51.395277 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b832f60-faaf-4fcf-8689-57719f56a7a1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.632815 Sep 07 09:46:51.432544 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 341/697] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:50 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:51.445997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:51.453456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:51.454968 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0d51c854-68f9-4923-bd9b-c91fa8ed6eed tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1504 microversion: 2.1 time: 2.361156 Sep 07 09:46:51.455555 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 357/698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:49 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1504 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:46:51.470388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:51.481610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:51.482553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:51.483185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:51.484092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:51.484718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:51.485417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:51.779279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1ea9219-006d-4d4e-994c-6162295fe026 tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] Calling method '.version_select at 0x7f14b26080d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:51.801210 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1ea9219-006d-4d4e-994c-6162295fe026 tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.344559 Sep 07 09:46:51.804782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 358/699] 10.222.0.60 () {60 vars in 1226 bytes} [Wed Sep 7 09:46:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:51.834566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:51.835736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:51.852373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:51.853785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:51.856959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:51.858045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:51.860628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:51.861293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:52.331878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.341982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.343482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.344701 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e0b5f43-958c-46de-91c6-cea54dccdb0f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.910767 Sep 07 09:46:52.372922 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 342/700] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:51 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:52.378479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63c10e0c-c46c-4b8e-bdd2-8a913372a94d tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1fbe0d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:52.387617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.415469 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aa8a4ef9-34d9-46e0-ae57-92080064b766 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1478 microversion: 2.1 time: 0.607987 Sep 07 09:46:52.440900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 359/701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:51 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1478 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:52.446607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:52.447597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:52.454735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:52.455489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:52.456144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:52.457209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:52.457972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:52.458621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:52.612557 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63c10e0c-c46c-4b8e-bdd2-8a913372a94d tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.237680 Sep 07 09:46:52.613455 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 343/702] 10.222.0.60 () {62 vars in 1247 bytes} [Wed Sep 7 09:46:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:52.625873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:52.626558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:52.635165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=9,nova_api:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:52.636338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.638165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:52.641297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:52.642914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:52.650728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.651872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:52.652843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:52.654132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:52.658270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:52.666661 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e4cb654-da99-482a-90de-5bcaa2e37ca2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.224302 Sep 07 09:46:52.667831 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 360/703] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:52 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:52.673793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-742ae1ce-b560-4abd-a0d3-ebaf38e6d8a7 tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] Calling method '.version_select at 0x7f14b27984c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:52.714768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-742ae1ce-b560-4abd-a0d3-ebaf38e6d8a7 tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.045325 Sep 07 09:46:52.716300 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 361/704] 10.222.0.60 () {60 vars in 1226 bytes} [Wed Sep 7 09:46:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:52.734171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4bbe5007-ae88-477f-91f2-9798ea6b42c7 tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] Action: 'update', calling method: .version_select at 0x7f14b22caee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:52.779405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:46:52.943643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4bbe5007-ae88-477f-91f2-9798ea6b42c7 tempest-QuotaClassesAdmin257Test-313120618 tempest-QuotaClassesAdmin257Test-313120618-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.216455 Sep 07 09:46:52.975120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 362/705] 10.222.0.60 () {62 vars in 1247 bytes} [Wed Sep 7 09:46:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:46:53.373925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:53.374541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:53.399598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:53.400198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:53.400689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:53.406503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:53.407342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:53.421053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:54.250268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:54.272724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:54.274354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:54.282849 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9609365a-2037-43f1-85df-5d08131a1703 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.913348 Sep 07 09:46:54.283567 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 363/706] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:53 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:46:54.294952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:54.303217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:54.317114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:54.320856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:54.329299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:54.329780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:54.330475 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d15a7b0-cd38-4dc1-834d-b7611e3bbb17 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1479 microversion: 2.1 time: 1.715507 Sep 07 09:46:54.331352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:54.331456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:54.332896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:54.349530 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 344/707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:52 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1479 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:54.380506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:54.381021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:54.411013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:54.413267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:54.413731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:54.414464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:54.414929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:54.415444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:54.526264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:46:54.858122 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4cbf8fcf-f2e1-4dde-b00a-f2849d3f6b77 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 204 len: 0 microversion: 2.1 time: 0.504764 Sep 07 09:46:54.862091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 345/708] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:46:54 2022] DELETE /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:46:54.883505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:54.886623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:54.905485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:54.906300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:54.907011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:54.916059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:54.916676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:54.917395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:55.311826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:55.326776 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5aa4998a-5345-4405-a722-095dabec9444 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1478 microversion: 2.1 time: 1.036549 Sep 07 09:46:55.327384 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 364/709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:54 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1478 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:55.345233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15f6473f-b7e2-4ae1-a6cd-c6e9b0804a65 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '.version_select at 0x7f14b2424160>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:55.349242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f6473f-b7e2-4ae1-a6cd-c6e9b0804a65 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:55.349756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f6473f-b7e2-4ae1-a6cd-c6e9b0804a65 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:55.350199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f6473f-b7e2-4ae1-a6cd-c6e9b0804a65 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:55.379870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:55.384643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15f6473f-b7e2-4ae1-a6cd-c6e9b0804a65 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1176 microversion: 2.1 time: 0.055839 Sep 07 09:46:55.385581 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 365/710] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:46:55 2022] GET /compute/v2.1/os-migrations => generated 1176 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:55.389832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:55.398033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:55.403524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:55.412587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:55.420984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:55.422678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-582849cd-9d7b-4d20-a04b-0a9c11f19130 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.557598 Sep 07 09:46:55.433954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:55.434443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:55.435894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:55.436531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:55.437121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:55.446245 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 346/711] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:54 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:55.458546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:55.459559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:55.471362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:55.476184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:55.476966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:55.477975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:55.478679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:55.479868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:55.980932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:55.995350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc581738-5866-4a8d-887a-0050e70ee1cd tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1714 microversion: 2.1 time: 0.607948 Sep 07 09:46:55.996388 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 366/712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:55 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1714 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:56.002394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:56.003292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:56.012371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.013822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.014398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:56.015229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.015756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.016294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:56.259978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:56.279389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:56.280870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:56.282097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-deefab43-c3c9-438e-a2d2-1ee321a7eb9b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.834690 Sep 07 09:46:56.282970 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 347/713] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:55 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:56.288381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5ae160ae-9311-4ff8-9147-678988e1a5ff req-a87cdd4f-df9c-4dc1-ad24-370a454e013f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a1035a-aea9-42e8-a35d-1eb6768c666d", "name": "network-vif-plugged", "status": "completed", "tag": "494a8253-cb34-4c7c-a5e6-93a8372fb872"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:56.298751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5ae160ae-9311-4ff8-9147-678988e1a5ff req-a87cdd4f-df9c-4dc1-ad24-370a454e013f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.299452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5ae160ae-9311-4ff8-9147-678988e1a5ff req-a87cdd4f-df9c-4dc1-ad24-370a454e013f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.300185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5ae160ae-9311-4ff8-9147-678988e1a5ff req-a87cdd4f-df9c-4dc1-ad24-370a454e013f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:56.329432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5ae160ae-9311-4ff8-9147-678988e1a5ff req-a87cdd4f-df9c-4dc1-ad24-370a454e013f service nova] Creating event network-vif-plugged:494a8253-cb34-4c7c-a5e6-93a8372fb872 for instance f7a1035a-aea9-42e8-a35d-1eb6768c666d on n-h2-836830-16 Sep 07 09:46:56.336049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5ae160ae-9311-4ff8-9147-678988e1a5ff req-a87cdd4f-df9c-4dc1-ad24-370a454e013f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051631 Sep 07 09:46:56.336965 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 348/714] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:56.355299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:56.356221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:56.364482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.364994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.365451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:56.366284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.366600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.367025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:56.826563 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf8e3618-459e-4f18-aa34-68693a7dc55f tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1632 microversion: 2.1 time: 0.828352 Sep 07 09:46:56.828679 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 367/715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:55 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1632 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:56.836939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:56.838068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:56.847650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.848606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.849252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:56.850408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:56.851076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:56.851686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:57.035952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:57.056993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:57.058549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:57.086014 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61cce17a-a0ba-43a9-9918-bbd40c71f009 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.256164 Sep 07 09:46:57.086617 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 368/716] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:56 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:57.114028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce457d15-7765-45c1-be5a-68b44fa0f0e5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Action: 'create', calling method: .version_select at 0x7f14b222dee0>, body: {"keypair": {"name": "tempest-keypair-1062363125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOl6TsM/KvM/VqYulp778yc7bb7xSweoTtapQuJZTUEM4KqJHqhMdymRyZ/qJCPbjZLLV+IA2ntbKLjSGJNBHzq3+Kcf9atnboB7q99wTncBRNG9Xe6xF9D7axaDGCGoA=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:46:57.156735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ce457d15-7765-45c1-be5a-68b44fa0f0e5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:46:57.165956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ce457d15-7765-45c1-be5a-68b44fa0f0e5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for user 224142a6fa7e4702b1780f4aaeb3f93f and project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:46:57.190821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:57.204050 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9de4abd-39ec-4d9b-a1f5-95130da16192 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1478 microversion: 2.1 time: 0.853257 Sep 07 09:46:57.206759 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 349/717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:56 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1478 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:57.217679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:57.221162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:57.234775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:57.235502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:57.236503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:57.238335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:57.240644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:57.242113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:57.255427 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce457d15-7765-45c1-be5a-68b44fa0f0e5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167595 Sep 07 09:46:57.257719 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 369/718] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:46:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:46:57.310991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:57.311618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:57.322948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:57.323448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:57.323898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:57.332184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:57.332685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:57.333162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:58.094142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.126027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.130175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.134743 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19e4ba85-2a0f-4932-a783-cd85029fe224 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.826406 Sep 07 09:46:58.135396 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 370/719] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:57 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:58.149829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:58.150670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:58.171120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:58.171770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:58.172212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:58.173417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:58.173883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:58.178396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:58.537798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.553666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.557098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.570709 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11e2b441-4b8c-4188-8dd3-009f9887ccc5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.432873 Sep 07 09:46:58.575717 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 371/720] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:58 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:46:58.585327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:58.592784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:58.598822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:58.606065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:58.616338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:58.617089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:58.618041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:58.618659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:58.619266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:58.653711 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c4f9349-b005-4c0a-b215-8d05180cc87f tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1714 microversion: 2.1 time: 1.444402 Sep 07 09:46:58.659502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 350/721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:57 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1714 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:59.165393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:46:59.166385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:46:59.177211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:59.181771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:59.183133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:59.185317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:46:59.190734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:46:59.191507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:46:59.451179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:46:59.478534 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-da3126ae-086e-4011-8753-4ef3fe99aec2 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1464 microversion: 2.1 time: 0.897959 Sep 07 09:46:59.479686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 372/722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:46:58 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1464 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:46:59.882283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ec83ffc-aac4-4df6-b2b1-11e082873142 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] Action: 'create', calling method: .version_select at 0x7f14b25a35e0>, body: {"security_group": {"name": "tempest-securitygroup-896029262", "description": "tempest-description-392896240"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:00.061273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:00.072909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:00.074442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:00.076051 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f983af04-b672-4a81-a575-22c7b7a57bb4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1569 microversion: 2.25 time: 0.916541 Sep 07 09:47:00.089583 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 351/723] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:46:59 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1569 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:00.095298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:00.096095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:00.116631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:00.117395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:00.118180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:00.119080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:00.119692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:00.120266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:00.695907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:00.715017 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b74cc94-b05a-491e-ac14-1322b6ab7b71 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1464 microversion: 2.1 time: 0.623905 Sep 07 09:47:00.715543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 352/724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:00 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1464 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:00.722944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:00.729200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:00.743802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:00.744545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:00.745023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:00.745791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:00.748377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:00.750493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:00.975383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:00.991047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:00.996811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:01.016645 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-098a0cd0-6af8-438f-a1be-82f7ee3381b2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1531 microversion: 2.91 time: 0.297263 Sep 07 09:47:01.017300 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 353/725] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:00 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1531 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:01.060563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f685d745-ac54-4000-90f0-ad9bf945824e req-cada9286-9024-4f11-99e1-f2e70a3ee38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceffe667-57c6-4ae8-a0f3-6491b75d2353", "name": "network-vif-unplugged", "status": "completed", "tag": "0ac5e1c3-5127-407e-b8fa-7afde32aea1a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:01.090133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f685d745-ac54-4000-90f0-ad9bf945824e req-cada9286-9024-4f11-99e1-f2e70a3ee38d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.091595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f685d745-ac54-4000-90f0-ad9bf945824e req-cada9286-9024-4f11-99e1-f2e70a3ee38d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.092298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f685d745-ac54-4000-90f0-ad9bf945824e req-cada9286-9024-4f11-99e1-f2e70a3ee38d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.107909 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f685d745-ac54-4000-90f0-ad9bf945824e req-cada9286-9024-4f11-99e1-f2e70a3ee38d service nova] Creating event network-vif-unplugged:0ac5e1c3-5127-407e-b8fa-7afde32aea1a for instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 on n-h2-836830-16 Sep 07 09:47:01.115272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f685d745-ac54-4000-90f0-ad9bf945824e req-cada9286-9024-4f11-99e1-f2e70a3ee38d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084122 Sep 07 09:47:01.116430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 354/726] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:01.123730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:01.124441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:01.138947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.139449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.139896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.140602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.141280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.141895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.441434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0e6192cec344439361da0019175b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90fba56c62e4660ae559b2649e2c801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:01.444491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:01.454547 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ae8daa4-a69e-43af-bfef-6c685e7deb5a tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 200 len: 1647 microversion: 2.1 time: 0.336383 Sep 07 09:47:01.471514 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 355/727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:01 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 1647 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:01.477850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:01.480827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:01.488463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.489161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.489771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.490642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.491250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.491825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.623942 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ec83ffc-aac4-4df6-b2b1-11e082873142 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.142625 Sep 07 09:47:01.624556 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 373/728] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:46:59 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:01.630910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:01.633270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:01.645533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:01.648110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:01.648803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:01.649571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:01.650240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:01.651784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.654747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.656030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.657680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.660215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.661068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.789729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:01.798117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.799812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.800418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.801571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.802242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.804627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.843120 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d93f5929-7e72-40a3-b399-5fe53a93b282 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 1068 microversion: 2.1 time: 0.369928 Sep 07 09:47:01.844144 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 356/729] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:47:01 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 1068 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 09:47:01.849419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:01.850025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:01.856979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.857484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.858005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:01.859021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:01.859863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:01.860470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:02.235563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lazy-loading 'services' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:02.264763 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-242be750-9fa8-4e7d-b459-f37c31febdd5 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1938 microversion: 2.91 time: 0.638401 Sep 07 09:47:02.265880 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 374/730] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:01 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1938 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:02.295772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c72a9f8-7647-4b4b-a612-2f2f60eb1cf2 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] Action: 'create', calling method: .version_select at 0x7f14b226e820>, body: {"security_group": {"name": "tempest-securitygroup-253506870", "description": "tempest-description-1011288381"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:02.544962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:02.565436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:02.569730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:02.572062 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2eedd708-5b18-4fff-82e4-e9fccb151d0a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1559 microversion: 2.25 time: 0.725546 Sep 07 09:47:02.585208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 357/731] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:01 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1559 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:02.594816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:02.594816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:02.597948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:02.600054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:02.600508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:02.600942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:02.601895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:02.602190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:02.602617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.643071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:03.651714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03e7b9f6-9546-4dff-bcce-01a429358e3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 1.075042 Sep 07 09:47:03.652317 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 358/732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:02 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:03.659770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0537734c-08c4-43a8-a978-d8586c846234 req-f90434be-f082-4683-a235-1f5474085f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceffe667-57c6-4ae8-a0f3-6491b75d2353", "name": "network-vif-deleted", "tag": "0ac5e1c3-5127-407e-b8fa-7afde32aea1a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:03.687120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0537734c-08c4-43a8-a978-d8586c846234 req-f90434be-f082-4683-a235-1f5474085f5f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:03.687614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0537734c-08c4-43a8-a978-d8586c846234 req-f90434be-f082-4683-a235-1f5474085f5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:03.688182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0537734c-08c4-43a8-a978-d8586c846234 req-f90434be-f082-4683-a235-1f5474085f5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.725267 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0537734c-08c4-43a8-a978-d8586c846234 req-f90434be-f082-4683-a235-1f5474085f5f service nova] Creating event network-vif-deleted:0ac5e1c3-5127-407e-b8fa-7afde32aea1a for instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 on n-h2-836830-16 Sep 07 09:47:03.741324 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0537734c-08c4-43a8-a978-d8586c846234 req-f90434be-f082-4683-a235-1f5474085f5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085105 Sep 07 09:47:03.742356 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 359/733] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:03.748200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:03.748682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:03.759896 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c72a9f8-7647-4b4b-a612-2f2f60eb1cf2 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.491975 Sep 07 09:47:03.761875 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 375/734] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:47:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:03.767674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:03.768482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:03.783986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:03.784612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:03.785075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.785867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:03.786334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:03.790825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:03.791250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:03.791682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.792379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:03.798051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.804660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:03.808217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.858370 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 HTTP/1.1 Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:03.863589 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:03.865298 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ceffe667-57c6-4ae8-a0f3-6491b75d2353'} Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:03.866187 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:03.867633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:03.868917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:03.868917 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-931d4b51-ac63-4d2d-baa0-e87f6f73a4d4 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 404 len: 111 microversion: 2.1 time: 0.103726 Sep 07 09:47:03.869857 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 376/735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:03 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:03.872318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lazy-loading 'flavor' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:03.880161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0eef21a-8e5f-41ad-9abf-c63de0ed4888 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '.version_select at 0x7f14b224cee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:03.888151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eef21a-8e5f-41ad-9abf-c63de0ed4888 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:03.893984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eef21a-8e5f-41ad-9abf-c63de0ed4888 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:03.898064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eef21a-8e5f-41ad-9abf-c63de0ed4888 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:03.916711 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0eef21a-8e5f-41ad-9abf-c63de0ed4888 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1288 microversion: 2.25 time: 0.044545 Sep 07 09:47:03.918422 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 377/736] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 7 09:47:03 2022] GET /compute/v2.1/os-migrations => generated 1288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:04.255870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-272f3c53-d3c2-47c2-8400-04c758a6bebc tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] Action: 'create', calling method: .version_select at 0x7f14b222d160>, body: {"security_group": {"name": "tempest-securitygroup-1498001709", "description": "tempest-description-746867065"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:04.301407 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ace17efc-1d60-415c-b1ef-4363dbd641ca tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action" status: 202 len: 0 microversion: 2.91 time: 0.557435 Sep 07 09:47:04.302598 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 360/737] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:47:03 2022] POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:04.328669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:04.329313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:04.347548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:04.348057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:04.348505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:04.349804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:04.350270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:04.350707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:04.378739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 HTTP/1.1 Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:04.380454 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:04.383376 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd69eab25-a71c-4dc7-96d1-a63e4174a056'} Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:04.384104 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:04.385288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:04.386464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:04.386464 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9a4bc0c-e653-410c-b6b9-35ae39f5e742 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 404 len: 111 microversion: 2.1 time: 0.077987 Sep 07 09:47:04.386464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 361/738] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:04 2022] DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:04.397034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:04.397743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:04.417350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:04.417859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:04.418301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:04.419932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:04.420437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:04.420879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:04.684062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid e32c33bb-7f8e-4a60-8857-37805be90773 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:04.712435 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d9bdc57-5a85-4d4c-b032-53f5a1ef2317 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 2054 microversion: 2.25 time: 0.328936 Sep 07 09:47:04.714164 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 362/739] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:04 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 2054 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:04.723875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-992229709", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "6eb86d04-a25b-47cd-8f75-34e1365a0fe3"}], "security_groups": [{"name": "tempest-securitygroup--1522460099"}], "key_name": "tempest-keypair-1062363125", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:04.748274 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-272f3c53-d3c2-47c2-8400-04c758a6bebc tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.815359 Sep 07 09:47:04.749216 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 378/740] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:47:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:04.914746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] validate_networks() for [('6eb86d04-a25b-47cd-8f75-34e1365a0fe3', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:47:04.982219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f301046-b8c0-4cd8-951c-c55645ea7113 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Action: 'create', calling method: .version_select at 0x7f14b25a3f70>, body: {"keypair": {"name": "tempest-keypair-1514341206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQr/RIF7kfug0gt3Q8iA+MrMKfDCOqjLllEs7qLsoGsrtZbSaRsuxENwFVcsroaVnF0LBC/v5FQ7HS33Eqp8N2nkJT19M0ssfptY6fscmBdSvlR5TtjRT10EMdkFmLa+Q=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:05.002903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9f301046-b8c0-4cd8-951c-c55645ea7113 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Getting quotas for project 017dac8978b64d4c94cc2ef118e5fa69. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:05.015707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9f301046-b8c0-4cd8-951c-c55645ea7113 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Getting quotas for user ba350a258ac24186b93317fcb1066a65 and project 017dac8978b64d4c94cc2ef118e5fa69. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:05.079529 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f301046-b8c0-4cd8-951c-c55645ea7113 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.329111 Sep 07 09:47:05.080705 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 379/741] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:47:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:05.086454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:05.087479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:05.100913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.103271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.103893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.104798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.110484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.111283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.253705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:05.261932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:05.264322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:05.283490 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c4d0fe84-89b9-435f-910c-c1c89d58cb53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.201531 Sep 07 09:47:05.284079 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 380/742] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:05 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:05.301113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:05.301776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:05.308429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.308930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.309432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.310517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.313122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.313824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.339995 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 HTTP/1.1 Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:05.347664 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:05.349150 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'd69eab25-a71c-4dc7-96d1-a63e4174a056'} Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:05.349900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:05.351050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:05.356050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:05.356050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be7102cc-424c-4f5a-88f8-97163642dbbe tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 404 len: 111 microversion: 2.1 time: 0.064121 Sep 07 09:47:05.356050 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 381/743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:05 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:05.366552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:05.367177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:05.375913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.376406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.376840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.380000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.380508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.384578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.741144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:05.744616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:05.745139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:05.745567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:05.746181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:05.747504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:05.759483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.765496 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7872be34-fa3a-4463-bdcb-9e993f26819d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.405389 Sep 07 09:47:05.767847 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 382/744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:05 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:05.770392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.771016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.772002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:05.772633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:05.773403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:05.787405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c091386-02ee-47a3-b816-b5e8a2e6c230 tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] Action: 'create', calling method: .version_select at 0x7f14b1e7d700>, body: {"security_group": {"name": "tempest-securitygroup-489706789", "description": "tempest-description-995466754"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:05.803743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:05.810906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for user 224142a6fa7e4702b1780f4aaeb3f93f and project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:05.827063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:47:05.829567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:47:05.913899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f8c00fe-77f5-4d97-9c8c-6aa7f5434570 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.195889 Sep 07 09:47:05.917247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 363/745] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:47:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:47:05.927318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1375329593", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "124ad2c9-0cc2-4b52-ab23-5623958d6487"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:06.020610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] validate_networks() for [('124ad2c9-0cc2-4b52-ab23-5623958d6487', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:47:06.611883 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c091386-02ee-47a3-b816-b5e8a2e6c230 tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.838420 Sep 07 09:47:06.612481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 383/746] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:47:05 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:06.618316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8494615b-bcec-4a06-a32b-b3e998743059 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '.version_select at 0x7f14b1ec4ee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:06.669578 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8494615b-bcec-4a06-a32b-b3e998743059 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509564207" status: 202 len: 0 microversion: 2.1 time: 0.054809 Sep 07 09:47:06.669991 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 384/747] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 09:47:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509564207 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:06.686116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6eb4f6f-0955-4b80-a89a-430e8362b5a0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:06.688552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d6eb4f6f-0955-4b80-a89a-430e8362b5a0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:06.958068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d6eb4f6f-0955-4b80-a89a-430e8362b5a0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:06.965902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d6eb4f6f-0955-4b80-a89a-430e8362b5a0 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1234 microversion: 2.1 time: 0.294623 Sep 07 09:47:06.978388 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 385/748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:06 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1234 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:06.992233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:06.992923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:07.008834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:07.009648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:07.010250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:07.011169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:07.011792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:07.012613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:07.239208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:07.247059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:07.274748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:07.276581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:07.287387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ace1b3bb-8a16-4f04-92f9-dfbf3a249de2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.307664 Sep 07 09:47:07.290845 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 386/749] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:06 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:07.296995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc04e80d-ca5b-4c12-b84f-7be1ba81f67d tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] Calling method '.version_select at 0x7f14b1ec4ee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:07.430427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:07.431928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:07.432575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:07.433195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:07.434337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:07.452826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:07.454786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:07.455593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:07.457978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:07.459726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:07.460770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:07.493260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:07.501225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for user 21737ade68344e3298131ce9189f5d8a and project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:07.523557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:47:07.526837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:47:07.606569 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db54e003-0c1d-4f3e-ab1b-619a414a83f4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.684743 Sep 07 09:47:07.614172 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 364/750] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:47:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:47:07.624775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:07.627257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:07.657739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:07.658328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:07.665120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:07.665938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:07.670104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:07.670947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:08.079593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:08.092467 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bef037f0-8fc0-46fe-a3be-601df8995f3b tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.475186 Sep 07 09:47:08.094254 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 365/751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:07 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:08.210871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-894214967", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "93ef6f9e-fbc6-4bbc-a58d-2c9d0d3cd529"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:08.330897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] validate_networks() for [('93ef6f9e-fbc6-4bbc-a58d-2c9d0d3cd529', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:47:09.314514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:09.315625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:09.316458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:09.317350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:09.317918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:09.338446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:09.339466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:09.340826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:09.342240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:09.342976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:09.343625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:09.367699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:09.381429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for user 03b1af68e8a948758e09d0ccbca23d4d and project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:09.427622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:47:09.429859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:47:09.470680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:09.550481 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d5ac13a-8eb3-47c1-8e4a-d0c33e9feae8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450912 Sep 07 09:47:09.554966 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 366/752] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:47:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:47:09.570105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:09.570918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:09.584511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:09.590106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:09.591573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:09.592764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:09.593459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:09.595638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:09.789004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:09.807740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:09.813750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:09.816768 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fdb905d6-5c8a-44ac-ab5b-9fa547400610 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1314 microversion: 2.25 time: 0.259697 Sep 07 09:47:09.821343 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 367/753] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:09 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:09.827155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61e91b09-8164-4af9-affc-3cc73f51f14c tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:09.877960 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-61e91b09-8164-4af9-affc-3cc73f51f14c tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1450913426" status: 202 len: 0 microversion: 2.1 time: 0.054697 Sep 07 09:47:09.882576 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 368/754] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:47:09 2022] DELETE /compute/v2.1/flavors/1450913426 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:09.892181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:09.894047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:09.904233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:09.905059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:09.905807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:09.906751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:09.907430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:09.908273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:10.451676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:10.461649 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1312b371-ff4b-4add-91ce-6f371d01f18b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1360 microversion: 2.1 time: 0.580277 Sep 07 09:47:10.474851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 369/755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:09 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1360 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:10.506695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:10.507567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:10.534040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:10.534895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:10.536875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:10.539046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:10.539747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:10.540712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:10.740866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:10.758898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:10.764866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:10.792870 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c9b8c8b-de59-4b30-ad1f-5ffd7616ba9b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.306770 Sep 07 09:47:10.794987 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 370/756] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:10 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:10.818571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-895793367", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "35bcb095-afe9-448b-a5ac-88034a80f020"}], "security_groups": [{"name": "tempest-securitygroup--1242843065"}], "key_name": "tempest-keypair-1514341206", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:11.021016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] validate_networks() for [('35bcb095-afe9-448b-a5ac-88034a80f020', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:47:12.325767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:12.327971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:12.329791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:12.330546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:12.331204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:12.342849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:12.343003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:12.343468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:12.345021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:12.345021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:12.345520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:12.366550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Getting quotas for project 017dac8978b64d4c94cc2ef118e5fa69. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:12.373002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Getting quotas for user ba350a258ac24186b93317fcb1066a65 and project 017dac8978b64d4c94cc2ef118e5fa69. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:12.388703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:47:12.393329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:47:12.465774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0af3bf5f-9299-4784-9724-4ab348a35ef8 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.668744 Sep 07 09:47:12.467040 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 371/757] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:47:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:47:12.472247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:12.473384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:12.487441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:12.488466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:12.490946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:12.491875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:12.498481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:12.499704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.032563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:13.046939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-156f9f14-2f9a-4a63-81f0-83ee66945b3a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.577607 Sep 07 09:47:13.047643 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 372/758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:12 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:13.052824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:13.054386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:13.062990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.063810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.064635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.065619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.066317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.067405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.072113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:13.237825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:13.249077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70bf3492-eeab-44f9-a8e4-7f781361bfa3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1282 microversion: 2.1 time: 0.200036 Sep 07 09:47:13.250332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 373/759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:13 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:13.255340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2f0d1ea-cd15-40cb-b642-30de1fb0840f tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:13.285371 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2f0d1ea-cd15-40cb-b642-30de1fb0840f tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.033510 Sep 07 09:47:13.286430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 374/760] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:47:13 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:13.291751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c082fecf-997e-466d-93b1-8cf90ad50537 req-fbcdeaf2-c5fa-4203-aaad-fac478a57397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc44587-4609-4b49-84a9-761bdb462451", "tag": "0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:13.303099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c082fecf-997e-466d-93b1-8cf90ad50537 req-fbcdeaf2-c5fa-4203-aaad-fac478a57397 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.304020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c082fecf-997e-466d-93b1-8cf90ad50537 req-fbcdeaf2-c5fa-4203-aaad-fac478a57397 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.304782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c082fecf-997e-466d-93b1-8cf90ad50537 req-fbcdeaf2-c5fa-4203-aaad-fac478a57397 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.317313 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c082fecf-997e-466d-93b1-8cf90ad50537 req-fbcdeaf2-c5fa-4203-aaad-fac478a57397 service nova] Creating event network-changed:0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021 for instance ddc44587-4609-4b49-84a9-761bdb462451 on n-h1-836830-16 Sep 07 09:47:13.323630 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c082fecf-997e-466d-93b1-8cf90ad50537 req-fbcdeaf2-c5fa-4203-aaad-fac478a57397 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035431 Sep 07 09:47:13.329020 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 375/761] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:13.335228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:13.336051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:13.344031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.344870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.345599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.346609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.347273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.347910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.867380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:13.882019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:13.904336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:13.910562 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e19ad39-006f-4c3c-8124-41c00c3aebd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.576692 Sep 07 09:47:13.912950 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 376/762] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:13 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:13.928096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:13.929059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:13.943474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.943980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.944421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:13.954078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:13.955405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:13.957518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:14.659039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:14.674043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd2cfad1-34d9-43a8-b19c-783d63ec1caa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1360 microversion: 2.1 time: 0.758950 Sep 07 09:47:14.674933 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 377/763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:13 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1360 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:14.690336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:14.691051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:14.717444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:14.717955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:14.718403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:14.720256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:14.727466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:14.728021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:14.886540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:14.900877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:14.907178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:14.913614 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4db544b7-e0ce-4987-9eb3-3f020bbeda3c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.237830 Sep 07 09:47:14.930063 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 378/764] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:14 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:14.952996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:14.953936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:14.967846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:14.968836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:14.969690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:14.970592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:14.971055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:14.971498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.113871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:15.124616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d56053b7-8acb-4e7c-8f4c-3b8afa1ad139 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1299 microversion: 2.1 time: 0.193046 Sep 07 09:47:15.126249 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 379/765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:14 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:15.134280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd004014-2fee-4098-b75d-577777c587d7 tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:15.161563 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd004014-2fee-4098-b75d-577777c587d7 tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1893678355" status: 202 len: 0 microversion: 2.1 time: 0.033824 Sep 07 09:47:15.165909 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 380/766] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:47:15 2022] DELETE /compute/v2.1/flavors/1893678355 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:15.174218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:15.175008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:15.185414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:15.186480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:15.187129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.187608 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc04e80d-ca5b-4c12-b84f-7be1ba81f67d tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13045 microversion: 2.1 time: 7.895484 Sep 07 09:47:15.188947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:15.189682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:15.190392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.197909 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 387/767] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 7 09:47:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13045 bytes in 7906 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:47:15.204080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:15.207107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:15.222811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:15.224759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:15.226676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.227444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:15.227939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:15.228348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.868997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:15.878416 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e5d60a55-9eec-4e4a-8f71-f376f9f26ae7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.710971 Sep 07 09:47:15.879224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 381/768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:15 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:15.883517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:15.884126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:15.890201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:15.890879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:15.891481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.892422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:15.893237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:15.893881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:15.958952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:15.968530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dd1f0e0f-d04a-4e24-83de-c4772160b40c tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.768818 Sep 07 09:47:15.969424 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 388/769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:15 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:15.975521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d85fcd9e-2671-4941-9c58-cf056b8526f4 tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:16.047885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d85fcd9e-2671-4941-9c58-cf056b8526f4 tempest-ServersWithSpecificFlavorTestJSON-951012884 tempest-ServersWithSpecificFlavorTestJSON-951012884-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076150 Sep 07 09:47:16.054402 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 389/770] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:47:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:16.065155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eba37e20-49e4-4510-a9f9-033fddd36d30 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] Calling method '.version_select at 0x7f14b1ec4700>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:16.435100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:16.443876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:16.445713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:16.447273 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-166e3659-241b-4fcf-9328-941fddff0c2e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.567343 Sep 07 09:47:16.448411 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 382/771] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:15 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:16.455561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:16.456405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:16.468495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.469199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.470654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.475425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.476186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.477024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.872779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eba37e20-49e4-4510-a9f9-033fddd36d30 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.816344 Sep 07 09:47:16.873718 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 390/772] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 7 09:47:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:16.878373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fdcbc918-e5fc-49f3-a1ce-eb13831e9ce1 req-622dec7d-ddb1-49de-9e74-ec4d97ff6e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f456e92c-4ff9-4278-9391-9ca4253df6d6", "tag": "e440e054-f02d-4b47-8e0e-ee98e0f5d85e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:16.886355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:16.891012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fdcbc918-e5fc-49f3-a1ce-eb13831e9ce1 req-622dec7d-ddb1-49de-9e74-ec4d97ff6e1a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.891427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fdcbc918-e5fc-49f3-a1ce-eb13831e9ce1 req-622dec7d-ddb1-49de-9e74-ec4d97ff6e1a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.891863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fdcbc918-e5fc-49f3-a1ce-eb13831e9ce1 req-622dec7d-ddb1-49de-9e74-ec4d97ff6e1a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.897128 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-082c4971-53ea-4aff-8308-902b671c1bc6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1360 microversion: 2.1 time: 0.445164 Sep 07 09:47:16.898563 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 383/773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:16 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1360 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:16.905119 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fdcbc918-e5fc-49f3-a1ce-eb13831e9ce1 req-622dec7d-ddb1-49de-9e74-ec4d97ff6e1a service nova] Creating event network-changed:e440e054-f02d-4b47-8e0e-ee98e0f5d85e for instance f456e92c-4ff9-4278-9391-9ca4253df6d6 on n-h2-836830-16 Sep 07 09:47:16.905468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:16.906385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:16.912290 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fdcbc918-e5fc-49f3-a1ce-eb13831e9ce1 req-622dec7d-ddb1-49de-9e74-ec4d97ff6e1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037409 Sep 07 09:47:16.913915 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 391/774] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:16.914339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.914831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.915270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.916009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.916459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.916887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.919956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:16.921148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:16.927627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.928428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.928874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.929617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.930415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.931145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.946541 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 HTTP/1.1 Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:16.948217 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:16.950249 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ceffe667-57c6-4ae8-a0f3-6491b75d2353'} Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:16.951539 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:16.952817 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:16.955762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:16.955762 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aa52a6a6-f53c-482c-8c7c-85ffc054ea24 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 404 len: 111 microversion: 2.1 time: 0.034752 Sep 07 09:47:16.955762 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 392/775] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:16 2022] DELETE /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:16.956207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:16.956804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:16.962589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.963068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.963504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.964191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:16.964643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:16.965060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:16.965741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=16 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:17.018978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.027086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.028591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.033528 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e543395-3e1d-45e3-9d9a-a86a2a132a31 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.133614 Sep 07 09:47:17.034099 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 384/776] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:16 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:17.038407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8c7668f1-009c-4284-ba76-ef3bfe4391d5 req-a9dd40c9-5653-4b6f-bbe4-837b8242f584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc44587-4609-4b49-84a9-761bdb462451", "name": "network-vif-plugged", "status": "completed", "tag": "0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:17.048295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8c7668f1-009c-4284-ba76-ef3bfe4391d5 req-a9dd40c9-5653-4b6f-bbe4-837b8242f584 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.049033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8c7668f1-009c-4284-ba76-ef3bfe4391d5 req-a9dd40c9-5653-4b6f-bbe4-837b8242f584 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.049731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8c7668f1-009c-4284-ba76-ef3bfe4391d5 req-a9dd40c9-5653-4b6f-bbe4-837b8242f584 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.061425 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8c7668f1-009c-4284-ba76-ef3bfe4391d5 req-a9dd40c9-5653-4b6f-bbe4-837b8242f584 service nova] Creating event network-vif-plugged:0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021 for instance ddc44587-4609-4b49-84a9-761bdb462451 on n-h1-836830-16 Sep 07 09:47:17.066421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8c7668f1-009c-4284-ba76-ef3bfe4391d5 req-a9dd40c9-5653-4b6f-bbe4-837b8242f584 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031177 Sep 07 09:47:17.067277 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 385/777] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:17.072513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6736a57a-d6da-4639-a4be-1759690f9003 req-a79d99c2-cc8a-44dd-b6cd-e2d10f09e007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193776ce-cebb-4703-b48b-c40e206b21ea", "tag": "85d9396a-28f4-41b8-a3e2-c1460f733d78"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:17.083844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6736a57a-d6da-4639-a4be-1759690f9003 req-a79d99c2-cc8a-44dd-b6cd-e2d10f09e007 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.084331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6736a57a-d6da-4639-a4be-1759690f9003 req-a79d99c2-cc8a-44dd-b6cd-e2d10f09e007 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.084773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6736a57a-d6da-4639-a4be-1759690f9003 req-a79d99c2-cc8a-44dd-b6cd-e2d10f09e007 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.096870 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6736a57a-d6da-4639-a4be-1759690f9003 req-a79d99c2-cc8a-44dd-b6cd-e2d10f09e007 service nova] Creating event network-changed:85d9396a-28f4-41b8-a3e2-c1460f733d78 for instance 193776ce-cebb-4703-b48b-c40e206b21ea on n-h1-836830-16 Sep 07 09:47:17.101744 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6736a57a-d6da-4639-a4be-1759690f9003 req-a79d99c2-cc8a-44dd-b6cd-e2d10f09e007 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033103 Sep 07 09:47:17.102355 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 386/778] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:17.107461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b3f7e89-cdfe-48ce-9473-eca33dafb2dd tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] Calling method '.version_select at 0x7f14b1e33940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.286607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.296562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7899084b-14e1-4089-a651-46690f93ab66 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1367 microversion: 2.1 time: 0.344150 Sep 07 09:47:17.297236 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 393/779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:16 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:17.302001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.302608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:17.309776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.310549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.311057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.312850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.313332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.313757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.562293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.569412 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b3f7e89-cdfe-48ce-9473-eca33dafb2dd tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/f57333f9-20ff-4a5d-9f44-274e759ff553" status: 202 len: 0 microversion: 2.1 time: 0.465737 Sep 07 09:47:17.570489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bdeae2cb-7875-499b-a7b9-70739bd175bc tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.272259 Sep 07 09:47:17.570891 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 387/780] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:47:17 2022] DELETE /compute/v2.1/os-security-groups/f57333f9-20ff-4a5d-9f44-274e759ff553 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:17.576941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.578048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: ceffe667-57c6-4ae8-a0f3-6491b75d2353] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:17.585055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.585586 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 394/781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:17 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:17.585918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.586370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.587076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.587536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.587961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.592416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.593047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:17.599331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.599863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.600573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.601387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.602031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.602622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.606487 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 HTTP/1.1 Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:17.608475 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:17.610092 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ceffe667-57c6-4ae8-a0f3-6491b75d2353'} Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:17.610991 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. Sep 07 09:47:17.612405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.614559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance ceffe667-57c6-4ae8-a0f3-6491b75d2353 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:17.614559 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eac92bca-f467-4d7d-9647-8d7967388446 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353" status: 404 len: 111 microversion: 2.1 time: 0.038280 Sep 07 09:47:17.627839 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 388/782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:17 2022] GET /compute/v2.1/servers/ceffe667-57c6-4ae8-a0f3-6491b75d2353 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:17.632708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.634946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:17.641850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.642338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.643001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.643630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.644081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.645068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.853289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.863035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ed76496-a932-4bd7-b48d-99c07da2d672 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.276412 Sep 07 09:47:17.863631 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 395/783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:17 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:17.868940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9a4a020-0893-4fe7-afad-7cfd9e74de73 tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] Calling method '.version_select at 0x7f14b22cc5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.885030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.895539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.897012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:17.898192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a2a5cee-0d4a-4079-9756-4fdac9d76cb6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.269271 Sep 07 09:47:17.899315 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 389/784] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:17 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:17.904757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.905546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:17.912335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.914595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.915278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.916255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.917013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.917678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.934038 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 HTTP/1.1 Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:17.937156 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:17.938767 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd69eab25-a71c-4dc7-96d1-a63e4174a056'} Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:17.943391 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:17.944852 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:17.947527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:17.947527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f385809-ba42-4b13-8c6a-7426b7f317bf tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 404 len: 111 microversion: 2.1 time: 0.038179 Sep 07 09:47:17.947527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 390/785] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:17 2022] DELETE /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:17.947527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:17.948153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:17.954791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.955270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.955920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:17.956810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:17.957581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:17.958021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.159724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:18.167522 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06ef5814-de07-4975-a665-3d6f2167cec7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1360 microversion: 2.1 time: 0.225893 Sep 07 09:47:18.168722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 391/786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:17 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:18.173645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:18.174343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] [instance: d69eab25-a71c-4dc7-96d1-a63e4174a056] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:18.180265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.180825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.181366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.182146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.182668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.183156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.200685 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] HTTP exception thrown: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Request method failure captured: Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 HTTP/1.1 Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGfx7sK2S_Q-FGmFIn6B8r3hbdE-tp08DUD7UPLrKbK-SBl1_85HgACq0iPDD15Wmp9oGx78VHZoEXQsuKPLES9HJR0PwuNXrFDQp0HGmsWTub43hNq9zuDCntEaHosyiR-ELOiYEVZuj16_0iJJx1ud998yDjiUr8K6R5Cg5G5CEBA Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:18.202580 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c90fba56c62e4660ae559b2649e2c801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c90fba56c62e4660ae559b2649e2c801", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c90fba56c62e4660ae559b2649e2c801 Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080 Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: ce0e6192cec344439361da0019175b24 Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1500143080-project Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:18.204125 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd69eab25-a71c-4dc7-96d1-a63e4174a056'} Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:18.208409 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. Sep 07 09:47:18.209872 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:18.211271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] Returning 404 to user: Instance d69eab25-a71c-4dc7-96d1-a63e4174a056 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:18.211271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5091802-c648-4c8a-88e0-460a47993657 tempest-ServersWithSpecificFlavorTestJSON-1500143080 tempest-ServersWithSpecificFlavorTestJSON-1500143080-project] 10.222.0.60 "GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056" status: 404 len: 111 microversion: 2.1 time: 0.034368 Sep 07 09:47:18.211271 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 392/787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:18 2022] GET /compute/v2.1/servers/d69eab25-a71c-4dc7-96d1-a63e4174a056 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:18.211271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:18.211271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:18.217036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.217926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.218724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.219730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.220206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.220644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.236935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9a4a020-0893-4fe7-afad-7cfd9e74de73 tempest-SecurityGroupsTestAdminJSON-1229991491 tempest-SecurityGroupsTestAdminJSON-1229991491-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6f06e8ba-f243-4c27-bd47-82669d8a7769" status: 202 len: 0 microversion: 2.1 time: 0.371061 Sep 07 09:47:18.238891 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 396/788] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:47:17 2022] DELETE /compute/v2.1/os-security-groups/6f06e8ba-f243-4c27-bd47-82669d8a7769 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:18.255122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54cea50c-ee8a-47f7-a45a-c5ca1048fed8 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] Calling method '.version_select at 0x7f14b260d670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:18.392455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:18.404422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:18.407056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:18.417565 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38f283c6-dbbe-454f-990b-88a353eaf5de tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.211524 Sep 07 09:47:18.419046 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 393/789] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:18 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:18.424477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:18.425281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:18.431903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.432612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.433240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.434292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.435177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.435763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.774879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:18.784631 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f900d03-d060-43f5-b9ca-a43d61db76e5 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1367 microversion: 2.1 time: 0.364065 Sep 07 09:47:18.799368 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 394/790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:18 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:18.799368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:18.799368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:18.817197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.817197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.817197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.829534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:18.830457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:18.831062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:18.862473 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54cea50c-ee8a-47f7-a45a-c5ca1048fed8 tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0909f4c7-de45-4437-87e2-0e26f77366f9" status: 202 len: 0 microversion: 2.1 time: 0.616431 Sep 07 09:47:18.864062 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 397/791] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:47:18 2022] DELETE /compute/v2.1/os-security-groups/0909f4c7-de45-4437-87e2-0e26f77366f9 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:18.871621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66d680e2-1bb2-44d9-89fd-16e1984f151c tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] Calling method '.version_select at 0x7f14b1ec4af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:19.210022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:19.219131 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3daa5445-b544-494b-80cf-bf19a89265bf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.432693 Sep 07 09:47:19.219930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 395/792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:18 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:19.224917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:19.225760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:19.234688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.235393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.235995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:19.237616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.238247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.238840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:19.824311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:19.827369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:19.835875 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d413b18e-1646-4314-a7e2-9ee226359fe0 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.614647 Sep 07 09:47:19.849791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 396/793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:19 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:19.857877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66d680e2-1bb2-44d9-89fd-16e1984f151c tempest-SecurityGroupsTestAdminJSON-114388107 tempest-SecurityGroupsTestAdminJSON-114388107-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fafd0712-7d57-408a-9a87-faa35dea4904" status: 202 len: 0 microversion: 2.1 time: 0.989763 Sep 07 09:47:19.858656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:19.859093 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 398/794] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:47:18 2022] DELETE /compute/v2.1/os-security-groups/fafd0712-7d57-408a-9a87-faa35dea4904 => generated 0 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:47:19.864752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:19.866790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-03152526-2b18-4269-b882-057c3a6aea49 req-106ded06-e7a9-4c55-a141-41a5a008a96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb66c3f-ef5b-4941-8949-163f2e52d0b8", "tag": "e203c470-0b0a-4f9d-b971-4ba8163d41ea"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:19.875679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.878080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.878531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:19.879262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.879719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.880231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03152526-2b18-4269-b882-057c3a6aea49 req-106ded06-e7a9-4c55-a141-41a5a008a96c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.881094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:19.882733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03152526-2b18-4269-b882-057c3a6aea49 req-106ded06-e7a9-4c55-a141-41a5a008a96c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.883770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03152526-2b18-4269-b882-057c3a6aea49 req-106ded06-e7a9-4c55-a141-41a5a008a96c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:19.896929 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-03152526-2b18-4269-b882-057c3a6aea49 req-106ded06-e7a9-4c55-a141-41a5a008a96c service nova] Creating event network-changed:e203c470-0b0a-4f9d-b971-4ba8163d41ea for instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 on n-h1-836830-16 Sep 07 09:47:19.902619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-03152526-2b18-4269-b882-057c3a6aea49 req-106ded06-e7a9-4c55-a141-41a5a008a96c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042091 Sep 07 09:47:19.904012 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 399/795] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:19.917509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:19.918737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:19.920842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:UPDATE=6,nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:19.941493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.942550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.942991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:19.943804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:19.944363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:19.944998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.113557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.123952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.125455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.127277 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1458f34-41a6-4c0e-a99a-7f8722da09ab tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.275638 Sep 07 09:47:20.143647 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 397/796] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:19 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:20.158368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:20.164854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:20.180839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.181945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.182572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.183482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.184316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.187374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.221900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.235621 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f8aeeed1-c91c-4160-81d7-f8b013956e54 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1360 microversion: 2.1 time: 0.322508 Sep 07 09:47:20.237488 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 400/797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:19 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1360 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:20.249496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:20.253107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:20.274292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.275232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.275687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.276432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.276881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.281968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.346386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.357386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.359184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.362306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=89,nova_api:DELETE=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:20.365731 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4b4b59b-d2fc-45db-906b-2b98106157ab tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.213177 Sep 07 09:47:20.367065 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 398/798] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:20 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:20.372474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:20.373525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:20.380746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.381514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.382354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.383385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.383951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.385005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.866136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.866822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:20.880628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1dbc8ab-0899-4a79-aa21-87346646eb9a tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1367 microversion: 2.1 time: 0.641138 Sep 07 09:47:20.883449 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 401/799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:20 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:20.885912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7222ecd4-d650-4248-b248-16bdd70b62b9 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.516938 Sep 07 09:47:20.887070 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 399/800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:20 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:20.893473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:20.896888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:20.913839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.914342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.914782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:20.916613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:20.919327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:20.919887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.157372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:21.158257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:21.165347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.165834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.166265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.166941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.167393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.169773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.334986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.347399 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18f7f92e-f82c-45d1-bddf-035ebe318340 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.462455 Sep 07 09:47:21.347900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 402/801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:20 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:21.353483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:21.354442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:21.363228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.363889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.364544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.365278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.365733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.366158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.508484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.523487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.526695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.528641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98ff4f48-19f9-4bf7-bfe9-363e9d28a5d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.376629 Sep 07 09:47:21.545646 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 400/802] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:21 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:21.561009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:21.562215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:21.573717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.574967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.576165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.577468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.578316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.579017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.611651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.624057 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ef12ead1-a877-4c50-ac35-594c451f95fa tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1544 microversion: 2.1 time: 0.274877 Sep 07 09:47:21.630212 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 403/803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:21 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1544 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:21.660782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:21.661482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:21.676729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.680676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.681208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.682118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.682732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.683488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.923128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.932077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.940968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:21.955470 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98bfadc0-a537-4019-a6b6-33a23de0f928 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1558 microversion: 2.91 time: 0.407949 Sep 07 09:47:21.956069 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 401/804] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:21 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1558 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:21.966839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:21.967504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:21.983834 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-acfc9093-7339-4610-85e4-0646105fe17d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.333018 Sep 07 09:47:21.984368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.984479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.984921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.986053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:21.986509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:21.986937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:21.992767 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 404/805] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:47:21 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-interface => generated 285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:47:21.999507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:22.003714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:22.016859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:22.017390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:22.017834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:22.024488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:22.024985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:22.025499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:22.354431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:22.381738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=24 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:22.702862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:22.718162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ceea67d4-824c-44a5-acf9-dbe2b97ab96f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.724201 Sep 07 09:47:22.718768 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 405/806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:21 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:22.733429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:22.734180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:22.735191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:22.735427 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b43947c-0117-47fc-bb5d-0aa65a13e280 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1367 microversion: 2.1 time: 0.772938 Sep 07 09:47:22.736313 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 402/807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:21 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1367 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:22.749712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:22.750655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:22.753592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:22.754108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:22.754557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:22.755278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:22.755746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:22.756180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:22.763697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:22.767506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:22.768342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:22.770636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:22.771350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:22.773865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.270312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.286879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.290418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.295715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7fe21910-d946-4932-95a9-e5d96b267409 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.558151 Sep 07 09:47:23.298113 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 403/808] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:22 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:23.317820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a7d491f5-8631-4262-bc1a-c7d8de29ba93 req-61ed441c-f9d9-4ae2-be83-47ab7963b93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193776ce-cebb-4703-b48b-c40e206b21ea", "name": "network-vif-plugged", "status": "completed", "tag": "85d9396a-28f4-41b8-a3e2-c1460f733d78"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:23.334143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a7d491f5-8631-4262-bc1a-c7d8de29ba93 req-61ed441c-f9d9-4ae2-be83-47ab7963b93b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.335008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a7d491f5-8631-4262-bc1a-c7d8de29ba93 req-61ed441c-f9d9-4ae2-be83-47ab7963b93b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.335670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a7d491f5-8631-4262-bc1a-c7d8de29ba93 req-61ed441c-f9d9-4ae2-be83-47ab7963b93b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.363731 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a7d491f5-8631-4262-bc1a-c7d8de29ba93 req-61ed441c-f9d9-4ae2-be83-47ab7963b93b service nova] Creating event network-vif-plugged:85d9396a-28f4-41b8-a3e2-c1460f733d78 for instance 193776ce-cebb-4703-b48b-c40e206b21ea on n-h1-836830-16 Sep 07 09:47:23.373544 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a7d491f5-8631-4262-bc1a-c7d8de29ba93 req-61ed441c-f9d9-4ae2-be83-47ab7963b93b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073675 Sep 07 09:47:23.374829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 404/809] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:23.381004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:23.382080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:23.389610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.390338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.390992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.391926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.392679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.393397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.421773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.432351 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0d4e5636-19f2-4cc0-aab1-13f7d29d90c4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.710016 Sep 07 09:47:23.436345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 406/810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:22 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:23.519690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.529781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.531438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:23.538973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-715a0a83-62e5-49ac-8697-5cc9dabbae18 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.162072 Sep 07 09:47:23.540137 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 405/811] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:23 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:23.764835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:23.765902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:23.769239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:23.770514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:23.778144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.778642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.784487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.786729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.787430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.787545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.789123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.791403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.792226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:23.792911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:23.794118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:23.794769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:24.322794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:24.330876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:24.344949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-061c67e6-7db6-4144-88b5-44e625a64f20 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.579892 Sep 07 09:47:24.347718 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 406/812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:23 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:24.350845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c82599c3-0c8e-4bf2-80dc-97b4a85014ed tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1367 microversion: 2.1 time: 0.578510 Sep 07 09:47:24.351749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 407/813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:23 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1367 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:24.378106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:24.405979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:24.434862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:24.435675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:24.436349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:24.437275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:24.437934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:24.438575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:24.460082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:24.460631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:24.473683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:24.475503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:24.475965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:24.477875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:24.478359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:24.478799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:24.834499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:24.848975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:24.858533 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69c390ec-7633-4a8d-ad54-fea598e50a86 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.402414 Sep 07 09:47:24.862680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:24.866031 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 408/814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:24 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:24.890745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:24.892061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:24.893448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d4ba091-a097-4b1a-9392-632efdd25c98 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.544516 Sep 07 09:47:24.895876 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 407/815] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:24 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:24.898954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:24.915537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:24.916335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:24.918692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:24.919782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:24.921658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:24.923326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:25.087310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:25.097712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:25.102931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:25.110423 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ba90d312-3f48-4965-8818-a8f879902d65 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.224021 Sep 07 09:47:25.125924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 409/816] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:24 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:25.374933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:25.377073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:25.390235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:25.390827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:25.391282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:25.398087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:25.399630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:25.401074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:25.427250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-539774347", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:25.549882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:47:25.749144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:25.759413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c81bb85-d42e-49b3-ac9e-bb66239be1ef tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.391643 Sep 07 09:47:25.763093 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 410/817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:25 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:25.769434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:25.770694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:25.783174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:25.784530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:25.785139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:25.787215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:25.788456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:25.789057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.053833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:26.054815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:26.055521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:26.056107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:26.056681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:26.079879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.080755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.081529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.082633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.083265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.084001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.126648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Getting quotas for project d949c2e340584158b0b04e2de6dff847. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:26.138039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Getting quotas for user d96a2d7ba1614977844673bed3d8a722 and project d949c2e340584158b0b04e2de6dff847. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:26.171217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:47:26.174119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:47:26.198046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:26.201327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:26.209009 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-965e1dac-b8db-4c11-bca1-f3821eb37376 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1555 microversion: 2.1 time: 0.444667 Sep 07 09:47:26.209628 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 411/818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:25 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1555 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:26.223869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f456e92c-4ff9-4278-9391-9ca4253df6d6", "name": "network-vif-plugged", "status": "completed", "tag": "e440e054-f02d-4b47-8e0e-ee98e0f5d85e"}, {"server_uuid": "4eb66c3f-ef5b-4941-8949-163f2e52d0b8", "name": "network-vif-plugged", "status": "completed", "tag": "e203c470-0b0a-4f9d-b971-4ba8163d41ea"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:26.236635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.237470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.238059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.259917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0fbc720d-8cee-41d1-8b5f-777d472042db tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065911 Sep 07 09:47:26.261513 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 408/819] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:47:26.270892 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] Creating event network-vif-plugged:e440e054-f02d-4b47-8e0e-ee98e0f5d85e for instance f456e92c-4ff9-4278-9391-9ca4253df6d6 on n-h2-836830-16 Sep 07 09:47:26.278150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] Creating event network-vif-plugged:e203c470-0b0a-4f9d-b971-4ba8163d41ea for instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 on n-h1-836830-16 Sep 07 09:47:26.295545 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-92af149d-ef6f-4fe6-a499-03750c9e4e50 req-5bd4d832-0798-4451-999f-2a8c22dcf05d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076416 Sep 07 09:47:26.298859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5db3c259-652e-428c-b8ab-17560dc5ab49 req-f775b1ae-84da-4787-9872-8eea543b935c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc44587-4609-4b49-84a9-761bdb462451", "tag": "0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:26.300288 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 412/820] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:26.312464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:26.313209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:26.333911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.334355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.334804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.335680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.336130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.336556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.347052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5db3c259-652e-428c-b8ab-17560dc5ab49 req-f775b1ae-84da-4787-9872-8eea543b935c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.351444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5db3c259-652e-428c-b8ab-17560dc5ab49 req-f775b1ae-84da-4787-9872-8eea543b935c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.356051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5db3c259-652e-428c-b8ab-17560dc5ab49 req-f775b1ae-84da-4787-9872-8eea543b935c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.394091 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5db3c259-652e-428c-b8ab-17560dc5ab49 req-f775b1ae-84da-4787-9872-8eea543b935c service nova] Creating event network-changed:0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021 for instance ddc44587-4609-4b49-84a9-761bdb462451 on n-h1-836830-16 Sep 07 09:47:26.429731 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5db3c259-652e-428c-b8ab-17560dc5ab49 req-f775b1ae-84da-4787-9872-8eea543b935c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166096 Sep 07 09:47:26.434662 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 409/821] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:26.459028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:26.465467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:26.482989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.490807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.493422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:26.498063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:26.500141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:26.500832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.185630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.209742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97babc27-bb5b-4138-960d-6e4487f27e45 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1324 microversion: 2.1 time: 0.903526 Sep 07 09:47:27.211365 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 413/822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:26 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1324 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:27.231811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:27.233091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:27.251743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.253940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.255805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.256783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.260210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.261087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.462793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.475932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.485382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.486707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.488449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.490202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.493548 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65d08dcd-529c-4be7-bca9-6ddffa2ef7a8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 1.049283 Sep 07 09:47:27.497397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 410/823] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:26 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:27.501522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb3b4737-be9c-4539-b939-f9ba2aa7c9bf tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.287671 Sep 07 09:47:27.506143 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 414/824] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:27 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:27.510181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:27.513457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:27.531101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:27.545798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.546687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:27.546954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.547623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.549901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.550696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.551526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.565362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.566057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.566639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.567750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.568402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.568979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.714699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:27.724100 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4122c39-6d88-4764-aaf7-6af7b1734cfa tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1218 microversion: 2.1 time: 0.216078 Sep 07 09:47:27.724676 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 415/825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:27 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1218 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:27.738303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:27.739208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:27.745756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.746789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.747862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.748744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:27.749561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:27.761465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:27.787789 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-91e9cc87-b8fd-4d7c-a03c-2b32e39e69ef tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289060 Sep 07 09:47:27.789109 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 411/826] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:47:27 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:28.230576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.234488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:28.235124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:28.243977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.244477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.244915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.245648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.246676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.247100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.251129 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44696cae-1d32-40b4-bf4d-f40e0853903a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.518718 Sep 07 09:47:28.255502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 416/827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:27 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:28.527477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:28.528837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:28.554434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.554835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.556311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.557071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.557554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.557990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.652993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.666881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9e292e23-c895-4595-9930-104f49a0f03f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.436385 Sep 07 09:47:28.685583 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 412/828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:28 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:28.691181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:28.692683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:28.700970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.701546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.701992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.702713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.703155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.703578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.891317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.913219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.922644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.930310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.943320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.948452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:28.951644 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-392b4115-47d0-4427-9191-857918e8a4ce tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.264859 Sep 07 09:47:28.953084 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f101f17-284c-4e35-a431-5ba39e708bfa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1362 microversion: 2.25 time: 0.429999 Sep 07 09:47:28.962194 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 417/829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:28 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:47:28.967826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:28.968728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:28.969407 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 413/830] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:28 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:28.980578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.981883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.982594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.983550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:28.984230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:28.984877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:28.987125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:28.989161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:29.010164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.013986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.016816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.020436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.024388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.025243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.134668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:29.148356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc0fc84a-99d1-44bb-a860-50c8788b1d21 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1274 microversion: 2.1 time: 0.177786 Sep 07 09:47:29.150016 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 414/831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:28 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:29.282681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:29.283305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:29.303963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.305428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.311725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.312834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.313750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.315185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:29.316161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.337348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e30c4f42-7d20-4332-950f-23355b1995f2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.370403 Sep 07 09:47:29.340797 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 418/832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:28 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:29.383933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d51dbd8-0219-4d2a-a123-a7f7aa242021 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-399939682", "metadata": {"": ""}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d51dbd8-0219-4d2a-a123-a7f7aa242021 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action HTTP/1.1 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 106 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:29.425172 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-399939682", "metadata": {"": ""}}} Sep 07 09:47:29.426649 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-399939682', 'metadata': {'': ''}}}} Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'': ''} Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:29.427465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.428791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:29.430199 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:29.430199 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:29.430199 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:47:29.430199 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:47:29.430199 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:29.430199 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:29.433202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d51dbd8-0219-4d2a-a123-a7f7aa242021 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:29.435014 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d51dbd8-0219-4d2a-a123-a7f7aa242021 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action" status: 400 len: 170 microversion: 2.1 time: 0.071425 Sep 07 09:47:29.436162 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 419/833] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 7 09:47:29 2022] POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action => generated 170 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:47:29.450551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:29.451531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:29.469083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.469882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.470536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.472130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.473604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.475904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.775443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:29.779121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:29.790243 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-701c8862-60f7-4184-9426-8bf8a70408fa tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1473 microversion: 2.1 time: 0.512652 Sep 07 09:47:29.801749 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 415/834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:29 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1473 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:29.808983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ae2c473a-0773-425f-bf64-f197e2bf2153 req-7e4af568-cc9c-4df9-8222-b4a1d0991bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193776ce-cebb-4703-b48b-c40e206b21ea", "tag": "85d9396a-28f4-41b8-a3e2-c1460f733d78"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:29.827759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ae2c473a-0773-425f-bf64-f197e2bf2153 req-7e4af568-cc9c-4df9-8222-b4a1d0991bd5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:29.828452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ae2c473a-0773-425f-bf64-f197e2bf2153 req-7e4af568-cc9c-4df9-8222-b4a1d0991bd5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:29.829690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ae2c473a-0773-425f-bf64-f197e2bf2153 req-7e4af568-cc9c-4df9-8222-b4a1d0991bd5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:29.859604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ae2c473a-0773-425f-bf64-f197e2bf2153 req-7e4af568-cc9c-4df9-8222-b4a1d0991bd5 service nova] Creating event network-changed:85d9396a-28f4-41b8-a3e2-c1460f733d78 for instance 193776ce-cebb-4703-b48b-c40e206b21ea on n-h1-836830-16 Sep 07 09:47:29.874962 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ae2c473a-0773-425f-bf64-f197e2bf2153 req-7e4af568-cc9c-4df9-8222-b4a1d0991bd5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071029 Sep 07 09:47:29.876159 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 416/835] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:29.959067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:29.974017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1663011-db3e-4a66-9da8-bebf27e9d01a tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.533488 Sep 07 09:47:29.974886 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 420/836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:29 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:29.987649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:29.988609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:30.008493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:30.009811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.010533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:30.011221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.014411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.015370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.015845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.016432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.030442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.030927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.044729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.046449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.054101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.054752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.179329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:30.201038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:30.203958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:30.210190 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8dfbd4cc-7a80-4b7b-b249-f577dde4645e tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.226928 Sep 07 09:47:30.211330 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 417/837] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:29 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:30.217346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:30.218237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:30.224742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.225483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.226117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.227371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.228609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.229982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.596553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:30.619040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:30.620654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:30.622433 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5dee50c-c08f-4474-8ddc-6fa70633ed58 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1558 microversion: 2.25 time: 0.630642 Sep 07 09:47:30.622995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 421/838] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:29 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1558 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:30.639893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:30.641101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:30.656402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.657501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.658171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.659660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:30.660422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:30.662020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:30.999436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:31.008003 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea6db080-40b6-42d8-b296-09e8d44d8a3b tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1274 microversion: 2.1 time: 0.383619 Sep 07 09:47:31.021651 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 422/839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:30 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1274 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:31.029810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:31.031991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:31.034656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:31.039504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f3b71fb-ee2c-4770-8d90-72d2ce898944 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.826946 Sep 07 09:47:31.043084 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 418/840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:30 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:31.048020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.048871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.049587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.050802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.051940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.052584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.053777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:31.054410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:31.075990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.076495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.076939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.084918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.085477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.086747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.591693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:31.602804 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ab7431c-0be8-4617-abed-d4838e87bdda tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1479 microversion: 2.1 time: 0.557766 Sep 07 09:47:31.604815 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 419/841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:31 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1479 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:31.610513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:31.612917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c7f56be-46e7-468e-af58-06dbf4733e98 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1340008523", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c7f56be-46e7-468e-af58-06dbf4733e98 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action HTTP/1.1 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 619 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:31.637521 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:31.638921 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:47:31.639522 n-d-836830-16 devstack@n-api.service[128832]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1340008523", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 07 09:47:31.639522 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:31.639522 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1340008523', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 07 09:47:31.639747 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:31.640518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.642701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:31.644332 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:31.644332 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:31.644332 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:47:31.644332 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:47:31.644332 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:47:31.644332 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:31.645241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c7f56be-46e7-468e-af58-06dbf4733e98 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:31.647076 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a05b2d61-a4d8-47cc-931f-5ee9415c9a3a tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 2053 microversion: 2.25 time: 0.624108 Sep 07 09:47:31.648136 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 423/842] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:31 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 2053 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:31.649067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c7f56be-46e7-468e-af58-06dbf4733e98 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action" status: 400 len: 938 microversion: 2.1 time: 0.042395 Sep 07 09:47:31.650877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 420/843] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 7 09:47:31 2022] POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action => generated 938 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:47:31.664167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:31.670568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:31.674262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:31.675522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:31.691909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.692677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.693126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.693972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.694328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.694757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.701910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.708107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.709024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:31.710602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:31.711359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:31.711950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.105840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:32.116276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:32.119705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:32.145564 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5448d3c1-c9f1-486c-8a97-a673c312f088 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.492960 Sep 07 09:47:32.147080 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 424/844] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:31 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:32.159871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:32.160840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:32.176810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.179825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.180490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.181441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.184387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.185738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.432021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:32.453962 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8534210d-3043-42b6-8637-c0de0f14b59d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.798207 Sep 07 09:47:32.455268 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 421/845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:31 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:32.461679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:32.464734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:32.479257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.482082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.482559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.484848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.485654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.486711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.579656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:32.610865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7aade1e4-27ea-43e7-8286-9c5c8dfdff08 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 2053 microversion: 2.25 time: 0.462419 Sep 07 09:47:32.611546 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 425/846] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:32 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 2053 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:32.629065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ea7d9a17-72c7-40cf-8423-13c1b42df980 req-02a7881e-0192-4e13-9139-ea69f56a727c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a1035a-aea9-42e8-a35d-1eb6768c666d", "name": "network-vif-unplugged", "status": "completed", "tag": "494a8253-cb34-4c7c-a5e6-93a8372fb872"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:32.644356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:32.649385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea7d9a17-72c7-40cf-8423-13c1b42df980 req-02a7881e-0192-4e13-9139-ea69f56a727c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.649801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea7d9a17-72c7-40cf-8423-13c1b42df980 req-02a7881e-0192-4e13-9139-ea69f56a727c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.650238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea7d9a17-72c7-40cf-8423-13c1b42df980 req-02a7881e-0192-4e13-9139-ea69f56a727c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.658205 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0245dba9-837e-4550-b08f-efc5f4b03a39 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1280 microversion: 2.1 time: 0.194448 Sep 07 09:47:32.659394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 422/847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:32 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:32.666951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:32.674235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:32.689075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.691365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.692270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.694113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.695312 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ea7d9a17-72c7-40cf-8423-13c1b42df980 req-02a7881e-0192-4e13-9139-ea69f56a727c service nova] Creating event network-vif-unplugged:494a8253-cb34-4c7c-a5e6-93a8372fb872 for instance f7a1035a-aea9-42e8-a35d-1eb6768c666d on n-h2-836830-16 Sep 07 09:47:32.697874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.698520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.712186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ea7d9a17-72c7-40cf-8423-13c1b42df980 req-02a7881e-0192-4e13-9139-ea69f56a727c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099465 Sep 07 09:47:32.712816 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 426/848] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:32.750725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:32.755317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:32.775291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.775800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.776242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:32.776960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:32.777988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:32.778420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.056985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.069968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.071051 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e872ae9d-4381-45de-ba3c-2b51a44cf201 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.409998 Sep 07 09:47:33.071981 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 423/849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:32 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:33.085608 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-acbc1512-28a1-4f9e-8488-ed3b50d43287 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1479 microversion: 2.1 time: 0.347850 Sep 07 09:47:33.098873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:33.106588 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 427/850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:32 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1479 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:33.107846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.108413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.109446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.110751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.111286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.111786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.111912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f00caa38-1ba8-40f0-ae16-ba4e2094faf5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f00caa38-1ba8-40f0-ae16-ba4e2094faf5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action HTTP/1.1 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 285 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:33.124635 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:33.126035 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:47:33.126680 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:47:33.127446 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:47:33.128634 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:47:33.130731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 09:47:33.130731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:33.130731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f00caa38-1ba8-40f0-ae16-ba4e2094faf5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:33.130731 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f00caa38-1ba8-40f0-ae16-ba4e2094faf5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action" status: 400 len: 619 microversion: 2.1 time: 0.018459 Sep 07 09:47:33.131227 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 428/851] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 7 09:47:33 2022] POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:47:33.148406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:33.152203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:33.169996 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b87b0726-8517-48ff-9ff3-5425b2b54498 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.074711 Sep 07 09:47:33.172299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.180573 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 424/852] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 7 09:47:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:47:33.182026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:33.182026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:33.185351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.186352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.187310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.190924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.191560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.193537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.195583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.195583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.195583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.195906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.196266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.457742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.472694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.474176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.497342 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1c04afa-f073-464d-b74a-34cdb2931065 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.320824 Sep 07 09:47:33.499306 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 425/853] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:33 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:33.513372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:33.514629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:33.531801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.533835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.534247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.535022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.535514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.535945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.723698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6563f336-3cda-452a-999c-0820029ec274 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6/action" status: 202 len: 0 microversion: 2.25 time: 0.221656 Sep 07 09:47:33.724374 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 426/854] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:47:33 2022] POST /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:33.729862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:33.731189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:33.757583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.758630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.758630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.759136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.761479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.762611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.787217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.796325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-55000b6c-59c7-4c8d-b3a6-6205bc29790f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.658265 Sep 07 09:47:33.803414 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 429/855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:33 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:33.817475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:33.818103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:33.843148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.843906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.844815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.846604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.849824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.850496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.957064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:33.968059 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e65b35d9-2e7d-455d-bb1c-f83c20a7b670 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1280 microversion: 2.1 time: 0.242469 Sep 07 09:47:33.968924 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 427/856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:33 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:33.974796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:33.976394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:33.989476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.991060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.991681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:33.992602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:33.993405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:33.994775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.180469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:34.191171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:34.227419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9bd47320-f5e0-4040-9a66-94d6b95c3fcf tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 2058 microversion: 2.25 time: 0.421396 Sep 07 09:47:34.245220 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 430/857] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:33 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 2058 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:34.250460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:34.251372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:34.260716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:34.263052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:34.266875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.268626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:34.269301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:34.271344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.532392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:34.549907 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac3371a7-142f-4172-8d00-91f83c8b0bb9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.579319 Sep 07 09:47:34.562839 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 428/858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:33 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:34.594632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:34.595328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:34.611622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:34.612123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:34.612589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.618459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:34.618797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:34.619638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.722829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:34.733568 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb8eab69-88b8-4835-80ae-fc0bafa0325f tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1479 microversion: 2.1 time: 0.500747 Sep 07 09:47:34.734152 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 431/859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:34 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1479 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:34.747698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:34.754217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-88271023"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:34.760020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:34.760218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:34.763968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:34.772107 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb5505e5-2d03-45d4-af06-31e59234daee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.189129 Sep 07 09:47:34.772430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:34.772920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:34.773385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.774421 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 429/860] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:34 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:34.789655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:34.791044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:34.792104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:34.992751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:34.995421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:35.012707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.014494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.017250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.020409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.021684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.024104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.232981 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-097220b9-aeed-4c4e-9fca-1b675ec48d75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action" status: 202 len: 0 microversion: 2.1 time: 0.488942 Sep 07 09:47:35.235721 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 432/861] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:47:34 2022] POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:47:35.247587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1761804551"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:35.251525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:35.264418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.265262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.265859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.267044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.267650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.268525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.309257 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Cannot 'createImage' instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 while it is in task_state image_snapshot_pending Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action HTTP/1.1 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 85 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:35.311458 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1761804551"}} Sep 07 09:47:35.312973 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot 'createImage' instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 while it is in task_state image_snapshot_pending Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1761804551'}}} Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:35.313734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 while it is in task_state image_snapshot_pending Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 while it is in task_state image_snapshot_pending Sep 07 09:47:35.315077 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:35.317711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 409 to user: Cannot 'createImage' instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 while it is in task_state image_snapshot_pending {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:35.318764 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bcc1f373-48eb-4542-94ed-8b43efd10391 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action" status: 409 len: 167 microversion: 2.1 time: 0.077406 Sep 07 09:47:35.320074 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 433/862] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:47:35 2022] POST /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8/action => generated 167 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:47:35.326384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:35.327667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:35.335713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.336566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.337702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.339308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.341156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.342004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.553009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:35.570551 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae5dfa30-ea06-440e-840b-a652ea2f6711 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.582137 Sep 07 09:47:35.591033 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 430/863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:34 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:35.602300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-321fc279-8aa8-48fc-a43e-59c6d7f2500d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '.version_select at 0x7f14b1fbe0d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:35.661007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:35.687090 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a460ae1b-a284-48b4-996d-10f8c85bbf47 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 2038 microversion: 2.25 time: 0.365718 Sep 07 09:47:35.687677 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 434/864] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:35 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 2038 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:35.720271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-16", "block_migration": "auto"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:35.724382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:35.731979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.733148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.733841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.734895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.736045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.736698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.770958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'flavor' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:35.788766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Going to try to live migrate instance to n-h1-836830-16 {{(pid=128833) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:47:35.842458 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-321fc279-8aa8-48fc-a43e-59c6d7f2500d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/images/109c487d-eb44-4988-a13d-f65076512288" status: 204 len: 0 microversion: 2.1 time: 0.248969 Sep 07 09:47:35.843091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 431/865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:35 2022] DELETE /compute/v2.1/images/109c487d-eb44-4988-a13d-f65076512288 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:35.852063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:35.857289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:35.876802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.877760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.878711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:35.880300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:35.882846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:35.886510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.160163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:36.242723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:36.254558 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f71c8f45-033e-4518-be00-10f25bf1ab16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1479 microversion: 2.1 time: 0.409921 Sep 07 09:47:36.259472 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 432/866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:35 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1479 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:36.286218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:36.286844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:36.300526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.301029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.301508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.307274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.308221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.309416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.510458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:36.526295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:36.529603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:36.537605 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8c0f0769-db85-457f-aadb-8bced443d7c7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.274867 Sep 07 09:47:36.538852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 433/867] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:36 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:36.545217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:36.546103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:36.553419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.554887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.555611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.556589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.557246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.557892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.854667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:36.860508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:36.869770 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb6c1de7-9768-470d-a6e7-6ebbf5f64120 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1539 microversion: 2.1 time: 0.329378 Sep 07 09:47:36.882781 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 434/868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:36 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1539 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:36.894455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fc35d0c9-cf7f-4f4f-82e0-98a031630600 req-8aa27380-711f-4799-aec8-bb4ee4fbec1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a1035a-aea9-42e8-a35d-1eb6768c666d", "name": "network-vif-plugged", "status": "completed", "tag": "494a8253-cb34-4c7c-a5e6-93a8372fb872"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:36.904359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:36.909914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fc35d0c9-cf7f-4f4f-82e0-98a031630600 req-8aa27380-711f-4799-aec8-bb4ee4fbec1d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.910484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fc35d0c9-cf7f-4f4f-82e0-98a031630600 req-8aa27380-711f-4799-aec8-bb4ee4fbec1d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.910923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fc35d0c9-cf7f-4f4f-82e0-98a031630600 req-8aa27380-711f-4799-aec8-bb4ee4fbec1d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.945635 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fc35d0c9-cf7f-4f4f-82e0-98a031630600 req-8aa27380-711f-4799-aec8-bb4ee4fbec1d service nova] Creating event network-vif-plugged:494a8253-cb34-4c7c-a5e6-93a8372fb872 for instance f7a1035a-aea9-42e8-a35d-1eb6768c666d on n-h2-836830-16 Sep 07 09:47:36.953449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fc35d0c9-cf7f-4f4f-82e0-98a031630600 req-8aa27380-711f-4799-aec8-bb4ee4fbec1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067638 Sep 07 09:47:36.954389 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 435/869] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:36.966063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:36.967854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:36.977528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.978297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.978920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:36.979779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:36.980695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:36.981458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:37.424205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:37.435392 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d074e7c-d899-498f-bd71-3e2dddac8283 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.475386 Sep 07 09:47:37.444475 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 436/870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:36 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:37.464231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1ffd548d-7025-467d-b7d4-b4263a38cc99 req-48231d70-f225-487f-b156-14e76759b9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9f55c3-1552-4637-a28b-dd202a84f23a", "tag": "7fd8c201-017f-421c-ad32-3d89a9ff8a4d"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:37.479924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1ffd548d-7025-467d-b7d4-b4263a38cc99 req-48231d70-f225-487f-b156-14e76759b9f9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:37.480476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1ffd548d-7025-467d-b7d4-b4263a38cc99 req-48231d70-f225-487f-b156-14e76759b9f9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:37.481017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1ffd548d-7025-467d-b7d4-b4263a38cc99 req-48231d70-f225-487f-b156-14e76759b9f9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:37.514788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1ffd548d-7025-467d-b7d4-b4263a38cc99 req-48231d70-f225-487f-b156-14e76759b9f9 service nova] Creating event network-changed:7fd8c201-017f-421c-ad32-3d89a9ff8a4d for instance dd9f55c3-1552-4637-a28b-dd202a84f23a on n-h2-836830-16 Sep 07 09:47:37.520445 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1ffd548d-7025-467d-b7d4-b4263a38cc99 req-48231d70-f225-487f-b156-14e76759b9f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073497 Sep 07 09:47:37.529456 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 437/871] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:37.534821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:37.535542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:37.555439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:37.555439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:37.555439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:37.556265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:37.556600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:37.556880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:37.791207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:37.801823 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a9ea528-328c-41a7-b40d-987a0c2c1428 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1479 microversion: 2.1 time: 0.270766 Sep 07 09:47:37.802527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 438/872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:37 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1479 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:37.807801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:37.809417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:37.817633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:37.818484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:37.819527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:37.820663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:37.821538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:37.823129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:37.976357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:37.989287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:37.992650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:38.005129 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86f89bed-d1d9-42b6-9ef5-2ec8a3b7ce55 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.201208 Sep 07 09:47:38.007074 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 439/873] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:37 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:38.016022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:38.021087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:38.046640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.053296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.054243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.055970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.057915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.058183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.122537 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e74f2c68-8d28-486f-89e0-34f66b12c5f1 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6/action" status: 202 len: 0 microversion: 2.25 time: 2.408573 Sep 07 09:47:38.124067 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 435/874] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:47:35 2022] POST /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6/action => generated 0 bytes in 2411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:38.132374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:38.134200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:38.142034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.142773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.143629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.144594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.145492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.146169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.338923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:38.351434 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e5f380ee-f1b6-446b-bc99-6101ec64f90b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1539 microversion: 2.1 time: 0.341728 Sep 07 09:47:38.372833 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 440/875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:38 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1539 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:38.428222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:38.444642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:38.446748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:38.448217 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e82fc5f4-ad20-4e9d-9088-7b4402376bde tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.319889 Sep 07 09:47:38.448849 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 436/876] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:38 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:38.475387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:38.476092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:38.482629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.483392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.483598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.484273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.484737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.485165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.745236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:38.759697 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b13541c-afd0-4b62-9839-9818da29a15a tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.288081 Sep 07 09:47:38.774156 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 441/877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:38 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:38.832112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:38.833106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:38.840085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.840935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.841848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:38.842830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:38.843450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:38.844056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:39.005670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c40627f-9502-4552-96ca-0237a12f95d3 tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-829682854", "id": 879866708, "os-flavor-access:is_public": "True"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:39.025784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:39.035978 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c40627f-9502-4552-96ca-0237a12f95d3 tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.226414 Sep 07 09:47:39.036847 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 437/878] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:47:38 2022] POST /compute/v2.1/flavors => generated 467 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 09:47:39.039553 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2011fdb8-8f0f-401b-873b-d501c23fecaf tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1479 microversion: 2.1 time: 0.212015 Sep 07 09:47:39.040644 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 442/879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:38 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1479 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:39.041551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:39.042363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:39.056790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b5adde3-59dd-4ce9-b43f-30268d5b009f tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:39.062189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:39.062943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:39.063551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:39.065110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:39.066428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:39.067291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:39.145429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:39.155443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:39.156906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:39.164876 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-64507df7-df02-4c03-880b-0c8f892cfc53 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.126940 Sep 07 09:47:39.165796 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 438/880] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:39 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:39.276666 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b5adde3-59dd-4ce9-b43f-30268d5b009f tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/879866708/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.223128 Sep 07 09:47:39.279325 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 443/881] 10.222.0.60 () {62 vars in 1262 bytes} [Wed Sep 7 09:47:39 2022] POST /compute/v2.1/flavors/879866708/os-extra_specs => generated 62 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:39.290568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20ec3efc-bde0-47b7-aa61-2e3f7a8f163f tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:39.314473 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20ec3efc-bde0-47b7-aa61-2e3f7a8f163f tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/879866708" status: 202 len: 0 microversion: 2.86 time: 0.027501 Sep 07 09:47:39.315252 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 439/882] 10.222.0.60 () {60 vars in 1199 bytes} [Wed Sep 7 09:47:39 2022] DELETE /compute/v2.1/flavors/879866708 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:39.325453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35df6125-098e-46b3-95c0-b0d002500faf tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:39.350847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35df6125-098e-46b3-95c0-b0d002500faf tempest-FlavorMetadataValidation-873132497 tempest-FlavorMetadataValidation-873132497-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.029894 Sep 07 09:47:39.369230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 444/883] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 09:47:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:39.381006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:39.382590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:39.390184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:39.390983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:39.391666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:39.392687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:39.393353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:39.393931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:39.527696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:39.533027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:39.568044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:39.568551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:39.569020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:39.569824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:39.570291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:39.571223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.161464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.169718 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79f19d0d-9aaf-47cd-99c5-5ec403a8d56b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1521 microversion: 2.1 time: 0.793407 Sep 07 09:47:40.181506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 440/884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:39 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1521 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:40.182207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:40.185924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:40.197989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.198874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.200610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.202489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.203252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.203907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.588305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.607933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.610200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.612123 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45431b3f-2345-46b6-9cd6-244841752da8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 1.112284 Sep 07 09:47:40.618201 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 445/885] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:39 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:40.630888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:40.631879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:40.642147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.642927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.651458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.653221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.656767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.657416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.698110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.710180 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b076caf2-d914-4907-86fb-80dfddd1318c tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.532424 Sep 07 09:47:40.712813 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 441/886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:40 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:40.726718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:40.727458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:40.741586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.743164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.745144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.748214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.748867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.750199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.887254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.897114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.899253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:40.903020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:40.906341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-190ed4ed-5262-4bb4-8742-6bd0b8956392 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1553 microversion: 2.91 time: 0.189980 Sep 07 09:47:40.907481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 442/887] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:40 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:40.912213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:40.912705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:40.921756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.922447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.923419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.925595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:40.926505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:40.927081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:40.960620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:47:41.043656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:41.056371 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f17c34a-5ca5-4902-997a-cdb4faff4c16 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1464 microversion: 2.1 time: 0.436729 Sep 07 09:47:41.057818 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 446/888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:40 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1464 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:41.062368 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5ac58ae8-adb9-4508-828b-52f85b457f11 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 204 len: 0 microversion: 2.1 time: 0.153357 Sep 07 09:47:41.063217 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 443/889] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:40 2022] DELETE /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:41.072613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.073568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.080999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.081862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.082532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.083447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.084192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.084783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.093659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:41.098086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.107752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.108804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.110457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.111716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.112189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.112633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.116029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:41.207333 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d3b060dd-c08a-480d-a0d4-cb5e34f104fc tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 0 microversion: 2.1 time: 0.121193 Sep 07 09:47:41.208977 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 444/890] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:47:41 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:47:41.217459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.218320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.224354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.225144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.225710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.226470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.227102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.227666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.293887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.294534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.295079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.295644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lazy-loading 'fault' on Instance uuid f7a1035a-aea9-42e8-a35d-1eb6768c666d {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:41.309719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:41.329591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ff1a150d-0d62-4c9d-a38a-2c5ce9c51762 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1527 microversion: 2.1 time: 0.261991 Sep 07 09:47:41.347332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 447/891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:41 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1527 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:41.437275 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2a05d5e9-9873-4b94-9910-f57d7a81d247 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1600 microversion: 2.1 time: 0.224525 Sep 07 09:47:41.437847 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 445/892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:41 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1600 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:41.460817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:41.463179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.470240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.471632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.472079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.472784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.475009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.475447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.551194 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25242470-00c1-4699-8221-b87289be49e1 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action" status: 202 len: 0 microversion: 2.1 time: 0.094070 Sep 07 09:47:41.552300 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 448/893] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:47:41 2022] POST /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:47:41.560928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.561734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.567989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.568563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.569077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.569935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.570465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.570988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.640366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.640995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.647678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.648495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.648939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.649703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.650162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.650588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.749604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02cbc15c-2cd1-4a42-995b-f341ffe54617 tempest-ServersAdminTestJSON-509179499 tempest-ServersAdminTestJSON-509179499-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1617 microversion: 2.1 time: 0.192794 Sep 07 09:47:41.750359 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 446/894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:41 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1617 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:41.755131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.755745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.767624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.768416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.769018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.769984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.770596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.771175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.828928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:41.840146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:41.842065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:41.843743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c48fea5-cd59-4522-8e62-78cb343e1615 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.208029 Sep 07 09:47:41.844627 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 449/895] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:41 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:41.850062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.850501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.859219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.859930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.860532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.861521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.862192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.862836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.929510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:47:41.932852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:41.941620 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26d399d7-c63b-43fc-9d25-cc0c54943aec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.189908 Sep 07 09:47:41.942929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 447/896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:41 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:41.966862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:41.967525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:41.974428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.975125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.975929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:41.976817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:41.977645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:41.978254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.031666 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d6539700-3a71-4ec9-b293-7eeeaa9f9e58 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 204 len: 0 microversion: 2.1 time: 0.184720 Sep 07 09:47:42.031666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 450/897] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:41 2022] DELETE /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:42.040260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:42.040974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:42.050334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.050949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.051515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.052328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.053012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.053563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.080730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:42.098983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:42.111631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:42.113458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:42.127361 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-28c336d8-f417-4a93-aacf-e2dbd1908ad7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1535 microversion: 2.91 time: 0.171523 Sep 07 09:47:42.129873 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 448/898] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:41 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1535 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:42.141270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6b8e584d-add2-41f8-bf6f-a05eb40f80d5 req-1f522e6e-249b-43c1-80aa-47478552904b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9f55c3-1552-4637-a28b-dd202a84f23a", "name": "network-vif-plugged", "status": "completed", "tag": "7fd8c201-017f-421c-ad32-3d89a9ff8a4d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:42.159473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6b8e584d-add2-41f8-bf6f-a05eb40f80d5 req-1f522e6e-249b-43c1-80aa-47478552904b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.159960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6b8e584d-add2-41f8-bf6f-a05eb40f80d5 req-1f522e6e-249b-43c1-80aa-47478552904b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.160390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6b8e584d-add2-41f8-bf6f-a05eb40f80d5 req-1f522e6e-249b-43c1-80aa-47478552904b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.172995 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6b8e584d-add2-41f8-bf6f-a05eb40f80d5 req-1f522e6e-249b-43c1-80aa-47478552904b service nova] Creating event network-vif-plugged:7fd8c201-017f-421c-ad32-3d89a9ff8a4d for instance dd9f55c3-1552-4637-a28b-dd202a84f23a on n-h2-836830-16 Sep 07 09:47:42.184771 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6b8e584d-add2-41f8-bf6f-a05eb40f80d5 req-1f522e6e-249b-43c1-80aa-47478552904b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052511 Sep 07 09:47:42.191817 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 449/899] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:42.233076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:42.242073 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e747ded-8413-454f-94a9-1061ad7a9736 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1469 microversion: 2.1 time: 0.206073 Sep 07 09:47:42.242649 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 451/900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:42 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:42.354961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:42.356395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:42.362716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.363137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.363573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.364263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.364714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.365132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.506601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:42.514864 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-700738d4-e84a-4c78-927e-d8872f210aae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1527 microversion: 2.1 time: 0.164789 Sep 07 09:47:42.515430 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 450/901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:42 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:42.864122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-999c77a8-33d4-414b-895d-497183404995 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-526042085", "ram": 512, "vcpus": 1, "disk": 10, "id": 1978136441, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:42.870298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:42.871567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:42.877577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.878055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.878480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.879156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:42.879603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:42.880016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:42.909264 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-999c77a8-33d4-414b-895d-497183404995 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.162278 Sep 07 09:47:42.916050 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 452/902] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:47:42 2022] POST /compute/v2.1/flavors => generated 415 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:43.033139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-388fd9ee-c81f-47b5-b27e-c306b8e902aa tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.043482 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-388fd9ee-c81f-47b5-b27e-c306b8e902aa tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] HTTP exception thrown: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-388fd9ee-c81f-47b5-b27e-c306b8e902aa tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Request method failure captured: Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/flavors/1978136441/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGi-f3niSXAIww40jb8I7AoH8OOe9XeAgL9Hs8jYyTGHrMLWeH6ta1Q9f4wc70IDdSViKp7bRf2L6mf0vQc7ElyxT5iLIWrWy6NWnB-MQBEqLYq9YRqX_VnFUcKs9NB_q0vM2o7zQ-TepUSXtSeKmSH9_tzotAJOifVYi58zQ4_pia4 Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:43.045866 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d210442523e14e7aad4b4aa7163838fa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 9a0f2f4c00d64563a91226b98a23ef88 Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:43.047198 n-d-836830-16 devstack@n-api.service[128832]: exception: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'flavor_id': '1978136441', 'id': 'hw:cpu_thread_policy'} Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.047882 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-388fd9ee-c81f-47b5-b27e-c306b8e902aa tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Returning 404 to user: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-388fd9ee-c81f-47b5-b27e-c306b8e902aa tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] 10.222.0.60 "GET /compute/v2.1/flavors/1978136441/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.128012 Sep 07 09:47:43.049144 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 453/903] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 09:47:42 2022] GET /compute/v2.1/flavors/1978136441/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:43.054704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.055953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:43.062584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.063077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.063592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.064297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.064724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.065320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.141704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:43.156558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.165237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.167130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.168925 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7c70151b-458e-454c-b0a0-e1626c78a24b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.302602 Sep 07 09:47:43.169521 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 451/904] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:42 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:47:43.193078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05572bc6-7777-4649-b4e0-0d5ab01be44f tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.196728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05572bc6-7777-4649-b4e0-0d5ab01be44f tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '9a0f2f4c00d64563a91226b98a23ef88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd210442523e14e7aad4b4aa7163838fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05572bc6-7777-4649-b4e0-0d5ab01be44f tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Request method failure captured: Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/flavors/1978136441/os-extra_specs HTTP/1.1 Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 66 Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGi-f3niSXAIww40jb8I7AoH8OOe9XeAgL9Hs8jYyTGHrMLWeH6ta1Q9f4wc70IDdSViKp7bRf2L6mf0vQc7ElyxT5iLIWrWy6NWnB-MQBEqLYq9YRqX_VnFUcKs9NB_q0vM2o7zQ-TepUSXtSeKmSH9_tzotAJOifVYi58zQ4_pia4 Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:43.198971 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d210442523e14e7aad4b4aa7163838fa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 9a0f2f4c00d64563a91226b98a23ef88 Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 07 09:47:43.200598 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'flavor_id': '1978136441', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:47:43.201697 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 07 09:47:43.203084 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.205269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05572bc6-7777-4649-b4e0-0d5ab01be44f tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.206278 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05572bc6-7777-4649-b4e0-0d5ab01be44f tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] 10.222.0.60 "POST /compute/v2.1/flavors/1978136441/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023207 Sep 07 09:47:43.206998 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 452/905] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 7 09:47:43 2022] POST /compute/v2.1/flavors/1978136441/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:43.217964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.218801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:43.226975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.227741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.228399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.229340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.229957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.231152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.291448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.300364 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1cb61de9-a762-4a59-aed5-48d407084094 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.251328 Sep 07 09:47:43.300944 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 454/906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:43 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:43.305864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe60984b-afd5-44ad-8d94-899a6538e7ca tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.325864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.334958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.336631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.337371 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe60984b-afd5-44ad-8d94-899a6538e7ca tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1978136441/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035158 Sep 07 09:47:43.343282 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 455/907] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 7 09:47:43 2022] POST /compute/v2.1/flavors/1978136441/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:47:43.350889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.352879 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d278200-b4f6-4f2b-8833-77ebcd9ed7dc tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1535 microversion: 2.91 time: 0.139133 Sep 07 09:47:43.353671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 453/908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:43 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1535 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:43.357790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:43.369472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.369940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.370578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.371328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.371893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.372462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.374316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c713b349-cd5e-4ea4-aad4-de769d5afacd tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.376599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c713b349-cd5e-4ea4-aad4-de769d5afacd tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '9a0f2f4c00d64563a91226b98a23ef88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd210442523e14e7aad4b4aa7163838fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c713b349-cd5e-4ea4-aad4-de769d5afacd tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Request method failure captured: Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGi-f3niSXAIww40jb8I7AoH8OOe9XeAgL9Hs8jYyTGHrMLWeH6ta1Q9f4wc70IDdSViKp7bRf2L6mf0vQc7ElyxT5iLIWrWy6NWnB-MQBEqLYq9YRqX_VnFUcKs9NB_q0vM2o7zQ-TepUSXtSeKmSH9_tzotAJOifVYi58zQ4_pia4 Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:43.378187 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d210442523e14e7aad4b4aa7163838fa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 9a0f2f4c00d64563a91226b98a23ef88 Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:43.379477 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'flavor_id': '1978136441', 'id': 'hw:numa_nodes'} Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:47:43.380144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.381330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c713b349-cd5e-4ea4-aad4-de769d5afacd tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.384850 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c713b349-cd5e-4ea4-aad4-de769d5afacd tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] 10.222.0.60 "DELETE /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023649 Sep 07 09:47:43.384850 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 454/909] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 09:47:43 2022] DELETE /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:43.390060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33ec4953-f83a-4d12-8b5a-d6483f1de855 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.433373 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33ec4953-f83a-4d12-8b5a-d6483f1de855 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1978136441/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047067 Sep 07 09:47:43.439610 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 455/910] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 7 09:47:43 2022] POST /compute/v2.1/flavors/1978136441/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:47:43.445474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63030e61-cb7b-49bf-b18a-ac3da402ba58 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.448741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-63030e61-cb7b-49bf-b18a-ac3da402ba58 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '9a0f2f4c00d64563a91226b98a23ef88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd210442523e14e7aad4b4aa7163838fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63030e61-cb7b-49bf-b18a-ac3da402ba58 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Request method failure captured: Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 22 Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGi-f3niSXAIww40jb8I7AoH8OOe9XeAgL9Hs8jYyTGHrMLWeH6ta1Q9f4wc70IDdSViKp7bRf2L6mf0vQc7ElyxT5iLIWrWy6NWnB-MQBEqLYq9YRqX_VnFUcKs9NB_q0vM2o7zQ-TepUSXtSeKmSH9_tzotAJOifVYi58zQ4_pia4 Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:43.451304 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d210442523e14e7aad4b4aa7163838fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d210442523e14e7aad4b4aa7163838fa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d210442523e14e7aad4b4aa7163838fa Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 9a0f2f4c00d64563a91226b98a23ef88 Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: {"hw:numa_nodes": "1"} Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:43.452607 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'flavor_id': '1978136441', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:47:43.453440 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 07 09:47:43.455226 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.457885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63030e61-cb7b-49bf-b18a-ac3da402ba58 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.457885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-63030e61-cb7b-49bf-b18a-ac3da402ba58 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728 tempest-FlavorsExtraSpecsNegativeTestJSON-307964728-project] 10.222.0.60 "PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011776 Sep 07 09:47:43.458784 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 456/911] 10.222.0.60 () {60 vars in 1265 bytes} [Wed Sep 7 09:47:43 2022] PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:43.465876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba880c9a-2f7a-48a4-b283-220ae3d07b5f tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.475194 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ba880c9a-2f7a-48a4-b283-220ae3d07b5f tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] HTTP exception thrown: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba880c9a-2f7a-48a4-b283-220ae3d07b5f tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Request method failure captured: Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/flavors/1978136441/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGi-8rdQgN6V-tuJT2gXn2PzZV8AWYRoNjBggDOST_uhk1ezCqZMeKopJu4qf6oaJv2hkPP1ttfx9-LIGUsLcaJJ8JiHevt52iaESYvti5uhCTpPPu7U6vKT5_6NpST8zNfygg-toleR7Qb7pDnImpi84gRdUx45p6fHNCDssg9tNsY Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 9389c64ef53d467f910c4c7d4170d74c Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:47:43.476537 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9389c64ef53d467f910c4c7d4170d74c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 9389c64ef53d467f910c4c7d4170d74c Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: cb89962518a943c1988fa59b1f54747e Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:43.477860 n-d-836830-16 devstack@n-api.service[128833]: exception: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'flavor_id': '1978136441', 'id': 'hw:cpu_thread_policy'} Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.478590 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba880c9a-2f7a-48a4-b283-220ae3d07b5f tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Returning 404 to user: Flavor 1978136441 has no extra specs with key hw:cpu_thread_policy. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ba880c9a-2f7a-48a4-b283-220ae3d07b5f tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1978136441/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.018165 Sep 07 09:47:43.480654 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 457/912] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:47:43 2022] DELETE /compute/v2.1/flavors/1978136441/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:43.488316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1962eab4-12e4-4980-82c4-234417042d23 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.491719 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-1962eab4-12e4-4980-82c4-234417042d23 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1962eab4-12e4-4980-82c4-234417042d23 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Request method failure captured: Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 27 Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGi-8rdQgN6V-tuJT2gXn2PzZV8AWYRoNjBggDOST_uhk1ezCqZMeKopJu4qf6oaJv2hkPP1ttfx9-LIGUsLcaJJ8JiHevt52iaESYvti5uhCTpPPu7U6vKT5_6NpST8zNfygg-toleR7Qb7pDnImpi84gRdUx45p6fHNCDssg9tNsY Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 9389c64ef53d467f910c4c7d4170d74c Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:47:43.493174 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9389c64ef53d467f910c4c7d4170d74c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 9389c64ef53d467f910c4c7d4170d74c Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: cb89962518a943c1988fa59b1f54747e Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: {"hw:cpu_policy": "shared"} Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:43.494451 n-d-836830-16 devstack@n-api.service[128833]: exception: Request body and URI mismatch Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'flavor_id': '1978136441', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.495197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1962eab4-12e4-4980-82c4-234417042d23 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1962eab4-12e4-4980-82c4-234417042d23 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010527 Sep 07 09:47:43.496747 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 458/913] 10.222.0.60 () {60 vars in 1265 bytes} [Wed Sep 7 09:47:43 2022] PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes => generated 73 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 07 09:47:43.504280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcd09979-e1f0-4da5-9a81-2ad7e62a3d88 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcd09979-e1f0-4da5-9a81-2ad7e62a3d88 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Request method failure captured: Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 49 Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGi-8rdQgN6V-tuJT2gXn2PzZV8AWYRoNjBggDOST_uhk1ezCqZMeKopJu4qf6oaJv2hkPP1ttfx9-LIGUsLcaJJ8JiHevt52iaESYvti5uhCTpPPu7U6vKT5_6NpST8zNfygg-toleR7Qb7pDnImpi84gRdUx45p6fHNCDssg9tNsY Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 9389c64ef53d467f910c4c7d4170d74c Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:47:43.508159 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9389c64ef53d467f910c4c7d4170d74c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9389c64ef53d467f910c4c7d4170d74c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 9389c64ef53d467f910c4c7d4170d74c Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: cb89962518a943c1988fa59b1f54747e Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 07 09:47:43.509505 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'flavor_id': '1978136441', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance: Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 07 09:47:43.510192 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.512076 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcd09979-e1f0-4da5-9a81-2ad7e62a3d88 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:43.513730 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fcd09979-e1f0-4da5-9a81-2ad7e62a3d88 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.009477 Sep 07 09:47:43.515219 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 459/914] 10.222.0.60 () {60 vars in 1265 bytes} [Wed Sep 7 09:47:43 2022] PUT /compute/v2.1/flavors/1978136441/os-extra_specs/hw:numa_nodes => generated 117 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 09:47:43.520846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66ac0761-4441-4381-9d1d-14ee20bf9ff0 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.540468 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66ac0761-4441-4381-9d1d-14ee20bf9ff0 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1978136441" status: 202 len: 0 microversion: 2.1 time: 0.023052 Sep 07 09:47:43.541694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 460/915] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:47:43 2022] DELETE /compute/v2.1/flavors/1978136441 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:47:43.547609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.548431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:43.554462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.554949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.555379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.556374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.557031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.557755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.702215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.717412 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23bed8d1-86d3-4a6f-9e23-11b1a185c7e5 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1469 microversion: 2.1 time: 0.372721 Sep 07 09:47:43.718328 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 456/916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:43 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:43.723983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fde925cd-0ca8-4e6f-8aea-3fbac4f5d4ac tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:43.745974 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fde925cd-0ca8-4e6f-8aea-3fbac4f5d4ac tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372 tempest-FlavorsExtraSpecsNegativeTestJSON-2048478372-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025035 Sep 07 09:47:43.750465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 457/917] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:47:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:43.799683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-87591ae1-38fe-491d-b538-4e3cacecc024 req-82becb8f-e871-4d24-8cbe-ea925105488e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb66c3f-ef5b-4941-8949-163f2e52d0b8", "name": "network-vif-deleted", "tag": "e203c470-0b0a-4f9d-b971-4ba8163d41ea"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:43.811139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87591ae1-38fe-491d-b538-4e3cacecc024 req-82becb8f-e871-4d24-8cbe-ea925105488e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:43.812021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87591ae1-38fe-491d-b538-4e3cacecc024 req-82becb8f-e871-4d24-8cbe-ea925105488e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:43.812462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87591ae1-38fe-491d-b538-4e3cacecc024 req-82becb8f-e871-4d24-8cbe-ea925105488e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:43.836965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-87591ae1-38fe-491d-b538-4e3cacecc024 req-82becb8f-e871-4d24-8cbe-ea925105488e service nova] Creating event network-vif-deleted:e203c470-0b0a-4f9d-b971-4ba8163d41ea for instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 on n-h1-836830-16 Sep 07 09:47:43.845567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-87591ae1-38fe-491d-b538-4e3cacecc024 req-82becb8f-e871-4d24-8cbe-ea925105488e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049437 Sep 07 09:47:43.846175 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 458/918] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:47:43.921193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:43.934290 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-83da8ef5-1d9a-49f5-9a0d-380986feb345 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1527 microversion: 2.1 time: 0.391272 Sep 07 09:47:43.935993 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 461/919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:43 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:44.200279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:44.202413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:44.210363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.211210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.212037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.214025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.214810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.215510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.239629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5a509316-9a37-404a-818d-45b2f06cf7cf req-e6e0919a-dc80-421a-ad3c-0de50bb7589d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5ec95b-f8f5-4072-9f78-fd20eacfbd70", "name": "network-vif-deleted", "tag": "dad07d2b-4833-4aef-a819-f3607253fd9f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:44.266139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a509316-9a37-404a-818d-45b2f06cf7cf req-e6e0919a-dc80-421a-ad3c-0de50bb7589d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.267214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a509316-9a37-404a-818d-45b2f06cf7cf req-e6e0919a-dc80-421a-ad3c-0de50bb7589d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.267950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a509316-9a37-404a-818d-45b2f06cf7cf req-e6e0919a-dc80-421a-ad3c-0de50bb7589d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.282744 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5a509316-9a37-404a-818d-45b2f06cf7cf req-e6e0919a-dc80-421a-ad3c-0de50bb7589d service nova] Creating event network-vif-deleted:dad07d2b-4833-4aef-a819-f3607253fd9f for instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 on n-h2-836830-16 Sep 07 09:47:44.288219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5a509316-9a37-404a-818d-45b2f06cf7cf req-e6e0919a-dc80-421a-ad3c-0de50bb7589d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053048 Sep 07 09:47:44.289415 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 462/920] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:44.325479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:44.326534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:44.335435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.336191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.336853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.337836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.339452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.340957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.565512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.582944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.590632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.602664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7268e5aa-91a2-4e55-8fd8-8ea6c80c6e31 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.405047 Sep 07 09:47:44.603890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.616153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5dfa321b-82c3-4bda-955e-368b962a1f48 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1322 microversion: 2.1 time: 0.295286 Sep 07 09:47:44.620275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 459/921] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:44 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:44.623273 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 463/922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:44 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:44.628563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:44.629451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:44.640760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.641381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.642017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.642937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.643617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.644118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.725837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.734602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.736941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.741432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:44.742043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:44.742705 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5c23083-dc11-409f-a4df-8fc6116aa6e6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1535 microversion: 2.91 time: 0.119452 Sep 07 09:47:44.743756 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 460/923] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:44 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1535 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:44.754459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.754948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.755540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.756419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.756872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.757316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.804319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.810192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.810916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.811677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lazy-loading 'fault' on Instance uuid 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:44.883259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:44.894452 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7870e353-7456-40f1-a32b-b00e667c7d6d tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 200 len: 1303 microversion: 2.1 time: 0.156769 Sep 07 09:47:44.903037 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 464/924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:44 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:44.967560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:44.968181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:44.987977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.990289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.990907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:44.995736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:44.997581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:44.999229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.053636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.054143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.054593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.055055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lazy-loading 'fault' on Instance uuid 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:45.139640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:45.149636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-404a5184-2f72-4ce5-829b-33f80b52bda4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 200 len: 1314 microversion: 2.1 time: 0.195343 Sep 07 09:47:45.150431 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 461/925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:44 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:45.642667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:45.644196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:45.654022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:45.655310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:45.662268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.664948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.665680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.668146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.669043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.670638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.672104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.674059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.676536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.677312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.678330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.678992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.953796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:45.965968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:45.967165 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0880539d-75c6-4e22-9219-8b868251e302 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1472 microversion: 2.1 time: 0.328375 Sep 07 09:47:45.968311 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 465/926] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:45 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:45.978477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:45.979789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:45.980962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:45.985258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:45.986952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a608dcdd-085e-4464-922c-32b91d854d19 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.342952 Sep 07 09:47:45.987527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 462/927] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:45 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:45.987673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.988396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.988841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.989589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:45.990207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:45.990933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:45.994492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:45.995172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.002841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.003559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.004207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.005121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.005718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.006762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.023990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] HTTP exception thrown: Instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 could not be found. Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Request method failure captured: Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 HTTP/1.1 Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgzF_AanEjn8uz4vPqYRL8u4MBXUaVyHnx2Dy9ifJ0JmU7QZeaMhqaIlLmqq5jukH-u8-JY1q-GSYPkNlPqDBxkgZ6ddI0HQQ_o1-txHFh4vnrdLI4po_YImjKJl9T2KB1HibGZBjlfJFyTUqoeq3spQkmTT7-FwSks1TKpJSEO75w Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 98fddf9336df4df884fbd1d79f4736cf Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminTestJSON-882290761 Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:46.025803 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98fddf9336df4df884fbd1d79f4736cf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminTestJSON-882290761 Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 98fddf9336df4df884fbd1d79f4736cf Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminTestJSON-882290761 Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminTestJSON-882290761-project Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a45a5949bf834f569db07ad668f99a82 Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminTestJSON-882290761-project Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 could not be found. Sep 07 09:47:46.027925 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '0e5ec95b-f8f5-4072-9f78-fd20eacfbd70'} Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 could not be found. Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:46.028921 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 could not be found. Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 could not be found. Sep 07 09:47:46.033656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.035269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Returning 404 to user: Instance 0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:46.035269 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-10d66eaa-934e-4542-b903-efccbd57c8e7 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70" status: 404 len: 111 microversion: 2.1 time: 0.038741 Sep 07 09:47:46.035269 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 463/928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:45 2022] GET /compute/v2.1/servers/0e5ec95b-f8f5-4072-9f78-fd20eacfbd70 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:46.035269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.035269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.040572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.041054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.041525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.042215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.043178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.043740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.071550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.081792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.083666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.088833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.089902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8bbc546e-b016-4b65-b341-0fce4daac58f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1538 microversion: 2.91 time: 0.120296 Sep 07 09:47:46.093306 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 466/929] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:45 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1538 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Request method failure captured: Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a/diagnostics HTTP/1.1 Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGirdvh65f-oDJKI2TtByXwywfoGEiHyHLD6CwVQH6_9pMd-Q2b3RdYsstoFItX6we1EZGRPK6DzlNWNSfsyvLdQFF5QmWgdQkIWefq9AKwn7G84oz64r7WRYF1Ml1FTwyfF-ET-isX9XnjYVwCkavpt7JrguIcSz4WsVrCUjSuuJFs Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d949c2e340584158b0b04e2de6dff847 Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2099173182 Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:47:46.095658 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d949c2e340584158b0b04e2de6dff847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d949c2e340584158b0b04e2de6dff847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d949c2e340584158b0b04e2de6dff847"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d949c2e340584158b0b04e2de6dff847", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2099173182 Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d949c2e340584158b0b04e2de6dff847 Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2099173182 Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerDiagnosticsNegativeTest-2099173182-project Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d96a2d7ba1614977844673bed3d8a722 Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2099173182-project Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:47:46.097012 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': 'dd9f55c3-1552-4637-a28b-dd202a84f23a'} Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:47:46.097754 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.098979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:46.100241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a0996af1-e806-4322-b0bf-5cee977b40ec tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.067733 Sep 07 09:47:46.100332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.100332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.100470 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 464/930] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:47:46 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a/diagnostics => generated 117 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:46.112930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.113477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.120279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.121379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.121997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.122705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.123168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.123599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.127881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.128250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.128686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.129412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.130290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.131020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.158141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:47:46.170694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:47:46.174143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:46.253119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:46.259662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2cb2a7ff-a4b5-46ef-ae9b-b46cb11d3fd4 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 204 len: 0 microversion: 2.1 time: 0.151616 Sep 07 09:47:46.263962 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 465/931] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:46 2022] DELETE /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:46.269355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:46.270440 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-498e07db-8306-4921-b6c3-02429b2ebf48 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 204 len: 0 microversion: 2.1 time: 0.175545 Sep 07 09:47:46.274228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.275362 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 467/932] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:46 2022] DELETE /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:46.280028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.280523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.280971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.281795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.282259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.282693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.285881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.287044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.293952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.294659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.297934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.299394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.299394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.299740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.319606 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 HTTP/1.1 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:46.322127 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:47:46.324588 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8'} Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:46.325755 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:47:46.328294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:46.331808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:46.331808 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6985102-13a5-46ac-b290-78eb0acf97a5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 404 len: 111 microversion: 2.1 time: 0.051378 Sep 07 09:47:46.332014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-836830-16". {{(pid=128832) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 09:47:46.332128 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 468/933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:46 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:46.341369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.342243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.349710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.350285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.350836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.352313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.352313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.353919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.416077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ce8f95c5-2dde-43a0-bb50-b7050287dd31 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action" status: 202 len: 0 microversion: 2.91 time: 0.154140 Sep 07 09:47:46.416985 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 466/934] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:47:46 2022] POST /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:46.423746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.424371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.432783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.432921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.434085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.435107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.436128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.436248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.565108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.577488 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-568edcef-87db-4500-8015-d095af262b78 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1478 microversion: 2.1 time: 0.246467 Sep 07 09:47:46.578514 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 469/935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:46 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1478 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:46.601038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c73c27f5-2db3-467c-bba4-1b0466ec6889 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'create', calling method: .version_select at 0x7f14b1dec430>, body: {"keypair": {"name": "tempest-keypair-463654019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlB4TTLXEtXvLKAoyJlVIHxLqdqXW+3bHJHqzuYlXu2ll2Kj5vP5C1V+ovPg0QHfbFghJRqSBs9kr//thxgoC+1bwViQaHvYQucerNnVn1krbHKkJ5h+lOjsQIYmrM9ug=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:46.619726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c73c27f5-2db3-467c-bba4-1b0466ec6889 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:46.624717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.627022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c73c27f5-2db3-467c-bba4-1b0466ec6889 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for user 03b1af68e8a948758e09d0ccbca23d4d and project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:46.634981 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a68ab75-c6f5-4054-aaa3-dc6a8c8a9998 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1470 microversion: 2.1 time: 0.217092 Sep 07 09:47:46.635771 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 467/936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:46 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:46.641796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f456e92c-4ff9-4278-9391-9ca4253df6d6", "name": "network-vif-unplugged", "status": "completed", "tag": "e440e054-f02d-4b47-8e0e-ee98e0f5d85e"}, {"name": "network-changed", "server_uuid": "f456e92c-4ff9-4278-9391-9ca4253df6d6", "tag": "e440e054-f02d-4b47-8e0e-ee98e0f5d85e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:46.652504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.653449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.654241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.669260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c73c27f5-2db3-467c-bba4-1b0466ec6889 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076614 Sep 07 09:47:46.670012 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] Creating event network-vif-unplugged:e440e054-f02d-4b47-8e0e-ee98e0f5d85e for instance f456e92c-4ff9-4278-9391-9ca4253df6d6 on n-h2-836830-16 Sep 07 09:47:46.670812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] Creating event network-changed:e440e054-f02d-4b47-8e0e-ee98e0f5d85e for instance f456e92c-4ff9-4278-9391-9ca4253df6d6 on n-h2-836830-16 Sep 07 09:47:46.676385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a92ef124-f55c-427d-acf0-f8cf7e33df0f req-77d4e5ff-5fad-4d05-a1ab-63f5b7124b19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037919 Sep 07 09:47:46.677483 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 468/937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:46.677777 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 470/938] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:47:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:46.682858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:46.684151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:46.692591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.693102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.693561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.694268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:46.694721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:46.695568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:46.779063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.795000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.797611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:46.806148 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06905aa9-6eff-4048-b772-f283894cb31f tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1486 microversion: 2.91 time: 0.127079 Sep 07 09:47:46.806918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 471/939] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:46 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1486 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:47.016636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.020573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:47.032270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.032893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.033651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.034807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.035597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.036347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.191587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.201695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.203491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.204679 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-722ba20d-7db4-4999-97d3-16cc92cd6a85 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.194637 Sep 07 09:47:47.205290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 469/940] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:47.338948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf3a166d-fef0-401b-a187-dd0f11f5bcdb tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1743348017", "id": 336350537, "os-flavor-access:is_public": "True"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:47.359212 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf3a166d-fef0-401b-a187-dd0f11f5bcdb tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.144592 Sep 07 09:47:47.359923 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 472/941] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:47:47 2022] POST /compute/v2.1/flavors => generated 465 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:47:47.498349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e0838a3e-aef3-4ba6-9df4-5d9ab6ccffab tempest-FlavorsV261TestJSON-904546158 tempest-FlavorsV261TestJSON-904546158-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.508118 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e0838a3e-aef3-4ba6-9df4-5d9ab6ccffab tempest-FlavorsV261TestJSON-904546158 tempest-FlavorsV261TestJSON-904546158-project] 10.222.0.60 "GET /compute/v2.1/flavors/336350537" status: 200 len: 465 microversion: 2.61 time: 0.138679 Sep 07 09:47:47.508813 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 470/942] 10.222.0.60 () {60 vars in 1196 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/flavors/336350537 => generated 465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:47:47.523103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75d40bfa-a07c-4324-bd33-ed597099e8bc tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] Action: 'update', calling method: .version_select at 0x7f14b3a8b940>, body: {"flavor": {"description": "new"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:47.538054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:47.576653 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75d40bfa-a07c-4324-bd33-ed597099e8bc tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/336350537" status: 200 len: 466 microversion: 2.61 time: 0.057289 Sep 07 09:47:47.577329 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 473/943] 10.222.0.60 () {62 vars in 1216 bytes} [Wed Sep 7 09:47:47 2022] PUT /compute/v2.1/flavors/336350537 => generated 466 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:47:47.590733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b160dad8-8a1b-41f9-a1aa-1f50c9b063ae tempest-FlavorsV261TestJSON-904546158 tempest-FlavorsV261TestJSON-904546158-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.604303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.605065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:47.612620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.613193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.613828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.614865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.615471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.616047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.616169 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b160dad8-8a1b-41f9-a1aa-1f50c9b063ae tempest-FlavorsV261TestJSON-904546158 tempest-FlavorsV261TestJSON-904546158-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.029704 Sep 07 09:47:47.617425 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 471/944] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:47.641530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d58c02a2-b9fc-403c-8895-d063e856fb16 tempest-FlavorsV261TestJSON-904546158 tempest-FlavorsV261TestJSON-904546158-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.664116 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d58c02a2-b9fc-403c-8895-d063e856fb16 tempest-FlavorsV261TestJSON-904546158 tempest-FlavorsV261TestJSON-904546158-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.027996 Sep 07 09:47:47.665572 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 472/945] 10.222.0.60 () {60 vars in 1166 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:47.675596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.676448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:47.682902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.683979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.684537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.685080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.685571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.686001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.816189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.828254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f76318cd-7d56-48e1-b758-cf11dda8aab9 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1478 microversion: 2.1 time: 0.227837 Sep 07 09:47:47.831259 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 474/946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1478 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:47.835753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-22062d05-8d00-4ee6-8656-0e3af34232e9 tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.866304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-22062d05-8d00-4ee6-8656-0e3af34232e9 tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/336350537" status: 202 len: 0 microversion: 2.61 time: 0.033530 Sep 07 09:47:47.867777 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 475/947] 10.222.0.60 () {60 vars in 1199 bytes} [Wed Sep 7 09:47:47 2022] DELETE /compute/v2.1/flavors/336350537 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:47.874597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.875887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.876628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:47.883715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.884214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.884748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.885496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:47.885824 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-10264205-68c0-41d2-bea4-d318e27554b0 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1470 microversion: 2.1 time: 0.215136 Sep 07 09:47:47.885953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:47.886481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:47.886865 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 473/948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:47.891523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f274e7b-c0b5-4481-a122-f2cf529e1a54 tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:47.914486 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f274e7b-c0b5-4481-a122-f2cf529e1a54 tempest-FlavorsV261TestJSON-25505773 tempest-FlavorsV261TestJSON-25505773-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.026346 Sep 07 09:47:47.915160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 474/949] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:47.962916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.972500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.974123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:47.979660 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-298f65b3-a048-4237-b3b3-b8badac911c2 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1486 microversion: 2.91 time: 0.110590 Sep 07 09:47:47.981040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 476/950] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:47 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1486 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:48.160357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1658520967", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:48.216720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] validate_networks() for [('93ef6f9e-fbc6-4bbc-a58d-2c9d0d3cd529', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:47:48.230775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:48.231426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:48.237718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.238206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.238648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.239350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.239806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.240234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.502089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:48.510508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:48.512653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:48.513829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7e98013-60df-4c9a-bbf8-fbfac2776a37 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.287191 Sep 07 09:47:48.514591 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 477/951] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:48 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:48.799186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:47:48.800246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:47:48.800726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:47:48.801135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:47:48.801568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:47:48.810436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.810919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.811356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.812085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.812535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.813147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.820346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:48.834803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:48.841010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for user 03b1af68e8a948758e09d0ccbca23d4d and project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:48.853107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:48.854413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:48.858519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:47:48.861635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:47:48.863539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.864027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.864669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.865402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.866237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.866633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.926739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dfc90fc1-d271-4c50-8bb9-56a885109d29 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.770484 Sep 07 09:47:48.933602 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 475/952] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:47:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:47:48.933602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:48.933602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:48.940380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.940875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.941527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:48.942770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:48.943388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:48.944050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:49.151852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:49.154080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:49.166952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4c20576-5f14-42a0-89b9-8f6f28222ca6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1470 microversion: 2.1 time: 0.236898 Sep 07 09:47:49.182546 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 476/953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:48 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:49.203442 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6639f99d-1460-44c3-bf60-4b05faf189cd tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1478 microversion: 2.1 time: 0.354674 Sep 07 09:47:49.204044 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 478/954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:48 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:49.211005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57148558-0218-4163-a27f-7558d54286d9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:49.213292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57148558-0218-4163-a27f-7558d54286d9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:49.217609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:49.219369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:49.235980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:49.237228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:49.238316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:49.242349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:49.243964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:49.244757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:49.432682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57148558-0218-4163-a27f-7558d54286d9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:49.440233 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57148558-0218-4163-a27f-7558d54286d9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1225 microversion: 2.1 time: 0.254324 Sep 07 09:47:49.453206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 477/955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:49 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1225 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:49.543955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:49.544655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:49.552996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:49.561041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:49.564116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:49.564927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:49.565439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:49.566486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:49.798062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:49.806535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:49.808314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:49.815120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7234820c-d3f6-4b63-878f-268049f56b0a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1488 microversion: 2.91 time: 0.605051 Sep 07 09:47:49.816017 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 479/956] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:49 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1488 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:50.064532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:50.091503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:50.093719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:50.095362 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2537a76-e247-46f0-bf13-1ddc0dabba12 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.557246 Sep 07 09:47:50.096588 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 478/957] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:49 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:50.208253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:50.209671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:50.220532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.221204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.221851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.222810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.223429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.224021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.234585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:50.236677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:50.250350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.251897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.252691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.257421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.258301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.259433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.428804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:50.448562 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4d16d17-3736-4e99-b776-c718e094aa16 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1436 microversion: 2.1 time: 0.221811 Sep 07 09:47:50.457309 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 479/958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:50 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1436 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:50.479570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:50.481938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:50.500717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.501272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.501715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.502425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.502882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.503315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.634177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:50.649721 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97637110-6c3a-4273-a3ab-3853400beab6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1470 microversion: 2.1 time: 0.445830 Sep 07 09:47:50.652405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 480/959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:50 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:50.712659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bb705034-0c9d-4b54-928f-0a956cc9e5c3 req-36da0f80-e721-4856-b12a-f016990edb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9f55c3-1552-4637-a28b-dd202a84f23a", "name": "network-vif-deleted", "tag": "7fd8c201-017f-421c-ad32-3d89a9ff8a4d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:50.753313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bb705034-0c9d-4b54-928f-0a956cc9e5c3 req-36da0f80-e721-4856-b12a-f016990edb7f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.754296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bb705034-0c9d-4b54-928f-0a956cc9e5c3 req-36da0f80-e721-4856-b12a-f016990edb7f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.756960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bb705034-0c9d-4b54-928f-0a956cc9e5c3 req-36da0f80-e721-4856-b12a-f016990edb7f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.782812 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bb705034-0c9d-4b54-928f-0a956cc9e5c3 req-36da0f80-e721-4856-b12a-f016990edb7f service nova] Creating event network-vif-deleted:7fd8c201-017f-421c-ad32-3d89a9ff8a4d for instance dd9f55c3-1552-4637-a28b-dd202a84f23a on n-h2-836830-16 Sep 07 09:47:50.793158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:50.799241 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bb705034-0c9d-4b54-928f-0a956cc9e5c3 req-36da0f80-e721-4856-b12a-f016990edb7f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091867 Sep 07 09:47:50.801627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 481/960] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:50.805692 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-285233b8-d760-4925-a4fe-8955203f03ec tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1277 microversion: 2.1 time: 0.331203 Sep 07 09:47:50.824796 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 480/961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:50 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:50.849449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:50.850540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:50.866586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.870036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.870883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:50.872078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:50.874900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:50.875568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.121198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:51.121872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:51.139383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.140706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.144272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.148304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.153351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.154224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.379191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.396845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.398443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.411681 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-798e64e3-bd00-4fe5-9c6b-14c71c84e52d tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.567540 Sep 07 09:47:51.425571 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 482/962] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:50 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:51.489976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:51.490678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:51.510265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.515597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.518049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.519079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.520841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.521527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.664700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.665739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.668931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.680606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lazy-loading 'fault' on Instance uuid dd9f55c3-1552-4637-a28b-dd202a84f23a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:51.703210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.718992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.723412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.728086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad616b25-1507-4666-968d-42f2439adaa8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.611479 Sep 07 09:47:51.728676 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 481/963] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:51 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:51.749614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-64d90dbc-0ff8-4826-9344-0b26da7ea039 req-00496f95-bc45-4bf8-a669-973358fb3baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e050121-8471-48dd-9127-29dffb0c37c2", "name": "network-vif-deleted", "tag": "36ccbe9d-1ce8-4a89-a3b2-bd620fa8c21c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:51.770485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-64d90dbc-0ff8-4826-9344-0b26da7ea039 req-00496f95-bc45-4bf8-a669-973358fb3baa service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.771221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-64d90dbc-0ff8-4826-9344-0b26da7ea039 req-00496f95-bc45-4bf8-a669-973358fb3baa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.771828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-64d90dbc-0ff8-4826-9344-0b26da7ea039 req-00496f95-bc45-4bf8-a669-973358fb3baa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.821224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-64d90dbc-0ff8-4826-9344-0b26da7ea039 req-00496f95-bc45-4bf8-a669-973358fb3baa service nova] Creating event network-vif-deleted:36ccbe9d-1ce8-4a89-a3b2-bd620fa8c21c for instance 7e050121-8471-48dd-9127-29dffb0c37c2 on n-h2-836830-16 Sep 07 09:47:51.827363 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-64d90dbc-0ff8-4826-9344-0b26da7ea039 req-00496f95-bc45-4bf8-a669-973358fb3baa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089730 Sep 07 09:47:51.828605 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 482/964] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:51.833966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:51.834268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:51.835166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:51.845564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.846286 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99c52c06-9039-468c-8cd5-9e05c5d40b46 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1312 microversion: 2.1 time: 0.369087 Sep 07 09:47:51.846702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.846847 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 483/965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:51 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:51.847743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.848745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.855344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.856070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.873570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:51.876872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:51.896196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.896431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.896690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.897124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.897519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.898215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:51.898841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lazy-loading 'fault' on Instance uuid 7e050121-8471-48dd-9127-29dffb0c37c2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:51.906461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:51.906946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:51.907511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:52.086640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:52.092042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:52.101898 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85395e15-4f1c-40b8-b5c1-c0b05a910c93 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1283 microversion: 2.1 time: 0.253937 Sep 07 09:47:52.102175 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5bc24727-0625-4634-b8aa-a0f3cc823f19 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1304 microversion: 2.1 time: 0.272188 Sep 07 09:47:52.108137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 484/966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:51 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:52.121446 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 483/967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:51 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1304 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:52.451126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:52.452550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:52.462016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:52.462988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:52.466943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:52.473973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:52.474910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:52.475353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:52.601946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:52.611998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:52.613527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:52.633421 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7a3d6af-0a6b-44dc-a1b7-4a1938f044ee tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.192582 Sep 07 09:47:52.664701 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 485/968] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:52 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:52.768077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:52.769748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:52.793620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:52.799361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:52.799951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:52.800712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:52.801217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:52.806205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:52.875508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:52.877943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:52.900876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:52.904177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:52.905140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:52.907897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:52.909557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:52.912454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.009359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.011912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.013375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.014043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lazy-loading 'fault' on Instance uuid dd9f55c3-1552-4637-a28b-dd202a84f23a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:53.150448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96a2d7ba1614977844673bed3d8a722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd949c2e340584158b0b04e2de6dff847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:53.162926 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-181f8349-baa7-40d2-9542-cbbcb4bc10a8 tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 200 len: 1312 microversion: 2.1 time: 0.294409 Sep 07 09:47:53.188002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 486/969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:52 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:53.195584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:53.196584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:53.205808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.206680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.207333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.208526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.209209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.210035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.237953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:53.493773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:53.506681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:53.516673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:53.520863 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e9f8de7-9f2e-48b8-8baf-0e5fb37cc265 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 0.760658 Sep 07 09:47:53.552603 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 484/970] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:52 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:53.558883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:53.559933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:53.568097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.569524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.570258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.571786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.572749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.573286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.638567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.642398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.645936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.646409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lazy-loading 'fault' on Instance uuid 7e050121-8471-48dd-9127-29dffb0c37c2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:53.766796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:53.794750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1304 microversion: 2.1 time: 0.240645 Sep 07 09:47:53.815449 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 485/971] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:53 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1304 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:53.817760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:53.826251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:53.827356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81c8e7cf-556c-4f58-b142-b9ce95708acd tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006032 Sep 07 09:47:53.829888 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f236d6e8-aeae-4102-86a8-6f6f130676b4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.640296 Sep 07 09:47:53.831858 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 486/972] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 7 09:47:53 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 09:47:53.842612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:53.847756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:53.852399 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 487/973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:53 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:53.880859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.882296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.888328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:53.889475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:53.892451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:53.896431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.086764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:54.098398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:54.099794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:54.109803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-11ddfade-a107-4fd2-b6ef-8641606f8a70 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.276694 Sep 07 09:47:54.140011 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 487/974] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:53 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:54.200416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:54.201342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] [instance: dd9f55c3-1552-4637-a28b-dd202a84f23a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:54.210067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.212667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.213353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.215154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.217763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.218357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.254544 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] HTTP exception thrown: Instance dd9f55c3-1552-4637-a28b-dd202a84f23a could not be found. Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Request method failure captured: Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a HTTP/1.1 Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGirdvh65f-oDJKI2TtByXwywfoGEiHyHLD6CwVQH6_9pMd-Q2b3RdYsstoFItX6we1EZGRPK6DzlNWNSfsyvLdQFF5QmWgdQkIWefq9AKwn7G84oz64r7WRYF1Ml1FTwyfF-ET-isX9XnjYVwCkavpt7JrguIcSz4WsVrCUjSuuJFs Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d949c2e340584158b0b04e2de6dff847 Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2099173182 Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:54.259612 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d949c2e340584158b0b04e2de6dff847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d949c2e340584158b0b04e2de6dff847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d949c2e340584158b0b04e2de6dff847"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d949c2e340584158b0b04e2de6dff847", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2099173182 Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d949c2e340584158b0b04e2de6dff847 Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2099173182 Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerDiagnosticsNegativeTest-2099173182-project Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d96a2d7ba1614977844673bed3d8a722 Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2099173182-project Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance dd9f55c3-1552-4637-a28b-dd202a84f23a could not be found. Sep 07 09:47:54.261513 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'dd9f55c3-1552-4637-a28b-dd202a84f23a'} Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9f55c3-1552-4637-a28b-dd202a84f23a could not be found. Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:54.262772 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9f55c3-1552-4637-a28b-dd202a84f23a could not be found. Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9f55c3-1552-4637-a28b-dd202a84f23a could not be found. Sep 07 09:47:54.264188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:54.268017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] Returning 404 to user: Instance dd9f55c3-1552-4637-a28b-dd202a84f23a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:54.268925 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-702d3592-ad1f-4e00-b902-960b6007001e tempest-ServerDiagnosticsNegativeTest-2099173182 tempest-ServerDiagnosticsNegativeTest-2099173182-project] 10.222.0.60 "GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a" status: 404 len: 111 microversion: 2.1 time: 0.073508 Sep 07 09:47:54.269725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 488/975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:54 2022] GET /compute/v2.1/servers/dd9f55c3-1552-4637-a28b-dd202a84f23a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:54.556713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:54.557470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:54.569753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.570613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.571076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.573259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.575470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.578000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.831509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:54.832795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:54.857031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.862443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.866090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.868798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.870877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.871637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.961903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:54.962911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:54.963570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:54.964211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lazy-loading 'fault' on Instance uuid 7e050121-8471-48dd-9127-29dffb0c37c2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:55.335621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:55.350425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df7fca6f-bac0-41e8-a7ee-8667df61be1e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 200 len: 1304 microversion: 2.1 time: 0.525454 Sep 07 09:47:55.351989 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 489/976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:54 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 1304 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:47:55.381489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:55.386470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:55.409660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:55.410363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:55.410905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:55.411732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:55.412300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:55.412845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:55.731185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:55.752756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:55.754394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:55.756321 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0555d885-bab2-4302-b746-83eabb4f8ee0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1568 microversion: 2.25 time: 1.204658 Sep 07 09:47:55.758013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 488/977] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:54 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1568 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:55.766014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-69a1c8ca-c80a-4af9-a28a-330377711970 req-4b5ce61e-c5e1-42d2-befe-2380b981d608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200aeb49-752f-4a80-9d7e-f927574201f6", "tag": "7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:55.783805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-69a1c8ca-c80a-4af9-a28a-330377711970 req-4b5ce61e-c5e1-42d2-befe-2380b981d608 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:55.784717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-69a1c8ca-c80a-4af9-a28a-330377711970 req-4b5ce61e-c5e1-42d2-befe-2380b981d608 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:55.785457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-69a1c8ca-c80a-4af9-a28a-330377711970 req-4b5ce61e-c5e1-42d2-befe-2380b981d608 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:55.809589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-69a1c8ca-c80a-4af9-a28a-330377711970 req-4b5ce61e-c5e1-42d2-befe-2380b981d608 service nova] Creating event network-changed:7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17 for instance 200aeb49-752f-4a80-9d7e-f927574201f6 on n-h1-836830-16 Sep 07 09:47:55.820818 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-69a1c8ca-c80a-4af9-a28a-330377711970 req-4b5ce61e-c5e1-42d2-befe-2380b981d608 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057565 Sep 07 09:47:55.824790 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 489/978] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:47:55.844975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:55.849594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:55.871194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:55.875936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:55.876966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:55.878313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:55.879275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:55.880004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.022607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:56.035082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:56.048026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a06cfdb-c493-41e8-ac7d-0783dcd31aa9 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.675479 Sep 07 09:47:56.048924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 490/979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:55 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:56.050178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:56.051676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:56.057633 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e38f6eb9-c872-47b2-a76f-7be5d5b270b5 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.227798 Sep 07 09:47:56.072291 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 490/980] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:55 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:56.383923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:56.390028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: 7e050121-8471-48dd-9127-29dffb0c37c2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:56.401754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.403963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.405424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.411910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.412645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.413283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.449006 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] HTTP exception thrown: Instance 7e050121-8471-48dd-9127-29dffb0c37c2 could not be found. Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Request method failure captured: Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 HTTP/1.1 Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgzF_AanEjn8uz4vPqYRL8u4MBXUaVyHnx2Dy9ifJ0JmU7QZeaMhqaIlLmqq5jukH-u8-JY1q-GSYPkNlPqDBxkgZ6ddI0HQQ_o1-txHFh4vnrdLI4po_YImjKJl9T2KB1HibGZBjlfJFyTUqoeq3spQkmTT7-FwSks1TKpJSEO75w Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 98fddf9336df4df884fbd1d79f4736cf Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAdminTestJSON-882290761 Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:47:56.454529 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98fddf9336df4df884fbd1d79f4736cf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAdminTestJSON-882290761 Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 98fddf9336df4df884fbd1d79f4736cf Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAdminTestJSON-882290761 Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAdminTestJSON-882290761-project Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a45a5949bf834f569db07ad668f99a82 Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAdminTestJSON-882290761-project Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 7e050121-8471-48dd-9127-29dffb0c37c2 could not be found. Sep 07 09:47:56.456426 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '7e050121-8471-48dd-9127-29dffb0c37c2'} Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e050121-8471-48dd-9127-29dffb0c37c2 could not be found. Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:47:56.458080 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e050121-8471-48dd-9127-29dffb0c37c2 could not be found. Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e050121-8471-48dd-9127-29dffb0c37c2 could not be found. Sep 07 09:47:56.461506 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:47:56.466169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Returning 404 to user: Instance 7e050121-8471-48dd-9127-29dffb0c37c2 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:47:56.468967 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b09d909-8b01-4773-bb0b-e96a235a30a6 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2" status: 404 len: 111 microversion: 2.1 time: 0.088123 Sep 07 09:47:56.471902 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 491/981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:56 2022] GET /compute/v2.1/servers/7e050121-8471-48dd-9127-29dffb0c37c2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:47:56.482409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:56.483219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:56.490871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.501039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.501676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.502485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.503025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.503634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.536808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:47:56.646346 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f70c2bf-bf2f-446e-8f07-7c072300b665 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 204 len: 0 microversion: 2.1 time: 0.171057 Sep 07 09:47:56.653998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 491/982] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:47:56 2022] DELETE /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:47:56.661550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:56.662814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:56.666913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:56.672221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.673448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.674221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.675200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.676063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.676943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.797649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:56.800184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:56.818673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.820950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.821713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:56.825345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:56.827349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:56.828851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.142921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.159076 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e47d39d-ec89-453f-92d5-24802a12038c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1470 microversion: 2.1 time: 0.501936 Sep 07 09:47:57.160375 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 492/983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:56 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1470 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:57.176592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.179185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:57.179823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:57.193494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.194333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.195461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.196631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.197430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.198165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.200093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.201733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.203181 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-59779fec-1f47-4192-880a-659e577ce9e4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1543 microversion: 2.25 time: 0.414416 Sep 07 09:47:57.217214 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 492/984] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:56 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1543 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:57.226014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:57.226014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:57.228852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.231477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.238780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.239712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.240343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.241068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.280901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:57.448947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.453072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.458079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.462282 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ad66c112-bd7d-4816-b55b-dca0ebac5f1b tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.300014 Sep 07 09:47:57.463399 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 493/985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:57 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:57.468943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fb4ffb68-97a0-4aad-ba1e-68e2dcb97044 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '.version_select at 0x7f14b1dd1f70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:57.470779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:57.486507 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e83eb925-8f99-4300-97d2-8f862141e938 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.279967 Sep 07 09:47:57.487360 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 493/986] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:57 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:57.488922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb4ffb68-97a0-4aad-ba1e-68e2dcb97044 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.489919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb4ffb68-97a0-4aad-ba1e-68e2dcb97044 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.491282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb4ffb68-97a0-4aad-ba1e-68e2dcb97044 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.517211 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fb4ffb68-97a0-4aad-ba1e-68e2dcb97044 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.051536 Sep 07 09:47:57.518391 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 494/987] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 7 09:47:57 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:57.534996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:57.535641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:57.542807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.543993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.548108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.548923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:57.549408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:57.549850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:57.742770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:47:57.761551 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41f173db-c279-4a7c-89fd-908d9a985e8b tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 2038 microversion: 2.25 time: 0.229985 Sep 07 09:47:57.780782 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 494/988] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:57 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 2038 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:57.802515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27f6a9b5-59e3-4098-83c3-9c34dfa57507 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Action: 'create', calling method: .version_select at 0x7f14b1deeb80>, body: {"keypair": {"name": "tempest-keypair-202538004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB++Fd4gLwM0rHZ3IUMPqUbW6TtebpAnoYcMzPPjFzjaCCz2NwufB6qv6zTTJ2N4u2UrSpJK+AQhgHdPSDK72AuPTOoLOd/nu1LkSl0j+h1HMjm8AOxe4Zh04Pmu//fvIw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:47:57.842846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-27f6a9b5-59e3-4098-83c3-9c34dfa57507 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:47:57.851724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-27f6a9b5-59e3-4098-83c3-9c34dfa57507 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for user 21737ade68344e3298131ce9189f5d8a and project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:47:57.881759 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27f6a9b5-59e3-4098-83c3-9c34dfa57507 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.084425 Sep 07 09:47:57.885345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 495/989] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:47:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:47:58.186052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:58.187358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:58.198483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:58.199278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:58.200293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:58.201292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:58.201980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:58.202620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:58.451199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:58.466166 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19448f8c-1586-4cb6-8a2e-f6494e57fe7a tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1470 microversion: 2.1 time: 0.283839 Sep 07 09:47:58.466695 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 495/990] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:58 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:58.494514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:58.495992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:58.517076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:58.519446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:58.520398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:58.521030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:58.521728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:58.524018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:58.526178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:58.527879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:58.562487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:58.573115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:58.574098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:58.574873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:58.575368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:58.575791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:58.708950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:58.726611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:58.729793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:58.741734 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e74dc75-f5e8-4af0-9303-bce7b0ffb8f1 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.225184 Sep 07 09:47:58.746817 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 496/991] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:58 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:58.903858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:58.920055 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc3af8c5-e337-4b86-96f9-9d15f6b9254e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.431212 Sep 07 09:47:58.940466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 496/992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:58 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:59.492183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:59.494008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:59.500905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:59.504221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:59.507269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:47:59.522943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:59.526382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:59.528229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:59.528986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:59.533859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:59.534622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:59.736571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:59.749592 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e7dade9-0834-44c2-8644-283cb9e88307 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1470 microversion: 2.1 time: 0.261951 Sep 07 09:47:59.750796 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 497/993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:59 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:47:59.772140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:59.772990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:59.780802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:59.782450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:59.784896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:59.785843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:59.786481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:59.787100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:59.892350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:59.908175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:59.914117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:47:59.925386 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1a3beab-4d4d-4c27-b9c9-67bfea58215b tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.157580 Sep 07 09:47:59.943297 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 497/994] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:47:59 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:47:59.951994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:47:59.951994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:47:59.956215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:59.957210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:59.957884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:47:59.958789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:47:59.959470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:47:59.960125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:00.281541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:00.289712 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-16dacb8e-6a92-4020-b8d0-c3dae85cd0e6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.345428 Sep 07 09:48:00.290854 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 498/995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:47:59 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:00.500263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Calling method '.version_select at 0x7f14b1d73820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:00.503803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:00.504302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:00.504748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:00.505514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:00.505975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:00.506401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:00.571099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-225b3f60-a434-4556-8239-4fa76e3d5d06 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.378442 Sep 07 09:48:00.574052 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 498/996] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 7 09:48:00 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:00.775083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:00.775745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:00.789455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:00.792383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:00.793842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:00.796232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:00.796883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:00.797658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:00.836272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94339d09-1613-42ff-9a10-bd9252b8d49f tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Calling method '.version_select at 0x7f14b1d34040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:00.846381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94339d09-1613-42ff-9a10-bd9252b8d49f tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'df342c7d220647d6bdd6f43c23c360c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904c32b2b724ef082cbbb323d6f54bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94339d09-1613-42ff-9a10-bd9252b8d49f tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Request method failure captured: Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjOCCPkSAgM8MZTVyPiqJu7MKfCBNEpGAdapuuRB8b5qmdnjC4r6OwKBuYGdS5pZ6HJiWerFRk_853dm5m95SQBr6hrE5KWs9DfnRN3ZvDNqY9Dpm7gbJ2woKf__HRcniOhIsonkvt-hjpC6GOrgK6NzICN5DIn4Z3K-w5kv2YwYj0 Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:00.848863 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2904c32b2b724ef082cbbb323d6f54bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: df342c7d220647d6bdd6f43c23c360c6 Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 09:48:00.850376 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:00.851231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 07 09:48:00.852957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.863197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94339d09-1613-42ff-9a10-bd9252b8d49f tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:00.864272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94339d09-1613-42ff-9a10-bd9252b8d49f tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.283670 Sep 07 09:48:00.869722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 499/997] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 7 09:48:00 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 289 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:00.881674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-da927983-9a04-4b85-b6e4-70b3085fe142 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Calling method '.version_select at 0x7f14b1ccdaf0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:00.883760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-da927983-9a04-4b85-b6e4-70b3085fe142 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'df342c7d220647d6bdd6f43c23c360c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904c32b2b724ef082cbbb323d6f54bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-da927983-9a04-4b85-b6e4-70b3085fe142 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Request method failure captured: Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hosts/n-d-836830-16/reboot HTTP/1.1 Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjOCCPkSAgM8MZTVyPiqJu7MKfCBNEpGAdapuuRB8b5qmdnjC4r6OwKBuYGdS5pZ6HJiWerFRk_853dm5m95SQBr6hrE5KWs9DfnRN3ZvDNqY9Dpm7gbJ2woKf__HRcniOhIsonkvt-hjpC6GOrgK6NzICN5DIn4Z3K-w5kv2YwYj0 Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:00.891893 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2904c32b2b724ef082cbbb323d6f54bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: df342c7d220647d6bdd6f43c23c360c6 Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'n-d-836830-16'} Sep 07 09:48:00.893544 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:00.894540 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 07 09:48:00.895901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.898160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-da927983-9a04-4b85-b6e4-70b3085fe142 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:00.898160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-da927983-9a04-4b85-b6e4-70b3085fe142 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-16/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026622 Sep 07 09:48:00.908250 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 500/998] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 7 09:48:00 2022] GET /compute/v2.1/os-hosts/n-d-836830-16/reboot => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:00.921373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-959fe1aa-9b4d-4952-afa4-ecee4bb3bcc3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Calling method '.version_select at 0x7f14b1d411f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:00.935016 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-959fe1aa-9b4d-4952-afa4-ecee4bb3bcc3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-959fe1aa-9b4d-4952-afa4-ecee4bb3bcc3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:00.938910 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'nonexistent_hostname'} Sep 07 09:48:00.940220 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:48:00.941086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 07 09:48:00.945942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-959fe1aa-9b4d-4952-afa4-ecee4bb3bcc3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:00.947239 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-959fe1aa-9b4d-4952-afa4-ecee4bb3bcc3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.034353 Sep 07 09:48:00.950402 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 501/999] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 7 09:48:00 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:00.962384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:00.963200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:00.985853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:00.987263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:00.988048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:00.989021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:00.991237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:00.992056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:01.364528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:01.383963 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d1c8584-5da1-4433-95e9-8470e952d795 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1470 microversion: 2.1 time: 0.613578 Sep 07 09:48:01.384901 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 499/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:00 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1470 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:01.391236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90a5036e-9509-4573-861c-5915428c2c33 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Calling method '.version_select at 0x7f14b1d62310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:01.393096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-90a5036e-9509-4573-861c-5915428c2c33 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'df342c7d220647d6bdd6f43c23c360c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904c32b2b724ef082cbbb323d6f54bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90a5036e-9509-4573-861c-5915428c2c33 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Request method failure captured: Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hosts/n-d-836830-16 HTTP/1.1 Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjOCCPkSAgM8MZTVyPiqJu7MKfCBNEpGAdapuuRB8b5qmdnjC4r6OwKBuYGdS5pZ6HJiWerFRk_853dm5m95SQBr6hrE5KWs9DfnRN3ZvDNqY9Dpm7gbJ2woKf__HRcniOhIsonkvt-hjpC6GOrgK6NzICN5DIn4Z3K-w5kv2YwYj0 Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:01.400611 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2904c32b2b724ef082cbbb323d6f54bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: df342c7d220647d6bdd6f43c23c360c6 Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-d-836830-16'} Sep 07 09:48:01.402617 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:01.403642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 07 09:48:01.404833 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:01.407403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90a5036e-9509-4573-861c-5915428c2c33 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:01.410200 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90a5036e-9509-4573-861c-5915428c2c33 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-16" status: 403 len: 109 microversion: 2.1 time: 0.024247 Sep 07 09:48:01.410987 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 500/1001] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 7 09:48:01 2022] GET /compute/v2.1/os-hosts/n-d-836830-16 => generated 109 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:01.420670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:01.427131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:01.446097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:01.458976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:01.459650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:01.462821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:01.463360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:01.463997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:01.488042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cbe49076-3cbd-49f5-8ec7-fd81db913251 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1816 microversion: 2.1 time: 0.529958 Sep 07 09:48:01.488945 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 502/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:00 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1816 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:01.502419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-703120479", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "124ad2c9-0cc2-4b52-ab23-5623958d6487"}], "security_groups": [{"name": "tempest-securitygroup--1997412948"}], "key_name": "tempest-keypair-202538004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:01.682441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:01.715669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:01.722559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:01.737026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93d39719-0b52-4ac9-aff6-ad2927aee741 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.321311 Sep 07 09:48:01.742423 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 501/1003] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:01 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:01.765660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:01.772467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:01.792071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:01.792930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:01.793060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:01.794051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:01.796472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:01.798353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:01.895173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] validate_networks() for [('124ad2c9-0cc2-4b52-ab23-5623958d6487', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:02.418875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:02.436581 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e61ddd4-df83-4449-8721-5843af71245e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.692839 Sep 07 09:48:02.437527 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 502/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:01 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:02.442548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c89faa30-762a-4b86-9190-ab8fafd61cb3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Calling method '.version_select at 0x7f14b1deee50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:02.458060 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c89faa30-762a-4b86-9190-ab8fafd61cb3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c89faa30-762a-4b86-9190-ab8fafd61cb3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:02.461936 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'nonexistent_hostname'} Sep 07 09:48:02.463432 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:02.464874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:02.466502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.467984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c89faa30-762a-4b86-9190-ab8fafd61cb3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:02.475258 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c89faa30-762a-4b86-9190-ab8fafd61cb3 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036519 Sep 07 09:48:02.475897 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 503/1005] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 7 09:48:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:02.484083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:02.499414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:02.499901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:02.500341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:02.507617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:02.508257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:02.508733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:02.554780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:02.577604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d7fa52b-91c2-4e45-9f04-152a694b905e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.100563 Sep 07 09:48:02.578832 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 504/1006] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:48:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:02.596298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:02.597642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:02.605961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:02.606809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:02.607419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:02.609893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:02.611569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:02.612944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:02.943808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:02.959056 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0930af1-229a-41d2-ae19-c9ccc3f5d86e tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1470 microversion: 2.1 time: 0.378195 Sep 07 09:48:02.961002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 505/1007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:02 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1470 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:02.972041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81031b2b-8787-4488-9d8a-41e517317d58 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Calling method '.version_select at 0x7f14b1d7aaf0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:02.978692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81031b2b-8787-4488-9d8a-41e517317d58 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'df342c7d220647d6bdd6f43c23c360c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904c32b2b724ef082cbbb323d6f54bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81031b2b-8787-4488-9d8a-41e517317d58 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Request method failure captured: Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hosts/n-d-836830-16/shutdown HTTP/1.1 Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjOCCPkSAgM8MZTVyPiqJu7MKfCBNEpGAdapuuRB8b5qmdnjC4r6OwKBuYGdS5pZ6HJiWerFRk_853dm5m95SQBr6hrE5KWs9DfnRN3ZvDNqY9Dpm7gbJ2woKf__HRcniOhIsonkvt-hjpC6GOrgK6NzICN5DIn4Z3K-w5kv2YwYj0 Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:02.991438 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2904c32b2b724ef082cbbb323d6f54bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: df342c7d220647d6bdd6f43c23c360c6 Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-d-836830-16'} Sep 07 09:48:02.994305 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:02.995745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 07 09:48:02.997156 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:02.998449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81031b2b-8787-4488-9d8a-41e517317d58 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:02.998449 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-81031b2b-8787-4488-9d8a-41e517317d58 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-16/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.033388 Sep 07 09:48:02.998853 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 506/1008] 10.222.0.60 () {58 vars in 1197 bytes} [Wed Sep 7 09:48:02 2022] GET /compute/v2.1/os-hosts/n-d-836830-16/shutdown => generated 113 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:03.008007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:03.012354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:03.028319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.028830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.029311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.030035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.030499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.030933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.223666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:03.238812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:03.242631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:03.258540 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-09411128-cabb-4d57-aca5-9b381e049c7a tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.258415 Sep 07 09:48:03.274486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 507/1009] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:02 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:03.309598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-269888de-230a-4024-adfa-b5163e73b7f8 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Calling method '.version_select at 0x7f14b1d735e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:03.333605 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-269888de-230a-4024-adfa-b5163e73b7f8 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-269888de-230a-4024-adfa-b5163e73b7f8 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:03.345322 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'nonexistent_hostname'} Sep 07 09:48:03.347069 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:48:03.347999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 07 09:48:03.349274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.350746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.354275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-269888de-230a-4024-adfa-b5163e73b7f8 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:03.356852 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-269888de-230a-4024-adfa-b5163e73b7f8 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.081075 Sep 07 09:48:03.368569 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 508/1010] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 09:48:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:03.379477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-22cf8157-e757-47cf-80ae-4f1630e64cd4 req-5e4571c9-30c7-444d-9626-5a7b0dc69190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200aeb49-752f-4a80-9d7e-f927574201f6", "name": "network-vif-plugged", "status": "completed", "tag": "7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:03.404940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22cf8157-e757-47cf-80ae-4f1630e64cd4 req-5e4571c9-30c7-444d-9626-5a7b0dc69190 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.408163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22cf8157-e757-47cf-80ae-4f1630e64cd4 req-5e4571c9-30c7-444d-9626-5a7b0dc69190 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.409979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22cf8157-e757-47cf-80ae-4f1630e64cd4 req-5e4571c9-30c7-444d-9626-5a7b0dc69190 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.449015 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-22cf8157-e757-47cf-80ae-4f1630e64cd4 req-5e4571c9-30c7-444d-9626-5a7b0dc69190 service nova] Creating event network-vif-plugged:7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17 for instance 200aeb49-752f-4a80-9d7e-f927574201f6 on n-h1-836830-16 Sep 07 09:48:03.466628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-22cf8157-e757-47cf-80ae-4f1630e64cd4 req-5e4571c9-30c7-444d-9626-5a7b0dc69190 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094980 Sep 07 09:48:03.468723 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 509/1011] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:03.483392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07d78adc-11ed-4f8d-b03f-1359c21e0bd3 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Calling method '.version_select at 0x7f14b1d73ca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:03.487816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07d78adc-11ed-4f8d-b03f-1359c21e0bd3 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'df342c7d220647d6bdd6f43c23c360c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904c32b2b724ef082cbbb323d6f54bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07d78adc-11ed-4f8d-b03f-1359c21e0bd3 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Request method failure captured: Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hosts/n-d-836830-16/startup HTTP/1.1 Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjOCCPkSAgM8MZTVyPiqJu7MKfCBNEpGAdapuuRB8b5qmdnjC4r6OwKBuYGdS5pZ6HJiWerFRk_853dm5m95SQBr6hrE5KWs9DfnRN3ZvDNqY9Dpm7gbJ2woKf__HRcniOhIsonkvt-hjpC6GOrgK6NzICN5DIn4Z3K-w5kv2YwYj0 Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:03.489821 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2904c32b2b724ef082cbbb323d6f54bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: df342c7d220647d6bdd6f43c23c360c6 Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-d-836830-16'} Sep 07 09:48:03.491227 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:03.492176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 07 09:48:03.493565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.503811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07d78adc-11ed-4f8d-b03f-1359c21e0bd3 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:03.505523 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07d78adc-11ed-4f8d-b03f-1359c21e0bd3 tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-16/startup" status: 403 len: 110 microversion: 2.1 time: 0.035377 Sep 07 09:48:03.507586 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 510/1012] 10.222.0.60 () {58 vars in 1194 bytes} [Wed Sep 7 09:48:03 2022] GET /compute/v2.1/os-hosts/n-d-836830-16/startup => generated 110 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:03.528165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:03.528721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:03.529121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:03.529471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:03.530222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:03.535942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:03.536429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:03.553373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.554291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.554911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.557111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.559039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.559671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.562037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.563680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.564256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.566015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.569769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.570615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.582113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:03.588667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for user 21737ade68344e3298131ce9189f5d8a and project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:03.645606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:48:03.648190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:48:03.732587 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1fa6789c-fe56-46f4-9ac2-d1a24686a10e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.234089 Sep 07 09:48:03.733370 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 503/1013] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:48:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:48:03.740952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-64c5b109-36d9-4798-b0e4-cc9516c202c0 req-1cfd869a-0161-428c-a5a1-8a4703fe0173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a1035a-aea9-42e8-a35d-1eb6768c666d", "name": "network-vif-deleted", "tag": "494a8253-cb34-4c7c-a5e6-93a8372fb872"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:03.758235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-64c5b109-36d9-4798-b0e4-cc9516c202c0 req-1cfd869a-0161-428c-a5a1-8a4703fe0173 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:03.758744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-64c5b109-36d9-4798-b0e4-cc9516c202c0 req-1cfd869a-0161-428c-a5a1-8a4703fe0173 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:03.761975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-64c5b109-36d9-4798-b0e4-cc9516c202c0 req-1cfd869a-0161-428c-a5a1-8a4703fe0173 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:03.782049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-64c5b109-36d9-4798-b0e4-cc9516c202c0 req-1cfd869a-0161-428c-a5a1-8a4703fe0173 service nova] Creating event network-vif-deleted:494a8253-cb34-4c7c-a5e6-93a8372fb872 for instance f7a1035a-aea9-42e8-a35d-1eb6768c666d on n-h2-836830-16 Sep 07 09:48:03.788758 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-64c5b109-36d9-4798-b0e4-cc9516c202c0 req-1cfd869a-0161-428c-a5a1-8a4703fe0173 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053876 Sep 07 09:48:03.800632 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 504/1014] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:03.818455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0444fdd6-4c11-4ba1-ada5-7c290b125395 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Calling method '.version_select at 0x7f14b1cd9160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:03.849574 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-0444fdd6-4c11-4ba1-ada5-7c290b125395 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0444fdd6-4c11-4ba1-ada5-7c290b125395 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:03.851772 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'nonexistent_hostname'} Sep 07 09:48:03.853710 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:48:03.859622 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 07 09:48:03.861151 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0444fdd6-4c11-4ba1-ada5-7c290b125395 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0444fdd6-4c11-4ba1-ada5-7c290b125395 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.051018 Sep 07 09:48:03.862635 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 505/1015] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 7 09:48:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:03.866043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65f94e1a-506f-4678-9b7e-68b470edd946 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:03.867048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65f94e1a-506f-4678-9b7e-68b470edd946 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:04.110357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.119618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01d9525a-828a-4652-970e-57ab9f5e5b8d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 0.597185 Sep 07 09:48:04.124728 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 511/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:03 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:04.131159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65f94e1a-506f-4678-9b7e-68b470edd946 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.141846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91396895-c58c-441e-8620-c731a21aa069 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1d629d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:04.157818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65f94e1a-506f-4678-9b7e-68b470edd946 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.159868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65f94e1a-506f-4678-9b7e-68b470edd946 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91396895-c58c-441e-8620-c731a21aa069 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/os-hosts/n-d-836830-16 HTTP/1.1 Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 51 Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:04.164915 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: {"status": "enable", "maintenance_mode": "invalid"} Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:04.166525 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-d-836830-16', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'disable', Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'Enable', Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'Disable', Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance: Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.167474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.169432 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.171014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.171014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:48:04.171014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:48:04.171014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.171014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.173142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91396895-c58c-441e-8620-c731a21aa069 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:04.180168 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65f94e1a-506f-4678-9b7e-68b470edd946 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1284 microversion: 2.25 time: 0.324570 Sep 07 09:48:04.182505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91396895-c58c-441e-8620-c731a21aa069 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-16" status: 400 len: 199 microversion: 2.1 time: 0.053069 Sep 07 09:48:04.187778 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 506/1017] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:03 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:04.197873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:04.199593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:04.210161 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 512/1018] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:48:04 2022] PUT /compute/v2.1/os-hosts/n-d-836830-16 => generated 199 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:04.226142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de66dc75-e058-4929-9790-bde273ae9449 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1d734c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:04.226666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:04.227540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:04.228008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:04.228758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:04.229255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:04.229745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de66dc75-e058-4929-9790-bde273ae9449 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/os-hosts/n-d-836830-16 HTTP/1.1 Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 51 Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:04.244220 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: {"status": "invalid", "maintenance_mode": "enable"} Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:04.246957 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-d-836830-16', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'disable', Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'Enable', Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'Disable', Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance: Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.247962 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.249761 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de66dc75-e058-4929-9790-bde273ae9449 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:04.256176 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de66dc75-e058-4929-9790-bde273ae9449 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-16" status: 400 len: 189 microversion: 2.1 time: 0.036807 Sep 07 09:48:04.261574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 513/1019] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:48:04 2022] PUT /compute/v2.1/os-hosts/n-d-836830-16 => generated 189 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:04.284331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6635a122-da5b-468d-8e89-cf7254654f6a tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Action: 'update', calling method: .version_select at 0x7f14b1d7a3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:04.288893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6635a122-da5b-468d-8e89-cf7254654f6a tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'df342c7d220647d6bdd6f43c23c360c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904c32b2b724ef082cbbb323d6f54bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6635a122-da5b-468d-8e89-cf7254654f6a tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Request method failure captured: Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/os-hosts/n-d-836830-16 HTTP/1.1 Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 50 Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjOCCPkSAgM8MZTVyPiqJu7MKfCBNEpGAdapuuRB8b5qmdnjC4r6OwKBuYGdS5pZ6HJiWerFRk_853dm5m95SQBr6hrE5KWs9DfnRN3ZvDNqY9Dpm7gbJ2woKf__HRcniOhIsonkvt-hjpC6GOrgK6NzICN5DIn4Z3K-w5kv2YwYj0 Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:04.290867 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2904c32b2b724ef082cbbb323d6f54bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2904c32b2b724ef082cbbb323d6f54bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 2904c32b2b724ef082cbbb323d6f54bc Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1514956135 Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: df342c7d220647d6bdd6f43c23c360c6 Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1514956135-project Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: {"status": "enable", "maintenance_mode": "enable"} Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 07 09:48:04.292939 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-d-836830-16', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:04.294196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 07 09:48:04.297449 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.298659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:04.298659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:04.298659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:04.298659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lazy-loading 'fault' on Instance uuid f7a1035a-aea9-42e8-a35d-1eb6768c666d {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:04.302265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6635a122-da5b-468d-8e89-cf7254654f6a tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:04.303438 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6635a122-da5b-468d-8e89-cf7254654f6a tempest-HostsAdminNegativeTestJSON-1514956135 tempest-HostsAdminNegativeTestJSON-1514956135-project] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-16" status: 403 len: 111 microversion: 2.1 time: 0.028168 Sep 07 09:48:04.324103 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 514/1020] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:48:04 2022] PUT /compute/v2.1/os-hosts/n-d-836830-16 => generated 111 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:04.334023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:04.349791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:04.387540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:04.390275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:04.405772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:04.438048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:04.438869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:04.439523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:04.511721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.529306 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d36b01e2-007b-4b92-b3c4-2d52ae63696c tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1304 microversion: 2.1 time: 0.341891 Sep 07 09:48:04.531034 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 507/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:04 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:04.548699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad5be632-1aba-4a4e-828a-7ec5de573f2d tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1cab160>, body: {"status": null, "maintenance_mode": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad5be632-1aba-4a4e-828a-7ec5de573f2d tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/os-hosts/n-d-836830-16 HTTP/1.1 Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 42 Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:04.561917 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: {"status": null, "maintenance_mode": null} Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 07 09:48:04.563502 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'n-d-836830-16', 'body': {'status': None, 'maintenance_mode': None}} Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'disable', Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'Enable', Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'Disable', Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance: Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi None Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.564487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.566400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.568082 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:48:04.568082 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:48:04.568082 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 07 09:48:04.568082 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.573060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad5be632-1aba-4a4e-828a-7ec5de573f2d tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:04.574490 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad5be632-1aba-4a4e-828a-7ec5de573f2d tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-16" status: 400 len: 127 microversion: 2.1 time: 0.040581 Sep 07 09:48:04.575286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 508/1022] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 7 09:48:04 2022] PUT /compute/v2.1/os-hosts/n-d-836830-16 => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:04.591429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4231358d-b855-4eab-bf5a-88dea932c953 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Action: 'update', calling method: .version_select at 0x7f14b24f19d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:04.594866 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.hosts [None req-4231358d-b855-4eab-bf5a-88dea932c953 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Enabling host nonexistent_hostname. Sep 07 09:48:04.621172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-4231358d-b855-4eab-bf5a-88dea932c953 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4231358d-b855-4eab-bf5a-88dea932c953 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Request method failure captured: Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 50 Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjPGKXqcdASWLQtj3AC42ImYjJZ1lhycZj1jZxzJZs4g7ANmjfvGJraO_MnIqf04OqU17kqnKm5xZnpnTbne14tKyh2OTsU1wxrdc2zJ6VmU1H3HXxkTxuTaooYxzdYiGHfyNogQtOZCg7Bj8OvU5BpkPUxEEynD-xJ_aO-jYjDgiw Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:04.624528 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c52eae8cace6445597caace63466a608"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c52eae8cace6445597caace63466a608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c52eae8cace6445597caace63466a608", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c52eae8cace6445597caace63466a608 Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2064127815 Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b9f5899ba8074e60bd64128546658dbc Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2064127815-project-admin Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: {"status": "enable", "maintenance_mode": "enable"} Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:04.625949 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 09:48:04.626849 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:04.627901 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:04.629048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4231358d-b855-4eab-bf5a-88dea932c953 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:04.629992 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4231358d-b855-4eab-bf5a-88dea932c953 tempest-HostsAdminNegativeTestJSON-2064127815 tempest-HostsAdminNegativeTestJSON-2064127815-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.046288 Sep 07 09:48:04.629992 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 509/1023] 10.222.0.60 () {60 vars in 1211 bytes} [Wed Sep 7 09:48:04 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:04.688077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.707400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.711360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:04.719423 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-105a31b1-90e6-453c-8304-94477bc21df7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.393881 Sep 07 09:48:04.720607 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 515/1024] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:04 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:05.233896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:05.234867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:05.236829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:05.237666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:05.259716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.263292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.264376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.264886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.266701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.270682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.271180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.272974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.273251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.273716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.277217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.277856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.501792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:05.504497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:05.517663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:05.531154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:05.532612 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce4af7b1-6684-4739-90c3-0c2ecd936ef9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1280 microversion: 2.25 time: 0.310595 Sep 07 09:48:05.533716 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 516/1025] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:05 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:05.560084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:05.560991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:05.574648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.575434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.577157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.582223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.586625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.586625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.650174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.668945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.669483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.675759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lazy-loading 'fault' on Instance uuid f7a1035a-aea9-42e8-a35d-1eb6768c666d {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:05.846270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45a5949bf834f569db07ad668f99a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fddf9336df4df884fbd1d79f4736cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:05.864317 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c669e3e9-4fc0-42da-85cb-5f12c57587c3 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 200 len: 1304 microversion: 2.1 time: 0.307744 Sep 07 09:48:05.876988 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 517/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:05 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:05.902132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:05.903755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:05.919259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.921170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.921884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:05.926843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:05.927616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:05.928335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:06.195905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.196743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.211024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.212967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.230007 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-121053aa-68fa-4c0b-be13-b0753d8095b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.354786 Sep 07 09:48:06.230872 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 518/1027] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:05 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:06.243919 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf2403f5-2930-4177-8c14-f932268c0cf6 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1325 microversion: 2.1 time: 1.012795 Sep 07 09:48:06.255074 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 510/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:05 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1325 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:06.571218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:06.573777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:06.595884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:06.598963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:06.600035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:06.601615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:06.607601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:06.617230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:06.894713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:06.895743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] [instance: f7a1035a-aea9-42e8-a35d-1eb6768c666d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:06.913994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:06.915389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:06.917828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:06.924551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:06.925479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.925885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:06.926355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:06.940021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.941527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:06.942937 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1bdb1496-bc09-4718-bd80-71da96a6bffa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1344 microversion: 2.25 time: 0.384356 Sep 07 09:48:06.943514 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 519/1029] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:06 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1344 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:06.975097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] HTTP exception thrown: Instance f7a1035a-aea9-42e8-a35d-1eb6768c666d could not be found. Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Request method failure captured: Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d HTTP/1.1 Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgzF_AanEjn8uz4vPqYRL8u4MBXUaVyHnx2Dy9ifJ0JmU7QZeaMhqaIlLmqq5jukH-u8-JY1q-GSYPkNlPqDBxkgZ6ddI0HQQ_o1-txHFh4vnrdLI4po_YImjKJl9T2KB1HibGZBjlfJFyTUqoeq3spQkmTT7-FwSks1TKpJSEO75w Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 98fddf9336df4df884fbd1d79f4736cf Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminTestJSON-882290761 Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:06.983859 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98fddf9336df4df884fbd1d79f4736cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98fddf9336df4df884fbd1d79f4736cf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminTestJSON-882290761 Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 98fddf9336df4df884fbd1d79f4736cf Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminTestJSON-882290761 Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminTestJSON-882290761-project Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a45a5949bf834f569db07ad668f99a82 Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminTestJSON-882290761-project Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f7a1035a-aea9-42e8-a35d-1eb6768c666d could not be found. Sep 07 09:48:06.985514 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f7a1035a-aea9-42e8-a35d-1eb6768c666d'} Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a1035a-aea9-42e8-a35d-1eb6768c666d could not be found. Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:06.986288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a1035a-aea9-42e8-a35d-1eb6768c666d could not be found. Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a1035a-aea9-42e8-a35d-1eb6768c666d could not be found. Sep 07 09:48:06.989662 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:06.992621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] Returning 404 to user: Instance f7a1035a-aea9-42e8-a35d-1eb6768c666d could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:06.992621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03ecb242-ac5e-4020-b392-3a728fdee579 tempest-ServersAdminTestJSON-882290761 tempest-ServersAdminTestJSON-882290761-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d" status: 404 len: 111 microversion: 2.1 time: 0.101503 Sep 07 09:48:06.994013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 511/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:06 2022] GET /compute/v2.1/servers/f7a1035a-aea9-42e8-a35d-1eb6768c666d => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:07.268246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:07.268879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:07.269882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:07.270474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:07.287505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.289339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.289804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.291837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.293722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.294234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.294380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.294691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.295194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.300062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.301089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.301981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.505723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:07.523389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:07.525663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:07.535896 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3393ccc7-f961-4b7a-9bef-2b4132940f5c tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1544 microversion: 2.91 time: 0.277355 Sep 07 09:48:07.542397 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 520/1031] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:07 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1544 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:07.808786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:07.819320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-07c68800-1269-4bfe-ae26-127fc10a9d9d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1523 microversion: 2.1 time: 0.556693 Sep 07 09:48:07.833520 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 512/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:07 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:07.859186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:07.860971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:07.863983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:07.869670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.871052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.871883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.873900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.874668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.875285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.975245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:07.975867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:07.986464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.989618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.993898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:07.994960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:07.996212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:07.996870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:08.237019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.248813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.251748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.256257 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-050c24bc-bc1d-4693-9bbd-28780aa27fd5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1342 microversion: 2.25 time: 0.284786 Sep 07 09:48:08.256883 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 513/1033] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:07 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1342 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:48:08.279738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df2f81ed-fa21-4d85-b849-30864e9f3d0d", "device": "/dev/xvdb"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:08.297631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:08.312648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:08.313754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:08.313754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:08.325655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:08.326259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:08.326716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:08.540765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.552934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-63facecf-a62e-4b2f-89f7-202f2db43eef tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1523 microversion: 2.1 time: 0.700426 Sep 07 09:48:08.554376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 521/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:07 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:08.575172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:08.585554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:08.602911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:08.609609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:08.612023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:08.614938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:08.615671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:08.616109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:08.817415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.833230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.839378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:08.854306 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb7432ef-2377-41c7-9cf3-c2e6a72193d4 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1531 microversion: 2.91 time: 0.283885 Sep 07 09:48:08.859758 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 522/1035] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:08 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1531 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:08.872409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1391199036"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:08.874895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:08.887896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:08.888667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:08.889377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:08.891101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:08.891728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:08.892320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.113032 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b0df4d8-fce9-42c8-9141-754873a28033 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "POST /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853765 Sep 07 09:48:09.113945 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 514/1036] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 09:48:08 2022] POST /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:09.131689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:09.141604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:09.162525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:09.165609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:09.169745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.172915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:09.173584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:09.176842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.335930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] Lazy-loading 'services' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:09.401048 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5d3c66d-bba1-41c5-87b4-603e7c40d034 tempest-UnshelveToHostMultiNodesTest-2100285377 tempest-UnshelveToHostMultiNodesTest-2100285377-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1938 microversion: 2.91 time: 0.285693 Sep 07 09:48:09.407819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 515/1037] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:09 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1938 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:09.412845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:09.428509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:09.471028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:09.473061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:09.475964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.476999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:09.478083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:09.481906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.550378 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c8e775e-e242-4486-ae3b-51c20e30ead2 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6/action" status: 202 len: 0 microversion: 2.1 time: 0.688126 Sep 07 09:48:09.560448 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 523/1038] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:48:08 2022] POST /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:48:09.579106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:09.579610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:09.607494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:09.607920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:09.608931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.610910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:09.612436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:09.612436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:09.716909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:48:09.987115 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8b99710-8430-472a-9dc8-424e101927b6 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 204 len: 0 microversion: 2.91 time: 0.424680 Sep 07 09:48:09.988343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 524/1039] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:48:09 2022] DELETE /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:48:09.995173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0abc92a-c558-4298-be4a-b020643c549c"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:10.007300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:10.034490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:10.035975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:10.040258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:10.041554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:10.049455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:10.052686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:10.756786 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-814a7e02-a8fb-4fb2-aa41-118fc5585713 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "POST /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762891 Sep 07 09:48:10.760175 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 525/1040] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 09:48:09 2022] POST /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:10.785332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-73da94f4-3e53-4597-b987-b4faa5e8fd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '.version_select at 0x7f14b1d153a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:10.802485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:10.818200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:10.831031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:10.835048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:10.839856 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df853a26-ce7d-4534-a131-12a1c581d760 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 1.429449 Sep 07 09:48:10.865709 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 516/1041] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:09 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:10.880709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:10.881396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:10.891992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:10.892494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:10.892935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:10.919196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:10.919710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:10.920159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:11.180287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-73da94f4-3e53-4597-b987-b4faa5e8fd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13" status: 204 len: 0 microversion: 2.1 time: 0.406453 Sep 07 09:48:11.181604 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 526/1042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:10 2022] DELETE /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:11.263662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:11.291061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:11.298601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:11.314183 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f39e0f1b-8586-47cc-8d88-c02f8f3ed9aa tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.450572 Sep 07 09:48:11.315693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 517/1043] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:10 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:11.331829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b22fe9eb-cf04-49d8-a43b-0b646b3597f3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '.version_select at 0x7f14b1c53a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:11.374011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b22fe9eb-cf04-49d8-a43b-0b646b3597f3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Image not found. Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b22fe9eb-cf04-49d8-a43b-0b646b3597f3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13 HTTP/1.1 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:11.381150 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '96f20db6-eae0-46b2-acf0-ed697777bf13'} Sep 07 09:48:11.382544 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:11.383364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 96f20db6-eae0-46b2-acf0-ed697777bf13 Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:11.384524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96f20db6-eae0-46b2-acf0-ed697777bf13 could not be found. Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:11.386519 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.387657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b22fe9eb-cf04-49d8-a43b-0b646b3597f3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:11.388664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b22fe9eb-cf04-49d8-a43b-0b646b3597f3 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13" status: 404 len: 62 microversion: 2.1 time: 0.066493 Sep 07 09:48:11.388664 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 518/1044] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:48:11 2022] GET /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:11.399511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:11.400523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:11.422360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:11.422878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:11.423323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:11.425110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:11.426701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:11.430803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:11.800005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f831d7b-9a3b-4820-b9d2-e5cc435309b9 tempest-FloatingIPDetailsNegativeTestJSON-562117729 tempest-FloatingIPDetailsNegativeTestJSON-562117729-project] Calling method '.version_select at 0x7f14b1d15c10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:11.897604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-4f831d7b-9a3b-4820-b9d2-e5cc435309b9 tempest-FloatingIPDetailsNegativeTestJSON-562117729 tempest-FloatingIPDetailsNegativeTestJSON-562117729-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 17787459-2047-42ed-a2ef-c43a88c696c6 could not be found", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:48:11.898690 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4f831d7b-9a3b-4820-b9d2-e5cc435309b9 tempest-FloatingIPDetailsNegativeTestJSON-562117729 tempest-FloatingIPDetailsNegativeTestJSON-562117729-project] HTTP exception thrown: Floating IP not found for ID 17787459-2047-42ed-a2ef-c43a88c696c6 Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f831d7b-9a3b-4820-b9d2-e5cc435309b9 tempest-FloatingIPDetailsNegativeTestJSON-562117729 tempest-FloatingIPDetailsNegativeTestJSON-562117729-project] Request method failure captured: Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-floating-ips/17787459-2047-42ed-a2ef-c43a88c696c6 HTTP/1.1 Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjajRSPRfUTIzwQzviM9Al_W7si3vMoxpUznbne9ejeaUglrs4imdLARYxbyI4OEOGGFGVIWy5wnousLd2RQzfR8dluDcqPc2LRzrK7eHEVHpCfa9FGGtWOlbvjmRtQLFPQOma59Ep06LjW7QyI_MNJGCWRr4U3ALYqP1aHT0wJGSk Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7fde44d5b839425881cf9cd253c5db9a Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-562117729 Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:11.916274 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7fde44d5b839425881cf9cd253c5db9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7fde44d5b839425881cf9cd253c5db9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7fde44d5b839425881cf9cd253c5db9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7fde44d5b839425881cf9cd253c5db9a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-562117729 Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7fde44d5b839425881cf9cd253c5db9a Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-562117729 Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-562117729-project Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 9293ba9a7b574eaab9acef4f32a4dd0e Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-562117729-project Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: exception: Floating IP not found for ID 17787459-2047-42ed-a2ef-c43a88c696c6 Sep 07 09:48:11.918779 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '17787459-2047-42ed-a2ef-c43a88c696c6'} Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:48:11.919608 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 17787459-2047-42ed-a2ef-c43a88c696c6 could not be found Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0cee2b2-0384-4e81-8efb-a3586123b3f7'] Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 17787459-2047-42ed-a2ef-c43a88c696c6. Sep 07 09:48:11.920718 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 17787459-2047-42ed-a2ef-c43a88c696c6 Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:11.921845 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:11.923503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:11.923503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 17787459-2047-42ed-a2ef-c43a88c696c6 Sep 07 09:48:11.923503 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:11.923503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f831d7b-9a3b-4820-b9d2-e5cc435309b9 tempest-FloatingIPDetailsNegativeTestJSON-562117729 tempest-FloatingIPDetailsNegativeTestJSON-562117729-project] Returning 404 to user: Floating IP not found for ID 17787459-2047-42ed-a2ef-c43a88c696c6 {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:11.923503 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f831d7b-9a3b-4820-b9d2-e5cc435309b9 tempest-FloatingIPDetailsNegativeTestJSON-562117729 tempest-FloatingIPDetailsNegativeTestJSON-562117729-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/17787459-2047-42ed-a2ef-c43a88c696c6" status: 404 len: 111 microversion: 2.1 time: 0.734584 Sep 07 09:48:11.932284 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 527/1045] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:48:11 2022] GET /compute/v2.1/os-floating-ips/17787459-2047-42ed-a2ef-c43a88c696c6 => generated 111 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:11.938354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:11.947827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:11.967584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:11.968087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:11.968524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:11.973048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:11.975716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:11.977234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:11.983724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.006296 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b78af71-07c6-4cc1-a7d3-eb304a19acae tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1541 microversion: 2.1 time: 0.606805 Sep 07 09:48:12.008333 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 519/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:11 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1541 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:12.350197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:12.351266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:12.379841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:12.381098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:12.383596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:12.392311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:12.394699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:12.395185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:12.465940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.481989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.483736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.487335 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95108042-e017-4ad7-8522-e385d4870ed9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 0.553839 Sep 07 09:48:12.501206 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 528/1047] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:11 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:12.646396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.665857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.675049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:12.703435 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-861a8ca8-a9bf-41f0-9250-0fb907698a68 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1537 microversion: 2.91 time: 0.352150 Sep 07 09:48:12.711158 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 520/1048] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:12 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1537 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:12.833986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9cd11e57-9ff3-4c9d-a1fc-c2b86f8b8a7a req-efa9fa71-a485-4e6f-9bd8-bf7af7f1c109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c670f25-8fd6-4cb0-8f33-b8544182fa74", "tag": "3089b6fa-f731-4eac-8874-7cddb46b3a8d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:12.839842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:12.877609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9cd11e57-9ff3-4c9d-a1fc-c2b86f8b8a7a req-efa9fa71-a485-4e6f-9bd8-bf7af7f1c109 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:12.878098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9cd11e57-9ff3-4c9d-a1fc-c2b86f8b8a7a req-efa9fa71-a485-4e6f-9bd8-bf7af7f1c109 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:12.878551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9cd11e57-9ff3-4c9d-a1fc-c2b86f8b8a7a req-efa9fa71-a485-4e6f-9bd8-bf7af7f1c109 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:12.931176 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9cd11e57-9ff3-4c9d-a1fc-c2b86f8b8a7a req-efa9fa71-a485-4e6f-9bd8-bf7af7f1c109 service nova] Creating event network-changed:3089b6fa-f731-4eac-8874-7cddb46b3a8d for instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 on n-h2-836830-16 Sep 07 09:48:12.944389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9cd11e57-9ff3-4c9d-a1fc-c2b86f8b8a7a req-efa9fa71-a485-4e6f-9bd8-bf7af7f1c109 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113942 Sep 07 09:48:12.945351 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 529/1049] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:13.037414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:13.038789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:13.052468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.054616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.058049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.060703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.062237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.063635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.422351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:13.439315 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01e26492-5332-499d-8701-4806be7bb907 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1536 microversion: 2.1 time: 0.405952 Sep 07 09:48:13.444962 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 521/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:13 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1536 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:13.515561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:13.516265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:13.534175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.534706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.537876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.538691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.541295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.544524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.733698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:13.739042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:13.740909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:13.756732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.762235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.763100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.764678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.768723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.771877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.878616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:13.879479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:13.880161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:13.880851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lazy-loading 'fault' on Instance uuid e49bd893-4cbc-4b47-8cb8-225c520e5d74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:14.036070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.049618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.056346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b3bf03c00a4fae8f80f718a7d01303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d912b9879b74199836cfc6599505fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.080113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-59c7c040-1b5f-499d-96e1-f0a4e247d7f7 tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 200 len: 1542 microversion: 2.91 time: 0.343085 Sep 07 09:48:14.081574 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 522/1051] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:13 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 1542 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:14.142698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:14.367152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.381602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.395335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.397463 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cb2a114-4690-4bf7-b4cc-a453530dfb96 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 0.886954 Sep 07 09:48:14.398644 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 530/1052] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:13 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:14.473853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:14.474888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:14.495644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:14.496835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:14.497544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:14.498513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:14.499224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:14.499879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:14.534096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:14.549910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Calling method '.version_select at 0x7f14b1c28c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:14.551958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:14.552602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:14.553044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:14.599912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:14.601039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:14.601712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:14.631928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:14.632439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:14.632887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:14.645603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fa988b3c-1971-40d2-a59f-4d0e0d044ebf tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.561503 Sep 07 09:48:14.650568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 523/1053] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:48:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:14.720392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-780002232", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:14.804626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:14.813731 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e6819f7-a21a-448f-8a87-005102464216 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1523 microversion: 2.1 time: 0.343778 Sep 07 09:48:14.817564 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 531/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:14 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:14.822339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:15.024970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-058fb743-23be-4e23-9375-2e24292fa07f tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Calling method '.version_select at 0x7f14b1d15e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.027982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-058fb743-23be-4e23-9375-2e24292fa07f tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '720788ee04404ce4a1a98a43651015ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d16403e0d404612b717900a129dbafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-058fb743-23be-4e23-9375-2e24292fa07f tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Request method failure captured: Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hypervisors/n-h1-836830-16/search HTTP/1.1 Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjbdL2Bh1cOY3ykyF8anGn1mGYJWBEIUfe_yR6v3WI_uAqtzbITvbiiIwOh9cWxQAaHWRU7_YmK_NELeNtHREQo2QIAnLBEq7pVrXqVAY1SZEoeR7l_AagZnFuj34x4nuCwk49vMRcjfCPekhynICckxLBvWWrbdM3ZtVFpUiiUTDo Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5d16403e0d404612b717900a129dbafe Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1981481255 Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:15.029740 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d16403e0d404612b717900a129dbafe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d16403e0d404612b717900a129dbafe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d16403e0d404612b717900a129dbafe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d16403e0d404612b717900a129dbafe", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1981481255 Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5d16403e0d404612b717900a129dbafe Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1981481255 Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 720788ee04404ce4a1a98a43651015ca Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 07 09:48:15.031061 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'n-h1-836830-16'} Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:15.031958 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 07 09:48:15.033065 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.036702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-058fb743-23be-4e23-9375-2e24292fa07f tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:15.036702 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-058fb743-23be-4e23-9375-2e24292fa07f tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h1-836830-16/search" status: 403 len: 117 microversion: 2.1 time: 0.213300 Sep 07 09:48:15.036702 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 532/1055] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 7 09:48:14 2022] GET /compute/v2.1/os-hypervisors/n-h1-836830-16/search => generated 117 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:15.054460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.054805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:15.092212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.092936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.093826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.097791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.098286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.098728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.159591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:48:15.199459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:15.200115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:15.200474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:15.200995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:15.201565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:15.219558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.220335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.222257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.224766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.225450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.226275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.251172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Getting quotas for project c4da1c88277749c48367e016f6cb7b91. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:15.257026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Getting quotas for user 494063ae805e4de1a64e229a7cfc6d81 and project c4da1c88277749c48367e016f6cb7b91. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:15.275833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:48:15.279510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:48:15.312019 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e9f2b12-b561-406e-871a-c66b6a1c17e4 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 204 len: 0 microversion: 2.1 time: 0.261061 Sep 07 09:48:15.312945 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 533/1056] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:48:15 2022] DELETE /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:15.326596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Calling method '.version_select at 0x7f14b1c85e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.331269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.333128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.334525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.347344 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Request method failure captured: Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjdkHUzgNy0zR2HGAtzWgOw_oa16vcd1jOdEboXMM0XH3izkcgfB9NfMCfApJd7jxHpFQqdGaVBCO9vGpLQKFsXP0xFZtnU5HMCLfc7KdYJr0_6acrD2m_LwKibD4uNMNIfcoQ2UoNXTyHy3YIUiNT1izVLf3LP_im12A0kbEOFZ5U Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 44c827550a474be4b82ddb5b2678d2f4 Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-688500919 Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:15.352509 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/44c827550a474be4b82ddb5b2678d2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/44c827550a474be4b82ddb5b2678d2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/44c827550a474be4b82ddb5b2678d2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_44c827550a474be4b82ddb5b2678d2f4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-688500919 Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 44c827550a474be4b82ddb5b2678d2f4 Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-688500919 Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e85c83779f414bbca415ac3268fded1d Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 09:48:15.354499 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.355341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.356579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.356579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:15.356579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:15.356579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 09:48:15.356579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.356579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:15.357604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f38b06da-9f4b-4669-bff5-97cfb2b61b15 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.038950 Sep 07 09:48:15.358622 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 534/1057] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:15.366693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.369246 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-777ec28f-1381-4d15-a64a-6451527e0e79 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717020 Sep 07 09:48:15.371656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] [instance: e49bd893-4cbc-4b47-8cb8-225c520e5d74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:15.374801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 524/1058] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:48:15.380134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-bcd8f150-0542-4023-919f-960a4152c539 req-dbd15c7e-38a2-410d-b111-c2a5b3dcbd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200aeb49-752f-4a80-9d7e-f927574201f6", "name": "network-vif-plugged", "status": "completed", "tag": "7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:15.388392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.405313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bcd8f150-0542-4023-919f-960a4152c539 req-dbd15c7e-38a2-410d-b111-c2a5b3dcbd20 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.405519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.406004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.406372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bcd8f150-0542-4023-919f-960a4152c539 req-dbd15c7e-38a2-410d-b111-c2a5b3dcbd20 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.407131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bcd8f150-0542-4023-919f-960a4152c539 req-dbd15c7e-38a2-410d-b111-c2a5b3dcbd20 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.408109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.408824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.411073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.428535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-bcd8f150-0542-4023-919f-960a4152c539 req-dbd15c7e-38a2-410d-b111-c2a5b3dcbd20 service nova] Creating event network-vif-plugged:7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17 for instance 200aeb49-752f-4a80-9d7e-f927574201f6 on n-h1-836830-16 Sep 07 09:48:15.434735 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-bcd8f150-0542-4023-919f-960a4152c539 req-dbd15c7e-38a2-410d-b111-c2a5b3dcbd20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058642 Sep 07 09:48:15.436082 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 525/1059] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:15.442451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.443381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:15.451191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.451621 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] HTTP exception thrown: Instance e49bd893-4cbc-4b47-8cb8-225c520e5d74 could not be found. Sep 07 09:48:15.452151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.452778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.453700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.454343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.454978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Request method failure captured: Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 HTTP/1.1 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhEid_BUozoNkrRgFr8mFOl-CF0FyXf4JgUVdhvHEYn2dPsLXmKmdnM1FifvhDLqTY050KhE-uwNdnIphvjWBY_U8oYKgx09NxthBPpXQi-I1PN_U7D2Gn2n4-MpOcR0Fl1fqAiFTWWXz_PXGWrWq4gy2gvJ7MJSOP8AK284115X1c Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.91 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 4d912b9879b74199836cfc6599505fe3 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1290323239 Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:15.460210 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d912b9879b74199836cfc6599505fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d912b9879b74199836cfc6599505fe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d912b9879b74199836cfc6599505fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d912b9879b74199836cfc6599505fe3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1290323239 Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 4d912b9879b74199836cfc6599505fe3 Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1290323239 Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-UnshelveToHostMultiNodesTest-1290323239-project Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 81b3bf03c00a4fae8f80f718a7d01303 Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1290323239-project Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e49bd893-4cbc-4b47-8cb8-225c520e5d74 could not be found. Sep 07 09:48:15.461781 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e49bd893-4cbc-4b47-8cb8-225c520e5d74'} Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49bd893-4cbc-4b47-8cb8-225c520e5d74 could not be found. Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:15.462677 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49bd893-4cbc-4b47-8cb8-225c520e5d74 could not be found. Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49bd893-4cbc-4b47-8cb8-225c520e5d74 could not be found. Sep 07 09:48:15.464126 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.466463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] Returning 404 to user: Instance e49bd893-4cbc-4b47-8cb8-225c520e5d74 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:15.467491 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9dd6f83-bffb-4f7a-8f21-5e0d892980be tempest-UnshelveToHostMultiNodesTest-1290323239 tempest-UnshelveToHostMultiNodesTest-1290323239-project] 10.222.0.60 "GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74" status: 404 len: 111 microversion: 2.91 time: 0.107775 Sep 07 09:48:15.468537 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 535/1060] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/servers/e49bd893-4cbc-4b47-8cb8-225c520e5d74 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:15.488633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Calling method '.version_select at 0x7f14b1c523a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.501812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.504310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.504958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.542189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.543287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.546255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.567657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.574109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.576777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.590887 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb1616d6-0683-4d18-a95f-956e93fa0d39 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.119034 Sep 07 09:48:15.594570 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 536/1061] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:15.606583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7bc0b267-7a73-480f-9e86-4327d8ef1a3b tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.607210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7bc0b267-7a73-480f-9e86-4327d8ef1a3b tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:15.688119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:15.696723 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5d2b39a-9974-42d6-bce7-4f5f5bf99c00 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1529 microversion: 2.1 time: 0.259140 Sep 07 09:48:15.701852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 526/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1529 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:15.725371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.726156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:15.746487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.750403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.750975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.752167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.752881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.753587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.793994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7bc0b267-7a73-480f-9e86-4327d8ef1a3b tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:15.805032 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7bc0b267-7a73-480f-9e86-4327d8ef1a3b tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1213 microversion: 2.1 time: 0.208173 Sep 07 09:48:15.824908 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 537/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:15.836411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26754657-c1f6-4970-a6ec-51fcd4872262 tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Calling method '.version_select at 0x7f14b1c85e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.838259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-26754657-c1f6-4970-a6ec-51fcd4872262 tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '720788ee04404ce4a1a98a43651015ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d16403e0d404612b717900a129dbafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26754657-c1f6-4970-a6ec-51fcd4872262 tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Request method failure captured: Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjbdL2Bh1cOY3ykyF8anGn1mGYJWBEIUfe_yR6v3WI_uAqtzbITvbiiIwOh9cWxQAaHWRU7_YmK_NELeNtHREQo2QIAnLBEq7pVrXqVAY1SZEoeR7l_AagZnFuj34x4nuCwk49vMRcjfCPekhynICckxLBvWWrbdM3ZtVFpUiiUTDo Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5d16403e0d404612b717900a129dbafe Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1981481255 Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:15.840749 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d16403e0d404612b717900a129dbafe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d16403e0d404612b717900a129dbafe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d16403e0d404612b717900a129dbafe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d16403e0d404612b717900a129dbafe", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1981481255 Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5d16403e0d404612b717900a129dbafe Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1981481255 Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 720788ee04404ce4a1a98a43651015ca Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 07 09:48:15.842473 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1'} Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:15.843461 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 07 09:48:15.845005 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.846091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26754657-c1f6-4970-a6ec-51fcd4872262 tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:15.846091 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26754657-c1f6-4970-a6ec-51fcd4872262 tempest-HypervisorAdminNegativeUnderV252Test-1981481255 tempest-HypervisorAdminNegativeUnderV252Test-1981481255-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011938 Sep 07 09:48:15.846091 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 538/1064] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:15.852066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Calling method '.version_select at 0x7f14b1d031f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:15.855977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:15.856777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:15.857504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:15.878789 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] HTTP exception thrown: No hypervisor matching '48542c91-2ee3-41cc-b35f-e6adb12f3f86' could be found. Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Request method failure captured: Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-hypervisors/48542c91-2ee3-41cc-b35f-e6adb12f3f86/servers HTTP/1.1 Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjdkHUzgNy0zR2HGAtzWgOw_oa16vcd1jOdEboXMM0XH3izkcgfB9NfMCfApJd7jxHpFQqdGaVBCO9vGpLQKFsXP0xFZtnU5HMCLfc7KdYJr0_6acrD2m_LwKibD4uNMNIfcoQ2UoNXTyHy3YIUiNT1izVLf3LP_im12A0kbEOFZ5U Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 44c827550a474be4b82ddb5b2678d2f4 Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-688500919 Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:15.883963 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/44c827550a474be4b82ddb5b2678d2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/44c827550a474be4b82ddb5b2678d2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/44c827550a474be4b82ddb5b2678d2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_44c827550a474be4b82ddb5b2678d2f4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-688500919 Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 44c827550a474be4b82ddb5b2678d2f4 Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-688500919 Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e85c83779f414bbca415ac3268fded1d Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: exception: No hypervisor matching '48542c91-2ee3-41cc-b35f-e6adb12f3f86' could be found. Sep 07 09:48:15.885294 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '48542c91-2ee3-41cc-b35f-e6adb12f3f86'} Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '48542c91-2ee3-41cc-b35f-e6adb12f3f86' could be found. Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.886604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:15.887729 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:15.887729 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:15.887729 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:15.887729 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:15.887729 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '48542c91-2ee3-41cc-b35f-e6adb12f3f86' could be found. Sep 07 09:48:15.887729 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:15.891776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] Returning 404 to user: No hypervisor matching '48542c91-2ee3-41cc-b35f-e6adb12f3f86' could be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:15.894231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7fb2c396-67ac-46be-b66a-b41c25274624 tempest-HypervisorAdminNegativeUnderV252Test-688500919 tempest-HypervisorAdminNegativeUnderV252Test-688500919-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/48542c91-2ee3-41cc-b35f-e6adb12f3f86/servers" status: 404 len: 123 microversion: 2.1 time: 0.046071 Sep 07 09:48:15.896573 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 539/1065] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/os-hypervisors/48542c91-2ee3-41cc-b35f-e6adb12f3f86/servers => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:16.551225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:16.570767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:16.601574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:16.609339 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-158a62ea-b771-4eb1-8691-fab97e74aa39 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 0.902182 Sep 07 09:48:16.614059 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 527/1066] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:15 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:16.734205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:16.736872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:16.749557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:16.751134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:16.752234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:16.754344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:16.755438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:16.756105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:16.838123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:16.840004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:16.881370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:16.892426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:16.894294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:16.896626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:16.898667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:16.900442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:16.903493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:17.216161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:17.234153 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee02880d-5da1-456e-bb31-5db95ebfe18f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1265 microversion: 2.1 time: 0.401820 Sep 07 09:48:17.234831 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 528/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:16 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:17.302133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:17.325308 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf167dfe-a206-47e9-b576-b0ac27eff89d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1529 microversion: 2.1 time: 0.595705 Sep 07 09:48:17.327893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 540/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:16 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1529 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:17.640909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:17.641809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:17.653762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:17.656615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:17.657359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:17.658428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:17.659804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:17.660428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:18.167565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:18.181862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:18.186788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:18.194837 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8bf0894f-8489-4b0e-9015-029b2a3b8d8a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 0.559674 Sep 07 09:48:18.201393 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 529/1069] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:17 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:18.262098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:18.262708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:18.291907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:18.304026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:18.304026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:18.304026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:18.304026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:18.304376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:18.352218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:18.353090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:18.374158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:18.374678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:18.375124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:18.375853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:18.376316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:18.376746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:18.591969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:18.607503 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fabc1e28-8940-410a-b49e-a6f6be0c626f tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1271 microversion: 2.1 time: 0.345363 Sep 07 09:48:18.608272 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 541/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:18 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1271 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:18.637474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-177a111e-bb35-4569-adcc-4bee22407d19 req-d7b92075-77af-4d6f-a96d-cf6e663781a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200aeb49-752f-4a80-9d7e-f927574201f6", "name": "network-vif-deleted", "tag": "7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:18.642243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:18.658782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-177a111e-bb35-4569-adcc-4bee22407d19 req-d7b92075-77af-4d6f-a96d-cf6e663781a7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:18.660456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-177a111e-bb35-4569-adcc-4bee22407d19 req-d7b92075-77af-4d6f-a96d-cf6e663781a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:18.661351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-177a111e-bb35-4569-adcc-4bee22407d19 req-d7b92075-77af-4d6f-a96d-cf6e663781a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:18.667890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db84637f-2db1-40b6-afd1-a7d6f65e98da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 200 len: 1487 microversion: 2.1 time: 0.318505 Sep 07 09:48:18.668965 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 530/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:18 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 1487 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:18.708597 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-177a111e-bb35-4569-adcc-4bee22407d19 req-d7b92075-77af-4d6f-a96d-cf6e663781a7 service nova] Creating event network-vif-deleted:7c91a53b-bb7f-4f75-b1c3-33bc5f84dc17 for instance 200aeb49-752f-4a80-9d7e-f927574201f6 on n-h1-836830-16 Sep 07 09:48:18.715128 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-177a111e-bb35-4569-adcc-4bee22407d19 req-d7b92075-77af-4d6f-a96d-cf6e663781a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086546 Sep 07 09:48:18.717005 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 542/1072] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:48:19.219495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:19.220432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:19.231619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:19.232381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:19.235595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:19.236518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:19.246247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:19.250040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:19.652587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:19.657446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:19.698183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:19.700468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:19.701978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:19.703314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:19.705665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:19.707992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:19.945917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:19.958668 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-16e1d272-685b-4a4e-a7ba-a34385531bf1 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1271 microversion: 2.1 time: 0.323138 Sep 07 09:48:19.960944 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 543/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:19 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1271 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:19.968741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:19.969541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:19.976352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:19.976956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:19.978556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:19.981440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:19.982318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:19.982984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:20.003906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:20.007724 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 HTTP/1.1 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:20.013732 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:20.015151 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '200aeb49-752f-4a80-9d7e-f927574201f6'} Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:20.015932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:20.017269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:20.022123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:20.022273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:20.023051 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25cacae8-97de-4adf-bdbc-f650b0a0324e tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 404 len: 111 microversion: 2.1 time: 0.060611 Sep 07 09:48:20.023900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:20.024168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 544/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:19 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:20.025871 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b582315-b9a0-4de9-a1f2-a264c0d4b824 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 0.809676 Sep 07 09:48:20.026801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 531/1075] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:19 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:20.331590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1893910225", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:20.447433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] validate_networks() for [('93ef6f9e-fbc6-4bbc-a58d-2c9d0d3cd529', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:20.588169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8ecb4c6f-d26b-486f-8a04-06ef6fc3c227 req-1e1e1108-03f5-4d99-930f-9e0723b50033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c670f25-8fd6-4cb0-8f33-b8544182fa74", "name": "network-vif-plugged", "status": "completed", "tag": "3089b6fa-f731-4eac-8874-7cddb46b3a8d"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:20.617732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ecb4c6f-d26b-486f-8a04-06ef6fc3c227 req-1e1e1108-03f5-4d99-930f-9e0723b50033 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:20.622535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ecb4c6f-d26b-486f-8a04-06ef6fc3c227 req-1e1e1108-03f5-4d99-930f-9e0723b50033 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:20.623364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ecb4c6f-d26b-486f-8a04-06ef6fc3c227 req-1e1e1108-03f5-4d99-930f-9e0723b50033 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:20.654881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8ecb4c6f-d26b-486f-8a04-06ef6fc3c227 req-1e1e1108-03f5-4d99-930f-9e0723b50033 service nova] Creating event network-vif-plugged:3089b6fa-f731-4eac-8874-7cddb46b3a8d for instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 on n-h2-836830-16 Sep 07 09:48:20.664621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8ecb4c6f-d26b-486f-8a04-06ef6fc3c227 req-1e1e1108-03f5-4d99-930f-9e0723b50033 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079975 Sep 07 09:48:20.673856 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 532/1076] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:20.986362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:20.987411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:21.006509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:21.007816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:21.013345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:21.016122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:21.016837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:21.019634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:21.596703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:21.609276 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c8ee5565-ac90-4c68-bd93-49ac3af0a681 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.626954 Sep 07 09:48:21.610001 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 533/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:20 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:21.627711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:21.628376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:21.643087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:21.645922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:21.646383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:21.649722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:21.650416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:21.652230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:21.840567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:21.841039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:21.841469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:21.841874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:21.842281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:21.864001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:21.864123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:21.864511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:21.871211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:21.871940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:21.872537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:21.922016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:21.930217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Getting quotas for user 03b1af68e8a948758e09d0ccbca23d4d and project 0cba4c3920814bd68ebe8734b405ad74. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:21.947531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:48:21.950899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:48:21.996198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:22.044749 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82d13e1c-c9dc-4b03-85f0-f0d086a7ec75 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.720428 Sep 07 09:48:22.045739 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 545/1078] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:48:22.057015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-12d1cd1d-2527-49d3-b777-465b196f7992 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:22.058450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-12d1cd1d-2527-49d3-b777-465b196f7992 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:22.075007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:22.090119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:22.092905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:22.095192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13c52833-9bdf-4536-8da0-8328b558eeca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1410 microversion: 2.25 time: 0.480894 Sep 07 09:48:22.102109 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 534/1079] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:21 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1410 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:22.169514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-12d1cd1d-2527-49d3-b777-465b196f7992 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:22.178043 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-12d1cd1d-2527-49d3-b777-465b196f7992 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1225 microversion: 2.1 time: 0.125019 Sep 07 09:48:22.178626 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 546/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:22 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:22.641300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:22.642292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:22.655228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:22.656502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:22.657506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:22.659165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:22.659983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:22.661813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:22.701760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3da64c01-8a93-410c-8c5f-bffebe0296ff req-6318eae2-1147-4367-ba95-a5e50ccd5bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16434926-5260-479a-a235-812a4f133852", "tag": "bbe522b0-498d-4b86-b8a0-06eb6119dc15"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:22.751846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3da64c01-8a93-410c-8c5f-bffebe0296ff req-6318eae2-1147-4367-ba95-a5e50ccd5bb4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:22.753456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3da64c01-8a93-410c-8c5f-bffebe0296ff req-6318eae2-1147-4367-ba95-a5e50ccd5bb4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:22.755081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3da64c01-8a93-410c-8c5f-bffebe0296ff req-6318eae2-1147-4367-ba95-a5e50ccd5bb4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:22.787424 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3da64c01-8a93-410c-8c5f-bffebe0296ff req-6318eae2-1147-4367-ba95-a5e50ccd5bb4 service nova] Creating event network-changed:bbe522b0-498d-4b86-b8a0-06eb6119dc15 for instance 16434926-5260-479a-a235-812a4f133852 on n-h2-836830-16 Sep 07 09:48:22.798885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3da64c01-8a93-410c-8c5f-bffebe0296ff req-6318eae2-1147-4367-ba95-a5e50ccd5bb4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101947 Sep 07 09:48:22.802011 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 547/1081] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:23.040685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:23.051245 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5199e9be-4f18-4947-bad9-0124ab7c5a19 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.417770 Sep 07 09:48:23.056615 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 535/1082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:22 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:23.137077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:23.139179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:23.179611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:23.196734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:23.198249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:23.223009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:23.224016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:23.224644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:23.249496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:23.497478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba718af5-3d06-4257-8803-ae6fc900cebb tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Calling method '.version_select at 0x7f14b1d343a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:23.560698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:23.572534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:23.575292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:23.578768 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1fb2e3bd-a2cd-438b-a0e0-ca02a35e5cff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1607 microversion: 2.25 time: 0.454328 Sep 07 09:48:23.580963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 536/1083] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:48:23 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1607 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:23.602189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:23.602994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:23.612203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:23.613014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:23.613651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:23.614509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:23.615289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:23.615863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:23.747155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:23.763024 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-feb260b4-f1df-447d-8f15-809646039331 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1277 microversion: 2.1 time: 0.169439 Sep 07 09:48:23.766115 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 537/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:23 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:23.778705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:23.779597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:23.793031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:23.793766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:23.794373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:23.795849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:23.796476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:23.797210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:23.905332 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8be735be-9994-4fdf-867b-e3b8e70c9d27 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.137434 Sep 07 09:48:23.905920 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 538/1085] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 09:48:23 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:48:23.946522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ba718af5-3d06-4257-8803-ae6fc900cebb tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 371 microversion: 2.1 time: 1.142520 Sep 07 09:48:23.947376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 548/1086] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 09:48:22 2022] GET /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 371 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:24.014691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1c49310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:24.023641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.024247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.025731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.042761 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d46b152a-898f-499c-9f0b-424fcf7f929e tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] 10.222.0.60 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.093594 Sep 07 09:48:24.044051 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 549/1087] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 7 09:48:23 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 09:48:24.048966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.049504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.050729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.050870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1c523a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:24.071799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] HTTP exception thrown: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Request method failure captured: Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 HTTP/1.1 Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 56 Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjnk11JbvsRV9g13RuVcmZ0vgf9SPoH-pJkxjdz0Z3yBy-6e4SvGNx116LieA-9c6ipuXguBY2qi2AcKYmdBnHeEJ-aJsV6geZOLmlmP3GGbzeOvQlq2Lgv3qqlrE8esEaEOr7QhMhrcCNPD9bpDB2CAjqhEIaAYTmXGVCwCXPeZHA Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: bdb9748392584fabb3da988b0cdaf7aa Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:24.074877 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdb9748392584fabb3da988b0cdaf7aa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: bdb9748392584fabb3da988b0cdaf7aa Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 61744d806d4042469217cdc939460830 Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:24.076300 n-d-836830-16 devstack@n-api.service[128832]: exception: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'eb30723a-7731-478a-9d3b-9f4f2ffcd8f4', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.077127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.078463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.079694 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.079694 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.079694 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.079694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Returning 404 to user: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.079694 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb4bd2ff-1a8a-478b-b52f-d56dcaea0679 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4" status: 404 len: 110 microversion: 2.53 time: 0.169495 Sep 07 09:48:24.079694 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 539/1088] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Sep 7 09:48:23 2022] PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 => generated 110 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:24.098003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32398a63-1395-4dc2-b67f-132c8a5765c2 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Calling method '.version_select at 0x7f14b1c28c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.174166 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-32398a63-1395-4dc2-b67f-132c8a5765c2 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] HTTP exception thrown: Image not found. Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32398a63-1395-4dc2-b67f-132c8a5765c2 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Request method failure captured: Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjn37DY42jv9zx_o5jmkOpUKtgrIP0ywU0tyuWdg23sROyYvwWJbEOB-V2oLizr8sTqSeLYF0bkB1Fgs3-2S1RKtrJVybC0lEokTq9Z2WuDFM7XswmMNdrmfh8nuNhBdT2e68HtJGH-7bwhha97qk3VPw_BEC2sE6Mh_hWPlo7ybp0 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:24.176273 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63b03c6b5de44f7a87e7734a7d944af2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 142351470e144decb9b0cc9fb0a7856b Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '-1'} Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.177710 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.178607 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.184415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32398a63-1395-4dc2-b67f-132c8a5765c2 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-32398a63-1395-4dc2-b67f-132c8a5765c2 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] 10.222.0.60 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.090385 Sep 07 09:48:24.185782 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 540/1089] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 7 09:48:24 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:24.186690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1bedca0>, body: {"status": "disabled"} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:24.186773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.186773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.186931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.187635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.190690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.191300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.193690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.197556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.199828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.216686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.217676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.218123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.232765 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] HTTP exception thrown: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Request method failure captured: Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 HTTP/1.1 Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 22 Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjnk11JbvsRV9g13RuVcmZ0vgf9SPoH-pJkxjdz0Z3yBy-6e4SvGNx116LieA-9c6ipuXguBY2qi2AcKYmdBnHeEJ-aJsV6geZOLmlmP3GGbzeOvQlq2Lgv3qqlrE8esEaEOr7QhMhrcCNPD9bpDB2CAjqhEIaAYTmXGVCwCXPeZHA Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: bdb9748392584fabb3da988b0cdaf7aa Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:24.237927 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdb9748392584fabb3da988b0cdaf7aa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: bdb9748392584fabb3da988b0cdaf7aa Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 61744d806d4042469217cdc939460830 Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: {"status": "disabled"} Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: exception: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.239401 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'eb30723a-7731-478a-9d3b-9f4f2ffcd8f4', 'body': {'status': 'disabled'}} Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.240306 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.243174 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.245558 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.245558 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.245966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Returning 404 to user: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.249142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46cbee72-6e7c-4a3c-b5c1-bfa06c187c8c tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4" status: 404 len: 110 microversion: 2.53 time: 0.068882 Sep 07 09:48:24.255573 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 541/1090] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Sep 7 09:48:24 2022] PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 => generated 110 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:24.264464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.267546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:24.283991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.287400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.289424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.290784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.293692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.294863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.327373 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a2eb34a-a792-426e-99fd-2e1b969d4e7d tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 328 microversion: 2.1 time: 0.282035 Sep 07 09:48:24.328343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 550/1091] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:24 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:24.332854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bfd2851-0f8d-4793-8c76-b36d308fb1ab tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Calling method '.version_select at 0x7f14b1d731f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.374982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0bfd2851-0f8d-4793-8c76-b36d308fb1ab tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] HTTP exception thrown: Image not found. Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bfd2851-0f8d-4793-8c76-b36d308fb1ab tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Request method failure captured: Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/5fe02938-802a-49a7-90ba-05eb2a5a2a5j HTTP/1.1 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjn37DY42jv9zx_o5jmkOpUKtgrIP0ywU0tyuWdg23sROyYvwWJbEOB-V2oLizr8sTqSeLYF0bkB1Fgs3-2S1RKtrJVybC0lEokTq9Z2WuDFM7XswmMNdrmfh8nuNhBdT2e68HtJGH-7bwhha97qk3VPw_BEC2sE6Mh_hWPlo7ybp0 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:24.377067 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63b03c6b5de44f7a87e7734a7d944af2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 142351470e144decb9b0cc9fb0a7856b Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5fe02938-802a-49a7-90ba-05eb2a5a2a5j'} Sep 07 09:48:24.378743 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5fe02938-802a-49a7-90ba-05eb2a5a2a5j to delete Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.379621 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5fe02938-802a-49a7-90ba-05eb2a5a2a5j could not be found. Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.381173 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bfd2851-0f8d-4793-8c76-b36d308fb1ab tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.382639 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0bfd2851-0f8d-4793-8c76-b36d308fb1ab tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] 10.222.0.60 "DELETE /compute/v2.1/images/5fe02938-802a-49a7-90ba-05eb2a5a2a5j" status: 404 len: 62 microversion: 2.1 time: 0.049206 Sep 07 09:48:24.383737 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 551/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:24 2022] DELETE /compute/v2.1/images/5fe02938-802a-49a7-90ba-05eb2a5a2a5j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:24.387831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1d150d0>, body: {"status": "enabled"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:24.391379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.391860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.392302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.417610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.418097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.418524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.433555 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] HTTP exception thrown: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Request method failure captured: Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 HTTP/1.1 Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 21 Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjnk11JbvsRV9g13RuVcmZ0vgf9SPoH-pJkxjdz0Z3yBy-6e4SvGNx116LieA-9c6ipuXguBY2qi2AcKYmdBnHeEJ-aJsV6geZOLmlmP3GGbzeOvQlq2Lgv3qqlrE8esEaEOr7QhMhrcCNPD9bpDB2CAjqhEIaAYTmXGVCwCXPeZHA Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: bdb9748392584fabb3da988b0cdaf7aa Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:24.435503 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb9748392584fabb3da988b0cdaf7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdb9748392584fabb3da988b0cdaf7aa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: bdb9748392584fabb3da988b0cdaf7aa Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125 Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 61744d806d4042469217cdc939460830 Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: {"status": "enabled"} Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: exception: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.437124 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'eb30723a-7731-478a-9d3b-9f4f2ffcd8f4', 'body': {'status': 'enabled'}} Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.438141 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.439616 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.441019 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. Sep 07 09:48:24.441019 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.441854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Returning 404 to user: Service eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.443120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52c93e7a-fb8c-4444-a68f-814c94b3b44d tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4" status: 404 len: 110 microversion: 2.53 time: 0.062962 Sep 07 09:48:24.443851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 552/1093] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Sep 7 09:48:24 2022] PUT /compute/v2.1/os-services/eb30723a-7731-478a-9d3b-9f4f2ffcd8f4 => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:24.448861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-709df3bd-25a5-4762-b9a9-1add7aa2bb39 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Calling method '.version_select at 0x7f14b1c05c10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.475529 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-709df3bd-25a5-4762-b9a9-1add7aa2bb39 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] HTTP exception thrown: Image not found. Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-709df3bd-25a5-4762-b9a9-1add7aa2bb39 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Request method failure captured: Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/2866cbf6-084c-4703-945d-c933b7555b091 HTTP/1.1 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjn37DY42jv9zx_o5jmkOpUKtgrIP0ywU0tyuWdg23sROyYvwWJbEOB-V2oLizr8sTqSeLYF0bkB1Fgs3-2S1RKtrJVybC0lEokTq9Z2WuDFM7XswmMNdrmfh8nuNhBdT2e68HtJGH-7bwhha97qk3VPw_BEC2sE6Mh_hWPlo7ybp0 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:24.478105 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63b03c6b5de44f7a87e7734a7d944af2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 142351470e144decb9b0cc9fb0a7856b Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2866cbf6-084c-4703-945d-c933b7555b091'} Sep 07 09:48:24.480302 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2866cbf6-084c-4703-945d-c933b7555b091 to delete Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.481344 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2866cbf6-084c-4703-945d-c933b7555b091 could not be found. Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.482470 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:24.483612 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.486374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-709df3bd-25a5-4762-b9a9-1add7aa2bb39 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.487534 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-709df3bd-25a5-4762-b9a9-1add7aa2bb39 tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] 10.222.0.60 "DELETE /compute/v2.1/images/2866cbf6-084c-4703-945d-c933b7555b091" status: 404 len: 62 microversion: 2.1 time: 0.042617 Sep 07 09:48:24.493240 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 553/1094] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:48:24 2022] DELETE /compute/v2.1/images/2866cbf6-084c-4703-945d-c933b7555b091 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:24.529592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.533836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.534334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.534775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.540603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.541131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.544532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.575001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea8b68c9-6642-4dbe-b880-ab9d1258426e tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.074999 Sep 07 09:48:24.577333 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 554/1095] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 7 09:48:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:24.582346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b75da2b-d117-4d5c-82c7-5f062916feac tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Calling method '.version_select at 0x7f14b1c523a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.612906 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0b75da2b-d117-4d5c-82c7-5f062916feac tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] HTTP exception thrown: Image not found. Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b75da2b-d117-4d5c-82c7-5f062916feac tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Request method failure captured: Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/tempest-invalid-364645103 HTTP/1.1 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjn37DY42jv9zx_o5jmkOpUKtgrIP0ywU0tyuWdg23sROyYvwWJbEOB-V2oLizr8sTqSeLYF0bkB1Fgs3-2S1RKtrJVybC0lEokTq9Z2WuDFM7XswmMNdrmfh8nuNhBdT2e68HtJGH-7bwhha97qk3VPw_BEC2sE6Mh_hWPlo7ybp0 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:24.614709 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63b03c6b5de44f7a87e7734a7d944af2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 142351470e144decb9b0cc9fb0a7856b Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'tempest-invalid-364645103'} Sep 07 09:48:24.616046 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-364645103 to delete Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.616826 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-364645103 could not be found. Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.618012 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:24.619265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.622776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b75da2b-d117-4d5c-82c7-5f062916feac tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.623835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b75da2b-d117-4d5c-82c7-5f062916feac tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] 10.222.0.60 "DELETE /compute/v2.1/images/tempest-invalid-364645103" status: 404 len: 62 microversion: 2.1 time: 0.045213 Sep 07 09:48:24.629678 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 555/1096] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 7 09:48:24 2022] DELETE /compute/v2.1/images/tempest-invalid-364645103 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:24.632500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:24.640725 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23aacfea-7712-4284-b305-f16acdb1cfc4 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.381913 Sep 07 09:48:24.641331 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 542/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:24 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:24.653432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.653432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.653777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.655500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.656559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.657331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.657986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.719088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2053879708", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:24.740299 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e915b1ba-f691-4ebb-9865-210f34cf9dec tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.097644 Sep 07 09:48:24.741466 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 543/1098] 10.222.0.60 () {60 vars in 1211 bytes} [Wed Sep 7 09:48:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:24.756802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0a8690cb-15db-4334-9ebf-80672544a5cb tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Calling method '.version_select at 0x7f14b1c28ca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.790139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-0a8690cb-15db-4334-9ebf-80672544a5cb tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] HTTP exception thrown: Image not found. Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0a8690cb-15db-4334-9ebf-80672544a5cb tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Request method failure captured: Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/images/5f143065-dfd4-4696-82be-e17b09d018a6 HTTP/1.1 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjn37DY42jv9zx_o5jmkOpUKtgrIP0ywU0tyuWdg23sROyYvwWJbEOB-V2oLizr8sTqSeLYF0bkB1Fgs3-2S1RKtrJVybC0lEokTq9Z2WuDFM7XswmMNdrmfh8nuNhBdT2e68HtJGH-7bwhha97qk3VPw_BEC2sE6Mh_hWPlo7ybp0 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:24.792732 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63b03c6b5de44f7a87e7734a7d944af2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63b03c6b5de44f7a87e7734a7d944af2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 63b03c6b5de44f7a87e7734a7d944af2 Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-296972395 Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 142351470e144decb9b0cc9fb0a7856b Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-296972395-project Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5f143065-dfd4-4696-82be-e17b09d018a6'} Sep 07 09:48:24.794400 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5f143065-dfd4-4696-82be-e17b09d018a6 to delete Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.795339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f143065-dfd4-4696-82be-e17b09d018a6 could not be found. Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:24.796672 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:24.798135 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:24.802470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0a8690cb-15db-4334-9ebf-80672544a5cb tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:24.807410 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0a8690cb-15db-4334-9ebf-80672544a5cb tempest-ImagesDeleteNegativeTestJSON-296972395 tempest-ImagesDeleteNegativeTestJSON-296972395-project] 10.222.0.60 "DELETE /compute/v2.1/images/5f143065-dfd4-4696-82be-e17b09d018a6" status: 404 len: 62 microversion: 2.1 time: 0.054468 Sep 07 09:48:24.808497 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 544/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:24 2022] DELETE /compute/v2.1/images/5f143065-dfd4-4696-82be-e17b09d018a6 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:24.814041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.826462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.827136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.827747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.828678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.833202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.833937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.845769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:24.867411 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-323c7c8a-681f-4060-a17c-9221cb398ee2 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.055891 Sep 07 09:48:24.879833 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 545/1100] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 7 09:48:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:24.885169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:24.886582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:24.893317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.893854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.895551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:24.895551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:24.895551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:24.898310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.225600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:25.270219 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dca959cf-9b20-4c39-a6dc-a88118895c27 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1283 microversion: 2.1 time: 0.386581 Sep 07 09:48:25.271670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 546/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:24 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1283 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:25.283647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:25.296462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.297397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.299745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.302199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.303681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.310096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.311040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:25.368667 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e8c4b9e-ecf7-4d3e-a6ce-cdea24945481 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-836830-16&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.095417 Sep 07 09:48:25.370138 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 547/1102] 10.222.0.60 () {60 vars in 1237 bytes} [Wed Sep 7 09:48:25 2022] GET /compute/v2.1/os-services?host=n-d-836830-16&binary=xxx => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:25.384729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:25.392486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.395425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.396359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.397402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.399655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.400285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.444948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:25.445691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:25.446326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:25.446896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:25.447704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:25.456989 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac2fa29e-1423-4c84-a2b2-1a0ec5198368 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.076395 Sep 07 09:48:25.463198 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 548/1103] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 7 09:48:25 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:48:25.466491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.467178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.467787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.468697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.469343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.469947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.478646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:25.487574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.488087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.488535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.489425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.489816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.490253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.493304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Getting quotas for project 5d25e4d5134e4526b920b9290e029326. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:25.499870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Getting quotas for user cdd30133cecc4bf8b2f1fc05921c7af9 and project 5d25e4d5134e4526b920b9290e029326. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:25.514838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.utils [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] cores quota exceeded for 5d25e4d5134e4526b920b9290e029326, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128833) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 07 09:48:25.516015 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Request method failure captured: Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 145 Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjlrQTI0qxAbsx6kCrlG_UkctRqda3kYxaVRmVS3NalzC3jmtjoqTd21XqKywn2Sw5O2NMwFKfqkk8lDL_JlbWunhhVcZeFQo622NFOMIk9ZVRScadZdtZNFwJghFqQLCWuUcqhm44Cj_sp3BGfmcLUO0TLPn4wrfi7xtJ0av8q6TA Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:25.519854 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d25e4d5134e4526b920b9290e029326", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: cdd30133cecc4bf8b2f1fc05921c7af9 Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2053879708", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} Sep 07 09:48:25.521521 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2053879708', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452'}}} Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 09:48:25.522425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:25.523802 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.525531 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:25.527731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:25.527731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:25.527731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:25.527731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:25.527731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 09:48:25.527731 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.529717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:25.531222 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e151ba3d-28ff-4a7f-b34d-27b66442c234 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.900165 Sep 07 09:48:25.532830 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 556/1104] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:24 2022] POST /compute/v2.1/servers => generated 111 bytes in 902 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:25.542075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1c0e700>, body: {"quota_set": {"cores": 20}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:25.552969 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14bd79fa-2598-4a81-81cc-3c15cdd92a67 tempest-ServicesAdminNegativeV253TestJSON-1824104125 tempest-ServicesAdminNegativeV253TestJSON-1824104125-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.082828 Sep 07 09:48:25.561507 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 549/1105] 10.222.0.60 () {60 vars in 1239 bytes} [Wed Sep 7 09:48:25 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:25.953371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d705a5a6-8387-491a-8073-4bccca326d17 tempest-ServicesAdminNegativeV253TestJSON-698710006 tempest-ServicesAdminNegativeV253TestJSON-698710006-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:25.958947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d705a5a6-8387-491a-8073-4bccca326d17 tempest-ServicesAdminNegativeV253TestJSON-698710006 tempest-ServicesAdminNegativeV253TestJSON-698710006-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '96041b793a0744f7a3a517032b4d24f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5109e36199984d579203e305043c7537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d705a5a6-8387-491a-8073-4bccca326d17 tempest-ServicesAdminNegativeV253TestJSON-698710006 tempest-ServicesAdminNegativeV253TestJSON-698710006-project] Request method failure captured: Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjl5cbd76agXowvqms3e1Xrh5t4i_O3wu3TlTeHYJAutbmQsQwkqqYYGdaHqnzk9QWp5U3PeBzL2uRoIVuavn8Ln8Adfb9ezdquTW-GSstXmWXydQlygEW70XtbzsZqvi1al1bY6P1tZKlMuQJPehZkBt7opmJzp2aFAletw9EppII Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5109e36199984d579203e305043c7537 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-698710006 Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:25.964169 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5109e36199984d579203e305043c7537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5109e36199984d579203e305043c7537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5109e36199984d579203e305043c7537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5109e36199984d579203e305043c7537", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-698710006 Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5109e36199984d579203e305043c7537 Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-698710006 Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServicesAdminNegativeV253TestJSON-698710006-project Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 96041b793a0744f7a3a517032b4d24f6 Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-698710006-project Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 09:48:25.965566 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:25.966386 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 09:48:25.967725 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:25.969100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d705a5a6-8387-491a-8073-4bccca326d17 tempest-ServicesAdminNegativeV253TestJSON-698710006 tempest-ServicesAdminNegativeV253TestJSON-698710006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:25.969100 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d705a5a6-8387-491a-8073-4bccca326d17 tempest-ServicesAdminNegativeV253TestJSON-698710006 tempest-ServicesAdminNegativeV253TestJSON-698710006-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.403664 Sep 07 09:48:25.971104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.971606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.972051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.977286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 550/1106] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 7 09:48:25 2022] GET /compute/v2.1/os-services => generated 112 bytes in 415 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Sep 07 09:48:25.978695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:25.979770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:25.980427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:25.987968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:25.989454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:26.000269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:26.000777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:26.001288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:26.001969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:26.002492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:26.002999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:26.207696 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fea63100-7e19-4aca-9941-2a395b9ad552 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 329 microversion: 2.1 time: 0.669520 Sep 07 09:48:26.208894 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 557/1107] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:25 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 329 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:26.225663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-43a37221-7f24-4dc8-ac97-5fa26891e534 req-ccc85268-3a5a-484e-a16e-3f28f18ee368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c670f25-8fd6-4cb0-8f33-b8544182fa74", "tag": "3089b6fa-f731-4eac-8874-7cddb46b3a8d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:26.282505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-43a37221-7f24-4dc8-ac97-5fa26891e534 req-ccc85268-3a5a-484e-a16e-3f28f18ee368 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:26.282865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-43a37221-7f24-4dc8-ac97-5fa26891e534 req-ccc85268-3a5a-484e-a16e-3f28f18ee368 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:26.283315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-43a37221-7f24-4dc8-ac97-5fa26891e534 req-ccc85268-3a5a-484e-a16e-3f28f18ee368 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:26.310276 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-43a37221-7f24-4dc8-ac97-5fa26891e534 req-ccc85268-3a5a-484e-a16e-3f28f18ee368 service nova] Creating event network-changed:3089b6fa-f731-4eac-8874-7cddb46b3a8d for instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 on n-h2-836830-16 Sep 07 09:48:26.343517 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-43a37221-7f24-4dc8-ac97-5fa26891e534 req-ccc85268-3a5a-484e-a16e-3f28f18ee368 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123339 Sep 07 09:48:26.347487 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 558/1108] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:26.355840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e8ca930-f7f0-46ed-ae4d-6449fa52e1fc tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Calling method '.version_select at 0x7f14b1c0ea60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:26.801243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:26.811770 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-47ee68f9-63be-4311-86ef-81193abfe0fd tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.833333 Sep 07 09:48:26.832091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 551/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:25 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:26.842320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:26.846968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:26.861629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:26.864526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:26.865529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:26.866587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:26.868998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:26.870550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:27.003651 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e8ca930-f7f0-46ed-ae4d-6449fa52e1fc tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 371 microversion: 2.1 time: 0.653533 Sep 07 09:48:27.010727 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 559/1110] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 09:48:26 2022] GET /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 371 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:27.019619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1b78160>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:27.428829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:27.429348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:27.429798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:27.430527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:27.430983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:27.431406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:27.564334 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1b7ca04-4aa8-4dab-ad9d-baa03c14b493 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 328 microversion: 2.1 time: 0.550866 Sep 07 09:48:27.565851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 560/1111] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:27 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:27.610295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:27.627054 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b2e5356-13e1-4f66-a504-6d431b1f0e78 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.793257 Sep 07 09:48:27.627657 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 552/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:26 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:27.791342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-752127901", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:27.840537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:27.841990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:27.858576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:27.860417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:27.862578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:27.863631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:27.864640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:27.873296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:27.888262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:28.342526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:28.352532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6aa4f06-14f1-4d96-85b6-d71e7132b87a tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.515836 Sep 07 09:48:28.376880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 553/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:27 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:28.527153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:28.527762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:28.528186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:28.528596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:28.529006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:28.545009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:28.545557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:28.546154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:28.547340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:28.547815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:28.548704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:28.573622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Getting quotas for project 5d25e4d5134e4526b920b9290e029326. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:28.579970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Getting quotas for user cdd30133cecc4bf8b2f1fc05921c7af9 and project 5d25e4d5134e4526b920b9290e029326. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:28.602186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.utils [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] instances quota exceeded for 5d25e4d5134e4526b920b9290e029326, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128833) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 07 09:48:28.602957 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Request method failure captured: Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 144 Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjlrQTI0qxAbsx6kCrlG_UkctRqda3kYxaVRmVS3NalzC3jmtjoqTd21XqKywn2Sw5O2NMwFKfqkk8lDL_JlbWunhhVcZeFQo622NFOMIk9ZVRScadZdtZNFwJghFqQLCWuUcqhm44Cj_sp3BGfmcLUO0TLPn4wrfi7xtJ0av8q6TA Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:28.605458 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d25e4d5134e4526b920b9290e029326", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: cdd30133cecc4bf8b2f1fc05921c7af9 Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-752127901", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} Sep 07 09:48:28.607024 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-752127901', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452'}}} Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 09:48:28.607792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:28.608866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.611353 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f80cc295-7b9a-43d5-b936-77c711bed086 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.825027 Sep 07 09:48:28.614164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 561/1114] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:27 2022] POST /compute/v2.1/servers => generated 119 bytes in 829 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:28.626043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1b7fa60>, body: {"quota_set": {"instances": 10}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:28.801070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-307ed0ff-c386-4cd2-996f-1e5aa39d73f7 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1c28af0>, body: {"keypair": {"name": "tempest-keypair-344248120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo+WWbnACt9L6KwdKhPliOyIeYTK6pZWLA7/oA6hR5CNRj0E6io6m4uy9H2qlFO/En0N4O6rG6r4va2NQAxLQxBi+8x5PGPZWyRXg8A/GvL0+lxDeJOxIQjbyb35Mq88A=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:28.839253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-307ed0ff-c386-4cd2-996f-1e5aa39d73f7 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:28.859325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-307ed0ff-c386-4cd2-996f-1e5aa39d73f7 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:28.893054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:28.893628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:28.894048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:28.894779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:28.895239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:28.895871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:28.902904 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-307ed0ff-c386-4cd2-996f-1e5aa39d73f7 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.529766 Sep 07 09:48:28.909801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 554/1115] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 537 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 09:48:28.920026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:28.920668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:28.933364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:28.934830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:28.935786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:28.935927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:28.937961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:28.938420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:28.938868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:28.985126 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25ba3475-2104-44ff-9cd9-8213b8eb0d59 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 329 microversion: 2.1 time: 0.367957 Sep 07 09:48:28.993440 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 562/1116] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:28 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 329 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:28.993440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-201ce5dd-0e34-40ee-8a8f-1d48c2e44b64 req-01e87ca0-5568-4e41-b83f-f1c32a084fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a", "tag": "8d92969e-86af-4173-bc21-5b5132271027"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.003261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-201ce5dd-0e34-40ee-8a8f-1d48c2e44b64 req-01e87ca0-5568-4e41-b83f-f1c32a084fa7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:29.003903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-201ce5dd-0e34-40ee-8a8f-1d48c2e44b64 req-01e87ca0-5568-4e41-b83f-f1c32a084fa7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:29.004338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-201ce5dd-0e34-40ee-8a8f-1d48c2e44b64 req-01e87ca0-5568-4e41-b83f-f1c32a084fa7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:29.015856 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-201ce5dd-0e34-40ee-8a8f-1d48c2e44b64 req-01e87ca0-5568-4e41-b83f-f1c32a084fa7 service nova] Creating event network-changed:8d92969e-86af-4173-bc21-5b5132271027 for instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a on n-h1-836830-16 Sep 07 09:48:29.020629 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-201ce5dd-0e34-40ee-8a8f-1d48c2e44b64 req-01e87ca0-5568-4e41-b83f-f1c32a084fa7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 Sep 07 09:48:29.021635 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 563/1117] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:29.028267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96e7d9a9-5caa-49cd-8020-126cb95688f5 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b80820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.037583 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96e7d9a9-5caa-49cd-8020-126cb95688f5 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-344248120" status: 200 len: 511 microversion: 2.2 time: 0.014582 Sep 07 09:48:29.038145 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 564/1118] 10.222.0.60 () {60 vars in 1255 bytes} [Wed Sep 7 09:48:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-344248120 => generated 511 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:29.047127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-362f996b-c204-466b-a8f4-92bd2d05e8be tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Calling method '.version_select at 0x7f14b1b90040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.144895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:29.153819 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a0e3f8a6-3ade-4f55-ae65-576176c10095 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.242942 Sep 07 09:48:29.154375 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 555/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:28 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:29.159043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d837a2d-6ba8-4eef-93bf-31e75be3b994 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1c35280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.189671 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d837a2d-6ba8-4eef-93bf-31e75be3b994 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344248120" status: 204 len: 0 microversion: 2.2 time: 0.032768 Sep 07 09:48:29.190409 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 556/1120] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Sep 7 09:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344248120 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:29.203112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dcb6d2b4-232a-4910-994d-4bc3f3a9d5a5 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1c3c9d0>, body: {"keypair": {"name": "tempest-keypair-2067544193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtrOtemP5xnBne8uYvKmfOHHaIFFUD9n+KV/0OcAvXaCKBTcQtT4AcFNffugwqkuTl9Rc1E62g9zw2NXcZiCBZ7QBBO2F4spgIKllHXUD0aHDcV0UIltSQ3RqEtIPccMw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.220611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dcb6d2b4-232a-4910-994d-4bc3f3a9d5a5 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:29.225836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dcb6d2b4-232a-4910-994d-4bc3f3a9d5a5 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:29.251705 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dcb6d2b4-232a-4910-994d-4bc3f3a9d5a5 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.052722 Sep 07 09:48:29.252617 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 557/1121] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 07 09:48:29.264875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-994170e9-99d1-415c-bf3b-4660b241ae9e tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1c1cf70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.287006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-994170e9-99d1-415c-bf3b-4660b241ae9e tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067544193" status: 204 len: 0 microversion: 2.2 time: 0.027698 Sep 07 09:48:29.287614 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 558/1122] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 7 09:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067544193 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:29.299311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19911222-3b05-4674-897a-a582e19425a3 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1c285e0>, body: {"keypair": {"name": "tempest-keypair-2113574786", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.319572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-19911222-3b05-4674-897a-a582e19425a3 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:29.325372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-19911222-3b05-4674-897a-a582e19425a3 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:29.351143 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-362f996b-c204-466b-a8f4-92bd2d05e8be tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 371 microversion: 2.1 time: 0.311915 Sep 07 09:48:29.351698 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 565/1123] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 09:48:29 2022] GET /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:29.356036 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19911222-3b05-4674-897a-a582e19425a3 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.061889 Sep 07 09:48:29.356639 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 559/1124] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:29 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 07 09:48:29.367226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1bb1c10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.491926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65d1bd87-f0b1-44be-ba74-b3720bc41c33 tempest-ListImageFiltersNegativeTestJSON-903258066 tempest-ListImageFiltersNegativeTestJSON-903258066-project] Calling method '.version_select at 0x7f14b1b90b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.509310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:29.509772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:29.510842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:29.511737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:29.512202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:29.512701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:29.513239 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-65d1bd87-f0b1-44be-ba74-b3720bc41c33 tempest-ListImageFiltersNegativeTestJSON-903258066 tempest-ListImageFiltersNegativeTestJSON-903258066-project] HTTP exception thrown: Image not found. Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65d1bd87-f0b1-44be-ba74-b3720bc41c33 tempest-ListImageFiltersNegativeTestJSON-903258066 tempest-ListImageFiltersNegativeTestJSON-903258066-project] Request method failure captured: Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/images/7e8aa58a-7f3e-4bd5-97cc-4f5460c29191 HTTP/1.1 Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGjtVcP39kzLywQEb20tFYgkze_8FXJKGriVNK1N2g8sQ3SPT1o3Xt4CCQLIOkxoG9tFFtnrofOwMwR6CUkvs7nSEs2QHs7uOfp7kD_TeGertmV22_s2zruni_3pw_xb7WSc91ghbew03Z1DmBP0YJOPhMVYYXg8G48zhz44YfxiSKM Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c337890a430141b6ade2ab6a7f04a611 Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-903258066 Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:29.515424 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c337890a430141b6ade2ab6a7f04a611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c337890a430141b6ade2ab6a7f04a611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c337890a430141b6ade2ab6a7f04a611"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c337890a430141b6ade2ab6a7f04a611", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-903258066 Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c337890a430141b6ade2ab6a7f04a611 Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-903258066 Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListImageFiltersNegativeTestJSON-903258066-project Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 88aa0ac8732d4c6999b39985f753208f Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-903258066-project Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '7e8aa58a-7f3e-4bd5-97cc-4f5460c29191'} Sep 07 09:48:29.517034 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:29.518040 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7e8aa58a-7f3e-4bd5-97cc-4f5460c29191 Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:29.519357 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e8aa58a-7f3e-4bd5-97cc-4f5460c29191 could not be found. Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:29.520784 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:29.522013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65d1bd87-f0b1-44be-ba74-b3720bc41c33 tempest-ListImageFiltersNegativeTestJSON-903258066 tempest-ListImageFiltersNegativeTestJSON-903258066-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:29.523116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65d1bd87-f0b1-44be-ba74-b3720bc41c33 tempest-ListImageFiltersNegativeTestJSON-903258066 tempest-ListImageFiltersNegativeTestJSON-903258066-project] 10.222.0.60 "GET /compute/v2.1/images/7e8aa58a-7f3e-4bd5-97cc-4f5460c29191" status: 404 len: 62 microversion: 2.1 time: 0.157903 Sep 07 09:48:29.523116 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 566/1125] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:48:29 2022] GET /compute/v2.1/images/7e8aa58a-7f3e-4bd5-97cc-4f5460c29191 => generated 62 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:29.527136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c258502a-eb7f-4b07-875f-caaac7fed019 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b900d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.528243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:29.550264 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c258502a-eb7f-4b07-875f-caaac7fed019 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113574786" status: 204 len: 0 microversion: 2.2 time: 0.026596 Sep 07 09:48:29.550894 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 567/1126] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 7 09:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113574786 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:29.555772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.556665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:29.564399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:29.565343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:29.565791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:29.566638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:29.567102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:29.567796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:29.579976 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46476339-a40c-4175-8a49-842be050f3ce tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 325 microversion: 2.1 time: 0.216316 Sep 07 09:48:29.585223 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 560/1127] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:29 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:29.586087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c00c97c4-0dce-406a-8430-065c88c41556 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1c35ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1431541859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRXypBftdNPfPYADE9tMZujuKnNN9fAORFr2mzzal7MHDJPIlEzZPPlzLebpXNgbXzQ9KKwvV0Xu+MqXxeogdh3YoOu/BFzPfjZx4CAZEhYgsGW8ZGlAmrZWFBnKxt9SQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.605882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c00c97c4-0dce-406a-8430-065c88c41556 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:29.612055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c00c97c4-0dce-406a-8430-065c88c41556 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:29.644507 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c00c97c4-0dce-406a-8430-065c88c41556 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.062373 Sep 07 09:48:29.645108 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 561/1128] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 09:48:29.660807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5047f7f6-a89d-46f6-9116-63a8dc3d82ba tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1bb15e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1641212768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaQtYMzH29m89MYSjjhq0m/1Dqdt0tVugx4Yw1a1xW65zhEGbn6M8OzFSf85Kzz2ID4p0h486Scv2Hyw9eLrVyP2AQ4kd1KxqaIv/bmeBMQ5riv7RKbXclLHoJqHEzpow=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.679102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5047f7f6-a89d-46f6-9116-63a8dc3d82ba tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:29.692055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5047f7f6-a89d-46f6-9116-63a8dc3d82ba tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:29.743583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5047f7f6-a89d-46f6-9116-63a8dc3d82ba tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.087981 Sep 07 09:48:29.753682 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 562/1129] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 07 09:48:29.753682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1807793386", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.784810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:29.794965 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54b28ada-9fe7-44cb-85c2-81cf9d8f5f81 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.242825 Sep 07 09:48:29.813275 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 568/1130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:29 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:29.820859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c08e141c-1ad4-4082-8073-9394f7d778f8 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1b81280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1546416503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO1lGIINdv3Z3lJLtIk8rqz0rhTsMzQKKxIvnkZO5wcfrDtQg/D6Kx1b+WxLEL+cgIBXdPn/mfO9XioI4fRvK0QN15vlrwYGV4OI80tWss7m0xPukjbGaYOWby0cv8K2g=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:29.830162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:29.846306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c08e141c-1ad4-4082-8073-9394f7d778f8 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:29.852184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c08e141c-1ad4-4082-8073-9394f7d778f8 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:29.880411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c08e141c-1ad4-4082-8073-9394f7d778f8 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.065895 Sep 07 09:48:29.881006 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 569/1131] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 09:48:29.892686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7908ec09-87ec-4a83-9907-e0ea92e312cd tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b7f9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.896498 n-d-836830-16 devstack@n-api.service[128833]: WARNING oslo_db.sqlalchemy.utils [None req-7908ec09-87ec-4a83-9907-e0ea92e312cd tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 09:48:29.902114 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7908ec09-87ec-4a83-9907-e0ea92e312cd tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.013239 Sep 07 09:48:29.902972 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 570/1132] 10.222.0.60 () {60 vars in 1177 bytes} [Wed Sep 7 09:48:29 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:29.915478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26644f98-a6a8-498a-840a-e23bb38bfbaa tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1d343a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.937618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26644f98-a6a8-498a-840a-e23bb38bfbaa tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1546416503" status: 204 len: 0 microversion: 2.2 time: 0.025768 Sep 07 09:48:29.938088 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 571/1133] 10.222.0.60 () {60 vars in 1321 bytes} [Wed Sep 7 09:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1546416503 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:29.947185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d3cf71bc-003e-464d-b625-ddbbc0f3d930 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1d154c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.967776 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d3cf71bc-003e-464d-b625-ddbbc0f3d930 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1641212768" status: 204 len: 0 microversion: 2.2 time: 0.025441 Sep 07 09:48:29.969417 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 572/1134] 10.222.0.60 () {60 vars in 1321 bytes} [Wed Sep 7 09:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1641212768 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:48:29.976844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d713fc0-4486-4025-8b2c-e09f48cb1ab1 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b894c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:29.997628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d713fc0-4486-4025-8b2c-e09f48cb1ab1 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1431541859" status: 204 len: 0 microversion: 2.2 time: 0.024514 Sep 07 09:48:29.998219 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 573/1135] 10.222.0.60 () {60 vars in 1321 bytes} [Wed Sep 7 09:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1431541859 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:48:30.011114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2347462a-286c-4ea3-906f-5397206a0139 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1d035e0>, body: {"keypair": {"name": "tempest-keypair-662726861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCz29I7vCQS15rnT/eo2MO7i5hYTosrIy0Z9cLzF4zDa8MXfkozYcyM8mxvga45lH1ouCvIn0J8cyPvrnq18izdNPPmRidufeqlJHrGneHsrIIyGkUV/5ugChN03MsMTg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:30.027691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2347462a-286c-4ea3-906f-5397206a0139 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:30.034503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2347462a-286c-4ea3-906f-5397206a0139 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:30.056545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:30.057106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:30.057774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:30.058197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:30.058634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:30.066741 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2347462a-286c-4ea3-906f-5397206a0139 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.059899 Sep 07 09:48:30.068186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 574/1136] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 7 09:48:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 09:48:30.075780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.076531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.077141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.078083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.078799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.079422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.082892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30b55dd0-7db4-4759-8661-57c03198943c tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1d343a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:30.095224 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30b55dd0-7db4-4759-8661-57c03198943c tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-662726861" status: 200 len: 512 microversion: 2.2 time: 0.018138 Sep 07 09:48:30.097894 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 575/1137] 10.222.0.60 () {60 vars in 1255 bytes} [Wed Sep 7 09:48:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-662726861 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:30.101561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Getting quotas for project 5d25e4d5134e4526b920b9290e029326. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:30.108310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Getting quotas for user cdd30133cecc4bf8b2f1fc05921c7af9 and project 5d25e4d5134e4526b920b9290e029326. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:30.110208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ddf03ac-4dff-4019-b622-b004fad8bc29 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1d15280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:30.114354 n-d-836830-16 devstack@n-api.service[128833]: WARNING oslo_db.sqlalchemy.utils [None req-7ddf03ac-4dff-4019-b622-b004fad8bc29 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 09:48:30.121760 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ddf03ac-4dff-4019-b622-b004fad8bc29 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.016584 Sep 07 09:48:30.124287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.utils [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] ram quota exceeded for 5d25e4d5134e4526b920b9290e029326, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128832) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 07 09:48:30.125225 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 09:48:30.128894 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 576/1138] 10.222.0.60 () {60 vars in 1177 bytes} [Wed Sep 7 09:48:30 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Request method failure captured: Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 145 Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjlrQTI0qxAbsx6kCrlG_UkctRqda3kYxaVRmVS3NalzC3jmtjoqTd21XqKywn2Sw5O2NMwFKfqkk8lDL_JlbWunhhVcZeFQo622NFOMIk9ZVRScadZdtZNFwJghFqQLCWuUcqhm44Cj_sp3BGfmcLUO0TLPn4wrfi7xtJ0av8q6TA Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:30.129101 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d25e4d5134e4526b920b9290e029326", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: cdd30133cecc4bf8b2f1fc05921c7af9 Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1807793386", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} Sep 07 09:48:30.130753 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1807793386', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452'}}} Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 09:48:30.131742 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:30.133166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.134699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:30.137067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d464964-49fd-4adf-93fd-421917deb5d3 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.382070 Sep 07 09:48:30.139601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-657a48f0-2696-46a9-b276-86cf4a730fa7 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b79b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:30.139703 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 563/1139] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:30.140830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1c28ee0>, body: {"quota_set": {"ram": 51200}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:30.166036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-657a48f0-2696-46a9-b276-86cf4a730fa7 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662726861" status: 204 len: 0 microversion: 2.2 time: 0.035441 Sep 07 09:48:30.168259 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 577/1140] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Sep 7 09:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662726861 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:30.183272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:30.185111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:30.194454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.194961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.195627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.196601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.197060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.197604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.389739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.390335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.390850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.391837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.392386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.393478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.427334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:30.435857 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-784d22dc-8af1-4199-a90e-b56cf50c4215 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.260132 Sep 07 09:48:30.436430 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 578/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:30 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:30.441379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Action: 'create', calling method: .version_select at 0x7f14b1b81550>, body: {"keypair": {"name": "tempest-keypair-1022299035", "type": "x509"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:30.463841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:30.469766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:30.470414 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-33520ca6-49b6-4d7e-b85a-5de6320b2265 tempest-QuotasAdminNegativeTest-1318370602 tempest-QuotasAdminNegativeTest-1318370602-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 200 len: 329 microversion: 2.1 time: 0.333849 Sep 07 09:48:30.471170 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 564/1142] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:30 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 329 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:30.476274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0d9e6f0e-e640-4f8b-8cd8-f49439df65c9 req-9ca103d9-c316-4a6a-af48-bfbaf748f48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16434926-5260-479a-a235-812a4f133852", "name": "network-vif-plugged", "status": "completed", "tag": "bbe522b0-498d-4b86-b8a0-06eb6119dc15"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:30.488486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.processutils [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcj8xv6nj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcj8xv6nj/temp.key -subj /CN=542baf0e876146758e177c2d3deeab87 -extensions v3_req_client {{(pid=128833) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 07 09:48:30.494795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d9e6f0e-e640-4f8b-8cd8-f49439df65c9 req-9ca103d9-c316-4a6a-af48-bfbaf748f48e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.495393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d9e6f0e-e640-4f8b-8cd8-f49439df65c9 req-9ca103d9-c316-4a6a-af48-bfbaf748f48e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.495875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d9e6f0e-e640-4f8b-8cd8-f49439df65c9 req-9ca103d9-c316-4a6a-af48-bfbaf748f48e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.509367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0d9e6f0e-e640-4f8b-8cd8-f49439df65c9 req-9ca103d9-c316-4a6a-af48-bfbaf748f48e service nova] Creating event network-vif-plugged:bbe522b0-498d-4b86-b8a0-06eb6119dc15 for instance 16434926-5260-479a-a235-812a4f133852 on n-h2-836830-16 Sep 07 09:48:30.515606 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0d9e6f0e-e640-4f8b-8cd8-f49439df65c9 req-9ca103d9-c316-4a6a-af48-bfbaf748f48e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042653 Sep 07 09:48:30.516207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 565/1143] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:30.523355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65de0d94-5d44-4145-80e5-3d8e1968f216 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Action: 'update', calling method: .version_select at 0x7f14b1c53d30>, body: {"quota_set": {"ram": 0}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:30.531844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65de0d94-5d44-4145-80e5-3d8e1968f216 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'cdd30133cecc4bf8b2f1fc05921c7af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d25e4d5134e4526b920b9290e029326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65de0d94-5d44-4145-80e5-3d8e1968f216 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Request method failure captured: Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 HTTP/1.1 Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 25 Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjlrQTI0qxAbsx6kCrlG_UkctRqda3kYxaVRmVS3NalzC3jmtjoqTd21XqKywn2Sw5O2NMwFKfqkk8lDL_JlbWunhhVcZeFQo622NFOMIk9ZVRScadZdtZNFwJghFqQLCWuUcqhm44Cj_sp3BGfmcLUO0TLPn4wrfi7xtJ0av8q6TA Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:30.534111 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d25e4d5134e4526b920b9290e029326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d25e4d5134e4526b920b9290e029326", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5d25e4d5134e4526b920b9290e029326 Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-346714276 Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: cdd30133cecc4bf8b2f1fc05921c7af9 Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-QuotasAdminNegativeTest-346714276-project Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: {"quota_set": {"ram": 0}} Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 07 09:48:30.536734 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5d25e4d5134e4526b920b9290e029326', 'body': {'quota_set': {'ram': 0}}} Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:30.538340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.539702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:30.541333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:30.541333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:30.541333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:30.541333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:30.541333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 07 09:48:30.541333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:30.543545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65de0d94-5d44-4145-80e5-3d8e1968f216 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:30.544628 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65de0d94-5d44-4145-80e5-3d8e1968f216 tempest-QuotasAdminNegativeTest-346714276 tempest-QuotasAdminNegativeTest-346714276-project] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326" status: 403 len: 116 microversion: 2.1 time: 0.026831 Sep 07 09:48:30.545417 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 566/1144] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 09:48:30 2022] PUT /compute/v2.1/os-quota-sets/5d25e4d5134e4526b920b9290e029326 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:30.731962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.processutils [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcj8xv6nj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcj8xv6nj/temp.key -subj /CN=542baf0e876146758e177c2d3deeab87 -extensions v3_req_client" returned: 0 in 0.243s {{(pid=128833) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 07 09:48:30.733838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.processutils [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcj8xv6nj/temp.key -password pass: {{(pid=128833) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 07 09:48:30.762726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.processutils [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcj8xv6nj/temp.key -password pass:" returned: 0 in 0.028s {{(pid=128833) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 07 09:48:30.819055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:30.820204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:30.862229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.867385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.868047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.869646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:30.870494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:30.871830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:30.878975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:30.895488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Getting quotas for user 542baf0e876146758e177c2d3deeab87 and project c611f42076374141b07ca790bd97b8a7. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:30.937540 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-329a3a18-1ef1-44ae-bf5e-418b4a6533c9 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.499727 Sep 07 09:48:30.942131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 579/1145] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Sep 7 09:48:30 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 505 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:30.959349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5006d775-70cf-4a67-b07f-da96f21b19fb tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b81040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:30.983295 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5006d775-70cf-4a67-b07f-da96f21b19fb tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1022299035" status: 200 len: 1534 microversion: 2.2 time: 0.033477 Sep 07 09:48:30.984289 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 580/1146] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Sep 7 09:48:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1022299035 => generated 1534 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:31.000470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-797b411f-c2ea-4c5f-b3b9-4ff3cc0a8004 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b82b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:31.005541 n-d-836830-16 devstack@n-api.service[128833]: WARNING oslo_db.sqlalchemy.utils [None req-797b411f-c2ea-4c5f-b3b9-4ff3cc0a8004 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 09:48:31.011698 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-797b411f-c2ea-4c5f-b3b9-4ff3cc0a8004 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.015593 Sep 07 09:48:31.012624 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 581/1147] 10.222.0.60 () {60 vars in 1177 bytes} [Wed Sep 7 09:48:30 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:31.026667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9a8432ec-a34f-4d4c-96ff-b4f66f46c695 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] Calling method '.version_select at 0x7f14b1b7fe50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:31.053341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9a8432ec-a34f-4d4c-96ff-b4f66f46c695 tempest-KeyPairsV22TestJSON-337662861 tempest-KeyPairsV22TestJSON-337662861-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022299035" status: 204 len: 0 microversion: 2.2 time: 0.032301 Sep 07 09:48:31.056790 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 582/1148] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 7 09:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022299035 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:31.262906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:31.273450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c7739cc-4960-446c-8cd3-2b81c48bfe76 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1313 microversion: 2.1 time: 0.458025 Sep 07 09:48:31.274464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 567/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:30 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:31.460062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:31.461010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:31.476302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:31.478962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:31.479537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:31.479990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:31.482280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:31.482755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:31.483225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:31.669128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:31.678116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91d656c2-f4ca-4a07-bef2-01d45530626d tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.221846 Sep 07 09:48:31.678960 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 583/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:31 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:31.738384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Calling method '.version_select at 0x7f14b1c2d9d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:31.750211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:31.750699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:31.751143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:31.751870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:31.752329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:31.752850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:31.774584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6ade61e-e20e-4f4e-a206-d4679b4b5650 tempest-AbsoluteLimitsTestJSON-1612995681 tempest-AbsoluteLimitsTestJSON-1612995681-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.197838 Sep 07 09:48:31.775499 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 568/1151] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 7 09:48:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:32.103897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:32.105598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:32.112576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:32.113448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:32.114064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:32.114919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:32.115527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:32.115941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:32.282752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:32.289408 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd357649-eff4-4371-a986-c18eb77d4e9d tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1862 microversion: 2.1 time: 0.189115 Sep 07 09:48:32.290521 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 584/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:32 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1862 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:32.298196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:32.302782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:32.330033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:32.330605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:32.331051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:32.331755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:32.333965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:32.336600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:32.338892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:32.341763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:32.364108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:32.365820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:32.366340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:32.368987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:32.372354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:32.373204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:32.417655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lazy-loading 'flavor' on Instance uuid ddc44587-4609-4b49-84a9-761bdb462451 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:32.435938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Going to try to live migrate instance to n-h2-836830-16 {{(pid=128833) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:48:32.658226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:32.672083 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-07042716-542c-4e36-8894-83eb6bbcd959 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1462 microversion: 2.1 time: 0.377763 Sep 07 09:48:32.673930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 569/1153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:32 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1462 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:33.320748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Calling method '.version_select at 0x7f14b1c53040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:33.353311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:33.355979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:33.356850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:33.379657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:33.380382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:33.381015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:33.424620 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d0b8506-f4aa-478d-b4f3-51cf27098864 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/c4da1c88277749c48367e016f6cb7b91?start=2022-09-06T09%3A48%3A32.696651&end=2022-09-08T09%3A48%3A32.696651" status: 200 len: 694 microversion: 2.1 time: 0.723022 Sep 07 09:48:33.425812 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 570/1154] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Sep 7 09:48:32 2022] GET /compute/v2.1/os-simple-tenant-usage/c4da1c88277749c48367e016f6cb7b91?start=2022-09-06T09%3A48%3A32.696651&end=2022-09-08T09%3A48%3A32.696651 => generated 694 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:33.430790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:33.431404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:33.450826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:33.451326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:33.453292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:33.454209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:33.454835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:33.455429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:33.685292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:33.696357 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2d6a0b61-0f10-4ac9-8f79-6667761cd975 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.269298 Sep 07 09:48:33.696900 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 571/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:33 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:33.970708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc11fc3c-e3e4-4a22-b298-324e1642991e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/action" status: 202 len: 0 microversion: 2.1 time: 1.661009 Sep 07 09:48:33.972102 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 585/1156] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:48:32 2022] POST /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/action => generated 0 bytes in 1664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:48:33.982185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '.version_select at 0x7f14b1b99700>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:33.997626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:33.999017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:33.999514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.021060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.021843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.022656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.048555 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8ade657-1167-4577-bf02-0cd26c157088 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/c4da1c88277749c48367e016f6cb7b91?start=2022-09-06T09%3A48%3A32.696651&end=2022-09-08T09%3A48%3A32.696651" status: 200 len: 694 microversion: 2.1 time: 0.070902 Sep 07 09:48:34.049673 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 586/1157] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Sep 7 09:48:33 2022] GET /compute/v2.1/os-simple-tenant-usage/c4da1c88277749c48367e016f6cb7b91?start=2022-09-06T09%3A48%3A32.696651&end=2022-09-08T09%3A48%3A32.696651 => generated 694 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:34.061272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:34.064631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:34.077701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.078641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.079492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.080814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.081322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.082985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.094734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6c913916-5625-4564-81ca-b4b1387c31a7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:34.097841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:34.111485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.114419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.115678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.116644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.119116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.120667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.360774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] HTTP exception thrown: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Request method failure captured: Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments/d0abc92a-c558-4298-be4a-b020643c549c HTTP/1.1 Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 74 Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGiY_EJDexYROTwVJIAA1drQm5jMnHdul8TaVZSNcTgPsssQdMXUq3lfYFzdqvthjRVbHJ4njwikagCfGIG__6ChdIWk7Ooxx3e3uzvZt8T1IaVbHJR3uiHHSqM__xyqxQxfpypA1c-FF0jj-7qx2Z9L9EbWHapxlyoZoFMRbyS3rtg Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 4205fd3d83614bca9b47239065393c52 Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesAdminNegativeTest-1059058548 Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:48:34.366252 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4205fd3d83614bca9b47239065393c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4205fd3d83614bca9b47239065393c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4205fd3d83614bca9b47239065393c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4205fd3d83614bca9b47239065393c52", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesAdminNegativeTest-1059058548 Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 4205fd3d83614bca9b47239065393c52 Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1059058548 Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesAdminNegativeTest-1059058548-project-admin Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4b3e11edc3c14f738d9a01ac20092fd3 Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesAdminNegativeTest-1059058548-project-admin Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: {"volumeAttachment": {"volumeId": "6c913916-5625-4564-81ca-b4b1387c31a7"}} Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:34.367979 n-d-836830-16 devstack@n-api.service[128832]: exception: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': '193776ce-cebb-4703-b48b-c40e206b21ea', 'id': 'd0abc92a-c558-4298-be4a-b020643c549c', 'body': {'volumeAttachment': {'volumeId': '6c913916-5625-4564-81ca-b4b1387c31a7'}}} Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 09:48:34.369145 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. (HTTP 404) (Request-ID: req-a1566f6d-ab6b-4bbb-a8d0-5049e6f1fb98) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 09:48:34.370981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:34.372289 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. Sep 07 09:48:34.373835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:34.378053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Returning 400 to user: Volume 6c913916-5625-4564-81ca-b4b1387c31a7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:34.379567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8bb69cde-afad-467d-8bbf-33e9b5ee110a tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments/d0abc92a-c558-4298-be4a-b020643c549c" status: 400 len: 107 microversion: 2.1 time: 0.679884 Sep 07 09:48:34.380275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 572/1158] 10.222.0.60 () {60 vars in 1433 bytes} [Wed Sep 7 09:48:33 2022] PUT /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments/d0abc92a-c558-4298-be4a-b020643c549c => generated 107 bytes in 681 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:34.396172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Calling method '.version_select at 0x7f14b3bcfca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:34.408960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.412587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.413068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.448943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.453573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.454367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.472977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:34.533134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:34.550467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-181ddcd7-ca4e-410f-9f93-5c7e0417e0cf tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.499260 Sep 07 09:48:34.550815 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-886ff62d-74b1-4c91-8aa3-24aa84225d08 tempest-TenantUsagesTestJSON-1945032151 tempest-TenantUsagesTestJSON-1945032151-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T09%3A48%3A32.696651&end=2022-09-08T09%3A48%3A32.696651&detailed=1" status: 200 len: 12962 microversion: 2.1 time: 0.168302 Sep 07 09:48:34.552505 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 573/1159] 10.222.0.60 () {58 vars in 1335 bytes} [Wed Sep 7 09:48:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T09%3A48%3A32.696651&end=2022-09-08T09%3A48%3A32.696651&detailed=1 => generated 12962 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:48:34.578801 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 587/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:34 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:34.594449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:34.594963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:34.599218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:34.599925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:34.610593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.611208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.611646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.612358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.612811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.613246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.616146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.616712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.617145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.617874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.618490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.619115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.665209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:48:34.838700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca36a0ae-7bb3-4fc6-a229-0d01f1280a58 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "DELETE /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 204 len: 0 microversion: 2.1 time: 0.248400 Sep 07 09:48:34.842427 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 588/1161] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:48:34 2022] DELETE /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:34.866506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:34.867252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:34.873854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lazy-loading 'services' on Instance uuid 193776ce-cebb-4703-b48b-c40e206b21ea {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:34.903135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.906418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.907577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:34.908920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:34.909791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:34.911926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.100350 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c3358e04-6bc3-48fa-8c40-4c01cd0d2ebe tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments/d0abc92a-c558-4298-be4a-b020643c549c" status: 202 len: 0 microversion: 2.1 time: 0.518997 Sep 07 09:48:35.101307 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 574/1162] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 09:48:34 2022] DELETE /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments/d0abc92a-c558-4298-be4a-b020643c549c => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:48:35.119617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:35.121010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:35.136094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:35.140682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:35.142915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:35.143440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.144182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:35.147554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:35.148101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.158843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-512e6965-1d3f-4220-9426-f883fce1cd58 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.308356 Sep 07 09:48:35.163264 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 589/1163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:34 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:35.175758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:35.181831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:35.190945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:35.191573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:35.192109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.193324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:35.194041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:35.199560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.262705 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b4976aea-056b-4810-8e5f-a94f8ee39d98 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097251 Sep 07 09:48:35.264743 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 590/1164] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:35 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:35.598465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:35.599140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:35.630555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:35.631273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:35.631885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.632782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:35.633256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:35.634718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:35.762666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:35.782925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1e6ae3d-1421-44c6-97a0-b39d78d28550 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1468 microversion: 2.1 time: 0.675884 Sep 07 09:48:35.783530 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 575/1165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:35 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1468 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:35.888365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:35.911642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d79d714-4941-456f-b10f-825959729c52 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.317370 Sep 07 09:48:35.917258 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 591/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:35 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:36.194556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:36.196179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:36.212967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.216116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.218931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.221498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.222798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.224682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.278469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:36.281174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:36.312757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.313316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.316647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.317907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.318548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.320944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.407233 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7304b9a1-81a5-4c95-96f9-7998d4507203 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134471 Sep 07 09:48:36.409151 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 592/1167] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:36 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:48:36.808875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:36.809539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:36.820424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.820920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.825751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.826724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.827443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.828093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.907936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:36.918108 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b23e496a-2574-4287-9103-a0bdcdccc9da tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.730633 Sep 07 09:48:36.930234 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 576/1168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:36 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:36.940050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:36.940938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:36.952615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.953463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.954127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:36.955032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:36.957790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:36.958517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:37.937321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:37.984095 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42b21427-f02b-44e2-b1b5-9aa667fbc613 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1468 microversion: 2.1 time: 1.179245 Sep 07 09:48:37.987332 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 593/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:36 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1468 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:38.004651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:38.013415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:38.024421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:38.024918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:38.025410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:38.027501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:38.027974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:38.029093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:38.164726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:38.190304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ad5bd5b8-0fdc-47b5-b60b-e68264498530 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199387 Sep 07 09:48:38.190818 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 594/1170] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:37 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:38.195733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75eea8a7-19eb-440f-b3f6-bcc413627338 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 1.254422 Sep 07 09:48:38.196688 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 577/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:36 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:38.208118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:38.212399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:38.227315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:38.228074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:38.228796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:38.230130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:38.230838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:38.231493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:38.249843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7c249c2a-6295-4ee1-8ef0-d6c235b1b2a7 req-dea13a19-afe4-479c-832b-c0abb9772f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a", "name": "network-vif-plugged", "status": "completed", "tag": "8d92969e-86af-4173-bc21-5b5132271027"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:38.325506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7c249c2a-6295-4ee1-8ef0-d6c235b1b2a7 req-dea13a19-afe4-479c-832b-c0abb9772f74 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:38.326628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7c249c2a-6295-4ee1-8ef0-d6c235b1b2a7 req-dea13a19-afe4-479c-832b-c0abb9772f74 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:38.327289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7c249c2a-6295-4ee1-8ef0-d6c235b1b2a7 req-dea13a19-afe4-479c-832b-c0abb9772f74 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:38.357122 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7c249c2a-6295-4ee1-8ef0-d6c235b1b2a7 req-dea13a19-afe4-479c-832b-c0abb9772f74 service nova] Creating event network-vif-plugged:8d92969e-86af-4173-bc21-5b5132271027 for instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a on n-h1-836830-16 Sep 07 09:48:38.367001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7c249c2a-6295-4ee1-8ef0-d6c235b1b2a7 req-dea13a19-afe4-479c-832b-c0abb9772f74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174861 Sep 07 09:48:38.368002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 595/1172] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:38.380422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e81ff2b2-121d-4cb5-9cc4-5d8f7c368f4e req-8a984e21-e4c4-439c-9345-9e67714fb20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16434926-5260-479a-a235-812a4f133852", "name": "network-vif-deleted", "tag": "bbe522b0-498d-4b86-b8a0-06eb6119dc15"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:38.447303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e81ff2b2-121d-4cb5-9cc4-5d8f7c368f4e req-8a984e21-e4c4-439c-9345-9e67714fb20e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:38.448234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e81ff2b2-121d-4cb5-9cc4-5d8f7c368f4e req-8a984e21-e4c4-439c-9345-9e67714fb20e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:38.448848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e81ff2b2-121d-4cb5-9cc4-5d8f7c368f4e req-8a984e21-e4c4-439c-9345-9e67714fb20e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:38.529332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:38.539214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e81ff2b2-121d-4cb5-9cc4-5d8f7c368f4e req-8a984e21-e4c4-439c-9345-9e67714fb20e service nova] Creating event network-vif-deleted:bbe522b0-498d-4b86-b8a0-06eb6119dc15 for instance 16434926-5260-479a-a235-812a4f133852 on n-h2-836830-16 Sep 07 09:48:38.548237 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f8d1e323-58c9-4f0e-889b-56da9cb84635 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.348684 Sep 07 09:48:38.548865 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 578/1173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:38 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:38.566806 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e81ff2b2-121d-4cb5-9cc4-5d8f7c368f4e req-8a984e21-e4c4-439c-9345-9e67714fb20e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197155 Sep 07 09:48:38.568719 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 596/1174] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:39.015582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:39.016244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:39.046693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.049963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.050917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.053783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.054732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.058263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.172445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.173796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.174621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.175603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lazy-loading 'fault' on Instance uuid 16434926-5260-479a-a235-812a4f133852 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:48:39.204447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:39.210497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:39.231966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.237777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.239194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.240202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.242043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.245524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.268257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494063ae805e4de1a64e229a7cfc6d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4da1c88277749c48367e016f6cb7b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:39.278918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7bfd7dbb-127d-4716-8abc-eb0eb49217da tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 200 len: 1303 microversion: 2.1 time: 0.270383 Sep 07 09:48:39.283376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 579/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:39 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 1303 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:39.293831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:39.294509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:39.323872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.324374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.324806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.325565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.326018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.326447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.358289 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96cb70c2-ab2a-4887-8878-8bb5b61c2197 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158334 Sep 07 09:48:39.360667 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 597/1176] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:39 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:39.576660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:39.577928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:39.604264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.608571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.609670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.610650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:39.614714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:39.615819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:39.970794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:39.987216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94a703d3-6781-48a4-8f4f-0df17497875e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.701843 Sep 07 09:48:39.988078 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 580/1177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:39 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:40.159432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:40.193549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a98ebb50-4ffa-4bd1-be1d-df12f5353ef8 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1325 microversion: 2.1 time: 0.609677 Sep 07 09:48:40.196947 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 598/1178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:39 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1325 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:40.309117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:40.310342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] [instance: 16434926-5260-479a-a235-812a4f133852] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:40.326197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:40.340480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:40.342545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:40.343224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:40.344802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:40.346710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:40.351662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:40.375022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:40.382854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:40.419632 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] HTTP exception thrown: Instance 16434926-5260-479a-a235-812a4f133852 could not be found. Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Request method failure captured: Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 HTTP/1.1 Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGjcHM8A-VCw-v_lEkDDq8ku3uANOI4jsmfaj5M5MI3PO5rex1mpurFVu0QdlLWpK216nF4Jnn_3gxptHuoHKySpL5hUjYcaciPanFOofiB7ew7cn9gKLiH28_cBmEmwhtC1MCjK07LfEZZGTtZpkxTlF8K3kB12uqHnkoNBBcsCweg Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c4da1c88277749c48367e016f6cb7b91 Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TenantUsagesTestJSON-1794279581 Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:40.421567 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c4da1c88277749c48367e016f6cb7b91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c4da1c88277749c48367e016f6cb7b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c4da1c88277749c48367e016f6cb7b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c4da1c88277749c48367e016f6cb7b91", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TenantUsagesTestJSON-1794279581 Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c4da1c88277749c48367e016f6cb7b91 Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1794279581 Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TenantUsagesTestJSON-1794279581-project Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 494063ae805e4de1a64e229a7cfc6d81 Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TenantUsagesTestJSON-1794279581-project Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 16434926-5260-479a-a235-812a4f133852 could not be found. Sep 07 09:48:40.422989 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '16434926-5260-479a-a235-812a4f133852'} Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16434926-5260-479a-a235-812a4f133852 could not be found. Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:40.423777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16434926-5260-479a-a235-812a4f133852 could not be found. Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16434926-5260-479a-a235-812a4f133852 could not be found. Sep 07 09:48:40.425048 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:40.427305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] Returning 404 to user: Instance 16434926-5260-479a-a235-812a4f133852 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:40.428367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ccfeec73-b64a-4b27-8c9d-ee55aefc12e3 tempest-TenantUsagesTestJSON-1794279581 tempest-TenantUsagesTestJSON-1794279581-project] 10.222.0.60 "GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852" status: 404 len: 111 microversion: 2.1 time: 0.125070 Sep 07 09:48:40.428737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:40.429790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:40.435862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:40.436715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:40.438457 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 581/1179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:40 2022] GET /compute/v2.1/servers/16434926-5260-479a-a235-812a4f133852 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:40.439193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:40.440681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:40.558500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:40.584899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-78986dd4-ff35-4999-a40d-0bcf694aee23 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215436 Sep 07 09:48:40.591465 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 599/1180] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:40 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:41.016620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:41.017172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:41.031082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:41.031586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:41.032029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:41.032749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:41.033209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:41.038680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:41.225384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:41.226133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:41.229139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=76 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:41.273793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:41.274424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:41.274874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:41.279884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:41.281199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:41.284432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:41.748520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=44 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:42.157281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:42.169871 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37b49188-bb9f-4fc1-9ecc-cd0c1b053525 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 1.155477 Sep 07 09:48:42.173831 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 582/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:41 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:42.183143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:42.190488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:42.210116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:42.210643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:42.212014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:42.216650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:42.217412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:42.220162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:42.314906 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7db3ac7f-f266-4348-ac00-14883e1d77d4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139633 Sep 07 09:48:42.323241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 583/1182] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:42 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:42.713635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:42.734036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7cb3de2-e133-45f0-a872-6ec49806d117 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1522 microversion: 2.1 time: 1.513615 Sep 07 09:48:42.739519 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 600/1183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:41 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1522 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:42.771381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:42.772051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:42.788419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:42.795332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:42.796836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:42.799790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:42.800500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:42.801923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:42.881825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:48:43.190134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d37e827-9a7e-4561-80d1-146ade252148 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 204 len: 0 microversion: 2.1 time: 0.427254 Sep 07 09:48:43.191451 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 584/1184] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:48:42 2022] DELETE /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:48:43.200816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:43.203178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:43.221716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:43.225960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:43.227554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:43.229553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:43.233786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:43.238145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:43.613596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2006777860", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:43.726621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:43.788992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:43.800394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-51b32d3b-95f0-4b57-8872-ec292cd77638 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1528 microversion: 2.1 time: 0.604399 Sep 07 09:48:43.804007 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 585/1185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:43 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1528 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:43.831538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:43.832347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:43.847794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:43.849078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:43.849553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:43.852454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:43.854754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:43.857450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.015608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=20 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:44.423711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:44.434348 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2db81c2c-7b67-4e92-b25c-2c3d0a561a13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.615450 Sep 07 09:48:44.438068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 586/1186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:43 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:44.454825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:44.462441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:44.505968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=28 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:44.508080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:44.512668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:44.513724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.514226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:44.514832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:44.517068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.594215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:44.598932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:44.599612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:44.600132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:44.600657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:44.624211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:44.626723 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-510d4e9f-999b-48cd-815a-6872c6913dae tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185520 Sep 07 09:48:44.637985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:44.638879 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 587/1187] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:44 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:44.639646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.645916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:44.646548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:44.647126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.689312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:44.704989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:44.742064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:48:44.746120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:48:44.829304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:44.830618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:44.848883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:44.851019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:44.851019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.854428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:44.855212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:44.856436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:44.882210 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0e061bb-da51-4182-84ee-2039b93455a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897188 Sep 07 09:48:44.886294 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 601/1188] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:48:44.895209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f84b0477-93c3-41f7-bdf4-0ec52876fff7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:44.901804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f84b0477-93c3-41f7-bdf4-0ec52876fff7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:44.933745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:45.191307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f84b0477-93c3-41f7-bdf4-0ec52876fff7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:45.225770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f84b0477-93c3-41f7-bdf4-0ec52876fff7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1217 microversion: 2.1 time: 0.332448 Sep 07 09:48:45.229542 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 602/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:44 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1217 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:45.508076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab35c695-7d5f-4d3e-83ae-de2ba29e696f tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1bf1a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1990564517", "description": "tempest-description-1192686902"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:45.858063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:45.872832 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-108b2f7f-b9a6-4c55-998c-e4f17d8e5ed5 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1528 microversion: 2.1 time: 1.045911 Sep 07 09:48:45.893351 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 588/1190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:44 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1528 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:48:45.906235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:45.908371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:45.926776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:45.927585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:45.928884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:45.932903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:45.933695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:45.934398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:46.602673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab35c695-7d5f-4d3e-83ae-de2ba29e696f tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.368369 Sep 07 09:48:46.603290 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 603/1191] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:48:45 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:46.617758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:46.620122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:46.646916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:46.677332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:46.678706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:46.679685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:46.685510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:46.688864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:46.771032 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b3b94c0-e090-4d89-91d6-cf23f7dfd075 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157107 Sep 07 09:48:46.773138 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 604/1192] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:48:46 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:48:46.794874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:46.801536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:46.823921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:46.828354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:46.834577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:46.846667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:46.848771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:46.851145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:46.853026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:46.857760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6573fa2e-5962-4404-a97d-0c054bb75820 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.962862 Sep 07 09:48:46.864179 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 589/1193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:45 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:46.894452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe06bc94-fe34-4196-ac6a-f400650f99bf tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b19e4af0>, body: {"security_group_rule": {"parent_group_id": "3a40b9e4-4414-4201-ad48-4c9025a1ceb5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:47.111520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:47.126840 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e231d58a-2719-4a6d-8423-48ffed54f7a5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1269 microversion: 2.1 time: 0.349965 Sep 07 09:48:47.128576 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 605/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:46 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1269 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:47.141280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:47.142653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:47.155969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:47.157360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:47.158427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:47.160267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:47.180127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:47.181160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:48.314396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b1af68e8a948758e09d0ccbca23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cba4c3920814bd68ebe8734b405ad74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:48.336443 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-889f6280-04d4-4d94-9d97-9a6e38b7ab42 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 200 len: 1528 microversion: 2.1 time: 1.206442 Sep 07 09:48:48.341377 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 606/1195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:47 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 1528 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:48.352441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1158578106", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "35bcb095-afe9-448b-a5ac-88034a80f020"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:48.484150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] validate_networks() for [('35bcb095-afe9-448b-a5ac-88034a80f020', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:49.172710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe06bc94-fe34-4196-ac6a-f400650f99bf tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.303679 Sep 07 09:48:49.173858 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 590/1196] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 09:48:46 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:49.187711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:49.188765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:49.208287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:49.209291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:49.209686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:49.210419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:49.210886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:49.211322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:49.866881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:49.875792 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-476c6680-3001-4085-a2b7-c0ad69184305 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.700651 Sep 07 09:48:49.876656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 591/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:49 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:49.881526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:49.882420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:49.889160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:49.889971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:49.890901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:49.891855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:49.892555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:49.893254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:50.048172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:50.049674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:50.050163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:50.050551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:50.050967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:50.051373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:50.059848 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2dd26b3e-5d99-4681-8eb1-1573720d0d55 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1275 microversion: 2.1 time: 0.181730 Sep 07 09:48:50.061084 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 592/1198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:49 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:50.080715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:50.081227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:50.081670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:50.082408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:50.082868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:50.083296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:50.126078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Getting quotas for project 017dac8978b64d4c94cc2ef118e5fa69. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:50.142518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Getting quotas for user ba350a258ac24186b93317fcb1066a65 and project 017dac8978b64d4c94cc2ef118e5fa69. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:50.173331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:48:50.178491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:48:50.301693 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c48bc8c3-6803-404e-9091-c3704d962989 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.957437 Sep 07 09:48:50.304744 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 607/1199] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:48:50.318969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2d9b1cf8-0bee-430f-b250-170828aa394b req-2dc31352-11d5-4a77-a81a-5af052693652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a", "name": "network-vif-deleted", "tag": "8d92969e-86af-4173-bc21-5b5132271027"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:50.338656 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cdc06b7a-fe13-4e41-a57e-220c8650acb8 tempest-TenantUsagesNegativeTestJSON-1533831438 tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-06T09%3A48%3A48.394573&end=2022-09-08T09%3A48%3A48.394573" status: 404 len: 112 microversion: - time: 0.276278 Sep 07 09:48:50.339302 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 593/1200] 10.222.0.60 () {58 vars in 1316 bytes} [Wed Sep 7 09:48:50 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-06T09%3A48%3A48.394573&end=2022-09-08T09%3A48%3A48.394573 => generated 112 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 09:48:50.350330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bba0dd3d-90e4-4aae-b16a-35627db49701 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1bb15e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1103329709", "description": "tempest-description-1799175902"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:50.360103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2d9b1cf8-0bee-430f-b250-170828aa394b req-2dc31352-11d5-4a77-a81a-5af052693652 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:50.360839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2d9b1cf8-0bee-430f-b250-170828aa394b req-2dc31352-11d5-4a77-a81a-5af052693652 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:50.361490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2d9b1cf8-0bee-430f-b250-170828aa394b req-2dc31352-11d5-4a77-a81a-5af052693652 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:50.392002 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2d9b1cf8-0bee-430f-b250-170828aa394b req-2dc31352-11d5-4a77-a81a-5af052693652 service nova] Creating event network-vif-deleted:8d92969e-86af-4173-bc21-5b5132271027 for instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a on n-h1-836830-16 Sep 07 09:48:50.419046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2d9b1cf8-0bee-430f-b250-170828aa394b req-2dc31352-11d5-4a77-a81a-5af052693652 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111922 Sep 07 09:48:50.425587 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 608/1201] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:50.433575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:50.438052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:50.450961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:50.455052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:50.455758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:50.456667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:50.460444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:50.461075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:50.495388 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a could not be found. Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a HTTP/1.1 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:50.497199 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a could not be found. Sep 07 09:48:50.498829 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a'} Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a could not be found. Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:50.500009 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a could not be found. Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a could not be found. Sep 07 09:48:50.501307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.502403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:50.502403 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0230c94b-3f28-486d-88c7-186e1e01a9b1 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a" status: 404 len: 111 microversion: 2.1 time: 0.071112 Sep 07 09:48:50.508628 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 609/1202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:50 2022] GET /compute/v2.1/servers/c3cc70da-2ede-4fbf-a9ae-ad7ed282dc5a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:50.514494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f52c3043-3280-4697-98b7-ac01320d4f01 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:50.515129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f52c3043-3280-4697-98b7-ac01320d4f01 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:50.785310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f52c3043-3280-4697-98b7-ac01320d4f01 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:50.802167 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f52c3043-3280-4697-98b7-ac01320d4f01 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1218 microversion: 2.1 time: 0.292244 Sep 07 09:48:50.803649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 610/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:50 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1218 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:50.813167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f40e65c-fa26-438c-b77a-d0797793151a tempest-TenantUsagesNegativeTestJSON-1533831438 tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin] Calling method '.version_select at 0x7f14b1c0e550>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:50.823637 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7f40e65c-fa26-438c-b77a-d0797793151a tempest-TenantUsagesNegativeTestJSON-1533831438 tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f40e65c-fa26-438c-b77a-d0797793151a tempest-TenantUsagesNegativeTestJSON-1533831438 tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin] Request method failure captured: Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-simple-tenant-usage/ade04a8bde0541cbba4686af8ad42548?start=2022-09-08T09%3A48%3A48.394573&end=2022-09-06T09%3A48%3A48.394573 HTTP/1.1 Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGkAv0_BPIxMxtNbzXtaJuVynd7dJFzouNBhlwdMiQbsUwZy4tR-UqraJoWO2qCaUbWRrUTrwWTfEcvI1XuC85Bf3KNOdhGmR06AcJ1-N2yrGCZyCrWElEm2OdBZmTwfF3xOn5tcP2uq9ww4w6DQERrf8YsroxuMpUSWU52s6zhKihU Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 686a081e26554a3c84ab5eb26ab23108 Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1533831438 Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:48:50.829165 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/686a081e26554a3c84ab5eb26ab23108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/686a081e26554a3c84ab5eb26ab23108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/686a081e26554a3c84ab5eb26ab23108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_686a081e26554a3c84ab5eb26ab23108", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1533831438 Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 686a081e26554a3c84ab5eb26ab23108 Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1533831438 Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a92609c528a44023aada1965b5a3a67d Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid start time. The start time cannot occur after the end time. Sep 07 09:48:50.830576 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ade04a8bde0541cbba4686af8ad42548'} Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 09:48:50.831624 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 07 09:48:50.833048 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.836787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f40e65c-fa26-438c-b77a-d0797793151a tempest-TenantUsagesNegativeTestJSON-1533831438 tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:50.843487 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f40e65c-fa26-438c-b77a-d0797793151a tempest-TenantUsagesNegativeTestJSON-1533831438 tempest-TenantUsagesNegativeTestJSON-1533831438-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/ade04a8bde0541cbba4686af8ad42548?start=2022-09-08T09%3A48%3A48.394573&end=2022-09-06T09%3A48%3A48.394573" status: 400 len: 111 microversion: 2.1 time: 0.038687 Sep 07 09:48:50.844828 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 611/1204] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Sep 7 09:48:50 2022] GET /compute/v2.1/os-simple-tenant-usage/ade04a8bde0541cbba4686af8ad42548?start=2022-09-08T09%3A48%3A48.394573&end=2022-09-06T09%3A48%3A48.394573 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:48:50.852651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adaa7575-d2ad-46c8-81c5-d90d05ce70cf tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '.version_select at 0x7f14b1c0eee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:50.903332 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-adaa7575-d2ad-46c8-81c5-d90d05ce70cf tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Image not found. Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adaa7575-d2ad-46c8-81c5-d90d05ce70cf tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13 HTTP/1.1 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:50.907587 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '96f20db6-eae0-46b2-acf0-ed697777bf13'} Sep 07 09:48:50.909410 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 96f20db6-eae0-46b2-acf0-ed697777bf13 to delete Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:50.910243 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96f20db6-eae0-46b2-acf0-ed697777bf13 could not be found. Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:50.911431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:50.912869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:50.915559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adaa7575-d2ad-46c8-81c5-d90d05ce70cf tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:50.917695 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adaa7575-d2ad-46c8-81c5-d90d05ce70cf tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13" status: 404 len: 62 microversion: 2.1 time: 0.071518 Sep 07 09:48:50.918674 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 612/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:50 2022] DELETE /compute/v2.1/images/96f20db6-eae0-46b2-acf0-ed697777bf13 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:50.942764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bba0dd3d-90e4-4aae-b16a-35627db49701 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.596331 Sep 07 09:48:50.957752 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 594/1206] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:48:50 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:51.094116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1343584039", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a4c9e9f5-3e0a-4df6-af1d-c9061d526758"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:51.190569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] validate_networks() for [('a4c9e9f5-3e0a-4df6-af1d-c9061d526758', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:48:51.222455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-935bd219-1673-43c7-bf92-a9987ac9e096 tempest-TenantUsagesNegativeTestJSON-1099756475 tempest-TenantUsagesNegativeTestJSON-1099756475-project] Calling method '.version_select at 0x7f14b19faca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:51.228979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-935bd219-1673-43c7-bf92-a9987ac9e096 tempest-TenantUsagesNegativeTestJSON-1099756475 tempest-TenantUsagesNegativeTestJSON-1099756475-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '64fb084cd0a74e53a0b97efc9d7f4387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade04a8bde0541cbba4686af8ad42548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-935bd219-1673-43c7-bf92-a9987ac9e096 tempest-TenantUsagesNegativeTestJSON-1099756475 tempest-TenantUsagesNegativeTestJSON-1099756475-project] Request method failure captured: Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T09%3A48%3A48.394573&end=2022-09-08T09%3A48%3A48.394573&detailed=1 HTTP/1.1 Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGj_EqVY-x3afXJJbE5wwj2cO8UlLPcSrEHD6e6zsqkbI-maZtcrpm84bZCL3Tkx0omate-mgjtZtHCrD2p8UZa_tZe-3z_Ob5mMLLB7dsKpOEc7CS876HJLrv9JqGkkYs1BFjWqYM78-XCi3c4yTBqwFYiyqK_IjzJarYK4Nd-JFIM Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: ade04a8bde0541cbba4686af8ad42548 Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1099756475 Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:51.238337 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ade04a8bde0541cbba4686af8ad42548"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ade04a8bde0541cbba4686af8ad42548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ade04a8bde0541cbba4686af8ad42548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ade04a8bde0541cbba4686af8ad42548", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1099756475 Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: ade04a8bde0541cbba4686af8ad42548 Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1099756475 Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TenantUsagesNegativeTestJSON-1099756475-project Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 64fb084cd0a74e53a0b97efc9d7f4387 Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1099756475-project Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 09:48:51.240249 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:48:51.241330 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:48:51.242943 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:48:51.244976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 07 09:48:51.244976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.246812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-935bd219-1673-43c7-bf92-a9987ac9e096 tempest-TenantUsagesNegativeTestJSON-1099756475 tempest-TenantUsagesNegativeTestJSON-1099756475-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:51.247824 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-935bd219-1673-43c7-bf92-a9987ac9e096 tempest-TenantUsagesNegativeTestJSON-1099756475 tempest-TenantUsagesNegativeTestJSON-1099756475-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T09%3A48%3A48.394573&end=2022-09-08T09%3A48%3A48.394573&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.287531 Sep 07 09:48:51.249019 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 595/1207] 10.222.0.60 () {58 vars in 1335 bytes} [Wed Sep 7 09:48:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T09%3A48%3A48.394573&end=2022-09-08T09%3A48%3A48.394573&detailed=1 => generated 123 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:51.265882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:51.272692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:51.299415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:51.300046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:51.301407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:51.303268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:51.304529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:51.305817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:51.771058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:51.781148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb6a3516-5f86-41ed-a03d-9be8a5cc9a57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.527646 Sep 07 09:48:51.793550 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 596/1208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:51 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:51.801757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:51.802261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:51.815090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:51.815835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:51.816540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:51.818915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:51.819558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:51.820247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:51.845662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 HTTP/1.1 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:51.847695 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:51.849742 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '200aeb49-752f-4a80-9d7e-f927574201f6'} Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:51.850605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:51.852153 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:51.855339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:51.859142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-654826a1-f02b-4f6a-af53-4052b1258344 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 404 len: 111 microversion: 2.1 time: 0.062861 Sep 07 09:48:51.860829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 597/1209] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:48:51 2022] DELETE /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:51.872190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28675a51-b774-43e9-bf45-ddc0a52f42d2 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1a1c8b0>, body: {"security_group_rule": {"parent_group_id": "925827c7-0236-4047-b0b6-173564866cef", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:52.736589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:48:52.737131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:48:52.737507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:48:52.737914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:48:52.738329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:48:52.755871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:52.756356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:52.756793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:52.757573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:52.758029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:52.758455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:52.802318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Getting quotas for project 8e63b735a19d488d95553ff9f6acc846. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:48:52.805073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:48:52.809453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Getting quotas for user 0b88725326c244f6a10260dc710f2e55 and project 8e63b735a19d488d95553ff9f6acc846. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:48:52.824838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:48:52.827613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:48:52.910682 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d506fae-bc84-4ab3-9073-36448c5375c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.989444 Sep 07 09:48:52.911375 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 613/1210] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:48:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:48:52.922343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:52.922975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:52.951410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:52.954589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:52.956879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:52.957720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:52.961610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:52.962219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.146878 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28675a51-b774-43e9-bf45-ddc0a52f42d2 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.284755 Sep 07 09:48:53.147886 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 598/1211] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 09:48:51 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:53.156386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:53.157025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:53.174145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:53.174651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:53.175093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.175791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:53.180716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:53.184816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.426658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:53.444250 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03268c1f-f040-4dfb-abb2-26e4168cd976 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1276 microversion: 2.1 time: 0.294605 Sep 07 09:48:53.452669 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 599/1212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:53 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:53.460599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:53.462375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 200aeb49-752f-4a80-9d7e-f927574201f6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:53.490911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:53.491787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:53.495328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.497382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:53.500437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:53.501787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.529895 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 HTTP/1.1 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:48:53.573384 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:53.575156 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '200aeb49-752f-4a80-9d7e-f927574201f6'} Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:53.579168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. Sep 07 09:48:53.580605 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:48:53.581944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance 200aeb49-752f-4a80-9d7e-f927574201f6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:53.581944 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f78a4ba8-92f1-43e8-9706-b0cae2505372 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6" status: 404 len: 111 microversion: 2.1 time: 0.121040 Sep 07 09:48:53.581944 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 600/1213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:53 2022] GET /compute/v2.1/servers/200aeb49-752f-4a80-9d7e-f927574201f6 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:53.595470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:53.596166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:53.616743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:53.617480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:53.618295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.621632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:53.622327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:53.622928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:53.731035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:53.749663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5dbc4113-055b-4205-a03b-e963efc1c9a6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.832310 Sep 07 09:48:53.751859 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 614/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:52 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:53.780762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bdd0291a-6ba4-4b90-b2c9-701c949f6b48 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:53.781954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdd0291a-6ba4-4b90-b2c9-701c949f6b48 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:53.934562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bdd0291a-6ba4-4b90-b2c9-701c949f6b48 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:53.944310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bdd0291a-6ba4-4b90-b2c9-701c949f6b48 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1218 microversion: 2.1 time: 0.191115 Sep 07 09:48:53.945843 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 615/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:53 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:53.957458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-379069cd-fd42-450a-a8f7-ee1370fb8efc tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1b54f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-413939382", "description": "tempest-description-1990723375"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:54.227207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:54.240714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88164755-b323-4d8b-bf18-604f5595a561 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.653926 Sep 07 09:48:54.261781 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 601/1216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:53 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:54.292749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98a2b350-0001-47e6-a091-4814f39d8281 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '.version_select at 0x7f14b19e5430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:54.328942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98a2b350-0001-47e6-a091-4814f39d8281 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463654019" status: 202 len: 0 microversion: 2.1 time: 0.065698 Sep 07 09:48:54.330247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 602/1217] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 09:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463654019 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:48:54.404725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7a88f73f-b8f0-41aa-ab22-3a41e2e56e48 req-08fe9f0c-51ed-4727-88bb-1f0fee5c1c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311d2586-a4ff-42eb-90c9-bb56ecdd89e4", "tag": "92d34c8a-9571-4fd5-b485-acd13e1cfef5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:54.437949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7a88f73f-b8f0-41aa-ab22-3a41e2e56e48 req-08fe9f0c-51ed-4727-88bb-1f0fee5c1c2b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:54.448189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7a88f73f-b8f0-41aa-ab22-3a41e2e56e48 req-08fe9f0c-51ed-4727-88bb-1f0fee5c1c2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:54.450360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7a88f73f-b8f0-41aa-ab22-3a41e2e56e48 req-08fe9f0c-51ed-4727-88bb-1f0fee5c1c2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:54.496464 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7a88f73f-b8f0-41aa-ab22-3a41e2e56e48 req-08fe9f0c-51ed-4727-88bb-1f0fee5c1c2b service nova] Creating event network-changed:92d34c8a-9571-4fd5-b485-acd13e1cfef5 for instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 on n-h2-836830-16 Sep 07 09:48:54.525131 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7a88f73f-b8f0-41aa-ab22-3a41e2e56e48 req-08fe9f0c-51ed-4727-88bb-1f0fee5c1c2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117528 Sep 07 09:48:54.527114 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 603/1218] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:54.535244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:54.536599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:54.551397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:54.552112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:54.553100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:54.554198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:54.554832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:54.557036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:54.982136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:54.997901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1ecbc56-b241-4e8c-9632-e916c0465132 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1276 microversion: 2.1 time: 0.462290 Sep 07 09:48:55.002274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 604/1219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:54 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1276 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:55.017402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:55.019091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:55.034302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:55.034813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:55.035252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:55.035972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:55.036830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:55.037313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:55.144142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-379069cd-fd42-450a-a8f7-ee1370fb8efc tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.193822 Sep 07 09:48:55.152633 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 616/1220] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:48:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:55.154292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:55.155005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:55.167103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:55.168164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:55.169248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:55.170056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:55.170549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:55.170994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:55.339611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:55.351391 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61fb26d6-4c52-476a-b00d-83d3e585e2f8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1270 microversion: 2.1 time: 0.204096 Sep 07 09:48:55.354193 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 617/1221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:55 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:55.361394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd12d26b-9a16-456c-8740-dd83131417df tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1d15790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1984856053", "description": "tempest-description-1290234655"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:55.632376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:55.647518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c1d6be2-00bb-4230-96de-754cbeb9fd3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.643898 Sep 07 09:48:55.661599 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 605/1222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:55 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:55.669192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:55.669810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:55.675772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:55.676257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:55.676888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:55.677795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:55.678254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:55.678682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.136608 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd12d26b-9a16-456c-8740-dd83131417df tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.781092 Sep 07 09:48:56.137285 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 618/1223] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:48:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:56.151760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:56.154280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:56.164904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:56.170326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:56.171370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:56.171911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.172626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:56.173287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:56.174142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.188049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57832aea-cbd6-4b8e-bc8b-39e0f74c1934 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.518949 Sep 07 09:48:56.188934 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 606/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:55 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:56.194832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b97e152b-81f2-44db-8303-28e48439f174 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1a0bdc0>, body: {"security_group_rule": {"parent_group_id": "616ef300-095f-4fc1-93e0-ba12a7e29e26", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f0787735-97cb-4e18-b612-2bbb033607fe"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:56.526739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:56.535730 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b579a057-c6ee-4cf5-9c1a-3528fa490a8e tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.389041 Sep 07 09:48:56.536401 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 619/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:56 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:56.542156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:56.543030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:56.550027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:56.550825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:56.551456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.553355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:56.553355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:56.553355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.656837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:56.665208 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d4ea8d86-4ad3-4f97-b922-6346c0703134 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1276 microversion: 2.1 time: 0.127584 Sep 07 09:48:56.665954 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 620/1226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:56 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:56.670728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ad3898e-ae59-4916-9738-f37dee5fb30f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '.version_select at 0x7f14b1b81310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:56.695168 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7ad3898e-ae59-4916-9738-f37dee5fb30f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Image not found. Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ad3898e-ae59-4916-9738-f37dee5fb30f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/109c487d-eb44-4988-a13d-f65076512288 HTTP/1.1 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:56.698526 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '109c487d-eb44-4988-a13d-f65076512288'} Sep 07 09:48:56.700194 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 109c487d-eb44-4988-a13d-f65076512288 to delete Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:56.701213 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 109c487d-eb44-4988-a13d-f65076512288 could not be found. Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:56.702380 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ad3898e-ae59-4916-9738-f37dee5fb30f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:56.707856 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ad3898e-ae59-4916-9738-f37dee5fb30f tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/images/109c487d-eb44-4988-a13d-f65076512288" status: 404 len: 62 microversion: 2.1 time: 0.035845 Sep 07 09:48:56.709946 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 621/1227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:56 2022] DELETE /compute/v2.1/images/109c487d-eb44-4988-a13d-f65076512288 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:48:56.711091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:56.711722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:56.720693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:56.721267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:56.721656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.722357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:56.722985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:56.724059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:56.988014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:56.996465 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-87ee0242-4ed2-464c-8aec-911e4c79acd4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.291234 Sep 07 09:48:56.997417 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 622/1228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:56 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:57.011284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:57.012131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:57.018807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:57.019715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:57.020249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:57.021070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:57.022004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:57.022243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:57.038839 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 HTTP/1.1 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:57.041074 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.042607 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8'} Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:57.043381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.044706 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.045996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:57.045996 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-672b63e3-b85a-4334-8f96-7becef275e69 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 404 len: 111 microversion: 2.1 time: 0.044358 Sep 07 09:48:57.045996 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 623/1229] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:48:56 2022] DELETE /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:57.052417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:57.053124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] [instance: 4eb66c3f-ef5b-4941-8949-163f2e52d0b8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:57.060551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:57.061293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:57.061940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:57.062645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:57.063305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:57.064000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:57.079143 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b97e152b-81f2-44db-8303-28e48439f174 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.888876 Sep 07 09:48:57.081376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 607/1230] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 09:48:56 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:57.092271 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] HTTP exception thrown: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.096656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b479cfdd-b54e-48c3-bf80-d9e3911c2227 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1b5ad30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-968249800", "description": "tempest-description-1678204324"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Request method failure captured: Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 HTTP/1.1 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiavU3BPDsJdKgycMZCXTPqfXlWJwrWBPMkB_tfdt7cvVeGta40SvtyzDDRYzMEo44DvNDp9k_iLcNAJKB-fIAvfHu-izdELnkuAyyrJskaQeacDo_BxPByoFzWFZj4VcuJuD3HSgVXgxI54v1bt39kp4NdXImouI0rnKUre2RcrF8 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:48:57.099286 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0cba4c3920814bd68ebe8734b405ad74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0cba4c3920814bd68ebe8734b405ad74", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0cba4c3920814bd68ebe8734b405ad74 Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503 Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03b1af68e8a948758e09d0ccbca23d4d Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1214449503-project Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.100928 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4eb66c3f-ef5b-4941-8949-163f2e52d0b8'} Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:48:57.101893 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. Sep 07 09:48:57.103170 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:48:57.104380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] Returning 404 to user: Instance 4eb66c3f-ef5b-4941-8949-163f2e52d0b8 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:48:57.105861 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07b7652b-ac1d-4b39-9cbd-276dfe740d34 tempest-ImagesOneServerNegativeTestJSON-1214449503 tempest-ImagesOneServerNegativeTestJSON-1214449503-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8" status: 404 len: 111 microversion: 2.1 time: 0.056555 Sep 07 09:48:57.112725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 624/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:57 2022] GET /compute/v2.1/servers/4eb66c3f-ef5b-4941-8949-163f2e52d0b8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:48:57.216691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:57.217346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:57.226429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:57.227980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:57.229646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:57.232254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:57.233215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:57.234357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:57.987903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:57.998299 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de8d06e3-7dd0-416d-ae82-cc342366e922 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.786174 Sep 07 09:48:58.014701 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 625/1232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:57 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:58.021303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:58.022227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:58.029708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:58.030506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:58.031170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:58.032104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:58.033433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:58.034102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:58.230854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b479cfdd-b54e-48c3-bf80-d9e3911c2227 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.138232 Sep 07 09:48:58.241321 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 608/1233] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:48:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:58.249253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:58.249989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:58.261811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:58.262525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:58.263168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:58.264086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:58.264717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:58.265362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:58.647504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:58.662701 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-603e4c01-c946-4690-828f-7e048e24bcf4 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.646511 Sep 07 09:48:58.664627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 626/1234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:58 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:58.670900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:58.671828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:58.678558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:58.679388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:58.680049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:58.680974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:58.682353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:58.683082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:58.815617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:58.826573 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-83abde17-02f5-4adf-8755-a79ab7c014df tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1318 microversion: 2.1 time: 0.583501 Sep 07 09:48:58.827657 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 609/1235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:58 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:58.834245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e82bf844-a196-49a4-9321-c2bf437428e2 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1c53a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-623946960", "description": "tempest-description-1572133401"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:59.231152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:48:59.239418 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5886e867-21fd-4a90-9c4f-9b706ea0db0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.572564 Sep 07 09:48:59.240015 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 627/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:58 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:48:59.245555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-59a6947a-af23-4e5e-abd1-b244fb2dcf8d req-b27748d5-dba8-4f20-9556-bc35aa4856b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18fc57f6-b30c-4a88-bd29-12a3b7036a45", "tag": "10921d24-768e-4af8-941f-79752bd08fa1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:59.262545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-59a6947a-af23-4e5e-abd1-b244fb2dcf8d req-b27748d5-dba8-4f20-9556-bc35aa4856b0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:59.263825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-59a6947a-af23-4e5e-abd1-b244fb2dcf8d req-b27748d5-dba8-4f20-9556-bc35aa4856b0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:59.265211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-59a6947a-af23-4e5e-abd1-b244fb2dcf8d req-b27748d5-dba8-4f20-9556-bc35aa4856b0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:59.282781 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-59a6947a-af23-4e5e-abd1-b244fb2dcf8d req-b27748d5-dba8-4f20-9556-bc35aa4856b0 service nova] Creating event network-changed:10921d24-768e-4af8-941f-79752bd08fa1 for instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 on n-h1-836830-16 Sep 07 09:48:59.288797 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-59a6947a-af23-4e5e-abd1-b244fb2dcf8d req-b27748d5-dba8-4f20-9556-bc35aa4856b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047136 Sep 07 09:48:59.290005 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 628/1237] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:59.297497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-52d82f2e-cdec-44de-8b4f-cd2ad36a1ffb req-6a3b2338-3b70-40d1-8359-7c799559fe2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a88295-7950-4fde-80e4-6d15e59eef01", "tag": "88695c13-806f-452d-8e6b-90df9882cafb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:48:59.313466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-52d82f2e-cdec-44de-8b4f-cd2ad36a1ffb req-6a3b2338-3b70-40d1-8359-7c799559fe2c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:59.314102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-52d82f2e-cdec-44de-8b4f-cd2ad36a1ffb req-6a3b2338-3b70-40d1-8359-7c799559fe2c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:59.315548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-52d82f2e-cdec-44de-8b4f-cd2ad36a1ffb req-6a3b2338-3b70-40d1-8359-7c799559fe2c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:59.334001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-52d82f2e-cdec-44de-8b4f-cd2ad36a1ffb req-6a3b2338-3b70-40d1-8359-7c799559fe2c service nova] Creating event network-changed:88695c13-806f-452d-8e6b-90df9882cafb for instance 08a88295-7950-4fde-80e4-6d15e59eef01 on n-h1-836830-16 Sep 07 09:48:59.341050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-52d82f2e-cdec-44de-8b4f-cd2ad36a1ffb req-6a3b2338-3b70-40d1-8359-7c799559fe2c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048385 Sep 07 09:48:59.342419 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 629/1238] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:59.348872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:48:59.350079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:48:59.359804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:59.360529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:59.361274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:59.362201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:48:59.362832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:48:59.363316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:48:59.623597 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e82bf844-a196-49a4-9321-c2bf437428e2 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.794418 Sep 07 09:48:59.626559 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 610/1239] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:48:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:48:59.639799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-634c6547-85d5-497c-8606-c9bfd5e62f53 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1a0bee0>, body: {"security_group_rule": {"parent_group_id": "784914d5-e325-4282-95da-1b8ddc441250", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a69f8337-b198-47db-925d-42308f47b598"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:00.317907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:00.331902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f367312e-b88e-47b2-847a-09be521a0156 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.987229 Sep 07 09:49:00.333218 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 630/1240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:48:59 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:00.340142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:00.341261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:00.350968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:00.352146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:00.355408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:00.356598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:00.357499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:00.358241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:00.397526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:00.999331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:01.008664 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0790d70-35c8-446c-8f50-923daa3b7ce1 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.674401 Sep 07 09:49:01.012942 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 631/1241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:00 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:01.022668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:01.026471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:01.036234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:01.036737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:01.037217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:01.037937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:01.038397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:01.038830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:01.655359 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-634c6547-85d5-497c-8606-c9bfd5e62f53 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.013004 Sep 07 09:49:01.655359 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 611/1242] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 09:48:59 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:01.662261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:01.667065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:01.676796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:01.677792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:01.678658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:01.679553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:01.680488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:01.681950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:01.683750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:01.698337 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c0f3646-4189-4666-9bea-d5d7abbc32ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1318 microversion: 2.1 time: 0.679740 Sep 07 09:49:01.710088 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 632/1243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:01 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:01.714130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:01.715027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:01.727395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:01.733335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:01.734020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:01.734906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:01.735483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:01.736046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:02.240772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:02.255130 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1789d103-69b7-466e-8982-cfa5f0aa29bc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.554336 Sep 07 09:49:02.256173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 633/1244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:01 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:02.262419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:02.268161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:02.282018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:02.285527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:02.286206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:02.289851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:02.291056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:02.291849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:02.406308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 1c670f25-8fd6-4cb0-8f33-b8544182fa74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:49:02.444783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-785116a8-2aef-446e-9657-1f88048108e4 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 2346 microversion: 2.25 time: 0.786288 Sep 07 09:49:02.452966 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 612/1245] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:01 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 2346 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:02.474688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-75285f3b-1ecc-4998-be23-100e88576642 req-db7b2f16-a1cc-4b43-887b-fbe34fcedc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc44587-4609-4b49-84a9-761bdb462451", "name": "network-vif-unplugged", "status": "completed", "tag": "0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:02.495471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-75285f3b-1ecc-4998-be23-100e88576642 req-db7b2f16-a1cc-4b43-887b-fbe34fcedc23 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:02.498281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-75285f3b-1ecc-4998-be23-100e88576642 req-db7b2f16-a1cc-4b43-887b-fbe34fcedc23 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:02.500195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-75285f3b-1ecc-4998-be23-100e88576642 req-db7b2f16-a1cc-4b43-887b-fbe34fcedc23 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:02.518518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-75285f3b-1ecc-4998-be23-100e88576642 req-db7b2f16-a1cc-4b43-887b-fbe34fcedc23 service nova] Creating event network-vif-unplugged:0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021 for instance ddc44587-4609-4b49-84a9-761bdb462451 on n-h1-836830-16 Sep 07 09:49:02.526636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-75285f3b-1ecc-4998-be23-100e88576642 req-db7b2f16-a1cc-4b43-887b-fbe34fcedc23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072210 Sep 07 09:49:02.530135 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 613/1246] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:02.538727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fef4019e-b2ec-41f0-a1c9-db4a8e61f318 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b19bd820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:02.767989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:03.090679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:03.112430 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f7fcb14-ac9a-4023-b232-df1be783a853 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.850590 Sep 07 09:49:03.130282 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 634/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:02 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:03.139487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:03.140123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:03.150788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:03.154539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:03.155143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:03.155961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:03.156431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:03.156862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:03.942809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=24 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:04.116633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:04.136700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-496613af-04d8-4def-8689-79041afa26e0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 1.008822 Sep 07 09:49:04.161460 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 635/1248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:03 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:04.176774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:04.176880 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fef4019e-b2ec-41f0-a1c9-db4a8e61f318 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a69f8337-b198-47db-925d-42308f47b598" status: 202 len: 0 microversion: 2.1 time: 1.642956 Sep 07 09:49:04.179205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.179704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.180138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.180273 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 614/1249] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:02 2022] DELETE /compute/v2.1/os-security-groups/a69f8337-b198-47db-925d-42308f47b598 => generated 0 bytes in 1649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:04.180874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.182319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.187701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.187829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:04.187829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:04.215920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.216429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.216879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.217626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.218091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.218521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.266509 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d165e52-7e8d-4922-8d15-14e4e87e41ee tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.099259 Sep 07 09:49:04.267502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 636/1250] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 7 09:49:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:49:04.281856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3b12a7a2-90a4-42e2-bcca-48cba7226731 req-57826241-3dcb-48fe-8fc4-40d572e03a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311d2586-a4ff-42eb-90c9-bb56ecdd89e4", "name": "network-vif-plugged", "status": "completed", "tag": "92d34c8a-9571-4fd5-b485-acd13e1cfef5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:04.308439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b12a7a2-90a4-42e2-bcca-48cba7226731 req-57826241-3dcb-48fe-8fc4-40d572e03a61 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.310405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b12a7a2-90a4-42e2-bcca-48cba7226731 req-57826241-3dcb-48fe-8fc4-40d572e03a61 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.310849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b12a7a2-90a4-42e2-bcca-48cba7226731 req-57826241-3dcb-48fe-8fc4-40d572e03a61 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.347016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3b12a7a2-90a4-42e2-bcca-48cba7226731 req-57826241-3dcb-48fe-8fc4-40d572e03a61 service nova] Creating event network-vif-plugged:92d34c8a-9571-4fd5-b485-acd13e1cfef5 for instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 on n-h2-836830-16 Sep 07 09:49:04.356013 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3b12a7a2-90a4-42e2-bcca-48cba7226731 req-57826241-3dcb-48fe-8fc4-40d572e03a61 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087056 Sep 07 09:49:04.357363 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 637/1251] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:04.365399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:04.366081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:04.402570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.403477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.404459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.405421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.406049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.406671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.732028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:04.761336 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4222e074-f260-405f-81f7-f7f8a69ccef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1318 microversion: 2.1 time: 0.565831 Sep 07 09:49:04.763913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 615/1252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:04 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:04.783250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:04.788589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:04.803710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.809220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.812458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.814221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:04.817644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:04.818385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:04.984642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:04.993504 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e29766d8-037a-41a9-8562-fb8e9205d244 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.634909 Sep 07 09:49:04.994674 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 638/1253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:04 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:05.019736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9412b9d-d69a-4755-a7cf-c30a73ce73dd tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1d03e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:05.220274 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9412b9d-d69a-4755-a7cf-c30a73ce73dd tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/784914d5-e325-4282-95da-1b8ddc441250" status: 200 len: 247 microversion: 2.1 time: 0.224513 Sep 07 09:49:05.220976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 639/1254] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:49:04 2022] GET /compute/v2.1/os-security-groups/784914d5-e325-4282-95da-1b8ddc441250 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:05.225614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-198bc211-e6bf-4a7a-a4e9-44d348b74486 req-7611cfb3-0873-4af8-8b85-8984562a6312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc44587-4609-4b49-84a9-761bdb462451", "tag": "0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:05.242545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:05.248155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-198bc211-e6bf-4a7a-a4e9-44d348b74486 req-7611cfb3-0873-4af8-8b85-8984562a6312 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:05.253144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-198bc211-e6bf-4a7a-a4e9-44d348b74486 req-7611cfb3-0873-4af8-8b85-8984562a6312 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:05.253797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-198bc211-e6bf-4a7a-a4e9-44d348b74486 req-7611cfb3-0873-4af8-8b85-8984562a6312 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:05.258438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-44881496-dcdb-489e-9203-0a68b976f0e3 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.489012 Sep 07 09:49:05.268071 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 616/1255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:04 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:05.273005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:05.273766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:05.281518 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-198bc211-e6bf-4a7a-a4e9-44d348b74486 req-7611cfb3-0873-4af8-8b85-8984562a6312 service nova] Creating event network-changed:0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021 for instance ddc44587-4609-4b49-84a9-761bdb462451 on n-h1-836830-16 Sep 07 09:49:05.299106 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-198bc211-e6bf-4a7a-a4e9-44d348b74486 req-7611cfb3-0873-4af8-8b85-8984562a6312 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076758 Sep 07 09:49:05.307467 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 640/1256] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:05.310107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:05.310659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:05.311112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:05.311967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:05.312319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:05.319900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:05.324839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94f6cce6-a05d-4ab3-aebe-33f384ea2984 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1b81700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-428913820", "description": "tempest-description-267079707"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:06.007369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:06.020101 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01572d24-b76e-4efc-9b7f-15a57e19e659 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.755428 Sep 07 09:49:06.034870 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 617/1257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:05 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:06.036228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94f6cce6-a05d-4ab3-aebe-33f384ea2984 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.717496 Sep 07 09:49:06.036228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 641/1258] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:49:05 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:06.039041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:06.039662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:06.041010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:06.045461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:06.058680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:06.059801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:06.060439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:06.060714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:06.061760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:06.062265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:06.062596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:06.063966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:06.064350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:06.065243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:06.065825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:06.068214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:06.112935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:06.534861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:06.537911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:06.550745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-da0615e9-01d2-48b2-b4d2-49294f8fb8f6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1318 microversion: 2.1 time: 0.525168 Sep 07 09:49:06.551955 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 618/1259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:06 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:06.572489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-28d5e0d1-23c9-43bb-84ff-8d255f78aca5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1317 microversion: 2.1 time: 0.536171 Sep 07 09:49:06.575908 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 642/1260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:06 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:06.580682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92fb75ab-be33-4f03-8336-db20d5b4458e tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b19bd550>, body: {"security_group_rule": {"parent_group_id": "6b9dfea9-7fa3-4231-8889-3c55eff13749", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:06.592262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:06.592890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:06.608980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:06.609520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:06.609969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:06.617794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:06.619271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:06.620126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:07.183177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:07.204269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c1dcb29f-d8a7-4023-a027-22df7ec4ae2a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.623686 Sep 07 09:49:07.206297 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 643/1261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:06 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:07.222920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e8dc9ba4-c483-4344-ac8c-860433849704 req-c1b0ca6d-7e6f-48a8-af59-65deca921102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fc57f6-b30c-4a88-bd29-12a3b7036a45", "name": "network-vif-plugged", "status": "completed", "tag": "10921d24-768e-4af8-941f-79752bd08fa1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:07.253532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8dc9ba4-c483-4344-ac8c-860433849704 req-c1b0ca6d-7e6f-48a8-af59-65deca921102 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:07.254330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8dc9ba4-c483-4344-ac8c-860433849704 req-c1b0ca6d-7e6f-48a8-af59-65deca921102 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:07.255661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8dc9ba4-c483-4344-ac8c-860433849704 req-c1b0ca6d-7e6f-48a8-af59-65deca921102 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:07.279945 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e8dc9ba4-c483-4344-ac8c-860433849704 req-c1b0ca6d-7e6f-48a8-af59-65deca921102 service nova] Creating event network-vif-plugged:10921d24-768e-4af8-941f-79752bd08fa1 for instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 on n-h1-836830-16 Sep 07 09:49:07.285389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e8dc9ba4-c483-4344-ac8c-860433849704 req-c1b0ca6d-7e6f-48a8-af59-65deca921102 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076463 Sep 07 09:49:07.286589 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 644/1262] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:07.293495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:07.294487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:07.302705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:07.303549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:07.304226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:07.305151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:07.305863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:07.307572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:07.700378 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92fb75ab-be33-4f03-8336-db20d5b4458e tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.146941 Sep 07 09:49:07.709847 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 619/1263] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 09:49:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:07.715868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31892ec5-dc05-467c-b5d8-435075083f24", "device": "/dev/xvdb"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:07.718766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:07.726132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:07.727629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:07.730960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:07.732118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:07.733456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:07.734134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:07.967231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:07.982385 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0fa485ba-96b0-4635-b6f1-f9e79ef629f7 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.691700 Sep 07 09:49:07.983746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 645/1264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:07 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:07.996792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:08.000299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:08.012131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:08.012603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:08.015648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:08.017922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:08.018270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:08.019606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:08.259956 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9ac9614c-5217-4cc1-8aa1-1acbd9bd5473 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "POST /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.546772 Sep 07 09:49:08.261352 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 620/1265] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 7 09:49:07 2022] POST /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:49:08.298245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:08.299005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:08.320945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:08.321408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:08.326979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:08.328571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:08.329089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:08.330781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:08.855696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:08.871419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0e666ef-0cec-4b5d-bb62-f2ae6394589b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1318 microversion: 2.1 time: 0.885894 Sep 07 09:49:08.876357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 646/1266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:07 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1318 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:08.884871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ab62f84-ad40-4d31-9818-13266ad76318 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Action: 'create', calling method: .version_select at 0x7f14b1d03e50>, body: {"security_group_rule": {"parent_group_id": "6b9dfea9-7fa3-4231-8889-3c55eff13749", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:09.004145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:09.022072 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-29db6374-f727-441a-96d8-9a36e2004b25 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1466 microversion: 2.1 time: 0.752650 Sep 07 09:49:09.023355 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 621/1267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:08 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1466 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:09.033421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:09.055195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:09.083486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:09.084179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:09.084643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:09.085704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:09.086180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:09.086616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:10.539537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:10.566159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aff1e274-ef07-484f-afa1-7eb74baf8986 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 1.541418 Sep 07 09:49:10.568423 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 622/1268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:09 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:10.579481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:10.581296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:10.600952 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ab62f84-ad40-4d31-9818-13266ad76318 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.723072 Sep 07 09:49:10.601595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 647/1269] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 09:49:08 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:10.633436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:10.638067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:10.640608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:10.643717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:10.644665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:10.645370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:10.645967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:10.951681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:10.969568 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-501f972b-42b8-4868-a1e6-0606739ee2b3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.395280 Sep 07 09:49:10.972830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 623/1270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:10 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:10.981966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:10.983559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:10.998586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.000158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.002016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.003805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.004560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.004996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.130792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:11.131888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:11.152839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.169427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.172382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.174923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.175527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.178355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.273474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:11.285060 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de950171-468b-450e-bee6-494df92d06c0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1508 microversion: 2.1 time: 0.310385 Sep 07 09:49:11.286559 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 624/1271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:10 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:11.297523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5086695f-8fc6-4a71-a0be-127526eddcba req-e87df7fd-3da8-4cb2-b659-0fe27874ce12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a88295-7950-4fde-80e4-6d15e59eef01", "name": "network-vif-plugged", "status": "completed", "tag": "88695c13-806f-452d-8e6b-90df9882cafb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:11.317880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5086695f-8fc6-4a71-a0be-127526eddcba req-e87df7fd-3da8-4cb2-b659-0fe27874ce12 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.318366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5086695f-8fc6-4a71-a0be-127526eddcba req-e87df7fd-3da8-4cb2-b659-0fe27874ce12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.318802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5086695f-8fc6-4a71-a0be-127526eddcba req-e87df7fd-3da8-4cb2-b659-0fe27874ce12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.339767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5086695f-8fc6-4a71-a0be-127526eddcba req-e87df7fd-3da8-4cb2-b659-0fe27874ce12 service nova] Creating event network-vif-plugged:88695c13-806f-452d-8e6b-90df9882cafb for instance 08a88295-7950-4fde-80e4-6d15e59eef01 on n-h1-836830-16 Sep 07 09:49:11.355861 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5086695f-8fc6-4a71-a0be-127526eddcba req-e87df7fd-3da8-4cb2-b659-0fe27874ce12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060470 Sep 07 09:49:11.357767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 625/1272] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:11.363842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3276d5e5-ca27-4924-a66e-94482ea41b04 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b19d90d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:11.490933 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3276d5e5-ca27-4924-a66e-94482ea41b04 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/6b9dfea9-7fa3-4231-8889-3c55eff13749" status: 200 len: 663 microversion: 2.1 time: 0.131656 Sep 07 09:49:11.491641 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 626/1273] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:49:11 2022] GET /compute/v2.1/os-security-groups/6b9dfea9-7fa3-4231-8889-3c55eff13749 => generated 663 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:11.499397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:11.505713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:11.518078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.526154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.526755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.527810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:11.528504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:11.530063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:11.925015 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c5e159a9-0727-4c80-8579-5229805c44ad tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1619 microversion: 2.1 time: 1.322211 Sep 07 09:49:11.927388 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 648/1274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:10 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1619 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:11.935450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25f2a24a-aa1e-429d-a6e3-179b56c85c02 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1d030d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:12.064305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:12.097616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e1bc915-5ec3-4f38-9aaa-3b89849feee7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1508 microversion: 2.1 time: 0.601536 Sep 07 09:49:12.099780 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 627/1275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:11 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:12.116734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:12.123756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:12.139649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:12.141665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:12.143166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:12.144599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:12.146233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:12.147451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:12.418737 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25f2a24a-aa1e-429d-a6e3-179b56c85c02 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/3d0153a4-af99-4c67-836d-ffddf72a339e" status: 202 len: 0 microversion: 2.1 time: 0.489610 Sep 07 09:49:12.419668 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 649/1276] 10.222.0.60 () {58 vars in 1287 bytes} [Wed Sep 7 09:49:11 2022] DELETE /compute/v2.1/os-security-group-rules/3d0153a4-af99-4c67-836d-ffddf72a339e => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:12.426505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c90d5e13-4b2c-438c-b677-6fa5d8c816e6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: .version_select at 0x7f14b1d343a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-127847864", "policies": ["affinity"]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:12.493374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c90d5e13-4b2c-438c-b677-6fa5d8c816e6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:12.507506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c90d5e13-4b2c-438c-b677-6fa5d8c816e6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:12.530607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:12.544560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9dc9ba34-7904-4142-917a-dec40f76ed2b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.443509 Sep 07 09:49:12.545166 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 628/1277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:12 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:12.561953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:12.562581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:12.594894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:12.595402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:12.595854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:12.596570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:12.597027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:12.597474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:12.684262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c90d5e13-4b2c-438c-b677-6fa5d8c816e6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:12.693049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c90d5e13-4b2c-438c-b677-6fa5d8c816e6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:12.717293 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c90d5e13-4b2c-438c-b677-6fa5d8c816e6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.296104 Sep 07 09:49:12.720974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 650/1278] 10.222.0.60 () {60 vars in 1174 bytes} [Wed Sep 7 09:49:12 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:12.731759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:12.737515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:12.741951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:12.750133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:12.750878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:12.751491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:12.752374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:12.753153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:12.754039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:12.976562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:49:12.979842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:49:12.980343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:49:12.980751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:49:12.981166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:49:13.133549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:13.144741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:13.145537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:13.146132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:13.146789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:13.147614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:13.148088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:13.148583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:13.157454 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0bb1080-6a34-4846-8aa6-763df14e0365 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1318 microversion: 2.1 time: 0.603946 Sep 07 09:49:13.161496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 629/1279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:12 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:13.167344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cef7f4cc-48dc-4ddd-9e24-73a42cb37acc tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1a0bdc0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:13.222912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6d3ad70-b7bf-4726-b358-5aa92061ba01 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "POST /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45/action" status: 202 len: 1110 microversion: 2.1 time: 0.500504 Sep 07 09:49:13.224207 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 651/1280] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:49:12 2022] POST /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45/action => generated 1110 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 09:49:13.241896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-424545182", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b758ceea-36ad-4eef-b15d-83bcf1c199a4"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:13.390867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:49:13.778562 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cef7f4cc-48dc-4ddd-9e24-73a42cb37acc tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6b9dfea9-7fa3-4231-8889-3c55eff13749" status: 202 len: 0 microversion: 2.1 time: 0.615703 Sep 07 09:49:13.779167 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 630/1281] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:13 2022] DELETE /compute/v2.1/os-security-groups/6b9dfea9-7fa3-4231-8889-3c55eff13749 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:13.788146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:13.788871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:13.804096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:13.804610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:13.805060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:13.805808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:13.816041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:13.816511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:13.968773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:49:13.969913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:49:13.970461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:49:13.970941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:49:13.971291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:49:14.026319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:14.026914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:14.028176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:14.029121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:14.029791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:14.030487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:14.082103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:14.096175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:14.125277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:14.141973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-24a2299a-7b9a-441d-b81c-2e956e5f0c14 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.358049 Sep 07 09:49:14.142597 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 631/1282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:13 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:14.161050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Going to run 2 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:49:14.167281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:49:14.268097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128833) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 07 09:49:14.301887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:14.312182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:14.397260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa565556-da68-4d9b-91e9-cf4e40628d35 tempest-ListImagesTestJSON-1621290290 tempest-ListImagesTestJSON-1621290290-project] Calling method '.version_select at 0x7f14b1a1c820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:14.425837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:14.432495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:14.450734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=663137aa-8113-4d52-a3c8-224bc7bee2df,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:49:14.484502 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa565556-da68-4d9b-91e9-cf4e40628d35 tempest-ListImagesTestJSON-1621290290 tempest-ListImagesTestJSON-1621290290-project] 10.222.0.60 "GET /compute/v2.1/images/8aa3194e-7f8e-4ddc-8419-88dfe300e0f7" status: 200 len: 784 microversion: 2.1 time: 0.340794 Sep 07 09:49:14.485636 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 632/1283] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:49:14 2022] GET /compute/v2.1/images/8aa3194e-7f8e-4ddc-8419-88dfe300e0f7 => generated 784 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:14.491965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:14.492934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:14.520644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:14.529816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:14.531352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:14.533027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:14.533547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:14.535580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:14.554500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:14.563723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:14.666664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:14.673100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:14.731988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-355d45e9-993c-4121-880c-95f2afb83df9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.505151 Sep 07 09:49:14.732915 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 652/1284] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:49:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 1508 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 07 09:49:14.740093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1af41f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:14.840324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a69f8337-b198-47db-925d-42308f47b598 does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:49:14.841220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Neutron security group a69f8337-b198-47db-925d-42308f47b598 not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:49:14.848405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] HTTP exception thrown: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.848405 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Request method failure captured: Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/a69f8337-b198-47db-925d-42308f47b598 HTTP/1.1 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGj85as3NQyT-_A8pLBranqcC4i5Ury_VqDEVMRMJqZUyQr7Q9Bw8cl9BFxfo2Wn0Tb82KFcxCRQ2Htn2JWkKz5wUy2BCNu4wxiIoZAzOZvX1v7kPs3ITBu-v0GvacDpbE3gCxypUEURPnHAWkhNg0QRvMQ1ZA6Fsflen2IWIc3rT_4 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 74d1538c1a094975b29eb263b0f40206 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1559336212 Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:49:14.851364 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74d1538c1a094975b29eb263b0f40206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74d1538c1a094975b29eb263b0f40206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74d1538c1a094975b29eb263b0f40206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74d1538c1a094975b29eb263b0f40206", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1559336212 Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 74d1538c1a094975b29eb263b0f40206 Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1559336212 Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupRulesTestJSON-1559336212-project Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 90db7bf21edb4f24853d8607488c17d8 Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1559336212-project Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] Sep 07 09:49:14.853523 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a69f8337-b198-47db-925d-42308f47b598'} Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:49:14.859622 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:49:14.865110 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.868350 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] Sep 07 09:49:14.870884 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:14.871457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:14.873945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Returning 404 to user: Security group a69f8337-b198-47db-925d-42308f47b598 does not exist Sep 07 09:49:14.873945 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-3e16d78a-dc23-4a1d-b575-2149ce0587ea'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:49:14.874953 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18438c5e-6e3c-40aa-b293-5a5e7dbfd1ec tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a69f8337-b198-47db-925d-42308f47b598" status: 404 len: 194 microversion: 2.1 time: 0.138758 Sep 07 09:49:14.876305 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72521a19-f964-45ee-b0fc-8d1a7e53149f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.387928 Sep 07 09:49:14.884091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 633/1285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:14 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:14.889813 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 653/1286] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:14 2022] DELETE /compute/v2.1/os-security-groups/a69f8337-b198-47db-925d-42308f47b598 => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:49:14.898729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:14.901866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:14.903359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-43b54153-dc68-4bd9-9000-209f72cd3d1a tempest-ListImagesTestJSON-1621290290 tempest-ListImagesTestJSON-1621290290-project] Calling method '.version_select at 0x7f14b1d03e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:14.932609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:14.937281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:14.937858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:14.938668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:14.940764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:14.945361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:15.075194 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-43b54153-dc68-4bd9-9000-209f72cd3d1a tempest-ListImagesTestJSON-1621290290 tempest-ListImagesTestJSON-1621290290-project] 10.222.0.60 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.180655 Sep 07 09:49:15.075712 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 654/1287] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 7 09:49:14 2022] GET /compute/v2.1/images => generated 445 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:15.081401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:15.102100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:15.106206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Searching by: {'deleted': False, 'project_id': '16f96dd538e242b88d17442cb92b3d46'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:49:15.142980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:15.144280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:15.145219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:15.146167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:15.146634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:15.147075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:15.280321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:15.292513 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3381cd2e-6109-4b6f-a16f-fcda4cfef5af tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1506 microversion: 2.1 time: 0.406604 Sep 07 09:49:15.293693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 634/1288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:14 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:15.300584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1192846b-2710-411c-81fd-cb000bd60b8f tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1a15940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:15.347745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:49:15.872930 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66a3b6f6-8235-48f0-8736-ebc3978e69ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.796440 Sep 07 09:49:15.881536 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 655/1289] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 09:49:15 2022] GET /compute/v2.1/servers => generated 1002 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:15.888236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f0780f57-ec86-4881-b96b-3867222c5902 tempest-ListImagesTestJSON-1621290290 tempest-ListImagesTestJSON-1621290290-project] Calling method '.version_select at 0x7f14b1abe3a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:16.016164 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1192846b-2710-411c-81fd-cb000bd60b8f tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/784914d5-e325-4282-95da-1b8ddc441250" status: 202 len: 0 microversion: 2.1 time: 0.719054 Sep 07 09:49:16.019930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 635/1290] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:15 2022] DELETE /compute/v2.1/os-security-groups/784914d5-e325-4282-95da-1b8ddc441250 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:16.021891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:16.022691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:16.050454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:16.050953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:16.051410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:16.052115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:16.052578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:16.053008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:16.140197 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f0780f57-ec86-4881-b96b-3867222c5902 tempest-ListImagesTestJSON-1621290290 tempest-ListImagesTestJSON-1621290290-project] 10.222.0.60 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.257200 Sep 07 09:49:16.150359 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 656/1291] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:49:15 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:16.158302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-86165a73-bc01-482b-a3aa-a8d1b526ce3f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:16.159425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-86165a73-bc01-482b-a3aa-a8d1b526ce3f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:16.373664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-86165a73-bc01-482b-a3aa-a8d1b526ce3f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:16.380240 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-86165a73-bc01-482b-a3aa-a8d1b526ce3f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1218 microversion: 2.1 time: 0.228346 Sep 07 09:49:16.393371 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 657/1292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:16 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:16.403259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:16.403471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:16.418813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:16.419311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:16.419821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:16.420540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:16.421004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:16.421455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:16.457610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:16.600283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:16.612920 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14ffd6c3-4f9a-42ce-8fb2-a3267c89d7a1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.591492 Sep 07 09:49:16.613902 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 636/1293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:16 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:16.622650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4c213c4-e63e-480f-b802-6192b9cb70a2 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1b63940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:17.016799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:17.026624 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49bb0ebb-fceb-45ab-8d56-33f60b13a5b2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.644721 Sep 07 09:49:17.034158 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 658/1294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:16 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:17.284503 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4c213c4-e63e-480f-b802-6192b9cb70a2 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/f0787735-97cb-4e18-b612-2bbb033607fe" status: 202 len: 0 microversion: 2.1 time: 0.666048 Sep 07 09:49:17.285404 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 637/1295] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:16 2022] DELETE /compute/v2.1/os-security-groups/f0787735-97cb-4e18-b612-2bbb033607fe => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:17.294466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-989323b0-b9e6-4f76-b547-4b3e532a6f61 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1af4f70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:17.408668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:17.409634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:17.423561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:17.425726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:17.433986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:17.435095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:17.435800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:17.436579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:17.686875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:17.703477 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b9efbdf-b0f4-4c12-9f5a-95f96888e5b3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1214 microversion: 2.1 time: 0.299255 Sep 07 09:49:17.704152 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 638/1296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:17 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:49:17.717129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:17.718057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:17.743008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:17.744752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:17.753944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:17.754996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:17.755575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:17.756103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:18.455987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:18.473821 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67f3d99b-1891-42b2-9771-21bcbb2c00ef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.767040 Sep 07 09:49:18.475392 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 639/1297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:17 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:18.483261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-989323b0-b9e6-4f76-b547-4b3e532a6f61 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/616ef300-095f-4fc1-93e0-ba12a7e29e26" status: 202 len: 0 microversion: 2.1 time: 1.193668 Sep 07 09:49:18.487446 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 659/1298] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:17 2022] DELETE /compute/v2.1/os-security-groups/616ef300-095f-4fc1-93e0-ba12a7e29e26 => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:49:18.492654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb8124e3-1f46-4983-92be-b153adaf04a9 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1aefca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:18.502115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:18.506926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:18.516622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:18.517448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:18.517999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:18.518819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:18.519393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:18.519930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:18.548179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:19.637014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:19.646042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56ddcdd4-3d47-4f19-8e94-675e04e12b57 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 1.159640 Sep 07 09:49:19.673657 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 640/1299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:18 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:19.715765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:19.716518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:19.741069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:19.741602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:19.742077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:19.742876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:19.743970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:19.744570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:20.864858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:20.891079 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c80ba1d2-41b0-41da-85ab-325cb8000f1b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1276 microversion: 2.1 time: 1.201869 Sep 07 09:49:20.901228 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 641/1300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:19 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1276 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:20.955927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:20.982009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:21.008366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:21.014212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:21.014695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:21.015445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:21.015919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:21.016347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:23.490696 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb8124e3-1f46-4983-92be-b153adaf04a9 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/925827c7-0236-4047-b0b6-173564866cef" status: 202 len: 0 microversion: 2.1 time: 5.000588 Sep 07 09:49:23.492947 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 660/1301] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:18 2022] DELETE /compute/v2.1/os-security-groups/925827c7-0236-4047-b0b6-173564866cef => generated 0 bytes in 5005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:23.500085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:23.501548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:23.527575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:23.528088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:23.528683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:23.530663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:23.531148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:23.536224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:23.778084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:23.789580 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01b94867-6b58-4177-bb5b-f42034b53a09 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 2.884093 Sep 07 09:49:23.799372 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 642/1302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:20 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 2903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:23.815481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:23.818624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:23.845516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:23.848425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:23.849093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:23.849991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:23.854461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:23.855106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:24.345263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:24.357726 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a9c7a22-780a-44d9-b99d-93e0664b3745 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.863297 Sep 07 09:49:24.375506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 661/1303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:23 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:24.391417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "60cad099-7bbe-47b0-8d76-64bc23e3442d"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:24.404827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:24.430184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:24.431399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:24.434122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:24.434875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:24.437230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:24.438844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:24.547039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] HTTP exception thrown: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Request method failure captured: Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01/os-volume_attachments/1776a1b1-891a-4db3-a4bb-880d1ca4cb23 HTTP/1.1 Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 74 Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiY_EJDexYROTwVJIAA1drQm5jMnHdul8TaVZSNcTgPsssQdMXUq3lfYFzdqvthjRVbHJ4njwikagCfGIG__6ChdIWk7Ooxx3e3uzvZt8T1IaVbHJR3uiHHSqM__xyqxQxfpypA1c-FF0jj-7qx2Z9L9EbWHapxlyoZoFMRbyS3rtg Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 4205fd3d83614bca9b47239065393c52 Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesAdminNegativeTest-1059058548 Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:49:24.552533 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4205fd3d83614bca9b47239065393c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4205fd3d83614bca9b47239065393c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4205fd3d83614bca9b47239065393c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4205fd3d83614bca9b47239065393c52", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesAdminNegativeTest-1059058548 Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 4205fd3d83614bca9b47239065393c52 Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1059058548 Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesAdminNegativeTest-1059058548-project-admin Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 4b3e11edc3c14f738d9a01ac20092fd3 Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesAdminNegativeTest-1059058548-project-admin Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: {"volumeAttachment": {"volumeId": "60cad099-7bbe-47b0-8d76-64bc23e3442d"}} Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:49:24.554168 n-d-836830-16 devstack@n-api.service[128833]: exception: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '08a88295-7950-4fde-80e4-6d15e59eef01', 'id': '1776a1b1-891a-4db3-a4bb-880d1ca4cb23', 'body': {'volumeAttachment': {'volumeId': '60cad099-7bbe-47b0-8d76-64bc23e3442d'}}} Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 09:49:24.556265 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. (HTTP 404) (Request-ID: req-b15efad2-c684-4b59-9a05-36af03787c34) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 09:49:24.557555 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:49:24.560007 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. Sep 07 09:49:24.562626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:24.567242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] Returning 404 to user: Volume 1776a1b1-891a-4db3-a4bb-880d1ca4cb23 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:49:24.567242 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-021df5f4-f1b8-4154-bf2b-30db1eb119fe tempest-VolumesAdminNegativeTest-1059058548 tempest-VolumesAdminNegativeTest-1059058548-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01/os-volume_attachments/1776a1b1-891a-4db3-a4bb-880d1ca4cb23" status: 404 len: 109 microversion: 2.1 time: 0.176923 Sep 07 09:49:24.567242 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 662/1304] 10.222.0.60 () {60 vars in 1433 bytes} [Wed Sep 7 09:49:24 2022] PUT /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01/os-volume_attachments/1776a1b1-891a-4db3-a4bb-880d1ca4cb23 => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:49:24.572383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9084cbd7-3068-4b8f-9fdd-1b40e3acbbb7 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] Calling method '.version_select at 0x7f14b1af4af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:24.644313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:24.656003 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8225df80-2072-42ac-ab83-7405bf296e0e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.852926 Sep 07 09:49:24.657469 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 643/1305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:23 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:24.850468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:24.855623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:24.872146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:24.872641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:24.873077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:24.877476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:24.879203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:24.881113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:25.182946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:25.748005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:25.759676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c21d3047-6db3-47fd-93c7-6a81f00cd463 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.927728 Sep 07 09:49:25.777539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 644/1306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:24 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:25.782744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:25.784186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:25.791464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:25.792010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:25.800318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:25.801103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:25.801678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:25.802118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:26.380145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=32 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:26.785956 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9084cbd7-3068-4b8f-9fdd-1b40e3acbbb7 tempest-SecurityGroupRulesTestJSON-1559336212 tempest-SecurityGroupRulesTestJSON-1559336212-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3a40b9e4-4414-4201-ad48-4c9025a1ceb5" status: 202 len: 0 microversion: 2.1 time: 2.223840 Sep 07 09:49:26.787219 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 663/1307] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:49:24 2022] DELETE /compute/v2.1/os-security-groups/3a40b9e4-4414-4201-ad48-4c9025a1ceb5 => generated 0 bytes in 2226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:26.802991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:26.803796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:26.823469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:26.824350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:26.825711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:26.833601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:26.836000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:26.839114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:26.839956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:26.853468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-83df48cb-c358-4526-bf39-b06892c07409 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 1.077511 Sep 07 09:49:26.855791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 645/1308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:25 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:26.881435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:26.884912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:26.928662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:26.934463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:26.935020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:26.935787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:26.936270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:26.936708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:27.796386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:27.807507 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7c6c6a8-3b6f-42df-bce8-4175aba49f43 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 1.016658 Sep 07 09:49:27.810222 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 664/1309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:26 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:27.889796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:27.890984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:27.905845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:27.906647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:27.908630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:27.909807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:27.911719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:27.913700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:28.045653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:28.058495 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-482cbcc0-424f-48a9-a138-3f8303fbacf0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 1.199499 Sep 07 09:49:28.067288 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 646/1310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:26 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:28.641336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:28.660471 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25cbe481-e3a6-4abd-be6c-ad9f899b31e4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.775591 Sep 07 09:49:28.676500 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 665/1311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:27 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:28.846003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:28.847133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:28.860520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:28.863170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:28.869398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:28.870985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:28.872176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:28.872870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:29.093255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:29.094124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:29.106895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:29.108676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:29.124359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:29.129093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:29.134693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:29.136802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:30.207978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:30.222930 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d658693-b985-4b6d-8301-e6749e46f414 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 1.380446 Sep 07 09:49:30.224724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:30.225228 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 647/1312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:28 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:30.235882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:30.241277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:30.247435 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bccf6628-9748-46f6-ab47-2b9d01dd8ae7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 1.162013 Sep 07 09:49:30.255507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:30.256004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:30.256443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:30.256918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 666/1313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:29 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:30.263095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:30.263898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:30.266333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:30.268096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:30.270106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:30.278302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:30.278966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:30.279525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:30.282879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:30.283502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:30.284064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:30.862535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 1c670f25-8fd6-4cb0-8f33-b8544182fa74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:49:30.929840 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c3ed17f-a932-4de8-b644-324e5dd07e52 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 2424 microversion: 2.25 time: 0.703158 Sep 07 09:49:30.933680 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 648/1314] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:30 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 2424 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:30.943905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1b73b391-7c6e-4885-b593-466b327627e1 req-2fb52200-928a-41b5-b5bd-de0597ccf552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6290e549-3bbe-4969-b781-2336c21bf568", "tag": "f72fbdcf-2318-4e62-b4c1-c4145dfc9f9f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:30.981006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b73b391-7c6e-4885-b593-466b327627e1 req-2fb52200-928a-41b5-b5bd-de0597ccf552 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:30.981901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b73b391-7c6e-4885-b593-466b327627e1 req-2fb52200-928a-41b5-b5bd-de0597ccf552 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:30.982638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b73b391-7c6e-4885-b593-466b327627e1 req-2fb52200-928a-41b5-b5bd-de0597ccf552 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.021849 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1b73b391-7c6e-4885-b593-466b327627e1 req-2fb52200-928a-41b5-b5bd-de0597ccf552 service nova] Creating event network-changed:f72fbdcf-2318-4e62-b4c1-c4145dfc9f9f for instance 6290e549-3bbe-4969-b781-2336c21bf568 on n-h2-836830-16 Sep 07 09:49:31.037517 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1b73b391-7c6e-4885-b593-466b327627e1 req-2fb52200-928a-41b5-b5bd-de0597ccf552 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102263 Sep 07 09:49:31.043063 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 649/1315] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:31.054744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:31.059269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:31.068640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:31.071998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:31.075330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.078544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:31.079169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:31.079742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.139484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:49:31.169939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:31.186602 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cdd17ac-a7ac-469a-9589-4098ec395256 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1719 microversion: 2.1 time: 0.928432 Sep 07 09:49:31.187199 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 667/1316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:30 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1719 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:31.204625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-16", "block_migration": "auto"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:31.219738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:31.248974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:31.248974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:31.248974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.250436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:31.251193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:31.251784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.300612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'flavor' on Instance uuid 1c670f25-8fd6-4cb0-8f33-b8544182fa74 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:49:31.302214 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-33e09b4c-1a2d-4323-84b6-1b4ce387d685 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 204 len: 0 microversion: 2.1 time: 0.257284 Sep 07 09:49:31.305883 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 650/1317] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:49:31 2022] DELETE /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:49:31.310355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:31.311072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:31.320140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Going to try to live migrate instance to n-h1-836830-16 {{(pid=128833) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:49:31.327786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:31.335478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:31.336172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.337861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:31.338942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:31.339535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:31.341171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:31.960826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:31.989145 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd561ab4-8739-4274-95e5-d9a97026ea05 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.683444 Sep 07 09:49:32.011989 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 651/1318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:31 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:32.024625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:32.029319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:32.059014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:32.062019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:32.068131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:32.069761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:32.078856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:32.079483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:32.754985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:32.764807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ded5a3f-4e65-45bd-8502-31bdfd585181 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.751464 Sep 07 09:49:32.790914 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 652/1319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:32 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:32.829597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:32.835177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:32.871916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:32.874532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:32.876022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:32.881167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:32.882679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:32.885929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:33.750133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:33.762059 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-966c4f8c-dbe1-4152-8090-c94059271950 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1512 microversion: 2.1 time: 0.951823 Sep 07 09:49:33.778574 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 653/1320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:32 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1512 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:33.785250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:33.786095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:33.802529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:33.803594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:33.804220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:33.805138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:33.805848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:33.806843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:34.097800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:34.108637 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12d3d27c-47a1-437c-9bfd-bd8cf0481eb4 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1709 microversion: 2.1 time: 0.328629 Sep 07 09:49:34.137613 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 654/1321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:33 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1709 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:34.158531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:34.161802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:34.172372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:34.175568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:34.176206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:34.177324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:34.177956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:34.178547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:34.734921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:34.739173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:34.749990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aefaf53f-e3e1-4524-8529-4a496cc8298d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.608697 Sep 07 09:49:34.755102 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 655/1322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:34 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:35.077526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f2b3f9cf-32d7-46b2-815c-4529e7cf9210 req-235a6dfb-c4cb-4e3b-9f51-1f013e1e588c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663137aa-8113-4d52-a3c8-224bc7bee2df", "tag": "7c0dcf2b-018a-48f2-933b-9c3a731a9729"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:35.088313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f2b3f9cf-32d7-46b2-815c-4529e7cf9210 req-235a6dfb-c4cb-4e3b-9f51-1f013e1e588c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:35.088796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f2b3f9cf-32d7-46b2-815c-4529e7cf9210 req-235a6dfb-c4cb-4e3b-9f51-1f013e1e588c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:35.089442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f2b3f9cf-32d7-46b2-815c-4529e7cf9210 req-235a6dfb-c4cb-4e3b-9f51-1f013e1e588c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:35.105002 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f2b3f9cf-32d7-46b2-815c-4529e7cf9210 req-235a6dfb-c4cb-4e3b-9f51-1f013e1e588c service nova] Creating event network-changed:7c0dcf2b-018a-48f2-933b-9c3a731a9729 for instance 663137aa-8113-4d52-a3c8-224bc7bee2df on n-h2-836830-16 Sep 07 09:49:35.116280 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f2b3f9cf-32d7-46b2-815c-4529e7cf9210 req-235a6dfb-c4cb-4e3b-9f51-1f013e1e588c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358648 Sep 07 09:49:35.117594 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 656/1323] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:35.125402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:35.126402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:35.134191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:35.135337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:35.135960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:35.136938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:35.137654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:35.138277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:35.642004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9025fd2b-0f42-4627-bbaf-8e89f76c6453 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/action" status: 202 len: 0 microversion: 2.25 time: 4.447639 Sep 07 09:49:35.645485 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 668/1324] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:49:31 2022] POST /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/action => generated 0 bytes in 4452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:49:35.652895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8d76d67c-ee5c-485b-9c56-1f2f1e6fd825 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '.version_select at 0x7f14b1c42c10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:35.657375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d76d67c-ee5c-485b-9c56-1f2f1e6fd825 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:35.658293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d76d67c-ee5c-485b-9c56-1f2f1e6fd825 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:35.659275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d76d67c-ee5c-485b-9c56-1f2f1e6fd825 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:35.677218 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8d76d67c-ee5c-485b-9c56-1f2f1e6fd825 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.030234 Sep 07 09:49:35.678398 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 669/1325] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:49:35 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:35.687109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:35.691344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:35.721030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:35.722116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:35.723253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:35.724212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:35.724911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:35.725875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:36.080932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:36.091744 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e458327d-309a-4fe8-9c42-bafd91b601b4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.970223 Sep 07 09:49:36.092423 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 657/1326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:35 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:36.103062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:36.107662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:36.128727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:36.131958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:36.132486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:36.133259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:36.134314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:36.141509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:36.190874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:36.208446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69804c55-c66f-45bb-83aa-9477d1f23637 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 200 len: 1470 microversion: 2.1 time: 0.528564 Sep 07 09:49:36.234362 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 670/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:35 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:36.247481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:36.248112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:36.294398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:36.296928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:36.299283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:36.300084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:36.300566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:36.301017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.033882 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15afb4cf-c9e9-41c7-aeb1-bfd7b29f23be tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1862 microversion: 2.1 time: 0.796104 Sep 07 09:49:37.041730 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 671/1328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:36 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1862 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:37.048959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:37.049612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:37.071502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.072032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.072550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.073484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.073956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.074384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.121284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:37.144019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:37.146501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:37.147694 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74219ad6-997f-442d-a1b3-aef39bd214b0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 1.053495 Sep 07 09:49:37.148262 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 658/1329] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:36 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:37.153775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:37.154378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:37.169153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.169412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.169772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.172019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.172019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.172019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.582812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:37.596054 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-914fdc93-7177-4d1b-97ca-9beca68b774c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.552436 Sep 07 09:49:37.599178 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 672/1330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:37 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:37.632391 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ef62f8e5-fdb9-43ae-989f-581885896a3e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1862 microversion: 2.1 time: 0.483062 Sep 07 09:49:37.635168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 659/1331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:37 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1862 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:37.641597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:37.643143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:37.651283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.652167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.652849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.653829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.654551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.655468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.730213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-caddba06-943c-433e-a19e-e610afe42212 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Action: 'create', calling method: .version_select at 0x7f14b1bf11f0>, body: {"keypair": {"name": "tempest-keypair-814353555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo2v4vIpnWrF0xRrbF+2dQxHNncaQ36/wCCavhUF1WdkcUobbrI+15LZKs+Mlog+t3xo66Wxh4FvnBOzHXyQ2zRNDbV2hOapF55gZjafeat1ty0W9Ak82Y0zLUOy2KUWw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:37.773164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-caddba06-943c-433e-a19e-e610afe42212 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Getting quotas for project 5d9c07a2e93d4c9090437eb8619707e5. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:37.781569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-caddba06-943c-433e-a19e-e610afe42212 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Getting quotas for user 66766678af0742218f4981309826f885 and project 5d9c07a2e93d4c9090437eb8619707e5. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:37.818188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-caddba06-943c-433e-a19e-e610afe42212 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.217328 Sep 07 09:49:37.819139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 673/1332] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:49:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:37.839135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:37.842916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 08a88295-7950-4fde-80e4-6d15e59eef01] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:37.859142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.860614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.861289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.863544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.865608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:37.867189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:37.920152 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] HTTP exception thrown: Instance 08a88295-7950-4fde-80e4-6d15e59eef01 could not be found. Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Request method failure captured: Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 HTTP/1.1 Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGiBy_bDcWhCVBiG5JjTklmBTlbU1Mk9EAK2Lx0A_URcTfOzKVXcdWKUsEcj61dIjEnIXVt-kHBvcNC7xuD2_yZGOQ7_OI1WmB-jRI4w-Xkp47kuWmsCnDbtaU_w_8NbBP3S9mWmu6NJ9n4fGI3V1ChIMzHXMEzO9tqDXBqlB72RxSg Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 017dac8978b64d4c94cc2ef118e5fa69 Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesAdminNegativeTest-1451209324 Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:49:37.921634 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/017dac8978b64d4c94cc2ef118e5fa69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/017dac8978b64d4c94cc2ef118e5fa69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/017dac8978b64d4c94cc2ef118e5fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_017dac8978b64d4c94cc2ef118e5fa69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesAdminNegativeTest-1451209324 Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 017dac8978b64d4c94cc2ef118e5fa69 Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1451209324 Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesAdminNegativeTest-1451209324-project Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: ba350a258ac24186b93317fcb1066a65 Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesAdminNegativeTest-1451209324-project Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 08a88295-7950-4fde-80e4-6d15e59eef01 could not be found. Sep 07 09:49:37.923332 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '08a88295-7950-4fde-80e4-6d15e59eef01'} Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a88295-7950-4fde-80e4-6d15e59eef01 could not be found. Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:49:37.924732 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a88295-7950-4fde-80e4-6d15e59eef01 could not be found. Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a88295-7950-4fde-80e4-6d15e59eef01 could not be found. Sep 07 09:49:37.926631 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:49:37.928125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Returning 404 to user: Instance 08a88295-7950-4fde-80e4-6d15e59eef01 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:49:37.928125 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac96dc63-d2d6-4cec-a464-022faebc0bd0 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01" status: 404 len: 111 microversion: 2.1 time: 0.102470 Sep 07 09:49:37.949527 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 674/1333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:37 2022] GET /compute/v2.1/servers/08a88295-7950-4fde-80e4-6d15e59eef01 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:49:37.954662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d59e5ad9-51fe-4113-b88f-22b90c4cb7ab req-9181ca34-7eb4-45ea-a7d5-ff608e913226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a88295-7950-4fde-80e4-6d15e59eef01", "name": "network-vif-deleted", "tag": "88695c13-806f-452d-8e6b-90df9882cafb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:37.991672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d59e5ad9-51fe-4113-b88f-22b90c4cb7ab req-9181ca34-7eb4-45ea-a7d5-ff608e913226 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:37.999010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d59e5ad9-51fe-4113-b88f-22b90c4cb7ab req-9181ca34-7eb4-45ea-a7d5-ff608e913226 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.004139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d59e5ad9-51fe-4113-b88f-22b90c4cb7ab req-9181ca34-7eb4-45ea-a7d5-ff608e913226 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:38.036733 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d59e5ad9-51fe-4113-b88f-22b90c4cb7ab req-9181ca34-7eb4-45ea-a7d5-ff608e913226 service nova] Creating event network-vif-deleted:88695c13-806f-452d-8e6b-90df9882cafb for instance 08a88295-7950-4fde-80e4-6d15e59eef01 on n-h1-836830-16 Sep 07 09:49:38.057353 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d59e5ad9-51fe-4113-b88f-22b90c4cb7ab req-9181ca34-7eb4-45ea-a7d5-ff608e913226 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101502 Sep 07 09:49:38.059048 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 675/1334] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:38.069063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:38.069876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:38.111694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:38.117265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.120696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:38.121558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:38.125112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.126358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:38.241872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:38.265117 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4fcd26d9-74a5-4a8d-a1d4-73bcf64ebc04 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.627440 Sep 07 09:49:38.268312 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 660/1335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:37 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:38.283122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:38.284292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:38.313601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:38.314837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.315419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:38.319736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:38.320322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.338733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:38.540747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lazy-loading 'services' on Instance uuid ddc44587-4609-4b49-84a9-761bdb462451 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:49:38.845289 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab9c3ad8-5c6c-4cf8-a64b-f0d8292ba38e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments/df2f81ed-fa21-4d85-b849-30864e9f3d0d" status: 202 len: 0 microversion: 2.1 time: 0.783911 Sep 07 09:49:38.846506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 676/1336] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 09:49:38 2022] DELETE /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments/df2f81ed-fa21-4d85-b849-30864e9f3d0d => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:49:38.853051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:38.854008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:38.868344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:38.868879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.870939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:38.871592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:38.872079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:38.873109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:39.040564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:39.055673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:39.066159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:39.074438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75af2bbc-5cdc-4329-b4b3-73b9731b6f7c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.798356 Sep 07 09:49:39.075081 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 661/1337] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:38 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:39.091062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:39.131496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:39.161264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:39.162318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:39.169816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:39.176409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:39.177152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:39.179762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:39.394089 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f2290620-37b4-4e05-b09e-6a761eab4df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.315511 Sep 07 09:49:39.400734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 662/1338] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:39 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:39.425275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:39.428352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:39.458744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:39.464067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:39.465140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:39.468786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:39.470954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:39.475253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:39.536976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:39.549760 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9805d47-b319-4019-842c-414c26f711ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.699596 Sep 07 09:49:39.552400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 677/1339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:38 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:39.876423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:39.886482 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27a988f8-1485-43a0-a800-ccb9e9478f13 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1515 microversion: 2.1 time: 0.483561 Sep 07 09:49:39.887089 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 663/1340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:39 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1515 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:40.103967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:40.104582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:40.118370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.118869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.119313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.120023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.120476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.120901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.207407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:40.414444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:40.419216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:40.440126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.447242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.448931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.452199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.453675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.455617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.579403 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1600040-bfc0-488f-9ac1-7f05a2a9f2cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166528 Sep 07 09:49:40.581584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 664/1341] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:40 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:40.600967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:40.603070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:40.620472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:40.627997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.629668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.631990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:40.632619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.635381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.637297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.639450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.647898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:40.659760 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0342b6c9-8f7f-4d13-8537-1fe52f684bcf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.550326 Sep 07 09:49:40.660683 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 678/1342] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:40 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:40.918592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:40.919527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:40.938849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.940626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.941306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:40.945043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:40.946382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:40.949375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.017666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:41.032850 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62d5c255-9a71-43ce-9166-850b05be08e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.446338 Sep 07 09:49:41.034812 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 665/1343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:40 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:41.314190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:41.346850 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b4ed3c0-603c-41f9-9fb5-58c2b150568a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 0.423252 Sep 07 09:49:41.367148 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 679/1344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:40 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:49:41.595801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:41.598107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:41.615399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:41.618721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:41.623947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.629334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:41.631467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:41.633137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.713590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:41.715611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:41.716100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:41.716545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.717548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:41.718004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:41.718427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.761804 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-557d198d-e2b5-4096-ba3a-5c47ce480df7 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172614 Sep 07 09:49:41.771700 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 680/1345] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:41 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:41.777605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:41.795627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:41.796783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:41.824170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:41.824690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:41.825138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.828212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:41.831444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:41.834233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:41.839377 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8a23630-e912-443e-92e3-6eeaa87b7255 tempest-AZV2TestJSON-1556936794 tempest-AZV2TestJSON-1556936794-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.437199 Sep 07 09:49:41.840246 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 666/1346] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 7 09:49:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:49:41.913553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2037170411", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2f17eec9-55b7-4001-afba-5ca834e4aecb"}], "security_groups": [{"name": "tempest-securitygroup--1208552645"}], "key_name": "tempest-keypair-814353555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:42.323921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] validate_networks() for [('2f17eec9-55b7-4001-afba-5ca834e4aecb', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:49:42.379579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:42.396772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:42.398245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:42.406091 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ecf3208-2a3f-4097-8369-8ffacac90302 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.627026 Sep 07 09:49:42.418777 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 681/1347] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:41 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:42.442296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b3579eff-336c-44d5-b63c-fe21d1c9e96a req-1de84713-33b2-49e0-8fc1-206e8d933645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6290e549-3bbe-4969-b781-2336c21bf568", "name": "network-vif-plugged", "status": "completed", "tag": "f72fbdcf-2318-4e62-b4c1-c4145dfc9f9f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:42.466037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b3579eff-336c-44d5-b63c-fe21d1c9e96a req-1de84713-33b2-49e0-8fc1-206e8d933645 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:42.466518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b3579eff-336c-44d5-b63c-fe21d1c9e96a req-1de84713-33b2-49e0-8fc1-206e8d933645 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:42.473484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b3579eff-336c-44d5-b63c-fe21d1c9e96a req-1de84713-33b2-49e0-8fc1-206e8d933645 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:42.518741 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b3579eff-336c-44d5-b63c-fe21d1c9e96a req-1de84713-33b2-49e0-8fc1-206e8d933645 service nova] Creating event network-vif-plugged:f72fbdcf-2318-4e62-b4c1-c4145dfc9f9f for instance 6290e549-3bbe-4969-b781-2336c21bf568 on n-h2-836830-16 Sep 07 09:49:42.557830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b3579eff-336c-44d5-b63c-fe21d1c9e96a req-1de84713-33b2-49e0-8fc1-206e8d933645 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132077 Sep 07 09:49:42.569365 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 682/1348] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:42.590569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:42.614104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:42.684173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:42.690568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:42.691438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:42.700480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:42.706326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:42.711573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:43.394791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:43.420817 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cdbcdb49-5964-4aeb-b770-bab75de2bbcf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1318 microversion: 2.1 time: 0.842128 Sep 07 09:49:43.424642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 683/1349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:42 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:43.431391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:43.432268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:43.467798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:43.470149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:43.471361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:43.482405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:43.483765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:43.487101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.026064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:44.040873 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-caa74bda-4124-4e65-bf84-ef66441bf54e tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 0.614578 Sep 07 09:49:44.041523 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 684/1350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:43 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:44.065063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:44.075783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Getting quotas for project 5d9c07a2e93d4c9090437eb8619707e5. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:44.078655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:44.096878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Getting quotas for user 66766678af0742218f4981309826f885 and project 5d9c07a2e93d4c9090437eb8619707e5. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:44.111074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.111589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.112037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.112762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.115785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.116253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.119212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:49:44.119641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:49:44.123889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:49:44.124322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:49:44.124742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:49:44.155526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.160409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.161274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.162252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.162932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.163533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.215709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Getting quotas for project 5d9c07a2e93d4c9090437eb8619707e5. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:44.222225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Getting quotas for user 66766678af0742218f4981309826f885 and project 5d9c07a2e93d4c9090437eb8619707e5. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:44.242272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d332d1cb-247e-401c-bc63-12f719c7650c tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193391 Sep 07 09:49:44.244403 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 685/1351] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:44 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:44.248588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:49:44.251478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:49:44.265904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:44.268667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:44.289004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.291357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.291975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.293084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.293988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.294694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.339429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c1e84ce-e710-4196-8dce-9b20cbfde14b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.432419 Sep 07 09:49:44.361222 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 667/1352] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:49:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:49:44.375994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21e9e4a0-624a-4ed8-98fc-2a0e1f0e28ee tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:44.377106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-21e9e4a0-624a-4ed8-98fc-2a0e1f0e28ee tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:44.574839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21e9e4a0-624a-4ed8-98fc-2a0e1f0e28ee tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:44.582314 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21e9e4a0-624a-4ed8-98fc-2a0e1f0e28ee tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1269 microversion: 2.1 time: 0.219587 Sep 07 09:49:44.586112 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 668/1353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:44 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:44.597154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:44.598810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:44.614782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.617085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.619507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.622697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:44.623552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:44.624613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:44.716177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:44.737730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:44.741660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:44.750790 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3bc5bf08-eb5b-427b-99c2-906df5c78b23 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.504442 Sep 07 09:49:44.752474 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 686/1354] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:44 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:45.051600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:45.067432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55172d08-0ffb-4289-9f56-50c4760291fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1468 microversion: 2.1 time: 0.479185 Sep 07 09:49:45.070204 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 669/1355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:44 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:45.084332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:45.087369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:45.101342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.101846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.102886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.107102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.107570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.108020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.433909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:45.447042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e083c776-4a66-4f75-a8d4-c20ba6e0a8ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 0.373677 Sep 07 09:49:45.448041 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 670/1356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:45 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:45.454855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:45.455769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:45.464277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.465068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.465837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.468132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.469014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.469815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.486396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3efd3875-d49f-416c-9c58-25ee268df8b6 req-b93decf7-4576-4ebc-a2eb-e48051dbc92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663137aa-8113-4d52-a3c8-224bc7bee2df", "name": "network-vif-plugged", "status": "completed", "tag": "7c0dcf2b-018a-48f2-933b-9c3a731a9729"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:45.513397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3efd3875-d49f-416c-9c58-25ee268df8b6 req-b93decf7-4576-4ebc-a2eb-e48051dbc92f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.513899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3efd3875-d49f-416c-9c58-25ee268df8b6 req-b93decf7-4576-4ebc-a2eb-e48051dbc92f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.525626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3efd3875-d49f-416c-9c58-25ee268df8b6 req-b93decf7-4576-4ebc-a2eb-e48051dbc92f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.561992 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3efd3875-d49f-416c-9c58-25ee268df8b6 req-b93decf7-4576-4ebc-a2eb-e48051dbc92f service nova] Creating event network-vif-plugged:7c0dcf2b-018a-48f2-933b-9c3a731a9729 for instance 663137aa-8113-4d52-a3c8-224bc7bee2df on n-h2-836830-16 Sep 07 09:49:45.592088 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3efd3875-d49f-416c-9c58-25ee268df8b6 req-b93decf7-4576-4ebc-a2eb-e48051dbc92f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.837720 Sep 07 09:49:45.601662 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 687/1357] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:45.628769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:45.649923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:45.666140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.672074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.672955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.674081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.674695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.675420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.744712 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-73aff6ac-e547-40b2-a505-efbc854a3a34 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138696 Sep 07 09:49:45.750550 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 688/1358] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:45 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:45.762881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-495f1b30-0cd0-4fa5-aa7c-066d546b1ea7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:45.763768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-495f1b30-0cd0-4fa5-aa7c-066d546b1ea7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:45.794299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:45.807019 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b7e4ccbc-dfea-4dbd-83ec-de48e31df50f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1318 microversion: 2.1 time: 0.357397 Sep 07 09:49:45.809062 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 671/1359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:45 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:45.813981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:45.814864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:45.841827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.849624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.853637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.856083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:45.857941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:45.859377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:45.927219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-495f1b30-0cd0-4fa5-aa7c-066d546b1ea7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:45.938124 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-495f1b30-0cd0-4fa5-aa7c-066d546b1ea7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1269 microversion: 2.1 time: 0.186214 Sep 07 09:49:45.951402 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 689/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:45 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:46.264952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:46.283134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:46.286121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:46.292621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f32e19e8-858c-4bc6-b37c-3e76192568e8 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.481500 Sep 07 09:49:46.304584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 672/1361] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:45 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:46.475229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:46.476018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:46.496819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.504097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.504990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.506119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.507041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.510122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.757547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:46.760706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:46.787660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.789115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.790082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.791100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.791814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.792483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.861603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b9f35cc-8f99-4fc5-873b-06ad6cfa0714 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108160 Sep 07 09:49:46.865854 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 673/1362] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:46 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:49:46.879702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:46.885007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:46.910760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:46.911003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.911679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.915483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.916654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.920787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.924032 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4ecaaee2-ae64-409b-bd13-9e9f3c4ddbc6 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 0.451522 Sep 07 09:49:46.924706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.942538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 690/1363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:46 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:46.962207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:46.962207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:46.988830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.989585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.990176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:46.990901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:46.991393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:46.991829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:47.228929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:47.232315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:47.238772 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37dccc07-dfa2-4584-a632-25ef62ddbf0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1318 microversion: 2.1 time: 0.371692 Sep 07 09:49:47.242548 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-515aebcc-777c-42fb-8c04-4ed0ef763cca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1321 microversion: 2.1 time: 0.284951 Sep 07 09:49:47.243152 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 674/1364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:46 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:47.258715 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 691/1365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:46 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:47.319714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:47.320522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:47.337774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:47.338662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:47.339360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:47.340331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:47.341022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:47.341715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:47.380626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:47.881799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:47.886279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:47.924571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:47.926561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:47.928643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:47.936221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:47.937058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:47.940505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.052253 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f686715-dd9d-4a1a-9d72-b71ebef3413b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177078 Sep 07 09:49:48.057726 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 692/1366] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:47 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:48.064976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:48.070223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:48.093000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.094273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.096080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.097162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.099365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.104057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.498655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:48.510371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:48.512199 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48a13921-c719-40a8-bfea-7fc1c520a735 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 0.450736 Sep 07 09:49:48.512802 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 693/1367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:48 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:48.518943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:48.526502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:48.527529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:48.532661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:48.534134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de6c99e6-8ef6-4f7c-bf43-80bdff618330 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 1.218700 Sep 07 09:49:48.535147 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 675/1368] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:47 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:48.541278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:48.544024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:48.558824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.560599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.561526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.561746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.562414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.563353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.563944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.564816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.565614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.566303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.566922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.567494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.871946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:48.892422 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f3d42e0-50ad-4f41-82b3-379bba43d461 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1327 microversion: 2.1 time: 0.376927 Sep 07 09:49:48.893101 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 694/1369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:48 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1327 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:48.912834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3ef95655-a7f0-42d7-b1e6-9c06ccfa19c2 req-ae4473a2-eda4-42f5-b624-cb1cc0462137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fc57f6-b30c-4a88-bd29-12a3b7036a45", "name": "network-vif-plugged", "status": "completed", "tag": "10921d24-768e-4af8-941f-79752bd08fa1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:48.935399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3ef95655-a7f0-42d7-b1e6-9c06ccfa19c2 req-ae4473a2-eda4-42f5-b624-cb1cc0462137 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:48.935891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3ef95655-a7f0-42d7-b1e6-9c06ccfa19c2 req-ae4473a2-eda4-42f5-b624-cb1cc0462137 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:48.936411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3ef95655-a7f0-42d7-b1e6-9c06ccfa19c2 req-ae4473a2-eda4-42f5-b624-cb1cc0462137 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:48.961428 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3ef95655-a7f0-42d7-b1e6-9c06ccfa19c2 req-ae4473a2-eda4-42f5-b624-cb1cc0462137 service nova] Creating event network-vif-plugged:10921d24-768e-4af8-941f-79752bd08fa1 for instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 on n-h1-836830-16 Sep 07 09:49:49.038663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3ef95655-a7f0-42d7-b1e6-9c06ccfa19c2 req-ae4473a2-eda4-42f5-b624-cb1cc0462137 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144304 Sep 07 09:49:49.040197 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 695/1370] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:49.077991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:49.080600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:49.099705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:49.101315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:49.102054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:49.103464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:49.114635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:49.120755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:49.171963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:49.182162 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d70afe4a-45c8-475c-a33a-f69b7708d0d4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1468 microversion: 2.1 time: 0.644911 Sep 07 09:49:49.184176 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 676/1371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:48 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1468 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:49.185671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a25d44ab-ef64-440c-8740-f2f3737ed16e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119839 Sep 07 09:49:49.186945 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 696/1372] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:49 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:49:49.222922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:49.251851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:49.271340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Searching by: {'reservation_id': 'r-0qw82ngv', 'deleted': False, 'project_id': '16f96dd538e242b88d17442cb92b3d46'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:49:49.294028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:49.301065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:49.315744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:49.319465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:49.320071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:49.320658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:49.536845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:49.537786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:49.564347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:49.566881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:49.567352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:49.569877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:49.572069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:49.572968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:50.235038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:49:50.375576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:50.379275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:50.391899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:50.394272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29c6a4d2-9a86-4490-9fcc-14d16893122b tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 0.858385 Sep 07 09:49:50.395898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:50.396609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:50.399922 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 697/1373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:49 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:50.423784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:50.424424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:50.456174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:50.459407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:50.463045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:50.464782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:50.468452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:50.471219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:50.490244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:51.020817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:51.047116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:51.050202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:51.064874 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e899e5ef-ba77-4046-9b45-a886cedd1fff tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.661616 Sep 07 09:49:51.083661 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d84b81d-5f71-474e-b18e-2fd15e02dcdf tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-0qw82ngv" status: 200 len: 2929 microversion: 2.1 time: 1.878813 Sep 07 09:49:51.084909 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 677/1374] 10.222.0.60 () {58 vars in 1197 bytes} [Wed Sep 7 09:49:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0qw82ngv => generated 2929 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:51.089992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:51.090891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:51.110107 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 698/1375] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:50 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:51.135182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:51.136283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.138775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:51.139475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.140049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.143943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.144570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.146847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.168913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.175300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.177622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.181462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.182611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.183310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.256891 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e8f9271-88b0-44f3-b57e-fe15d3b59dbd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145264 Sep 07 09:49:51.258891 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 699/1376] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:49:51 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:49:51.264336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:51.265174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:51.273096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.274891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.275780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.276745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.277468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.278128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.316287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:49:51.531994 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a5b40775-4164-4aee-a641-05a1cc5c5275 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "DELETE /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 204 len: 0 microversion: 2.1 time: 0.271058 Sep 07 09:49:51.536030 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 700/1377] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:49:51 2022] DELETE /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:49:51.549398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ae7de3d-2217-4415-b228-b531bd3acde0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:51.576746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_groups [None req-3ae7de3d-2217-4415-b228-b531bd3acde0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Querying cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) for 2 instances {{(pid=128833) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 09:49:51.577976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ae7de3d-2217-4415-b228-b531bd3acde0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.578816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ae7de3d-2217-4415-b228-b531bd3acde0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.579497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ae7de3d-2217-4415-b228-b531bd3acde0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.629367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ae7de3d-2217-4415-b228-b531bd3acde0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/b758ceea-36ad-4eef-b15d-83bcf1c199a4" status: 200 len: 265 microversion: 2.1 time: 0.091540 Sep 07 09:49:51.631254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 701/1378] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:49:51 2022] GET /compute/v2.1/os-server-groups/b758ceea-36ad-4eef-b15d-83bcf1c199a4 => generated 265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:51.637619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:51.638732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:51.646316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.647508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.648195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:51.649689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:51.650590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:51.651255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:52.574487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:52.595265 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-629ea482-e914-45f8-a7fc-af3f9cf5b586 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1395 microversion: 2.1 time: 1.508887 Sep 07 09:49:52.596425 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 678/1379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:51 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1395 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:52.603406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:52.604694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:52.612288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:52.613304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:52.613992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:52.615017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:52.615710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:52.616366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:52.685804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:52.706020 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8becc816-d9ba-4524-8193-a6a2797b2561 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1521 microversion: 2.1 time: 1.069705 Sep 07 09:49:52.706924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 702/1380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:51 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1521 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:52.722607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:52.723242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:52.750630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:52.753824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:52.754291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:52.755036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:52.755510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:52.760959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:53.589629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:53.599509 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-741c6d57-cf7d-4937-99e1-34983aea4921 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1679 microversion: 2.1 time: 1.001666 Sep 07 09:49:53.625292 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 679/1381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:52 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1679 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:53.637439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:53.638303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:53.664220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:53.668156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:53.668897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:53.672612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:53.673393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:53.674077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:53.688654 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c9a4b9f-896f-42b1-b559-6a7748e8f072 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 200 len: 1621 microversion: 2.1 time: 0.979700 Sep 07 09:49:53.722701 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 703/1382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:52 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 1621 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:53.748478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:53.750014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:53.772956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:53.777938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:53.794432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:53.795365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:53.795864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:53.796316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:54.471965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:54.509025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:54.511084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:54.512869 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-210392d7-d1f5-4525-a8a8-4409766465e6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.900603 Sep 07 09:49:54.516326 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 680/1383] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:53 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:54.528968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:54.530060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:54.538280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:54.550249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:54.553683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:54.554859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:54.555887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:54.557823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:55.245490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:55.268766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2ac65b2-d181-485d-b0c9-27cec5108a6d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1395 microversion: 2.1 time: 1.543728 Sep 07 09:49:55.270056 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 704/1384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:53 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1395 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:55.280987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:55.294304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:55.337150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:55.338410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:55.345678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:55.346784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:55.352271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:55.354776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:55.919538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:55.940625 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b30ac90-fdb3-40b4-8418-ee4482860363 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1506 microversion: 2.1 time: 0.666963 Sep 07 09:49:55.942941 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 705/1385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:55 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:55.951904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:55.952899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:55.997688 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-61f3bc9b-b281-421f-86bd-217578ada77a tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1621 microversion: 2.1 time: 1.476738 Sep 07 09:49:55.997688 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 681/1386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:54 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1621 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:56.001047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:56.012225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fb3593ee-284e-4b07-9f1f-0299d9b6b776 req-43591408-1c96-44b3-9dfe-58e99627016e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca", "tag": "2f267084-f29e-4b08-adc6-997afd6d8076"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:56.019728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.024269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.024973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:56.025916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.027578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.029842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:56.068898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb3593ee-284e-4b07-9f1f-0299d9b6b776 req-43591408-1c96-44b3-9dfe-58e99627016e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.072231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb3593ee-284e-4b07-9f1f-0299d9b6b776 req-43591408-1c96-44b3-9dfe-58e99627016e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.072704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb3593ee-284e-4b07-9f1f-0299d9b6b776 req-43591408-1c96-44b3-9dfe-58e99627016e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:56.130818 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fb3593ee-284e-4b07-9f1f-0299d9b6b776 req-43591408-1c96-44b3-9dfe-58e99627016e service nova] Creating event network-changed:2f267084-f29e-4b08-adc6-997afd6d8076 for instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca on n-h1-836830-16 Sep 07 09:49:56.150548 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fb3593ee-284e-4b07-9f1f-0299d9b6b776 req-43591408-1c96-44b3-9dfe-58e99627016e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150644 Sep 07 09:49:56.151170 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 682/1387] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:56.163661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:56.171739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:56.202132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.204613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.205257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:56.215609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.216382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.217213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:56.706569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:56.715336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4cc86391-3dea-4f63-b5e7-9ca1140421aa tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1679 microversion: 2.1 time: 0.768599 Sep 07 09:49:56.730915 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 706/1388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:55 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1679 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:56.737121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:56.741782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:56.773125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.773706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.774336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:56.775050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:56.775579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:56.775922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.156818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:57.176765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:57.188993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:57.194687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-297f0ced-69a7-4317-8b1c-39b6174f612b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 1.041874 Sep 07 09:49:57.205517 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 683/1389] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:56 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:49:57.218596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-201598e8-08e5-4cd7-b33d-bdf5a29a6756 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: .version_select at 0x7f14b19235e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-826264807", "policies": ["anti-affinity"]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:57.276042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-201598e8-08e5-4cd7-b33d-bdf5a29a6756 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:57.297782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-201598e8-08e5-4cd7-b33d-bdf5a29a6756 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:57.369746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:57.388082 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-777a5ce3-d651-4576-adbd-94980cedfe17 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 200 len: 1506 microversion: 2.1 time: 0.658219 Sep 07 09:49:57.392688 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 707/1390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:56 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:57.408851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:57.411444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:57.426433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:57.428666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:57.430664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.432430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:57.435100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:57.436036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.440383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-201598e8-08e5-4cd7-b33d-bdf5a29a6756 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:49:57.453685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-201598e8-08e5-4cd7-b33d-bdf5a29a6756 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:49:57.495428 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-201598e8-08e5-4cd7-b33d-bdf5a29a6756 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.288050 Sep 07 09:49:57.498895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 684/1391] 10.222.0.60 () {60 vars in 1174 bytes} [Wed Sep 7 09:49:57 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:49:57.509692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:57.510458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:57.549428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:57.549925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:57.555040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.555839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:57.561757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:57.562454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.627858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:49:57.747258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:57.797676 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08989c62-b557-47e8-8fec-4112f3c73119 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1395 microversion: 2.1 time: 0.401646 Sep 07 09:49:57.799122 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 708/1392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:57 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1395 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:57.805501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:57.807298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:57.814526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:57.816294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:57.817418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:57.818808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.830341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:57.831028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:57.831835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:57.897336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:49:57.950198 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f3d16f0-7039-4a7c-b7ba-c1e3ab7de8aa tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "DELETE /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 204 len: 0 microversion: 2.1 time: 0.448367 Sep 07 09:49:57.959290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 685/1393] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:49:57 2022] DELETE /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:49:57.990964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-23236938", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3c6dcc26-7542-4d4a-bd5f-b52aaa21076f"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:58.014456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba350a258ac24186b93317fcb1066a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017dac8978b64d4c94cc2ef118e5fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:58.031627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df428625-6303-4369-99fa-fd28653fe8d3 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 200 len: 1611 microversion: 2.1 time: 0.229214 Sep 07 09:49:58.032256 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 709/1394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:49:57 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 1611 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:49:58.233521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:49:58.234142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:49:58.250928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:58.251414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:58.251858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:58.252575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:49:58.253034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:49:58.265461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:49:58.600692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:58.624353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:58.645119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:49:58.646441 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b76f24b-8b4c-4b91-9fcc-5870774d8ffd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.417592 Sep 07 09:49:58.664957 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 710/1395] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:49:58 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:49:58.675488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1651452658", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a4c9e9f5-3e0a-4df6-af1d-c9061d526758"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:49:59.463458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:01.729750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:01.752925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] validate_networks() for [('a4c9e9f5-3e0a-4df6-af1d-c9061d526758', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:02.513013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:02.513968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:02.514420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:02.514863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:02.515274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:02.555651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:02.556164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:02.558653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:02.559584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:02.560119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:02.560477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:02.597496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:02.607187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:02.630261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Going to run 2 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:02.634159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:02.694222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128832) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 07 09:50:02.695065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:02.696579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:02.697552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:02.698400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:02.699237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:02.709824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:02.710736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:02.711549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:02.712554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:02.713156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:02.713968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:02.717302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:02.726017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:02.741970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Getting quotas for project 8e63b735a19d488d95553ff9f6acc846. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:02.751442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Getting quotas for user 0b88725326c244f6a10260dc710f2e55 and project 8e63b735a19d488d95553ff9f6acc846. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:02.769767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:02.772241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:02.790990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:02.797413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:02.816750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=910000d6-f1b1-40df-b861-69549ab9bf94,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:02.832801 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ff510ad-27c2-4a4b-b8fc-1cb5100f0210 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.166523 Sep 07 09:50:02.842794 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 711/1396] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:50:02.916071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:02.927955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:03.004310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:03.019670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'server_group_members'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:03.096758 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54cb06e7-e0a8-4865-a397-907017512c1e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.129068 Sep 07 09:50:03.097766 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 686/1397] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:49:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 5138 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 07 09:50:03.125866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-318152887", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:03.194378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-156aee93-cc6b-43bc-b4a0-6234341db416 req-49cefdb2-3a51-445a-999a-920148046a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193776ce-cebb-4703-b48b-c40e206b21ea", "name": "network-vif-deleted", "tag": "85d9396a-28f4-41b8-a3e2-c1460f733d78"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:03.205534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-156aee93-cc6b-43bc-b4a0-6234341db416 req-49cefdb2-3a51-445a-999a-920148046a4f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.206132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-156aee93-cc6b-43bc-b4a0-6234341db416 req-49cefdb2-3a51-445a-999a-920148046a4f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.207088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-156aee93-cc6b-43bc-b4a0-6234341db416 req-49cefdb2-3a51-445a-999a-920148046a4f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:03.221133 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-156aee93-cc6b-43bc-b4a0-6234341db416 req-49cefdb2-3a51-445a-999a-920148046a4f service nova] Creating event network-vif-deleted:85d9396a-28f4-41b8-a3e2-c1460f733d78 for instance 193776ce-cebb-4703-b48b-c40e206b21ea on n-h1-836830-16 Sep 07 09:50:03.226014 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-156aee93-cc6b-43bc-b4a0-6234341db416 req-49cefdb2-3a51-445a-999a-920148046a4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126920 Sep 07 09:50:03.227473 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 687/1398] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:03.234735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:03.236583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:03.245034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.245745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.246361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:03.247449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.248123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.248719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:03.266273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] validate_networks() for [('f2369e65-f9a9-4a3b-bf47-c8cfca55e962', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:03.734783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:03.761124 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-32f2b1b2-ddc4-457e-9b46-6a11eb50e0fc tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1395 microversion: 2.1 time: 0.531106 Sep 07 09:50:03.763816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 688/1399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:03 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1395 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:03.775448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:03.780558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] [instance: 193776ce-cebb-4703-b48b-c40e206b21ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:03.799531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.800122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.800122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:03.803573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.804231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.805281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:03.845389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] HTTP exception thrown: Instance 193776ce-cebb-4703-b48b-c40e206b21ea could not be found. Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Request method failure captured: Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea HTTP/1.1 Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGiBy_bDcWhCVBiG5JjTklmBTlbU1Mk9EAK2Lx0A_URcTfOzKVXcdWKUsEcj61dIjEnIXVt-kHBvcNC7xuD2_yZGOQ7_OI1WmB-jRI4w-Xkp47kuWmsCnDbtaU_w_8NbBP3S9mWmu6NJ9n4fGI3V1ChIMzHXMEzO9tqDXBqlB72RxSg Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 017dac8978b64d4c94cc2ef118e5fa69 Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesAdminNegativeTest-1451209324 Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:50:03.849081 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/017dac8978b64d4c94cc2ef118e5fa69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/017dac8978b64d4c94cc2ef118e5fa69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/017dac8978b64d4c94cc2ef118e5fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_017dac8978b64d4c94cc2ef118e5fa69", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesAdminNegativeTest-1451209324 Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 017dac8978b64d4c94cc2ef118e5fa69 Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1451209324 Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesAdminNegativeTest-1451209324-project Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: ba350a258ac24186b93317fcb1066a65 Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesAdminNegativeTest-1451209324-project Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 193776ce-cebb-4703-b48b-c40e206b21ea could not be found. Sep 07 09:50:03.850639 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '193776ce-cebb-4703-b48b-c40e206b21ea'} Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193776ce-cebb-4703-b48b-c40e206b21ea could not be found. Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:03.851981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193776ce-cebb-4703-b48b-c40e206b21ea could not be found. Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193776ce-cebb-4703-b48b-c40e206b21ea could not be found. Sep 07 09:50:03.855944 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:03.861493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Returning 404 to user: Instance 193776ce-cebb-4703-b48b-c40e206b21ea could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:03.864875 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2db501c3-3e77-4483-8751-73f32bae0269 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea" status: 404 len: 111 microversion: 2.1 time: 0.099767 Sep 07 09:50:03.865875 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 689/1400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:03 2022] GET /compute/v2.1/servers/193776ce-cebb-4703-b48b-c40e206b21ea => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:50:03.879174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:03.880146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:03.899382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.900017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.900723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:03.901834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:03.902389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:03.902883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.332619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:04.361695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:04.363854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:04.365345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b383418-14b7-4107-913e-44fbaa95c3c9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.496444 Sep 07 09:50:04.367030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 690/1401] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:03 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:04.396202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:04.403110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:04.404838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:04.405307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:04.406939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:04.436671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.441025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.441546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.442408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.449563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.450752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.477454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Getting quotas for project 5db28e0418c74f48b2ace57130f2a096. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:04.484506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Getting quotas for user a2f916d809934c1d9648dd1128061540 and project 5db28e0418c74f48b2ace57130f2a096. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:04.531095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:04.534079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:04.542137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9c68636-5743-44b8-98c3-1aa3f6d2f12a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Action: 'create', calling method: .version_select at 0x7f14b1923670>, body: {"keypair": {"name": "tempest-keypair-1620481638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxQH405kmODTkFcRVm8Z0bhBdwdbnBnkHLIlNqfECZc7yMuFwgFMqky7IOmYAnhvBlcMeAhpTmmIjchSXPLDTQyrhVz3SZxjQxG6UCi6uCqfvAkR6SRd39pC+HFfDGf9g=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:04.585040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f9c68636-5743-44b8-98c3-1aa3f6d2f12a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Getting quotas for project f8a9db3020244360892d02bb7d28aef6. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:04.605171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f9c68636-5743-44b8-98c3-1aa3f6d2f12a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Getting quotas for user d5b84fc9a49f4f73b2f09265acbbea35 and project f8a9db3020244360892d02bb7d28aef6. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:04.615376 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6077aa9-26d9-47e8-aaff-fb8da7e84192 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770927 Sep 07 09:50:04.623008 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 712/1402] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:50:04.628697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:04.629713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:04.639715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.640862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.641537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.642758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.643699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.644347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.688307 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9c68636-5743-44b8-98c3-1aa3f6d2f12a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.320030 Sep 07 09:50:04.709393 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 691/1403] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:50:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:04.727437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:04.734380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:04.739699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Searching by: {'deleted': False, 'project_id': '16f96dd538e242b88d17442cb92b3d46'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:50:04.758269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:04.763678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.766057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.766532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.767278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.769593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.770042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.770611 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31966044-b8bd-47d5-a8ea-1a15b61b5bd8 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1270 microversion: 2.1 time: 0.146044 Sep 07 09:50:04.772869 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 713/1404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:04 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:04.786421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0acdc220-27c1-41f9-994c-a94caf2a0431 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] Calling method '.version_select at 0x7f14b1dee3a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:04.827467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0acdc220-27c1-41f9-994c-a94caf2a0431 tempest-VolumesAdminNegativeTest-1451209324 tempest-VolumesAdminNegativeTest-1451209324-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514341206" status: 202 len: 0 microversion: 2.1 time: 0.050050 Sep 07 09:50:04.828438 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 714/1405] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 09:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514341206 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:50:04.839625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b0859ef2-eab2-44a0-88f8-fb993fd7380b req-23291417-9719-4186-8409-13a29062e77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca", "name": "network-vif-plugged", "status": "completed", "tag": "2f267084-f29e-4b08-adc6-997afd6d8076"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:04.860973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b0859ef2-eab2-44a0-88f8-fb993fd7380b req-23291417-9719-4186-8409-13a29062e77a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:04.862171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b0859ef2-eab2-44a0-88f8-fb993fd7380b req-23291417-9719-4186-8409-13a29062e77a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:04.862905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b0859ef2-eab2-44a0-88f8-fb993fd7380b req-23291417-9719-4186-8409-13a29062e77a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:04.879295 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b0859ef2-eab2-44a0-88f8-fb993fd7380b req-23291417-9719-4186-8409-13a29062e77a service nova] Creating event network-vif-plugged:2f267084-f29e-4b08-adc6-997afd6d8076 for instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca on n-h1-836830-16 Sep 07 09:50:04.886417 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b0859ef2-eab2-44a0-88f8-fb993fd7380b req-23291417-9719-4186-8409-13a29062e77a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055754 Sep 07 09:50:04.892042 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 715/1406] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:04.899391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4af41cb8-e0bc-454d-b5e0-9c75973a33ba tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:04.901062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4af41cb8-e0bc-454d-b5e0-9c75973a33ba tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:04.940235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:50:05.014962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4af41cb8-e0bc-454d-b5e0-9c75973a33ba tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:05.033162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4af41cb8-e0bc-454d-b5e0-9c75973a33ba tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1223 microversion: 2.1 time: 0.139191 Sep 07 09:50:05.033971 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 716/1407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:04 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:05.064611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:05.065446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:05.074402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.075020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.075573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.076536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.077619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.078603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.113875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:05.207128 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7a5b1cc0-e5f6-4288-8998-a5f4def88ed7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.496691 Sep 07 09:50:05.214813 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 692/1408] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 09:50:04 2022] GET /compute/v2.1/servers => generated 1660 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:05.220961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:05.221615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:05.229427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.229932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.230397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.232239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.232717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.233148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.399399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:05.411680 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df41c9b6-44b8-418a-9df3-82d75a218c12 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1213 microversion: 2.1 time: 0.194476 Sep 07 09:50:05.425224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 693/1409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:05 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:05.454639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-463e9cb8-6819-4f7e-bc7e-c8d1669ef481 req-d7364aba-10c1-42ee-9834-5cbf05b8e24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fc57f6-b30c-4a88-bd29-12a3b7036a45", "name": "network-vif-deleted", "tag": "10921d24-768e-4af8-941f-79752bd08fa1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:05.502154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-463e9cb8-6819-4f7e-bc7e-c8d1669ef481 req-d7364aba-10c1-42ee-9834-5cbf05b8e24d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.503750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-463e9cb8-6819-4f7e-bc7e-c8d1669ef481 req-d7364aba-10c1-42ee-9834-5cbf05b8e24d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.504842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-463e9cb8-6819-4f7e-bc7e-c8d1669ef481 req-d7364aba-10c1-42ee-9834-5cbf05b8e24d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.573711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:05.582027 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-463e9cb8-6819-4f7e-bc7e-c8d1669ef481 req-d7364aba-10c1-42ee-9834-5cbf05b8e24d service nova] Creating event network-vif-deleted:10921d24-768e-4af8-941f-79752bd08fa1 for instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 on n-h1-836830-16 Sep 07 09:50:05.595613 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-463e9cb8-6819-4f7e-bc7e-c8d1669ef481 req-d7364aba-10c1-42ee-9834-5cbf05b8e24d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157602 Sep 07 09:50:05.598220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 694/1410] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:05.613497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:05.616571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:05.627954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:05.644932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.648990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.650403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.653785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.657814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.660322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.700163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:05.709483 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80a6b298-e93b-4ea5-81a4-68dbaaf24a23 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1395 microversion: 2.1 time: 0.674043 Sep 07 09:50:05.716496 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 717/1411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:05 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1395 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:05.799574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:05.800190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:05.814699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.816239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.817277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:05.818639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:05.821933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:05.822341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:06.014558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:06.024357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:06.026804 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-afff4a17-c46d-49a9-8e62-3dbbadd91d42 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1276 microversion: 2.1 time: 0.232239 Sep 07 09:50:06.028005 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 718/1412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:05 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:06.050005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:06.051975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:06.053392 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a23a6af-4275-4b9e-84c5-66d9c339dbb0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.453983 Sep 07 09:50:06.054767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 695/1413] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:05 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:06.074389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:06.076952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:06.091828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:06.093164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:06.093830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:06.095624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:06.096285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:06.097039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:06.207136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:06.236515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-350e6039-702c-40cc-a145-20b4cce28636 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1227 microversion: 2.1 time: 0.171799 Sep 07 09:50:06.241984 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 719/1414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:06 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1227 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:06.446639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:06.447959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:06.457883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:06.458753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:06.460020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:06.461704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:06.463943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:06.464630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:06.584707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:06.599048 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5da85763-800c-4948-9ed0-ebb7a22162ca tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1269 microversion: 2.1 time: 0.161472 Sep 07 09:50:06.600557 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 696/1415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:06 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:06.737440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:06.738190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:06.750427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:06.752362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:06.753048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:06.753872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:06.754563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:06.755210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.035554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.055381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:07.056615 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1be246b1-8a51-4c2d-89b8-b028ebeb65c6 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1395 microversion: 2.1 time: 0.327133 Sep 07 09:50:07.057138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:07.057307 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 720/1416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:06 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1395 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:07.069536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.071030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.071168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.071889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.072367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.073506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.085786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:07.087485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:07.099095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.100135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.106189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.108736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.109594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.110231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.247686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.256741 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7c6d6df-299c-4aa9-83ff-4d2aaa6a387f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1276 microversion: 2.1 time: 0.206951 Sep 07 09:50:07.259192 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 697/1417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:07 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:07.268449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:07.269422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:07.276819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.278827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.279485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.280401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.281238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.281840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.379167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.397166 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56985951-1e9f-43d2-a9a4-2502ccbba63e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1219 microversion: 2.1 time: 0.132336 Sep 07 09:50:07.413745 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 698/1418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:07 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:07.471366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.485357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.490353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.495714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-326eb4ad-d17e-4cc1-8329-cb57b7fc7ddb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.413764 Sep 07 09:50:07.511262 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 721/1419] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:07 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:50:07.634036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:07.637250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:07.649795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.651315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.652776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.656035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:07.657391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:07.658793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:07.786732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:07.816351 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ed09f14-de1b-450b-ad5d-0f8400188658 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1277 microversion: 2.1 time: 0.188288 Sep 07 09:50:07.819720 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 699/1420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:07 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:07.959608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-829591774", "imageRef": "a771af3d-3734-4ae1-ae51-e2cf9fe84384", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4d5c3709-67e0-4406-b353-6d76565f5e4f"}], "security_groups": [{"name": "tempest-securitygroup--50143374"}], "key_name": "tempest-keypair-1620481638", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:08.087726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:08.091409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:08.105086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:08.105863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:08.108652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:08.111104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:08.118290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:08.119157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:08.210412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] validate_networks() for [('4d5c3709-67e0-4406-b353-6d76565f5e4f', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:08.495581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:08.506237 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3343d9b6-ffef-49d4-9c9d-27616cf37138 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1576 microversion: 2.1 time: 0.425180 Sep 07 09:50:08.510671 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 700/1421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:08 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1576 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:08.538567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:08.539397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:08.551272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:08.552548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:08.553127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:08.554067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:08.555460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:08.556173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:08.837961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:08.859567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55a70bf5-b131-414f-9a3f-a7ec80eeae20 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1318 microversion: 2.1 time: 0.346425 Sep 07 09:50:08.862270 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 701/1422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:08 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:08.872867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:08.874440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:08.885034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:08.885815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:08.888147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:08.888147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:08.888766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:08.889525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.016320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:09.038361 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ec1e4ba-088d-4da1-8365-451b3cf763b4 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1219 microversion: 2.1 time: 0.174713 Sep 07 09:50:09.043845 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 702/1423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:08 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:09.050325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:09.051383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:09.064700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.066064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.066749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.067982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.069292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.069972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.197123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:09.198101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:09.198583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:09.199232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:09.199812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:09.216889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.217628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.218465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.219332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.219962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.220575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.257235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Getting quotas for project f8a9db3020244360892d02bb7d28aef6. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:09.274587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Getting quotas for user d5b84fc9a49f4f73b2f09265acbbea35 and project f8a9db3020244360892d02bb7d28aef6. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:09.295679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:09.299280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a771af3d-3734-4ae1-ae51-e2cf9fe84384',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:09.378864 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a749f12d-785d-4d10-9b47-2c09187f5e72 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.422277 Sep 07 09:50:09.387252 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 722/1424] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:50:09.397989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:09.398714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:09.430006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.430799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.431256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.435833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.437714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.438187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.489058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:09.499509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:09.500971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:09.514128 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92b31ff3-58ca-43ca-ade3-da876884cc7a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.468807 Sep 07 09:50:09.514787 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 703/1425] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:09 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:09.528982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:09.531607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:09.554972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.555748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.556307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.557041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:09.557538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:09.557975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:09.783331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:09.792126 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-685e0506-f5da-4a7c-b0f6-70eed2db2741 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1275 microversion: 2.1 time: 0.276271 Sep 07 09:50:09.801920 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 704/1426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:09 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1275 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:09.827062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79829c16-7fce-4ac4-93f9-5a5dc59c344f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:09.829238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-79829c16-7fce-4ac4-93f9-5a5dc59c344f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:10.010877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f44d00db-17f3-43a3-b6d1-ebfaae3db035 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.621304 Sep 07 09:50:10.011798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 723/1427] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:50:09 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca/os-interface => generated 285 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:10.030956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:10.032404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:10.064179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:10.067627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:10.072175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:10.105102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:10.108788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:10.114444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:10.754493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79829c16-7fce-4ac4-93f9-5a5dc59c344f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:10.778145 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79829c16-7fce-4ac4-93f9-5a5dc59c344f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1245 microversion: 2.1 time: 0.959440 Sep 07 09:50:10.796298 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 705/1428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:09 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1245 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:10.812154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:10.813504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:10.823097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:10.823979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:10.824639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:10.825623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:10.826316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:10.827222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.097766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:11.109312 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c67c1162-d723-4aa4-b709-005c453fcc55 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1281 microversion: 2.1 time: 0.311016 Sep 07 09:50:11.111720 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 706/1429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:10 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:11.118666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9ef65a2b-e642-441d-b23e-1e98d49eaa5c req-097b5ec6-016e-49af-9e1a-44ff7a6a0d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c670f25-8fd6-4cb0-8f33-b8544182fa74", "name": "network-vif-unplugged", "status": "completed", "tag": "3089b6fa-f731-4eac-8874-7cddb46b3a8d"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:11.143601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9ef65a2b-e642-441d-b23e-1e98d49eaa5c req-097b5ec6-016e-49af-9e1a-44ff7a6a0d4e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.144316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9ef65a2b-e642-441d-b23e-1e98d49eaa5c req-097b5ec6-016e-49af-9e1a-44ff7a6a0d4e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.144931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9ef65a2b-e642-441d-b23e-1e98d49eaa5c req-097b5ec6-016e-49af-9e1a-44ff7a6a0d4e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.175244 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9ef65a2b-e642-441d-b23e-1e98d49eaa5c req-097b5ec6-016e-49af-9e1a-44ff7a6a0d4e service nova] Creating event network-vif-unplugged:3089b6fa-f731-4eac-8874-7cddb46b3a8d for instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 on n-h2-836830-16 Sep 07 09:50:11.186844 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9ef65a2b-e642-441d-b23e-1e98d49eaa5c req-097b5ec6-016e-49af-9e1a-44ff7a6a0d4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072600 Sep 07 09:50:11.191484 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 707/1430] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:11.203902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:11.204624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:11.218898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.219650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.220284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.221217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.221837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.222444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.405939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:11.426013 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2388eed-f90a-4336-862e-c64ff74d7ef9 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1318 microversion: 2.1 time: 1.413029 Sep 07 09:50:11.441206 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 724/1431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:10 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1318 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:11.441206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:11.441206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:11.471646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.473586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.474313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.475513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.476563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.477261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.834502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:11.885876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:11.890387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:11.894963 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-17f77825-3912-4802-b1a5-83a5fd8d40bb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.700857 Sep 07 09:50:11.896437 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 708/1432] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:11 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:11.911223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:11.912461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:11.938616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.939234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.940980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:11.946442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:11.947125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:11.948251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:12.203609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:12.221348 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06aa1fbf-2cca-4e7b-ae09-49c56561c367 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1297 microversion: 2.1 time: 0.313666 Sep 07 09:50:12.241457 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 709/1433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:11 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1297 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:12.263637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:12.267904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:12.312655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:12.315962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:12.316680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:12.318853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:12.323111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:12.323713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:12.338127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:12.361266 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a88cf06-91f3-4242-8396-ceeb3c4cb6d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 0.916995 Sep 07 09:50:12.362838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 725/1434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:11 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:12.458108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:12.459229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:12.470793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:12.471296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:12.471738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:12.473368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:12.474125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:12.474851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:12.596285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:12.606878 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9ec6e0d1-a3e0-4944-96f9-37d75a8ef0b1 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1281 microversion: 2.1 time: 0.363522 Sep 07 09:50:12.617400 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 710/1435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:12 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:12.928781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:12.929547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:12.930710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:12.945991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:12.947953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:12.949386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:12.950902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c068f1f-a36a-4e1d-9784-b8a6266365ab tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1318 microversion: 2.1 time: 0.500700 Sep 07 09:50:12.951799 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 726/1436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:12 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:12.954231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:12.955980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:12.956596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:13.250145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:13.251436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:13.282855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:13.284147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:13.284844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:13.286227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:13.286922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:13.287658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:14.495065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:14.546289 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1635050c-c9df-4ca7-a029-1717dcfbfa53 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1303 microversion: 2.1 time: 1.292413 Sep 07 09:50:14.565483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 727/1437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:13 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1303 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:14.579475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c670f25-8fd6-4cb0-8f33-b8544182fa74", "tag": "3089b6fa-f731-4eac-8874-7cddb46b3a8d"}, {"name": "network-changed", "server_uuid": "af481ffe-3355-44b6-bd98-139ea86dabeb", "tag": "da722a00-2eeb-4a04-93d4-5149d610525a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:14.613969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:14.615518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:14.620378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:14.656261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] Creating event network-changed:3089b6fa-f731-4eac-8874-7cddb46b3a8d for instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 on n-h2-836830-16 Sep 07 09:50:14.656996 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] Creating event network-changed:da722a00-2eeb-4a04-93d4-5149d610525a for instance af481ffe-3355-44b6-bd98-139ea86dabeb on n-h1-836830-16 Sep 07 09:50:14.685670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9af3b0de-1a2a-40d2-ad1c-f6b58d29a6d0 req-5391ca97-d3ac-4027-9b3f-8374d17b6f78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118389 Sep 07 09:50:14.689905 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 728/1438] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:14.699044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:14.699772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:14.713035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:14.717727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:14.718368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:14.719694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:14.722263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:14.749885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:14.824910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:15.406002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:15.427059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:15.433688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:15.437733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86734028-0c2a-42e5-942f-c92f995d7c48 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 2.511163 Sep 07 09:50:15.441257 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 711/1439] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:12 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 2518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:50:15.455036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:15.456898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:15.466484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:15.467536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:15.468181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:15.469154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:15.469668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:15.470207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:16.440582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:16.456381 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a87da66b-5f23-49d7-b180-f4b987b14127 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 1.764934 Sep 07 09:50:16.482757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 729/1440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:14 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:16.524810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:16.530803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:16.572467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:16.577979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:16.578787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:16.581805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:16.584729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:16.589610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:17.221617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:17.258111 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df26e328-d92c-446c-8cc6-56f85f6579ed tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 1.813502 Sep 07 09:50:17.263879 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 712/1441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:15 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:17.290291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:17.293523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:17.309918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:17.310854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:17.312799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:17.314340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:17.315207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:17.316212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:17.327036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:17.862047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:17.875163 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7853a4f2-2a59-479f-8dc3-a0eddbd87cff tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1303 microversion: 2.1 time: 0.608505 Sep 07 09:50:17.878771 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 713/1442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:17 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1303 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:17.891785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:17.893617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:17.914318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:17.916158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:17.918146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:17.921749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:17.923376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:17.924969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:18.443774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:18.458788 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e573709-f783-4934-b77a-5bba41961053 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1318 microversion: 2.1 time: 1.974024 Sep 07 09:50:18.460139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 730/1443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:16 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1318 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:18.474205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:18.475188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:18.500616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:18.504521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:18.505276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:18.506262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:18.508575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:18.509889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:19.239798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:19.285788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=20 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:19.475845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:19.496476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:19.515140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:19.520998 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01206bf1-dc5b-4ff9-a28d-19e48b6509e7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 1.055103 Sep 07 09:50:19.528627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 731/1444] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:18 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:19.549576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0064b71d-5cb4-4647-adce-11d3af3e2163 req-175beba6-c5ab-448b-a488-a1fe07e97f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca", "tag": "2f267084-f29e-4b08-adc6-997afd6d8076"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:19.606385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0064b71d-5cb4-4647-adce-11d3af3e2163 req-175beba6-c5ab-448b-a488-a1fe07e97f50 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:19.608892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0064b71d-5cb4-4647-adce-11d3af3e2163 req-175beba6-c5ab-448b-a488-a1fe07e97f50 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:19.611636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0064b71d-5cb4-4647-adce-11d3af3e2163 req-175beba6-c5ab-448b-a488-a1fe07e97f50 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:19.687617 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0064b71d-5cb4-4647-adce-11d3af3e2163 req-175beba6-c5ab-448b-a488-a1fe07e97f50 service nova] Creating event network-changed:2f267084-f29e-4b08-adc6-997afd6d8076 for instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca on n-h1-836830-16 Sep 07 09:50:19.747292 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0064b71d-5cb4-4647-adce-11d3af3e2163 req-175beba6-c5ab-448b-a488-a1fe07e97f50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204606 Sep 07 09:50:19.748527 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 732/1445] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:19.794454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:19.806194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4ecb8194-1f26-4d18-821f-b51b58420675 req-9d028b35-1a93-4d90-a12c-7c32c2347c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a398b237-89ef-407c-9937-6a8bbde72eef", "tag": "bc230a1c-79f0-4163-b758-2f68baee50c0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:19.815645 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1e1aae7-7d1a-4cc1-a87b-7eb9342b339d tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1576 microversion: 2.1 time: 1.933488 Sep 07 09:50:19.827804 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 714/1446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:17 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1576 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:19.845577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:19.862202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:19.867145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4ecb8194-1f26-4d18-821f-b51b58420675 req-9d028b35-1a93-4d90-a12c-7c32c2347c74 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:19.868418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4ecb8194-1f26-4d18-821f-b51b58420675 req-9d028b35-1a93-4d90-a12c-7c32c2347c74 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:19.870023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4ecb8194-1f26-4d18-821f-b51b58420675 req-9d028b35-1a93-4d90-a12c-7c32c2347c74 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:19.900553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:19.901068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:19.901543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:19.902317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:19.902741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:19.903176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:19.911749 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4ecb8194-1f26-4d18-821f-b51b58420675 req-9d028b35-1a93-4d90-a12c-7c32c2347c74 service nova] Creating event network-changed:bc230a1c-79f0-4163-b758-2f68baee50c0 for instance a398b237-89ef-407c-9937-6a8bbde72eef on n-h2-836830-16 Sep 07 09:50:19.921402 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4ecb8194-1f26-4d18-821f-b51b58420675 req-9d028b35-1a93-4d90-a12c-7c32c2347c74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165426 Sep 07 09:50:19.923044 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 733/1447] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:19.929750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:19.930954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:19.954607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:19.957457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:19.957457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:19.962833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:19.968711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:19.973967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:20.778916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=50 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:22.018784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:22.030795 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0603339b-6371-4b66-969a-cca3534db7d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 2.198584 Sep 07 09:50:22.036827 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 715/1448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:19 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:22.047150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:22.057545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:22.080998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.083974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.084663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.088259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.089618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.090869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.124118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:22.140913 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d466e519-abdf-4423-96c6-67896290a709 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 2.213435 Sep 07 09:50:22.141803 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 734/1449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:19 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:22.146847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:22.159309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:22.184222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:22.186400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.187092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.190405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.192198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.195392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.201215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.693891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:22.713871 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-017e4de0-78a1-4fff-ba3c-6a938acc4955 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.674936 Sep 07 09:50:22.717629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 716/1450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:22 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:22.724123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:22.725202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:22.735595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.736542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.737964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.739064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.739836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.740699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.786185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:22.797465 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7475f10f-1e8f-42eb-ae4f-68232624a3ba tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1318 microversion: 2.1 time: 0.654116 Sep 07 09:50:22.798515 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 735/1451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:22 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:22.823313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6f3f6bd1-b0ae-429b-825f-7c263e946c7f req-d66bf1b2-fdb6-4848-9042-40256005d099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910000d6-f1b1-40df-b861-69549ab9bf94", "tag": "ec6299a7-4107-4800-9b04-2c6a7cfa98b4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:22.854666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6f3f6bd1-b0ae-429b-825f-7c263e946c7f req-d66bf1b2-fdb6-4848-9042-40256005d099 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.855220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6f3f6bd1-b0ae-429b-825f-7c263e946c7f req-d66bf1b2-fdb6-4848-9042-40256005d099 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.855657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6f3f6bd1-b0ae-429b-825f-7c263e946c7f req-d66bf1b2-fdb6-4848-9042-40256005d099 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.883079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6f3f6bd1-b0ae-429b-825f-7c263e946c7f req-d66bf1b2-fdb6-4848-9042-40256005d099 service nova] Creating event network-changed:ec6299a7-4107-4800-9b04-2c6a7cfa98b4 for instance 910000d6-f1b1-40df-b861-69549ab9bf94 on n-h1-836830-16 Sep 07 09:50:22.889125 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6f3f6bd1-b0ae-429b-825f-7c263e946c7f req-d66bf1b2-fdb6-4848-9042-40256005d099 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072967 Sep 07 09:50:22.890238 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 736/1452] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:22.898702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9be370a2-350e-435d-9736-6bc3686a9e70 req-b4387efd-124a-4b3d-aed1-1199cd6632e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af481ffe-3355-44b6-bd98-139ea86dabeb", "name": "network-vif-plugged", "status": "completed", "tag": "da722a00-2eeb-4a04-93d4-5149d610525a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:22.912178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9be370a2-350e-435d-9736-6bc3686a9e70 req-b4387efd-124a-4b3d-aed1-1199cd6632e9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:22.912920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9be370a2-350e-435d-9736-6bc3686a9e70 req-b4387efd-124a-4b3d-aed1-1199cd6632e9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:22.915243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9be370a2-350e-435d-9736-6bc3686a9e70 req-b4387efd-124a-4b3d-aed1-1199cd6632e9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:22.948839 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9be370a2-350e-435d-9736-6bc3686a9e70 req-b4387efd-124a-4b3d-aed1-1199cd6632e9 service nova] Creating event network-vif-plugged:da722a00-2eeb-4a04-93d4-5149d610525a for instance af481ffe-3355-44b6-bd98-139ea86dabeb on n-h1-836830-16 Sep 07 09:50:22.968570 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9be370a2-350e-435d-9736-6bc3686a9e70 req-b4387efd-124a-4b3d-aed1-1199cd6632e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076707 Sep 07 09:50:22.969578 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 737/1453] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:23.065156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:23.067681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:23.085790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:23.086459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:23.086915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:23.090715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:23.091300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:23.091748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:23.144178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:23.298032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:23.337154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:23.339802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:23.342827 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5569944-56cf-4d9a-a56a-4f58bcb8d8be tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.623153 Sep 07 09:50:23.344018 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 717/1454] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:22 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:23.348706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:23.351841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:23.359745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:23.360513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:23.361211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:23.362116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:23.363119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:23.363847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:24.866721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:24.892908 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11357d58-ecbb-4d1a-a559-f90246605050 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 1.835307 Sep 07 09:50:24.907067 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 738/1455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:23 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:24.931781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:24.933540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:24.951429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:24.953111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:24.955321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:24.957115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:24.969210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:24.970072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:25.912557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:25.931918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-475e36ef-e29c-4be2-ad41-f4c60692f6ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 2.586993 Sep 07 09:50:25.937922 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 718/1456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:23 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 2594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:25.955536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:25.960932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:25.981320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:25.990214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:25.993418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:25.994284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:25.994754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:25.995190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:26.434911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:26.476539 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c5dba9bb-aa4a-4a72-bce6-ae9aa373ff49 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 1.560325 Sep 07 09:50:26.482052 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 739/1457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:24 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:26.505467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:26.506095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:26.549567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:26.557778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:26.559375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:26.566227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:26.567036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:26.567687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:26.739045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:26.759323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d3818e28-3759-44cf-b053-47c255c0e04f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1318 microversion: 2.1 time: 0.816499 Sep 07 09:50:26.768399 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 719/1458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:25 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:26.781765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e7dcb81b-0edd-4eb1-b86f-89bfa2856fec req-4414bdd8-fb67-44f2-856f-b503fc432a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7209c74a-77e2-4eec-bf7e-1c628622b5ea", "tag": "3716a6a1-85e0-477a-8ae4-d13530d51dc4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:26.844448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e7dcb81b-0edd-4eb1-b86f-89bfa2856fec req-4414bdd8-fb67-44f2-856f-b503fc432a8b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:26.845444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e7dcb81b-0edd-4eb1-b86f-89bfa2856fec req-4414bdd8-fb67-44f2-856f-b503fc432a8b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:26.853316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e7dcb81b-0edd-4eb1-b86f-89bfa2856fec req-4414bdd8-fb67-44f2-856f-b503fc432a8b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:26.933993 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e7dcb81b-0edd-4eb1-b86f-89bfa2856fec req-4414bdd8-fb67-44f2-856f-b503fc432a8b service nova] Creating event network-changed:3716a6a1-85e0-477a-8ae4-d13530d51dc4 for instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea on n-h1-836830-16 Sep 07 09:50:26.950635 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e7dcb81b-0edd-4eb1-b86f-89bfa2856fec req-4414bdd8-fb67-44f2-856f-b503fc432a8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178300 Sep 07 09:50:26.957086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 720/1459] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:26.977660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:26.993947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:27.009170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:27.026045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:27.038404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:27.039964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:27.040630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:27.047526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:27.979435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:27.989909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:27.991588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:27.993472 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b455be63-46e0-4e8c-9528-f8334ec338b6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 1.510329 Sep 07 09:50:27.994596 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 740/1460] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:26 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:27.999977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d690425d-6b82-44c2-94d0-c8fb36da41fa req-d1857356-5ffd-4f7e-95a0-64afe303f371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398b237-89ef-407c-9937-6a8bbde72eef", "name": "network-vif-plugged", "status": "completed", "tag": "bc230a1c-79f0-4163-b758-2f68baee50c0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:28.011783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d690425d-6b82-44c2-94d0-c8fb36da41fa req-d1857356-5ffd-4f7e-95a0-64afe303f371 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.012740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d690425d-6b82-44c2-94d0-c8fb36da41fa req-d1857356-5ffd-4f7e-95a0-64afe303f371 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.013446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d690425d-6b82-44c2-94d0-c8fb36da41fa req-d1857356-5ffd-4f7e-95a0-64afe303f371 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.028741 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d690425d-6b82-44c2-94d0-c8fb36da41fa req-d1857356-5ffd-4f7e-95a0-64afe303f371 service nova] Creating event network-vif-plugged:bc230a1c-79f0-4163-b758-2f68baee50c0 for instance a398b237-89ef-407c-9937-6a8bbde72eef on n-h2-836830-16 Sep 07 09:50:28.034039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d690425d-6b82-44c2-94d0-c8fb36da41fa req-d1857356-5ffd-4f7e-95a0-64afe303f371 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037920 Sep 07 09:50:28.034761 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 741/1461] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:28.041722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:28.042549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:28.048861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.050579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.051295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.052078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.052611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.053132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.201356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:28.210509 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0caad7c5-77d9-43ae-9c7c-f5f5cc7b7dc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 1.251729 Sep 07 09:50:28.228895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 721/1462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:26 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:28.232459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:28.233008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:28.239988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.240415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.240855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.242300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.242864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.243293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.551297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:28.560272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d2cabc0-97c5-4a33-a95e-fd426791b1ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 0.523836 Sep 07 09:50:28.560862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 742/1463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:28 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:28.565988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:28.566798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:28.574460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.575207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.575748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.576521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.577053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.577580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.612020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:28.622188 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3d9c227-6a5e-4508-bc77-e95a8a4442d3 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.394235 Sep 07 09:50:28.623121 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 722/1464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:28 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:28.627816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1305579676", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6eb86d04-a25b-47cd-8f75-34e1365a0fe3"}], "block_device_mapping_v2": [{"uuid": "6254236c-e668-4bfe-9ef7-26235040d594", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:28.694146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] validate_networks() for [('6eb86d04-a25b-47cd-8f75-34e1365a0fe3', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:28.845067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:28.854081 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e733fab-b874-44a6-93f4-5e2b8232a556 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1508 microversion: 2.1 time: 0.291887 Sep 07 09:50:28.854671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 743/1465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:28 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:28.878939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:28.879652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:28.886530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.887163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.888083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:28.889982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:28.889982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:28.890472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:29.220640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:29.230845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5193a199-fc82-4cd4-acc2-fa6d8a61de38 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1508 microversion: 2.1 time: 0.356465 Sep 07 09:50:29.231632 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 744/1466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:28 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:29.237729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:29.238429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:29.245737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:29.246538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:29.247173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:29.248347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:29.248995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:29.249640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.228548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:30.237639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:30.239114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:30.240302 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9c9022e-d9a6-47cf-9ede-935e721fc3b1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 1.007690 Sep 07 09:50:30.253496 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 745/1467] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:29 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:30.263846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:30.264608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:30.273122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.274073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.274770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.275494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.275959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.276382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.440119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:30.440634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:30.441133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:30.441585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:30.442006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:30.451217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.451703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.452144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.452877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.453388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.453816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.471845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:30.478089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Getting quotas for user 224142a6fa7e4702b1780f4aaeb3f93f and project 913dc4cafc574c08a81d9f473a935e5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:30.537124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:30.540092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6254236c-e668-4bfe-9ef7-26235040d594',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:30.699235 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c016133d-f335-41e7-9a8d-de43cd1aa942 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075156 Sep 07 09:50:30.699916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 723/1468] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:50:30.710914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:30.714050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:30.720605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.726304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.727350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.728265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.731670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.732286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.806539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:30.810808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4bdbd4dd-6146-461e-be1d-bf560a884ea5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "PUT /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1080 microversion: 2.1 time: 0.109632 Sep 07 09:50:30.811793 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 724/1469] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 09:50:30 2022] PUT /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1080 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:30.816791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6b7ccb9b-705c-405d-91a0-be5da1e1d336 req-31f7cb6c-8cc1-4927-8022-5da76637237a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181cfb61-0e63-4cdb-91ba-06af35fa0dc1", "tag": "2529a441-5992-438d-88ea-625e2e882c5a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:30.819151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cdd0f2aa-f6f7-43c4-ac12-79838e9c1a4a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 0.562598 Sep 07 09:50:30.834630 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 746/1470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:30 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:30.837227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6b7ccb9b-705c-405d-91a0-be5da1e1d336 req-31f7cb6c-8cc1-4927-8022-5da76637237a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.837973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6b7ccb9b-705c-405d-91a0-be5da1e1d336 req-31f7cb6c-8cc1-4927-8022-5da76637237a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.838687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6b7ccb9b-705c-405d-91a0-be5da1e1d336 req-31f7cb6c-8cc1-4927-8022-5da76637237a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.847164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:30.847797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:30.856284 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6b7ccb9b-705c-405d-91a0-be5da1e1d336 req-31f7cb6c-8cc1-4927-8022-5da76637237a service nova] Creating event network-changed:2529a441-5992-438d-88ea-625e2e882c5a for instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 on n-h2-836830-16 Sep 07 09:50:30.863423 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6b7ccb9b-705c-405d-91a0-be5da1e1d336 req-31f7cb6c-8cc1-4927-8022-5da76637237a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050322 Sep 07 09:50:30.864652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 725/1471] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:30.867308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.868224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.868673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.869420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.871069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.874391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.874691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:30.875691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:30.885078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.885674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.886310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:30.887018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:30.887480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:30.887909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.334420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.342977 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b63c360-8e88-4f21-a15c-736bc285d753 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.476626 Sep 07 09:50:31.343670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 726/1472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:30 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:31.347924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.361257 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e7a5bef7-f992-48b6-b37d-128ad06b271c tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 0.516594 Sep 07 09:50:31.369710 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 747/1473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:30 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:31.369948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0fea45d8-b0a5-4c91-bbc1-e72ff194baa5 req-88246a81-4611-4c54-bfbb-8e577e0f45a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910000d6-f1b1-40df-b861-69549ab9bf94", "name": "network-vif-plugged", "status": "completed", "tag": "ec6299a7-4107-4800-9b04-2c6a7cfa98b4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:31.373782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:31.374651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:31.383150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0fea45d8-b0a5-4c91-bbc1-e72ff194baa5 req-88246a81-4611-4c54-bfbb-8e577e0f45a1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.383928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0fea45d8-b0a5-4c91-bbc1-e72ff194baa5 req-88246a81-4611-4c54-bfbb-8e577e0f45a1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.384593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0fea45d8-b0a5-4c91-bbc1-e72ff194baa5 req-88246a81-4611-4c54-bfbb-8e577e0f45a1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.386914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.387411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.388004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.388846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.389513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.391611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.423359 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0fea45d8-b0a5-4c91-bbc1-e72ff194baa5 req-88246a81-4611-4c54-bfbb-8e577e0f45a1 service nova] Creating event network-vif-plugged:ec6299a7-4107-4800-9b04-2c6a7cfa98b4 for instance 910000d6-f1b1-40df-b861-69549ab9bf94 on n-h1-836830-16 Sep 07 09:50:31.441528 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0fea45d8-b0a5-4c91-bbc1-e72ff194baa5 req-88246a81-4611-4c54-bfbb-8e577e0f45a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088326 Sep 07 09:50:31.446872 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 727/1474] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:31.474166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:31.477747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:31.478161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.490801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.492131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.492468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.492766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-550dc454-2108-4aa9-876a-c917cf607b5b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1103 microversion: 2.1 time: 0.128829 Sep 07 09:50:31.493848 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 748/1475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:31 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1103 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:31.494925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.495817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.496433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.499162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:31.500044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:31.508642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.509533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.510223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.511229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.511950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.512620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.827566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.838942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae5f6ad1-fd3b-4b53-b361-c056f39598af tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1506 microversion: 2.1 time: 0.387982 Sep 07 09:50:31.839588 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 728/1476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:31 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:31.857611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:31.858231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:31.865703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.866190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.868954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.869802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:31.873493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:31.874148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:31.932695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.945102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.946983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:31.949173 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-22077792-8540-468b-9ecf-17e0d7ffdc74 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1814 microversion: 2.25 time: 0.453921 Sep 07 09:50:31.961985 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 749/1477] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:31 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1814 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:32.003099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:32.006470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:32.015627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.016563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.027659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.029712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.031151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.032145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.394657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:32.407458 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd078c06-0085-4790-8ecb-84ea5e3d1764 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1317 microversion: 2.1 time: 0.561724 Sep 07 09:50:32.412676 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 729/1478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:31 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:32.419955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:32.420789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:32.429410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.430102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.430707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.431585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.432198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.432789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.454108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:32.475201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d36f22f-54e3-4d74-a679-ceb32b8ccc75 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1506 microversion: 2.1 time: 0.511597 Sep 07 09:50:32.476274 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 750/1479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:31 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:32.485879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:32.486555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:32.493425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.494302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.494926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.495884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.496510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.497287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.736483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:32.760458 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e1e3465-29cb-4a7a-abeb-9d5ff5f240d2 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.351211 Sep 07 09:50:32.774043 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 730/1480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:32 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:32.783676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:32.787608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:32.793093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:32.795883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.797096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.797866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.799160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.800033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.800798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.800924 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6815bf6-aa76-4bad-9e3f-25519ee27da5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 0.323427 Sep 07 09:50:32.805264 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 751/1481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:32 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:32.815619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:32.816238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:32.836848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.837541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.838595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.839346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:32.839808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:32.840242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:32.916523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:32.935425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:32.936014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:32.936597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:32.937266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:32.937993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:33.005705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:33.021429 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f0a9ce28-92e7-4cf6-8c7a-15d055a4191d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1151 microversion: 2.1 time: 0.218846 Sep 07 09:50:33.032289 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 752/1482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:32 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1151 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:33.052262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:33.054501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:33.055409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:33.063036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.063984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.064617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.064780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.066034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.067295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.070023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.071949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.074923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.076196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.076824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.077552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.126606 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e0f87bc-8f1c-4484-8e60-d5f37602514f tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "POST /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb/action" status: 202 len: 1112 microversion: 2.1 time: 0.351098 Sep 07 09:50:33.127616 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 731/1483] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:50:32 2022] POST /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb/action => generated 1112 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 09:50:33.146767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:33.148200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:33.154947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.155707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.156675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.157596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.158221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.158809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.777896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:33.794954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:33.797719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:33.799857 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1164d47c-1564-4f1a-8cfc-2fd5e81b24d4 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1804 microversion: 2.25 time: 0.751264 Sep 07 09:50:33.800596 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 753/1484] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:33 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1804 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:50:33.822616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:33.823868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:33.833878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.834597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.836251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.837171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.838293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.838892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.952846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:33.964396 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d94fe584-0d69-4b1f-bd57-548d616e51bd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.820993 Sep 07 09:50:33.965679 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 732/1485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:33 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:33.970908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:33.971682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:33.981413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.982417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.983218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:33.984224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:33.984945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:33.985574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.253081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:34.277214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb7ed13e-e0ef-4e57-98d2-316a95e477d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1467 microversion: 2.1 time: 0.471836 Sep 07 09:50:34.278440 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 754/1486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:33 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1467 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:34.299131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:34.300875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:34.319054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.321288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.323295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.325846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.326579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.329541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.437299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:34.448984 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7dc1a5f9-0c70-4821-abc0-5d4b8f7f2a25 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.481926 Sep 07 09:50:34.454061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 733/1487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:33 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:34.473347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5502c0b5-b687-42df-a2b9-4e69d60631c6 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '.version_select at 0x7f14b22b9700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:34.477217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5502c0b5-b687-42df-a2b9-4e69d60631c6 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.482001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5502c0b5-b687-42df-a2b9-4e69d60631c6 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.482741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5502c0b5-b687-42df-a2b9-4e69d60631c6 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.503912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5502c0b5-b687-42df-a2b9-4e69d60631c6 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2804 microversion: 2.25 time: 0.048476 Sep 07 09:50:34.504533 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 734/1488] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 7 09:50:34 2022] GET /compute/v2.1/os-migrations => generated 2804 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:34.520246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:34.521366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:34.533669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.535893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.540010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.540889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.541418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.542049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.702084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:34.712205 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f6a68b7-e27a-441e-8c30-654c4138283d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1169 microversion: 2.1 time: 0.195255 Sep 07 09:50:34.730024 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 735/1489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:34 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1169 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:34.734101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:34.736468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2e069adb-614f-41ee-99a1-aa4cd5193e6b req-d9996ad5-9c16-4ba8-8e5c-b0ca2c377093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7209c74a-77e2-4eec-bf7e-1c628622b5ea", "name": "network-vif-plugged", "status": "completed", "tag": "3716a6a1-85e0-477a-8ae4-d13530d51dc4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:34.738066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:34.748974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a06f398b-8457-4c7c-9f1f-d4c5b7ea33b5 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 0.469317 Sep 07 09:50:34.749904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 755/1490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:34 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:34.760092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:34.763268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2e069adb-614f-41ee-99a1-aa4cd5193e6b req-d9996ad5-9c16-4ba8-8e5c-b0ca2c377093 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.763446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:34.764084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:34.764864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2e069adb-614f-41ee-99a1-aa4cd5193e6b req-d9996ad5-9c16-4ba8-8e5c-b0ca2c377093 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.765643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2e069adb-614f-41ee-99a1-aa4cd5193e6b req-d9996ad5-9c16-4ba8-8e5c-b0ca2c377093 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.777407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.777909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.784348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.788238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.788850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.789442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.805300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2e069adb-614f-41ee-99a1-aa4cd5193e6b req-d9996ad5-9c16-4ba8-8e5c-b0ca2c377093 service nova] Creating event network-vif-plugged:3716a6a1-85e0-477a-8ae4-d13530d51dc4 for instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea on n-h1-836830-16 Sep 07 09:50:34.814140 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2e069adb-614f-41ee-99a1-aa4cd5193e6b req-d9996ad5-9c16-4ba8-8e5c-b0ca2c377093 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082580 Sep 07 09:50:34.815027 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 736/1491] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:34.828284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:34.829345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:34.845035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.845829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.847709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:34.848615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:34.853870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:34.854597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.231076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:35.245467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88194f07-a217-40fd-932a-fc03ee30f83d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 200 len: 1465 microversion: 2.1 time: 0.494110 Sep 07 09:50:35.246633 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 756/1492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:34 2022] GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 1465 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:35.254837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:35.255944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:35.269775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.270990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.271622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.273434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.274224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.275390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.383373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 1c670f25-8fd6-4cb0-8f33-b8544182fa74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:50:35.426298 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0fdbdcbb-e656-43c3-8260-a97258d1aabb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 2424 microversion: 2.25 time: 0.609800 Sep 07 09:50:35.437778 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 737/1493] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:34 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 2424 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:35.446412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:35.469656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:35.478491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Searching by: {'reservation_id': 'r-c5ifdvjz', 'deleted': False, 'project_id': '16f96dd538e242b88d17442cb92b3d46'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:50:35.492329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.493064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.493907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.494916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.495614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.496282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.593067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:35.603049 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-98cc3384-58e8-468f-8394-02a9350608f3 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.354066 Sep 07 09:50:35.608591 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 757/1494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:35 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:35.613696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:35.629041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:35.652215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.652957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.653603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.655009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.655666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.657034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:35.707609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:50:35.804708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:35.814226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:35.814966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:35.815577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.093926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 1c670f25-8fd6-4cb0-8f33-b8544182fa74 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:50:36.108617 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-405876ba-3f05-404e-8458-58d1197787de tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-c5ifdvjz" status: 200 len: 2925 microversion: 2.1 time: 0.667671 Sep 07 09:50:36.109789 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 738/1495] 10.222.0.60 () {58 vars in 1197 bytes} [Wed Sep 7 09:50:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-c5ifdvjz => generated 2925 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:36.115364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:36.116454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:36.119323 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-533241f8-f3ad-42c0-a97e-b9cbd45e1f06 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 2424 microversion: 2.25 time: 0.509231 Sep 07 09:50:36.129791 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 758/1496] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:50:35 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 2424 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:50:36.145340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.146223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:36.146356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.146925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:36.147285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.151471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.154591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.154940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.155382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.155779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.156157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.156528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.156960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.157276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.528677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:36.544285 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd9cde00-f119-42ef-be48-cd2e7fd81c60 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1211 microversion: 2.1 time: 0.413115 Sep 07 09:50:36.545210 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 759/1497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:36 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1211 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:36.550584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:36.556006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:36.566945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.567451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.568431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.568864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.569457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.569901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.722214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:36.745595 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab44a930-410e-4d3f-b012-cdade848240a tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.634182 Sep 07 09:50:36.757537 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 739/1498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:36 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:36.771269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f72bb505-df11-483e-b0f2-5fe8211722d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:36.815903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.compute.server_groups [None req-f72bb505-df11-483e-b0f2-5fe8211722d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Querying cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) for 2 instances {{(pid=128832) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 09:50:36.822307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f72bb505-df11-483e-b0f2-5fe8211722d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.823350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f72bb505-df11-483e-b0f2-5fe8211722d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.824048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f72bb505-df11-483e-b0f2-5fe8211722d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.902220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:36.907247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f72bb505-df11-483e-b0f2-5fe8211722d6 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/3c6dcc26-7542-4d4a-bd5f-b52aaa21076f" status: 200 len: 270 microversion: 2.1 time: 0.143490 Sep 07 09:50:36.911094 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 740/1499] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:50:36 2022] GET /compute/v2.1/os-server-groups/3c6dcc26-7542-4d4a-bd5f-b52aaa21076f => generated 270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:36.916256 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8340a195-f7a5-4e95-9ec6-d2d31306ad87 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1323 microversion: 2.1 time: 0.369698 Sep 07 09:50:36.916827 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 760/1500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:36 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:36.936619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:36.938139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:36.941850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:36.942537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:36.955738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.956652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.957157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.957653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.957861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.958374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.958843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.959000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.959275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:36.960678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:36.968336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:36.968906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.129426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lazy-loading 'services' on Instance uuid 1c670f25-8fd6-4cb0-8f33-b8544182fa74 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:50:37.271955 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6308495-8bf7-46ff-9bc2-2df2be9c380f tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments/31892ec5-dc05-467c-b5d8-435075083f24" status: 202 len: 0 microversion: 2.25 time: 0.359376 Sep 07 09:50:37.273649 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 741/1501] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 7 09:50:36 2022] DELETE /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments/31892ec5-dc05-467c-b5d8-435075083f24 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:50:37.279069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1c908c26-3f96-4189-8185-4cd9a910254b req-21449df7-c142-4df4-888c-19db00d97894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181cfb61-0e63-4cdb-91ba-06af35fa0dc1", "name": "network-vif-plugged", "status": "completed", "tag": "2529a441-5992-438d-88ea-625e2e882c5a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:37.306105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1c908c26-3f96-4189-8185-4cd9a910254b req-21449df7-c142-4df4-888c-19db00d97894 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.310090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1c908c26-3f96-4189-8185-4cd9a910254b req-21449df7-c142-4df4-888c-19db00d97894 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.310802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1c908c26-3f96-4189-8185-4cd9a910254b req-21449df7-c142-4df4-888c-19db00d97894 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.329553 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1c908c26-3f96-4189-8185-4cd9a910254b req-21449df7-c142-4df4-888c-19db00d97894 service nova] Creating event network-vif-plugged:2529a441-5992-438d-88ea-625e2e882c5a for instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 on n-h2-836830-16 Sep 07 09:50:37.336853 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1c908c26-3f96-4189-8185-4cd9a910254b req-21449df7-c142-4df4-888c-19db00d97894 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061307 Sep 07 09:50:37.340589 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 742/1502] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:37.362014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:37.363030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:37.372632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.380718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.389667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.391583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.396818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.400165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.553910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:37.576383 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-840d8755-2c8e-4ba5-a460-4686f2bbe125 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.645177 Sep 07 09:50:37.577589 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 761/1503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:36 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:37.590308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-414201b3-de3f-4c20-9962-7338a0cf47e9 req-2fed2ed3-882f-4ddc-bf85-11bde8e3a51f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891829aa-74cd-42e3-a67c-eb136af6b32c", "tag": "b2432ae8-6727-4d23-b5bf-863869d42ff6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:37.611539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-414201b3-de3f-4c20-9962-7338a0cf47e9 req-2fed2ed3-882f-4ddc-bf85-11bde8e3a51f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.612832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-414201b3-de3f-4c20-9962-7338a0cf47e9 req-2fed2ed3-882f-4ddc-bf85-11bde8e3a51f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.613529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-414201b3-de3f-4c20-9962-7338a0cf47e9 req-2fed2ed3-882f-4ddc-bf85-11bde8e3a51f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.628017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-414201b3-de3f-4c20-9962-7338a0cf47e9 req-2fed2ed3-882f-4ddc-bf85-11bde8e3a51f service nova] Creating event network-changed:b2432ae8-6727-4d23-b5bf-863869d42ff6 for instance 891829aa-74cd-42e3-a67c-eb136af6b32c on n-h2-836830-16 Sep 07 09:50:37.637770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-414201b3-de3f-4c20-9962-7338a0cf47e9 req-2fed2ed3-882f-4ddc-bf85-11bde8e3a51f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057422 Sep 07 09:50:37.640683 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 762/1504] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:37.652280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:37.655578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:37.667193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.668039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.668644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.669702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.670324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.671166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.736254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f0483cd4-db23-4f92-9699-d205d7f14f06 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093993 Sep 07 09:50:37.736855 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 763/1505] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:50:37 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:50:37.744438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-43736729-953b-41fc-893c-bab80d8d18da tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1620 microversion: 2.1 time: 0.395378 Sep 07 09:50:37.745303 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 743/1506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:37 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1620 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:37.753566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:37.754712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:37.761972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.763009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.763693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.766104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.766238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:37.766511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.766713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:37.766947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.773142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.774108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.774701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:37.775562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:37.776178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:37.776749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:38.101504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:38.110641 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d11f8e59-de81-4a96-aa4d-9d1adb7565c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1211 microversion: 2.1 time: 0.372694 Sep 07 09:50:38.111241 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 764/1507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:37 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1211 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:38.136237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:38.136630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:38.168344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:38.171320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:38.172374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:38.174018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:38.178579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:38.179350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:38.212084 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b8f895b-d448-4a69-a831-7f0c4343ed57 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 200 len: 1618 microversion: 2.1 time: 0.449787 Sep 07 09:50:38.217672 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 744/1508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:37 2022] GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 1618 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:38.251560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:38.253481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:38.278877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:38.279374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:38.282123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:38.282936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:38.283414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:38.283847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:38.662248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:38.671923 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8dda5c3d-d197-4a09-9fc3-854b94d603b1 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1369 microversion: 2.1 time: 0.540375 Sep 07 09:50:38.676615 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 765/1509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:38 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1369 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:38.690107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2044776619", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "311d2586-a4ff-42eb-90c9-bb56ecdd89e4"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:38.815826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:38.963539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:38.974896 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12c9bb6f-643f-4efa-8aaa-727614266c0d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1519 microversion: 2.1 time: 0.743467 Sep 07 09:50:38.975437 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 745/1510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:38 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1519 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:39.021446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:39.022151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:39.053374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:39.061574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:39.062339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:39.066451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:39.071137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:39.071608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:39.945340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:39.946110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:39.946603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:39.947030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:39.947436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:39.970255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:39.971026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:39.971641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:39.972417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:39.978207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:39.978729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:40.021492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:40.040593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:40.061860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:40.074171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:40.076632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:40.077958 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1ea387f-63ea-4ce5-b3c0-50c678305ae4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 1.079350 Sep 07 09:50:40.097227 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 746/1511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:38 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:40.111804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:40.118974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:40.138671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:40.140038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:40.140485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:40.143571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:40.144064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:40.144505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:40.157691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:40.192379 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa08fec7-37a5-45b7-bc76-2733af2e9a6b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513625 Sep 07 09:50:40.197379 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 766/1512] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:50:40.217278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:40.218293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:40.229408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:40.230303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:40.231389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ad791aa-d009-45fe-9b5c-b39211627ef1 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128522 Sep 07 09:50:40.231798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:40.232833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:40.233606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:40.236266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:40.238487 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 747/1513] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:50:40 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:50:40.244348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c5ad355-9784-4d59-8a97-0a2e31fb7f7f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1792433355", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c5ad355-9784-4d59-8a97-0a2e31fb7f7f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 243 Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:50:40.262212 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:50:40.263871 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1792433355", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1792433355', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f2369e65-f9a9-4a3b-bf47-c8cfca55e962'}]}}} Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 09:50:40.264667 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:40.266044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:40.267419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c5ad355-9784-4d59-8a97-0a2e31fb7f7f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:40.268139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1c5ad355-9784-4d59-8a97-0a2e31fb7f7f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.028344 Sep 07 09:50:40.271746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 748/1514] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:40 2022] POST /compute/v2.1/servers => generated 175 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:50:40.281613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:40.282622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:40.299270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:40.308066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:40.308799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:40.309747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:40.310374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:40.310983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.201715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:41.218108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:41.223206 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4865dbe9-3ece-4d00-b375-f0c82486fee2 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1211 microversion: 2.1 time: 1.021951 Sep 07 09:50:41.223843 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 767/1515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:40 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1211 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:41.251250 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac869656-486a-4366-9d7e-7b53f0bdd134 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1556 microversion: 2.1 time: 0.977123 Sep 07 09:50:41.253040 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 749/1516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:40 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1556 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:41.261021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:41.264405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:41.265845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa5c7a6b-beff-4a2b-ba62-a2678f51dcfe tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:41.266690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa5c7a6b-beff-4a2b-ba62-a2678f51dcfe tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: c30496f0-e85e-4ec5-999b-9ccb5694d9b5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:41.272990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.273762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.274558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.275439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.276114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.277288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.279410 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-aa5c7a6b-beff-4a2b-ba62-a2678f51dcfe tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] HTTP exception thrown: Instance c30496f0-e85e-4ec5-999b-9ccb5694d9b5 could not be found. Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa5c7a6b-beff-4a2b-ba62-a2678f51dcfe tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/c30496f0-e85e-4ec5-999b-9ccb5694d9b5/metadata HTTP/1.1 Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:50:41.290847 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:50:41.292749 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance c30496f0-e85e-4ec5-999b-9ccb5694d9b5 could not be found. Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': 'c30496f0-e85e-4ec5-999b-9ccb5694d9b5'} Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30496f0-e85e-4ec5-999b-9ccb5694d9b5 could not be found. Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:41.293640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30496f0-e85e-4ec5-999b-9ccb5694d9b5 could not be found. Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30496f0-e85e-4ec5-999b-9ccb5694d9b5 could not be found. Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.295399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa5c7a6b-beff-4a2b-ba62-a2678f51dcfe tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 404 to user: Instance c30496f0-e85e-4ec5-999b-9ccb5694d9b5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:41.297548 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa5c7a6b-beff-4a2b-ba62-a2678f51dcfe tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/c30496f0-e85e-4ec5-999b-9ccb5694d9b5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.036036 Sep 07 09:50:41.300639 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 750/1517] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:50:41 2022] GET /compute/v2.1/servers/c30496f0-e85e-4ec5-999b-9ccb5694d9b5/metadata => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:50:41.314323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:41.315902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:41.353955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.354769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.355391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.358101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.358795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.359423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.437388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:41.449673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01cfe7a8-2c42-460c-a159-ea7b5db063fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1213 microversion: 2.1 time: 0.221178 Sep 07 09:50:41.450713 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 768/1518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:41 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:41.473017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:41.475729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:41.491738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.492767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.493713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.494608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.495890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.497144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.576748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cac30dc-c2c8-4218-9c41-2af6cd61c2eb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108935 Sep 07 09:50:41.577876 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 769/1519] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:50:41 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:50:41.586446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:41.586966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:41.597131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.597663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.598100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.598810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:41.599265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:41.606931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:41.611258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:41.619965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f24e0857-f288-403e-b2cb-9333fb4f4809 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.318088 Sep 07 09:50:41.624200 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 751/1520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:41 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:41.742204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-699e0895-e567-427c-bb0c-1f91682169e0 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162329 Sep 07 09:50:41.743040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 770/1521] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:50:41 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:41.748903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89894493-0a60-4a23-ab2c-2461aef814fc tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1572195095", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89894493-0a60-4a23-ab2c-2461aef814fc tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 499 Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:50:41.759022 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.760831 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:50:41.761756 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1572195095", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} Sep 07 09:50:41.761756 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:50:41.761756 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.761756 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1572195095', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f2369e65-f9a9-4a3b-bf47-c8cfca55e962'}]}}} Sep 07 09:50:41.761756 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:41.761756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.762305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:50:41.763786 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:50:41.765125 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:50:41.765897 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.765897 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.769395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89894493-0a60-4a23-ab2c-2461aef814fc tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:41.770489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89894493-0a60-4a23-ab2c-2461aef814fc tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.025672 Sep 07 09:50:41.771120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 771/1522] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:41 2022] POST /compute/v2.1/servers => generated 687 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:50:41.828432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fbf656f2-1ce0-4d25-9e46-44323c436b51 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-513252930", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fbf656f2-1ce0-4d25-9e46-44323c436b51 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 499 Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:50:41.835990 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.838148 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:50:41.839058 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-513252930", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} Sep 07 09:50:41.839058 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:50:41.839058 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.839058 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-513252930', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f2369e65-f9a9-4a3b-bf47-c8cfca55e962'}]}}} Sep 07 09:50:41.839058 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:41.839058 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.839586 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:50:41.841049 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:50:41.842269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:50:41.843003 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.843003 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.843003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fbf656f2-1ce0-4d25-9e46-44323c436b51 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:41.843298 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fbf656f2-1ce0-4d25-9e46-44323c436b51 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012472 Sep 07 09:50:41.843298 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 772/1523] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:41 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 09:50:41.911911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1828667682", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ee662ca7-2394-47b2-9487-d69b5736a12f"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:41.921056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adc2edea-45ad-4a2c-89f6-4cdfb70a0f4f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1282186542", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adc2edea-45ad-4a2c-89f6-4cdfb70a0f4f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 754 Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:50:41.925452 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.927429 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:50:41.928229 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1282186542", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} Sep 07 09:50:41.928229 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:50:41.928229 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1282186542', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f2369e65-f9a9-4a3b-bf47-c8cfca55e962'}]}}} Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:50:41.928502 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:41.929206 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:50:41.930699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:50:41.931474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:50:41.932234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.932234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.932427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adc2edea-45ad-4a2c-89f6-4cdfb70a0f4f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:41.933679 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adc2edea-45ad-4a2c-89f6-4cdfb70a0f4f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016900 Sep 07 09:50:41.934172 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 773/1524] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:41 2022] POST /compute/v2.1/servers => generated 1197 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 07 09:50:41.989420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65658c27-ca17-4104-bb8b-e24a97400b14 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1455685612", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65658c27-ca17-4104-bb8b-e24a97400b14 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 1266 Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:50:41.996270 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:41.997786 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:50:41.998468 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1455685612", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f2369e65-f9a9-4a3b-bf47-c8cfca55e962"}]}} Sep 07 09:50:41.998468 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1455685612', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f2369e65-f9a9-4a3b-bf47-c8cfca55e962'}]}}} Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.998652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:50:41.999881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:50:42.001842 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 09:50:42.001842 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:42.002030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] validate_networks() for [('ee662ca7-2394-47b2-9487-d69b5736a12f', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:50:42.004866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65658c27-ca17-4104-bb8b-e24a97400b14 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:42.006063 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65658c27-ca17-4104-bb8b-e24a97400b14 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021288 Sep 07 09:50:42.019354 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 774/1525] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Sep 7 09:50:41 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 07 09:50:42.030387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ea94c1a-f544-4881-9fe3-62050164359f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:42.031268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ea94c1a-f544-4881-9fe3-62050164359f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 1988cbea-86d5-4db1-82a2-bcb134564edd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:42.037460 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2ea94c1a-f544-4881-9fe3-62050164359f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] HTTP exception thrown: Instance 1988cbea-86d5-4db1-82a2-bcb134564edd could not be found. Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ea94c1a-f544-4881-9fe3-62050164359f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/1988cbea-86d5-4db1-82a2-bcb134564edd/metadata/test2 HTTP/1.1 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 1988cbea-86d5-4db1-82a2-bcb134564edd could not be found. Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '1988cbea-86d5-4db1-82a2-bcb134564edd', 'id': 'test2'} Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1988cbea-86d5-4db1-82a2-bcb134564edd could not be found. Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1988cbea-86d5-4db1-82a2-bcb134564edd could not be found. Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:42.040422 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:42.044734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:50:42.044734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:50:42.044734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1988cbea-86d5-4db1-82a2-bcb134564edd could not be found. Sep 07 09:50:42.044734 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:42.046484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ea94c1a-f544-4881-9fe3-62050164359f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 404 to user: Instance 1988cbea-86d5-4db1-82a2-bcb134564edd could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:42.047585 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ea94c1a-f544-4881-9fe3-62050164359f tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/1988cbea-86d5-4db1-82a2-bcb134564edd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022063 Sep 07 09:50:42.048386 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 775/1526] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 09:50:42 2022] GET /compute/v2.1/servers/1988cbea-86d5-4db1-82a2-bcb134564edd/metadata/test2 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:50:42.066897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:42.068216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:42.075410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.076618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.077605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.078555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.079245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.079905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.114836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:50:42.223726 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3fdea1af-2a5a-4f10-84d5-774cf7de9197 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 204 len: 0 microversion: 2.1 time: 0.162945 Sep 07 09:50:42.226184 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 776/1527] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:50:42 2022] DELETE /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:50:42.235728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:42.236671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:42.246364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.247335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.248095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.249072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.249718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.251235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.258587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:42.528380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:42.537880 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fb045c7d-3eba-4ffc-8d62-fd22cd3cb335 tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1525 microversion: 2.1 time: 0.307458 Sep 07 09:50:42.539459 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 777/1528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:42 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1525 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:42.560662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:42.562695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:42.577971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.579294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.580167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.581376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.582647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.584389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.718213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:50:42.719201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:50:42.719844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:50:42.720432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:50:42.721056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:50:42.738186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.739212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.740050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.744449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.745282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.745932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.796177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:42.798579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Getting quotas for project 11f073a8bdbe4ac89c7beeb82fe458ce. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:50:42.806991 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03994217-5b9d-465f-bd8f-05f7deccf1b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1211 microversion: 2.1 time: 0.265963 Sep 07 09:50:42.807652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 778/1529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:42 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1211 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:42.817702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Getting quotas for user 46e1e110e1c74e4cb394d94906fd3c52 and project 11f073a8bdbe4ac89c7beeb82fe458ce. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:50:42.821538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:42.822271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:42.825467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:42.834114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.834528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.835702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.836649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.837118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:42.837577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:42.846998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:50:42.849436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:50:42.959175 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-11399115-e718-424b-bae0-a6eae2f1814a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333777 Sep 07 09:50:42.959847 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 752/1530] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:50:42.969162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:42.980086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:42.984129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:42.984430 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a840e642-8ae1-44f6-9178-fef22b5656e2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1277 microversion: 2.1 time: 0.172367 Sep 07 09:50:42.996133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:42.997447 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 779/1531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:42 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:43.015463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.017508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.021503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:43.026327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.027600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.028267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.028629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:43.042065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.052763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.053659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.054661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.055355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.056013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.088823 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-488a9a2a-7d66-49da-9cf0-b2099d61c34c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127583 Sep 07 09:50:43.094684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 753/1532] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:50:42 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:50:43.099673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3cd56495-e453-4778-827c-8e21359f2c5d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:43.100291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3cd56495-e453-4778-827c-8e21359f2c5d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:43.236547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3cd56495-e453-4778-827c-8e21359f2c5d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:43.245142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3cd56495-e453-4778-827c-8e21359f2c5d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1224 microversion: 2.1 time: 0.149304 Sep 07 09:50:43.254265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 754/1533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:43 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1224 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:43.372437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:43.383095 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-809c8abc-252b-4560-98ff-377b8f575221 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.370505 Sep 07 09:50:43.384460 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 780/1534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:43 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:43.563719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:43.564433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:43.577269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.577794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.579539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.580861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.582436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.582901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.658894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b0f633db-325b-43c0-b5c0-4d40fdb1dd3d req-a393dd28-9979-4515-b649-3337cd4df99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181cfb61-0e63-4cdb-91ba-06af35fa0dc1", "tag": "2529a441-5992-438d-88ea-625e2e882c5a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:43.677888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b0f633db-325b-43c0-b5c0-4d40fdb1dd3d req-a393dd28-9979-4515-b649-3337cd4df99c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.679346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b0f633db-325b-43c0-b5c0-4d40fdb1dd3d req-a393dd28-9979-4515-b649-3337cd4df99c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.680312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b0f633db-325b-43c0-b5c0-4d40fdb1dd3d req-a393dd28-9979-4515-b649-3337cd4df99c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.695745 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b0f633db-325b-43c0-b5c0-4d40fdb1dd3d req-a393dd28-9979-4515-b649-3337cd4df99c service nova] Creating event network-changed:2529a441-5992-438d-88ea-625e2e882c5a for instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 on n-h2-836830-16 Sep 07 09:50:43.707638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b0f633db-325b-43c0-b5c0-4d40fdb1dd3d req-a393dd28-9979-4515-b649-3337cd4df99c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053994 Sep 07 09:50:43.710833 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 781/1535] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:50:43.839972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:43.841409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:43.856814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.857713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.858376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:43.859290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:43.869983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:43.870743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.536876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:44.551215 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2af2cab1-85cd-480b-a80c-3df37839fa1d tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1525 microversion: 2.1 time: 0.992279 Sep 07 09:50:44.552064 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 755/1536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:43 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1525 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:44.581245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:44.584656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:44.597048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.597862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.608066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.609458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.611455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.615074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.831167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:44.841037 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4497b51-e566-4e26-b071-0508139dd88a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1211 microversion: 2.1 time: 1.006592 Sep 07 09:50:44.854097 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 782/1537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:43 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1211 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:44.857964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:44.860515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:44.874202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.874946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.875580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.876472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.877093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.877827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.900440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:44.914905 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9fb0b1e-6a27-46ae-9c2c-419dfd0e6e36 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1275 microversion: 2.1 time: 0.361655 Sep 07 09:50:44.929956 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 756/1538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:44 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1275 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:44.934819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:44.935444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:44.937388 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93f0276d-9161-4c78-8108-abf4393633cc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094631 Sep 07 09:50:44.938180 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 783/1539] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:50:44 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:50:44.943455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:44.945425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:44.958899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.959715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.960929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.962623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.963344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.963966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.968614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.969112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.969817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:44.970535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:44.970994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:44.971427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:45.276510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:45.288878 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-468c9bba-8785-4973-99f6-eab68d7bdedc tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1276 microversion: 2.1 time: 0.357500 Sep 07 09:50:45.289711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 757/1540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:44 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:45.575876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:45.576469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:45.588438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:45.589280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:45.589928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:45.591318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:45.591960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:45.592559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:45.795678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:45.804606 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a54f94a8-969c-4ead-8f42-cb5feec06f5d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.864635 Sep 07 09:50:45.805908 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 784/1541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:44 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:45.870980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:45.872459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:45.880243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:45.881014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:45.882368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:45.884380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:45.885075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:45.885697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.339474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:46.368692 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6ba9567-600f-405c-b7b3-1897374bd8ab tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1525 microversion: 2.1 time: 0.796649 Sep 07 09:50:46.369864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 758/1542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:45 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1525 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:46.377062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:46.377837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:46.385019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:46.385697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:46.386457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.387413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:46.387988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:46.388546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.865912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:46.875349 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d2bb9a0-3ada-4173-9a1d-11246c3ee2d9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1275 microversion: 2.1 time: 0.504076 Sep 07 09:50:46.891837 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 759/1543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:46 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1275 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:46.903200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:46.904697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:46.914229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:46.915538 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94d73387-66ca-4d71-b351-e486e51537ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1211 microversion: 2.1 time: 1.051099 Sep 07 09:50:46.916130 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 785/1544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:45 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1211 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:46.921889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:46.922622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:46.923282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.925387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:46.925988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:46.942191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:46.942691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:46.943392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.944764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:46.945250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:46.945700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.946367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:46.946870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:46.947319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:46.997939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-462fbecd-cab3-40a2-a059-f72634471ce5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.099198 Sep 07 09:50:47.004370 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 760/1545] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 09:50:46 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:47.010882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:47.011737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:47.021875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.022714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.023369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.024286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.024945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.025622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.276393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:47.295620 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e73f339d-5a2e-4f9e-b012-b26a5efe7512 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1282 microversion: 2.1 time: 0.374570 Sep 07 09:50:47.297162 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 786/1546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:46 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1282 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:47.309094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5a9106ad-e34c-4114-b3b7-386e1ddb0639 req-1bbc0552-92c6-4cef-bf03-e695798437a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7209c74a-77e2-4eec-bf7e-1c628622b5ea", "name": "network-vif-deleted", "tag": "3716a6a1-85e0-477a-8ae4-d13530d51dc4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:47.338232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a9106ad-e34c-4114-b3b7-386e1ddb0639 req-1bbc0552-92c6-4cef-bf03-e695798437a3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.339392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a9106ad-e34c-4114-b3b7-386e1ddb0639 req-1bbc0552-92c6-4cef-bf03-e695798437a3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.339989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a9106ad-e34c-4114-b3b7-386e1ddb0639 req-1bbc0552-92c6-4cef-bf03-e695798437a3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.369106 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5a9106ad-e34c-4114-b3b7-386e1ddb0639 req-1bbc0552-92c6-4cef-bf03-e695798437a3 service nova] Creating event network-vif-deleted:3716a6a1-85e0-477a-8ae4-d13530d51dc4 for instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea on n-h1-836830-16 Sep 07 09:50:47.378546 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5a9106ad-e34c-4114-b3b7-386e1ddb0639 req-1bbc0552-92c6-4cef-bf03-e695798437a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079177 Sep 07 09:50:47.381133 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 787/1547] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:47.387932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:47.395178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:47.396351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Searching by: {'deleted': False, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:50:47.405670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.406039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.406662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.407571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.408363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.408988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.438719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:50:47.481035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a2dd922-0176-44b6-8ad7-737310f9616e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.097566 Sep 07 09:50:47.482320 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 788/1548] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 09:50:47 2022] GET /compute/v2.1/servers => generated 334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:47.488158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:47.489123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:47.504196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.504691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.505132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.516122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.516624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.517058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.611851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.612345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.618662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.619271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lazy-loading 'fault' on Instance uuid 7209c74a-77e2-4eec-bf7e-1c628622b5ea {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:50:47.783764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f916d809934c1d9648dd1128061540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db28e0418c74f48b2ace57130f2a096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:47.814988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58f3187e-ba33-4b81-9e58-1bf33027a02e tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 200 len: 1313 microversion: 2.1 time: 0.328519 Sep 07 09:50:47.832038 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 789/1549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:47 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:47.834505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:47.841071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:47.862249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Searching by: {'deleted': False, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:50:47.887098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.888693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.890644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:47.892380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.896888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.900481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.901075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.906652 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d563a6e-5ba6-49f6-a947-234ccd578297 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.900767 Sep 07 09:50:47.907602 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 761/1550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:47 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:47.926719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:47.931640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:47.960537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.961392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.974177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.978897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:47.980366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:47.982247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:47.986970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:50:48.171094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:48.186534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:48.187027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:48.187467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:48.513423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:48.521227 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ba46477-0085-4013-bd65-074af8c894c3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.611255 Sep 07 09:50:48.530669 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 762/1551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:47 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:48.538340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:48.541208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:48.560925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:48.561722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:48.562175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:48.562889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:48.563374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:48.563806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:48.733743 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36a2f160-8386-4d85-8966-34f2836921c7 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.910393 Sep 07 09:50:48.735110 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 790/1552] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:50:47 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:48.740754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:48.742369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:48.749683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:48.750247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:48.750917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:48.751677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:48.752362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:48.752916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.058452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:49.071905 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be775d2c-ecf4-4266-b986-badb4ed8e2c8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.538576 Sep 07 09:50:49.072501 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 763/1553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:48 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:49.080564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87623f0c-0233-46f1-9394-8249a76046e0 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:49.091182 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87623f0c-0233-46f1-9394-8249a76046e0 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017100 Sep 07 09:50:49.092435 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 764/1554] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:50:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:49.097599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:49.098471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] [instance: 7209c74a-77e2-4eec-bf7e-1c628622b5ea] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:49.111073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.112050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.112718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.114532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.116964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.121994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.161911 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] HTTP exception thrown: Instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea could not be found. Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Request method failure captured: Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea HTTP/1.1 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGlGKM1O271DIySV_hR2cf6ugqYg2aeaNOlAWcPGccME8giWihtlheizDccPclNq1N0gfP8nVbcW_XbLNk-HTaj6TQCYdgMo-7c6rHuPjccUZQTo3T89Fx9lZ-9Lpjn4wwmlos3yQLRACWpGsTQO3FhTN7TZPtW5taQEv0RYw8wanWA Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5db28e0418c74f48b2ace57130f2a096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5db28e0418c74f48b2ace57130f2a096", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5db28e0418c74f48b2ace57130f2a096 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-137798826 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a2f916d809934c1d9648dd1128061540 Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-137798826-project Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea could not be found. Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7209c74a-77e2-4eec-bf7e-1c628622b5ea'} Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea could not be found. Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea could not be found. Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:49.166911 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea could not be found. Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] Returning 404 to user: Instance 7209c74a-77e2-4eec-bf7e-1c628622b5ea could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c948ac7-1366-4704-b050-5e8eb72f941a tempest-ServerMetadataNegativeTestJSON-137798826 tempest-ServerMetadataNegativeTestJSON-137798826-project] 10.222.0.60 "GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea" status: 404 len: 111 microversion: 2.1 time: 0.074797 Sep 07 09:50:49.171397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 765/1555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:49 2022] GET /compute/v2.1/servers/7209c74a-77e2-4eec-bf7e-1c628622b5ea => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:50:49.196010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:49.198882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:49.216182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.222934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.223707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.224284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.228269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.229624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.247968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:49.260653 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7fcaf584-5cb3-4685-9bfd-a2b8549e4e80 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.522356 Sep 07 09:50:49.264866 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 791/1556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:48 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:49.549212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:49.550239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:49.559600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.561252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.561659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.562373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.562844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.565052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.566169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:49.584794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6675cb5-31ea-410e-99d9-4d73603ef2dd tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.398293 Sep 07 09:50:49.586146 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 766/1557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:49 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:49.660402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:49.660899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:49.668575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.669070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.669727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.670405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.671116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.671713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.701583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:50:49.775280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:49.829389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f77894a9-fb85-425e-9f3b-13582ec48af3 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 204 len: 0 microversion: 2.1 time: 0.172500 Sep 07 09:50:49.830418 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 767/1558] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:50:49 2022] DELETE /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:50:49.843208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:49.844566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:49.853341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.853902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.854344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:49.855228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:49.855937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:49.856754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.047793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:50.078779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3059e9dc-2a18-48ea-be6f-ab45962c2710 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.534381 Sep 07 09:50:50.079656 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 792/1559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:49 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:50.102401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:50.103566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:50.115421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.117536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.118470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.119411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.120320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.121534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.259716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:50.272870 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a5b737f-ff38-473d-ae12-fa464f225c41 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1700 microversion: 2.1 time: 0.437982 Sep 07 09:50:50.276832 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 768/1560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:49 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1700 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:50.293026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:50.294414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:50.304670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.306267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.307245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.308453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.308954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.309581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.623486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:50.627716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:50.642570 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cd6cd1c-40cb-4e7c-8037-f29b63f49d29 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.550525 Sep 07 09:50:50.643487 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 793/1561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:50 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:50.648223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:50.648837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:50.665655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.666151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.666589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.667292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.677439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.678086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.803198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:50.811914 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c2e938f3-4d09-4143-818b-69ac21dfdb6c tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.523850 Sep 07 09:50:50.812738 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 769/1562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:50 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:50.817745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b3940725-09fb-44e2-94a3-dcdbc7424346 req-affe2e3f-9aff-4c9a-9d0f-ab71944bc165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087d933a-f15a-4ec9-a0cb-c02cc0afa064", "tag": "55e5a7c5-09b3-4fcb-9164-c25c06510811"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:50.841374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b3940725-09fb-44e2-94a3-dcdbc7424346 req-affe2e3f-9aff-4c9a-9d0f-ab71944bc165 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:50.842072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b3940725-09fb-44e2-94a3-dcdbc7424346 req-affe2e3f-9aff-4c9a-9d0f-ab71944bc165 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:50.842810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b3940725-09fb-44e2-94a3-dcdbc7424346 req-affe2e3f-9aff-4c9a-9d0f-ab71944bc165 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:50.861932 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b3940725-09fb-44e2-94a3-dcdbc7424346 req-affe2e3f-9aff-4c9a-9d0f-ab71944bc165 service nova] Creating event network-changed:55e5a7c5-09b3-4fcb-9164-c25c06510811 for instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 on n-h1-836830-16 Sep 07 09:50:50.867077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b3940725-09fb-44e2-94a3-dcdbc7424346 req-affe2e3f-9aff-4c9a-9d0f-ab71944bc165 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053257 Sep 07 09:50:50.868079 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 770/1563] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:50.969444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:50.990189 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aced9d1c-5ccf-4c7a-9e8e-f196b3c36182 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1517 microversion: 2.1 time: 0.345604 Sep 07 09:50:50.993963 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 794/1564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:50 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:51.104976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:51.106065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:51.120776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:51.122428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:51.123199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:51.125152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:51.130405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:51.130944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:51.299831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:51.300680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:51.320572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:51.321140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:51.321896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:51.322786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:51.323421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:51.324021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:51.545533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:51.564152 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eba8678c-0c6b-4933-94d9-54e7f63d10cd tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.464984 Sep 07 09:50:51.564759 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 771/1565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:51 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:51.668851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:51.669493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:51.687778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:51.688279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:51.688725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:51.689488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:51.689944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:51.690376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:52.224312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:52.233633 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-319bcd0c-0796-45ca-9494-d53875e6b0ca tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1700 microversion: 2.1 time: 0.937487 Sep 07 09:50:52.234227 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 795/1566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:51 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1700 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:52.239603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:52.240461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:52.259258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:52.260756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:52.262697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:52.264328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:52.266499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:52.270685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:52.497332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:52.505776 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8c25e6b-bfd1-4c49-9d6c-7c51e8fe8722 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.840663 Sep 07 09:50:52.510647 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 772/1567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:51 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:52.515449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:52.516072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:52.523252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:52.523758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:52.524199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:52.524904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:52.525395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:52.525818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:52.746745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:52.754181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:52.757065 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-acf3802e-fa40-4dd9-a8f8-f9d6cf6de480 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.521203 Sep 07 09:50:52.759973 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 796/1568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:52 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:52.766577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:52.767360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:52.774386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:52.775142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:52.775746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:52.778209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:52.786835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:52.791279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:53.244109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:53.798752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:53.842436 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-907d4d54-7fcf-4e79-84d5-6a1e03425705 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 1.053277 Sep 07 09:50:53.847007 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 797/1569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:52 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:53.869214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f8355f36-a8c2-4fdc-9f34-f33b10e4f5af req-379eccc5-24c9-4d76-bcff-33921be797cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:53.880499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:53.903014 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cfd93af8-0a8b-4398-9889-dea4b5225683 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1523 microversion: 2.1 time: 1.391126 Sep 07 09:50:53.921898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f8355f36-a8c2-4fdc-9f34-f33b10e4f5af req-379eccc5-24c9-4d76-bcff-33921be797cc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:53.925124 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 773/1570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:52 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1523 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:53.925314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f8355f36-a8c2-4fdc-9f34-f33b10e4f5af req-379eccc5-24c9-4d76-bcff-33921be797cc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:53.925907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f8355f36-a8c2-4fdc-9f34-f33b10e4f5af req-379eccc5-24c9-4d76-bcff-33921be797cc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:53.958302 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f8355f36-a8c2-4fdc-9f34-f33b10e4f5af req-379eccc5-24c9-4d76-bcff-33921be797cc service nova] Creating event network-changed:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:50:53.966250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:53.969500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:53.971209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f8355f36-a8c2-4fdc-9f34-f33b10e4f5af req-379eccc5-24c9-4d76-bcff-33921be797cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120913 Sep 07 09:50:53.971831 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 798/1571] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:53.986308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:53.987617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:53.989376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:53.990583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:53.991843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:53.996324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:53.998973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:54.000374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:54.005107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:54.009681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:54.010185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:54.010630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:54.011873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:54.012449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:54.012930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:54.604904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:54.663826 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-427f811b-abce-4cde-b182-7aa35529d822 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1700 microversion: 2.1 time: 0.735907 Sep 07 09:50:54.665736 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 774/1572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:53 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1700 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:54.680631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:54.681639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:54.689620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:54.690252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:54.690801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:54.691790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:54.692506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:54.693423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:54.875307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:54.898885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dd41543b-1d5b-4b3a-b728-5f76ecbe50a5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.920189 Sep 07 09:50:54.900990 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 799/1573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:53 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:54.909780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ab280b06-52d9-4a32-84bb-3c4f0553f408 req-c8aadf45-257e-4b25-9ad9-bf157b23a7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af481ffe-3355-44b6-bd98-139ea86dabeb", "name": "network-vif-unplugged", "status": "completed", "tag": "da722a00-2eeb-4a04-93d4-5149d610525a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:54.924556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ab280b06-52d9-4a32-84bb-3c4f0553f408 req-c8aadf45-257e-4b25-9ad9-bf157b23a7ce service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:54.925039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ab280b06-52d9-4a32-84bb-3c4f0553f408 req-c8aadf45-257e-4b25-9ad9-bf157b23a7ce service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:54.925516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ab280b06-52d9-4a32-84bb-3c4f0553f408 req-c8aadf45-257e-4b25-9ad9-bf157b23a7ce service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:54.965525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ab280b06-52d9-4a32-84bb-3c4f0553f408 req-c8aadf45-257e-4b25-9ad9-bf157b23a7ce service nova] Creating event network-vif-unplugged:da722a00-2eeb-4a04-93d4-5149d610525a for instance af481ffe-3355-44b6-bd98-139ea86dabeb on n-h1-836830-16 Sep 07 09:50:54.978394 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ab280b06-52d9-4a32-84bb-3c4f0553f408 req-c8aadf45-257e-4b25-9ad9-bf157b23a7ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075096 Sep 07 09:50:54.979014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 800/1574] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:54.995012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:54.997265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:55.025120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.025651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.026094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.026862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.035169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.036045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.151773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:55.164866 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1b2b270-1215-4dcd-b489-c5eec07f6ab4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.495313 Sep 07 09:50:55.166005 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 775/1575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:54 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:55.170770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:55.171598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:55.200160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.200680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.206460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.210514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.217159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.217993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.461629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:55.471910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e232ff9e-4032-403d-a7e3-f0be010658fc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.491710 Sep 07 09:50:55.475301 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 801/1576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:54 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:55.529788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:55.539740 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f59996ca-f3fe-4ba7-a6c5-337e61e58ec7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1523 microversion: 2.1 time: 0.372505 Sep 07 09:50:55.541350 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 776/1577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:55 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:55.696144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:55.697078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:55.704014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.704698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.705230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.706182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.706864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.707537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.797431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:55.806601 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-204f1378-e681-4824-8c61-1eedd03cf9de tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1632 microversion: 2.1 time: 0.117671 Sep 07 09:50:55.808105 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 802/1578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:55 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1632 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:55.925148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:55.926555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:55.937330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.938201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.938902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:55.939834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:55.940514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:55.941170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.036486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-461a852b-9d0c-4ad5-8f83-45b687c090b1 req-b5c98331-5b5c-4f4d-a9ed-d380f76f1169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca", "name": "network-vif-deleted", "tag": "2f267084-f29e-4b08-adc6-997afd6d8076"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:56.079614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-461a852b-9d0c-4ad5-8f83-45b687c090b1 req-b5c98331-5b5c-4f4d-a9ed-d380f76f1169 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.080159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-461a852b-9d0c-4ad5-8f83-45b687c090b1 req-b5c98331-5b5c-4f4d-a9ed-d380f76f1169 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.081650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-461a852b-9d0c-4ad5-8f83-45b687c090b1 req-b5c98331-5b5c-4f4d-a9ed-d380f76f1169 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.114364 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-461a852b-9d0c-4ad5-8f83-45b687c090b1 req-b5c98331-5b5c-4f4d-a9ed-d380f76f1169 service nova] Creating event network-vif-deleted:2f267084-f29e-4b08-adc6-997afd6d8076 for instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca on n-h1-836830-16 Sep 07 09:50:56.121801 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-461a852b-9d0c-4ad5-8f83-45b687c090b1 req-b5c98331-5b5c-4f4d-a9ed-d380f76f1169 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089072 Sep 07 09:50:56.124680 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 803/1579] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:50:56.194712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:56.197908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:56.211102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.212084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.217294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.217917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.218903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.221751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.291180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:56.309448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-647372c9-01f0-488c-b32c-eb33ef5ff273 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.389270 Sep 07 09:50:56.312875 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 777/1580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:55 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:56.500010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:56.501345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:56.516920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.517643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.521335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.523717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.529124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.529852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.719841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:56.737429 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac01c20e-38a4-4851-9933-38db3638f5d4 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.548438 Sep 07 09:50:56.743709 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 804/1581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:56 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:56.750519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:56.752889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:56.786165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.788859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.789474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:56.790637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:56.791685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:56.794519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.062672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:57.076490 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2d9e669-60ac-4c1b-a11f-e731bcf67311 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.581023 Sep 07 09:50:57.097595 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 778/1582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:56 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:57.110664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:57.114000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:57.125902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.126439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.126893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.128004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.128691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.129431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.249469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.250744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.252490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.253765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lazy-loading 'fault' on Instance uuid 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:50:57.780168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66766678af0742218f4981309826f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9c07a2e93d4c9090437eb8619707e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:57.788990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-819160f4-a81e-4b0b-9b8e-36ae35fc363e tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 200 len: 1359 microversion: 2.1 time: 0.690173 Sep 07 09:50:57.790267 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 779/1583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:57 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 1359 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:57.806287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:57.806944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:57.822018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.822900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.823564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.824511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.825705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.826383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.854535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:57.863838 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2198d0e-8d45-4a8b-b6ad-4d1c3fe36629 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1523 microversion: 2.1 time: 1.117886 Sep 07 09:50:57.864430 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 805/1584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:56 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1523 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:57.886698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:57.887668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:57.895661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.896724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.898017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.899102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:57.899754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:57.900442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:57.941687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:58.169165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:50:58.176655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:58.188007 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28e5ca78-183f-483c-9c93-a3ade8f47ee5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.395761 Sep 07 09:50:58.188960 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 780/1585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:57 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:58.195761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:58.197331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:58.206146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.207142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.208148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:58.209140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.210536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.211267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:58.346853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:58.361228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6aad9481-1be6-4c69-8c57-42e2ade834d9 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.482431 Sep 07 09:50:58.363737 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 806/1586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:57 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:58.369960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-83cdcfbe-e242-4e35-8e1b-fee91938452f req-52c9c94d-db45-4508-a1e5-bc4c534b4b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af481ffe-3355-44b6-bd98-139ea86dabeb", "name": "network-vif-plugged", "status": "completed", "tag": "da722a00-2eeb-4a04-93d4-5149d610525a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:50:58.381964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-83cdcfbe-e242-4e35-8e1b-fee91938452f req-52c9c94d-db45-4508-a1e5-bc4c534b4b3f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.382751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-83cdcfbe-e242-4e35-8e1b-fee91938452f req-52c9c94d-db45-4508-a1e5-bc4c534b4b3f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.383292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-83cdcfbe-e242-4e35-8e1b-fee91938452f req-52c9c94d-db45-4508-a1e5-bc4c534b4b3f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:58.398671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-83cdcfbe-e242-4e35-8e1b-fee91938452f req-52c9c94d-db45-4508-a1e5-bc4c534b4b3f service nova] Creating event network-vif-plugged:da722a00-2eeb-4a04-93d4-5149d610525a for instance af481ffe-3355-44b6-bd98-139ea86dabeb on n-h1-836830-16 Sep 07 09:50:58.405224 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-83cdcfbe-e242-4e35-8e1b-fee91938452f req-52c9c94d-db45-4508-a1e5-bc4c534b4b3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039244 Sep 07 09:50:58.406162 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 807/1587] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:50:58.484445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:58.492792 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c96578b0-3093-4d9d-b894-352bcb8accb7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.302374 Sep 07 09:50:58.495418 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 781/1588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:58 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:58.813306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:58.814019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] [instance: 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:58.822169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.823696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.824991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:58.826555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.827282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.828705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:58.850053 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] HTTP exception thrown: Instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca could not be found. Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Request method failure captured: Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca HTTP/1.1 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGkwy_8hOhXxQzYRsqD-VToXP30LOG-TRbX7ch4IlCiBv3yE8Rgt--triJ7d4d0ONA3dwj5-sP3f6HWesAh0vY7TjKyJaPKAGWj8s3qDT3P5NQ_y3mOsqFqfzVfB_enkpZtAByljF2DpS6QAeI5hcFsnmMwcCq3W_o2cF8h3_QZzH-I Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5d9c07a2e93d4c9090437eb8619707e5 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-64554549 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d9c07a2e93d4c9090437eb8619707e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d9c07a2e93d4c9090437eb8619707e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d9c07a2e93d4c9090437eb8619707e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d9c07a2e93d4c9090437eb8619707e5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-64554549 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5d9c07a2e93d4c9090437eb8619707e5 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-64554549 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-64554549-project Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 66766678af0742218f4981309826f885 Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-64554549-project Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca could not be found. Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca'} Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca could not be found. Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca could not be found. Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:58.853002 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:50:58.858282 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:50:58.858282 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:50:58.858282 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:50:58.858282 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:50:58.858282 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca could not be found. Sep 07 09:50:58.858282 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:50:58.860349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Returning 404 to user: Instance 1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:50:58.861501 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c471833f-ae75-4b1d-ac9e-afa7b3ec860b tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca" status: 404 len: 111 microversion: 2.1 time: 0.052577 Sep 07 09:50:58.862819 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 808/1589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:58 2022] GET /compute/v2.1/servers/1eab3ac5-6b02-4068-9fb8-dcbb7a1bd0ca => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:50:58.870922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb49d945-4521-4c54-90ec-d3369f7641a9 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] Calling method '.version_select at 0x7f14b1e918b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:58.892048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:58.892675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:58.909393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.909974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.910661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:58.911732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:58.912228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb49d945-4521-4c54-90ec-d3369f7641a9 tempest-ServersTestJSON-64554549 tempest-ServersTestJSON-64554549-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814353555" status: 202 len: 0 microversion: 2.1 time: 0.045037 Sep 07 09:50:58.912775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:58.913392 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 782/1590] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 09:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814353555 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:50:58.913792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:59.200104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:59.214153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f75d216-d918-4c21-afdb-e6748d9648c1 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1523 microversion: 2.1 time: 0.325345 Sep 07 09:50:59.215320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:59.215466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 809/1591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:58 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:59.215662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:59.225477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:59.227525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:59.229346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:59.230367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:59.232393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:59.233094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:59.389892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:59.390775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:59.400167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:59.400946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:59.401580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:59.403699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:59.404406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:59.405124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:59.686385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:59.712169 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-52f4e882-3b63-4e7e-8730-83f81657a1db tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.499822 Sep 07 09:50:59.715707 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 783/1592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:59 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:50:59.725205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:50:59.727709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:50:59.735393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:50:59.739414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51f1f5a1-ab94-4395-bc76-714b75f9a3a3 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.355481 Sep 07 09:50:59.741131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 810/1593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:59 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:50:59.790746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:59.791246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:59.791692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:50:59.792411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:50:59.792866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:50:59.793328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.242061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:00.243466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:00.257866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.258790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.259603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.270460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.271319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.272643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.326485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:00.338171 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-495b5c8e-8eb7-4737-91aa-fef67c1d3328 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.620605 Sep 07 09:51:00.340212 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 784/1594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:50:59 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:00.429930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-46311269-6e60-45a8-9956-01a25ae9c041 req-06805483-0b1c-45ca-b8bc-01cd25172abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "name": "network-vif-plugged", "status": "completed", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:00.451562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-46311269-6e60-45a8-9956-01a25ae9c041 req-06805483-0b1c-45ca-b8bc-01cd25172abc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.457464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-46311269-6e60-45a8-9956-01a25ae9c041 req-06805483-0b1c-45ca-b8bc-01cd25172abc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.458242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-46311269-6e60-45a8-9956-01a25ae9c041 req-06805483-0b1c-45ca-b8bc-01cd25172abc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.490203 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-46311269-6e60-45a8-9956-01a25ae9c041 req-06805483-0b1c-45ca-b8bc-01cd25172abc service nova] Creating event network-vif-plugged:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:51:00.500638 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-46311269-6e60-45a8-9956-01a25ae9c041 req-06805483-0b1c-45ca-b8bc-01cd25172abc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074266 Sep 07 09:51:00.502294 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 785/1595] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:00.663594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:00.705693 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a793d641-0bf8-419b-8852-981699e05a9c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1508 microversion: 2.1 time: 0.468545 Sep 07 09:51:00.711637 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 811/1596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:00 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:51:00.742885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:00.743974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:00.744751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:00.745382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:00.753719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.758163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.759064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.760372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.761006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.761391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.761540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.762187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.762813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.763087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:00.763550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:00.763993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:00.768620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:01.300669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:01.304174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:01.311977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e346f35-7693-4a22-98e8-88e8b82424a6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.573559 Sep 07 09:51:01.312601 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 812/1597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:00 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:01.323306 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a12619ac-f19e-478b-9533-3e80a4c1fbf4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 200 len: 1508 microversion: 2.1 time: 0.587894 Sep 07 09:51:01.324213 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 786/1598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:00 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:01.344360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:01.345711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:01.357102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:01.359467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:01.363765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:01.366058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:01.368904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:01.370222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:01.370938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:01.371617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:01.377783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:01.378287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:01.378726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:01.379435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:01.381003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:01.382731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:01.449831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:51:01.565103 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9aa6eec5-cb11-4480-b53b-4c10a4a14cef tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 204 len: 0 microversion: 2.1 time: 0.217664 Sep 07 09:51:01.572030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 787/1599] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:01 2022] DELETE /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:51:01.589703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:01.590780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:01.598120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:01.598796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:01.599416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:01.600845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:01.601495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:01.602235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:02.134112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:02.138512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:02.144858 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8f50305-cd96-4c7e-ba17-6edcdf221957 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1324 microversion: 2.1 time: 0.825586 Sep 07 09:51:02.145709 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 813/1600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:01 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1324 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:02.151743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-491182917", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a4c9e9f5-3e0a-4df6-af1d-c9061d526758"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:02.225973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] validate_networks() for [('a4c9e9f5-3e0a-4df6-af1d-c9061d526758', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:02.386271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:02.398806 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7fc0b43f-621f-48b0-a85c-5c7cefe3e090 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.824547 Sep 07 09:51:02.417404 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 788/1601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:01 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:02.423991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:02.424885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:02.433462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:02.435155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:02.435907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:02.436809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:02.437550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:02.438230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:03.046066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:03.067420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-568599c7-0f43-4cfd-a64e-c87e0764c4cc tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.648038 Sep 07 09:51:03.068803 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 789/1602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:02 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:03.077247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6896c7d5-39e4-4578-8023-0964b7c8bc93 req-39984c7f-9941-44bb-b1fd-cc43680a7a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087d933a-f15a-4ec9-a0cb-c02cc0afa064", "name": "network-vif-plugged", "status": "completed", "tag": "55e5a7c5-09b3-4fcb-9164-c25c06510811"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:03.113011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6896c7d5-39e4-4578-8023-0964b7c8bc93 req-39984c7f-9941-44bb-b1fd-cc43680a7a52 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:03.116697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6896c7d5-39e4-4578-8023-0964b7c8bc93 req-39984c7f-9941-44bb-b1fd-cc43680a7a52 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:03.117889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6896c7d5-39e4-4578-8023-0964b7c8bc93 req-39984c7f-9941-44bb-b1fd-cc43680a7a52 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:03.158738 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6896c7d5-39e4-4578-8023-0964b7c8bc93 req-39984c7f-9941-44bb-b1fd-cc43680a7a52 service nova] Creating event network-vif-plugged:55e5a7c5-09b3-4fcb-9164-c25c06510811 for instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 on n-h1-836830-16 Sep 07 09:51:03.175555 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6896c7d5-39e4-4578-8023-0964b7c8bc93 req-39984c7f-9941-44bb-b1fd-cc43680a7a52 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105137 Sep 07 09:51:03.177285 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 790/1603] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:03.185436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:03.186818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:03.196096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:03.196624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:03.207793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:03.208788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:03.212542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:03.213139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.179290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:04.189554 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e666f8d-d5e8-4e3d-8378-2778357c20ae tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1519 microversion: 2.1 time: 1.009490 Sep 07 09:51:04.190716 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 791/1604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:03 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1519 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:04.217621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:04.219164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:04.226682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:04.227461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:04.228406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.229689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:04.230805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:04.231274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.272721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:04.273281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:04.273880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:04.274398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:04.274922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:04.293040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:04.295372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:04.296964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.298227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:04.298808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:04.299355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.322373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Getting quotas for project 8e63b735a19d488d95553ff9f6acc846. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:04.331375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Getting quotas for user 0b88725326c244f6a10260dc710f2e55 and project 8e63b735a19d488d95553ff9f6acc846. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:04.346294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:04.349081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:04.404628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-741d692c-957c-4664-b281-66c42114cd66 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.257515 Sep 07 09:51:04.405772 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 814/1605] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:04.411107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:04.411815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:04.419361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:04.419938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:04.420451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.421511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:04.422048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:04.422605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:04.675809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:04.690776 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d511dcde-7def-4918-bb24-bb4ea5a846d3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1317 microversion: 2.1 time: 0.482507 Sep 07 09:51:04.692300 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 792/1606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:04 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:04.698758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1bc0ad0e-855d-4f21-90a1-5561fa6cb506 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'create', calling method: .version_select at 0x7f14b1932940>, body: {"pool": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:05.595910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:05.623259 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04b71eda-9c99-43be-af32-e4dc6dce3756 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 1.216229 Sep 07 09:51:05.624032 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 815/1607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:04 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:05.629007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:05.629649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:05.638931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:05.646856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:05.647414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:05.648540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:05.649011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:05.649471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:05.799459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:05.815554 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cf1a06f-bea8-499d-b1a5-f4bc62925929 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1213 microversion: 2.1 time: 0.190066 Sep 07 09:51:05.816153 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 816/1608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:05 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:05.823238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6c29f763-5e4c-4767-8f16-405a1eb36a95 req-ecc1c182-44e5-4084-afb6-39890b7f3757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891829aa-74cd-42e3-a67c-eb136af6b32c", "name": "network-vif-plugged", "status": "completed", "tag": "b2432ae8-6727-4d23-b5bf-863869d42ff6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:05.837021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c29f763-5e4c-4767-8f16-405a1eb36a95 req-ecc1c182-44e5-4084-afb6-39890b7f3757 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:05.837968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c29f763-5e4c-4767-8f16-405a1eb36a95 req-ecc1c182-44e5-4084-afb6-39890b7f3757 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:05.838577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c29f763-5e4c-4767-8f16-405a1eb36a95 req-ecc1c182-44e5-4084-afb6-39890b7f3757 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:05.861607 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6c29f763-5e4c-4767-8f16-405a1eb36a95 req-ecc1c182-44e5-4084-afb6-39890b7f3757 service nova] Creating event network-vif-plugged:b2432ae8-6727-4d23-b5bf-863869d42ff6 for instance 891829aa-74cd-42e3-a67c-eb136af6b32c on n-h2-836830-16 Sep 07 09:51:05.877907 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6c29f763-5e4c-4767-8f16-405a1eb36a95 req-ecc1c182-44e5-4084-afb6-39890b7f3757 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059831 Sep 07 09:51:05.879012 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 817/1609] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:05.886008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:05.887417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:05.903769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:05.904739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:05.906047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:05.906925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:05.907544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:05.908373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:06.480954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:06.493622 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-98ab2e71-d0bf-4853-8f77-7af6519e46a1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1467 microversion: 2.1 time: 0.608927 Sep 07 09:51:06.494254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 818/1610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:05 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1467 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:06.502392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b7a6256e-1d54-4a63-a053-f92c92c145c9 req-52767fb7-4658-41b0-b3f7-99cc799a0d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af481ffe-3355-44b6-bd98-139ea86dabeb", "name": "network-vif-deleted", "tag": "da722a00-2eeb-4a04-93d4-5149d610525a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:06.519269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b7a6256e-1d54-4a63-a053-f92c92c145c9 req-52767fb7-4658-41b0-b3f7-99cc799a0d5f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:06.520026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b7a6256e-1d54-4a63-a053-f92c92c145c9 req-52767fb7-4658-41b0-b3f7-99cc799a0d5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:06.520626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b7a6256e-1d54-4a63-a053-f92c92c145c9 req-52767fb7-4658-41b0-b3f7-99cc799a0d5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:06.541904 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b7a6256e-1d54-4a63-a053-f92c92c145c9 req-52767fb7-4658-41b0-b3f7-99cc799a0d5f service nova] Creating event network-vif-deleted:da722a00-2eeb-4a04-93d4-5149d610525a for instance af481ffe-3355-44b6-bd98-139ea86dabeb on n-h1-836830-16 Sep 07 09:51:06.547634 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b7a6256e-1d54-4a63-a053-f92c92c145c9 req-52767fb7-4658-41b0-b3f7-99cc799a0d5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051763 Sep 07 09:51:06.549345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 819/1611] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:06.556581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:06.557902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:06.578400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:06.581232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:06.582260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:06.582935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:06.584649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:06.585713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:06.586496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:07.075921 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c2eae00-6447-4f26-b6b4-66f1ade8a402 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1620 microversion: 2.1 time: 0.524246 Sep 07 09:51:07.094046 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 820/1612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:06 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1620 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:07.107224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:07.108098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:07.124737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:07.128183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:07.129295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:07.130248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:07.132308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:07.133053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:07.644034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:07.679737 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a119fb73-ab9b-4466-a6de-5fcc0db44b86 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1199 microversion: 2.1 time: 0.584022 Sep 07 09:51:07.682281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 821/1613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:07 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1199 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:07.689883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:07.690816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:07.700332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:07.700543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:07.701063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:07.701961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:07.702899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:07.703720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:07.825721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:07.839035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58181ccc-2d95-437f-97c1-b04d8273f6be tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1275 microversion: 2.1 time: 0.154208 Sep 07 09:51:07.842127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 822/1614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:07 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:07.847918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2029286990", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["311d2586-a4ff-42eb-90c9-bb56ecdd89e4"]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:07.939949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:09.077790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:09.079541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:09.080034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:09.080693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:09.081198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:09.101684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:09.104911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:09.105480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:09.109966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:09.110643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:09.111161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:09.194876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:09.241378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:09.298110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:09.308966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:09.484048 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36ff2e1b-843b-4fd1-8723-ad3d39242b8b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637218 Sep 07 09:51:09.488441 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 823/1615] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:09.500808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:09.501516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:09.521805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:09.522323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:09.522764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:09.526763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:09.527622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:09.530325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:10.160631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:10.177472 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c4215c05-ad82-42c9-9cb3-cbfdefe25813 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1382 microversion: 2.1 time: 0.687561 Sep 07 09:51:10.178149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 824/1616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:09 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1382 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:10.188845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:10.190023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:10.211901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:10.212404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:10.212838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:10.213584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:10.214039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:10.214464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:10.607353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:10.616620 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1bc0ad0e-855d-4f21-90a1-5561fa6cb506 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.922844 Sep 07 09:51:10.618651 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 793/1617] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:51:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:10.622188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-963a5e37-6764-45b7-aac3-2678777743d5 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1317 microversion: 2.1 time: 0.441876 Sep 07 09:51:10.625929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 825/1618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:10 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:10.632114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:10.633301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:10.651789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:10.655385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:10.658335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:10.659535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:10.661914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:10.664074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:10.809351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:10.824919 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-272a9b67-6f08-4aab-ba00-ba27473fd102 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1221 microversion: 2.1 time: 0.197614 Sep 07 09:51:10.843697 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 826/1619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:10 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1221 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:11.373840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-938464588", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:11.510436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:11.516128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:11.528025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] validate_networks() for [('24d4319a-518f-45ca-b50d-c0f83b0724bf', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:11.540628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:11.541845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:11.542655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:11.544431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:11.545089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:11.551557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:12.245829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f10eb8b-4e5e-4c0f-8a6d-79bc4498e955 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1535 microversion: 2.1 time: 1.399359 Sep 07 09:51:12.252794 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 827/1620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:10 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1535 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:12.281111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-429030677", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ee662ca7-2394-47b2-9487-d69b5736a12f"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:12.378526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] validate_networks() for [('ee662ca7-2394-47b2-9487-d69b5736a12f', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:13.290727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:13.291768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:13.292575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:13.293525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:13.295507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:13.321792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:13.325203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:13.325898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:13.328619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:13.331778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:13.333641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:13.438432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:13.473529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for user 46ddb24f5e0f46d4a1a6f228af0fbe8e and project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:13.492487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:13.496028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:13.594841 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8d9c669-9cae-494d-a91e-7551977b55a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.973006 Sep 07 09:51:13.597919 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 794/1621] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:13.605884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:13.607073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:13.632939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:13.639016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:13.639620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:13.640488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:13.641054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:13.641659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:14.450572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:14.461148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-914d8cc2-aaa6-433b-889a-d8bf2177d8bf tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1317 microversion: 2.1 time: 0.860119 Sep 07 09:51:14.462566 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 795/1622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:13 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1317 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:14.468865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:14.469910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:14.486483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:14.487949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:14.489040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:14.491080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:14.491744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:14.492431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:14.743007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:14.755449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-abd35829-55bb-4452-8cc9-01b51c2e0e64 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1275 microversion: 2.1 time: 0.291334 Sep 07 09:51:14.757504 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 796/1623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:14 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:14.780121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:14.781174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:14.792191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:14.793268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:14.794107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:14.795200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:14.796056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:14.797376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.275213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:15.278395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:15.279159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:15.281499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:15.282439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:15.321011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.321675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.322207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.323049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.323609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.324155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.367445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Getting quotas for project 11f073a8bdbe4ac89c7beeb82fe458ce. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:15.381572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Getting quotas for user 46e1e110e1c74e4cb394d94906fd3c52 and project 11f073a8bdbe4ac89c7beeb82fe458ce. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:15.434714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c4c5fce-b522-4547-97f0-33938b63127e tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1535 microversion: 2.1 time: 0.675716 Sep 07 09:51:15.436527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:15.438735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:15.439631 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 797/1624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:14 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1535 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:15.461313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-988b79de-cb65-4837-92f5-772c7578fa6c req-9282b108-abc8-4075-a1e0-0438fecd28aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2db9c1-cdda-45b0-bfe6-7a614dab83e1", "tag": "19013a64-d642-41f4-aead-a9679ca6825f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:15.508907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-988b79de-cb65-4837-92f5-772c7578fa6c req-9282b108-abc8-4075-a1e0-0438fecd28aa service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.509693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-988b79de-cb65-4837-92f5-772c7578fa6c req-9282b108-abc8-4075-a1e0-0438fecd28aa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.510314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-988b79de-cb65-4837-92f5-772c7578fa6c req-9282b108-abc8-4075-a1e0-0438fecd28aa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.535852 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-988b79de-cb65-4837-92f5-772c7578fa6c req-9282b108-abc8-4075-a1e0-0438fecd28aa service nova] Creating event network-changed:19013a64-d642-41f4-aead-a9679ca6825f for instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 on n-h1-836830-16 Sep 07 09:51:15.548946 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-988b79de-cb65-4837-92f5-772c7578fa6c req-9282b108-abc8-4075-a1e0-0438fecd28aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101500 Sep 07 09:51:15.550749 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 798/1625] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:15.564388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:15.568213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:15.581026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.587121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58c22cf3-3457-431b-913e-0af78d340928 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.332781 Sep 07 09:51:15.590312 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 828/1626] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:15.599128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.600558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.601040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2065892388", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "124ad2c9-0cc2-4b52-ab23-5623958d6487"}], "block_device_mapping_v2": [{"uuid": "48697aa2-4869-4471-8c03-a39ebd31423d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:15.603785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.605030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.609041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.738588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:15.755261 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b56bb6dd-1160-4071-8d78-3cba375b484f tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1273 microversion: 2.1 time: 0.198024 Sep 07 09:51:15.757709 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 799/1627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:15 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:15.776735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:15.776910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] validate_networks() for [('124ad2c9-0cc2-4b52-ab23-5623958d6487', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:15.802299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.805291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.808324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.809427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.813408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.817883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.916593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c8f81459-fe28-4d29-87a6-1467050b3544 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.157681 Sep 07 09:51:15.925880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 800/1628] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 09:51:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:15.940204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:15.946487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:15.956578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.957074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.959354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:15.960072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:15.961854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:15.963207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:16.380355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:16.392507 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f92d8b1-ed47-4f95-9e63-ec8894f6fe44 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1317 microversion: 2.1 time: 0.472217 Sep 07 09:51:16.401268 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 801/1629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:15 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:16.405338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:16.405960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:16.429318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:16.430016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:16.432248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:16.433128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:16.433995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:16.434564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:16.564061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:16.584311 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8a69279-1040-4161-9a8a-40d8b97a2aba tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1227 microversion: 2.1 time: 0.185560 Sep 07 09:51:16.597241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 802/1630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:16 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1227 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:16.597241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:16.597241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:16.635091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:16.635509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:16.638016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:16.638886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:16.640665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:16.641127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:17.138398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:17.140686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:17.141916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:17.142526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:17.143148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:17.157037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:17.157783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:17.158453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:17.159576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:17.160230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:17.160866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:17.215262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:17.228515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Getting quotas for user 21737ade68344e3298131ce9189f5d8a and project 607bcf1927e94f8a959bb30fce95ca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:17.308464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:17.310757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48697aa2-4869-4471-8c03-a39ebd31423d',volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:17.405016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:17.419504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-53c25e11-b017-4a56-8d9e-2c55eb78c5fa tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1317 microversion: 2.1 time: 0.832766 Sep 07 09:51:17.420301 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 803/1631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:16 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:17.442686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-16", "block_migration": false, "disk_over_commit": false}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:17.447245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:17.460218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:17.476162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:17.478355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:17.479429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:17.480401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:17.480946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:17.539850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lazy-loading 'flavor' on Instance uuid 891829aa-74cd-42e3-a67c-eb136af6b32c {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:17.543897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:17.553612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Going to try to live migrate instance to n-h1-836830-16 {{(pid=128832) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:51:17.586052 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9bb12322-c3b3-4e59-8e69-68da956641f3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.994013 Sep 07 09:51:17.588103 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 829/1632] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:51:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:51:17.603566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1804354031", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:17.685599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] validate_networks() for [('24d4319a-518f-45ca-b50d-c0f83b0724bf', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:21.981508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc4bdc0f-04fc-41cc-9986-3693d8684d32 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c/action" status: 202 len: 0 microversion: 2.1 time: 4.557308 Sep 07 09:51:21.982514 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 804/1633] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:51:17 2022] POST /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c/action => generated 0 bytes in 4562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:51:21.993247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:21.995293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:22.017850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:22.018350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:22.018793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:22.019968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:22.020483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:22.022337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:22.833218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:22.878318 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f23cea88-da2f-47c9-ae70-aba42f8bae1a tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1317 microversion: 2.1 time: 0.892427 Sep 07 09:51:22.879534 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 805/1634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:21 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:22.886116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:22.887007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:22.900791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:22.901331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:22.901761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:22.902218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:22.902846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:22.903116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:22.903869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:22.904610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:22.906763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:22.907410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:22.917121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:22.931944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:22.939091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:22.939593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:22.944448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:22.945757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:22.946197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.019972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:23.038532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for user 46ddb24f5e0f46d4a1a6f228af0fbe8e and project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:23.060693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:23.063721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:23.165194 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5df26b8e-d96d-4f59-8b23-a08f138a0eb7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.570987 Sep 07 09:51:23.168654 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 830/1635] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 5580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:23.185387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:23.186035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:23.240910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.244631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.246033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.249974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.250522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.255312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.419258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:23.436783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:23.440620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:23.447301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-907773b9-0f51-438a-a666-6bb0837c2e11 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1251 microversion: 2.25 time: 0.564536 Sep 07 09:51:23.448672 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 806/1636] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:22 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1251 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:23.460967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:23.461630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:23.480292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.480984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.481799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.482736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.483373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.483991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.490418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:23.556867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:23.577415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-217095fd-5d9d-414e-a0a7-560151dad6e7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1281 microversion: 2.1 time: 0.398273 Sep 07 09:51:23.592823 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 831/1637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:23 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:23.604905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9180d55d-b875-4001-90c1-402cbd3bb09c req-01444c0e-2dcc-4232-931c-8375304cd4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faa6ea3-74e8-46e7-bec2-3bf266377113", "tag": "8aae2f40-c0c3-43d1-abf4-5197e9c32c5a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:23.633278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9180d55d-b875-4001-90c1-402cbd3bb09c req-01444c0e-2dcc-4232-931c-8375304cd4c9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.634230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9180d55d-b875-4001-90c1-402cbd3bb09c req-01444c0e-2dcc-4232-931c-8375304cd4c9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.635419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9180d55d-b875-4001-90c1-402cbd3bb09c req-01444c0e-2dcc-4232-931c-8375304cd4c9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.672977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9180d55d-b875-4001-90c1-402cbd3bb09c req-01444c0e-2dcc-4232-931c-8375304cd4c9 service nova] Creating event network-changed:8aae2f40-c0c3-43d1-abf4-5197e9c32c5a for instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 on n-h1-836830-16 Sep 07 09:51:23.685881 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9180d55d-b875-4001-90c1-402cbd3bb09c req-01444c0e-2dcc-4232-931c-8375304cd4c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091379 Sep 07 09:51:23.688052 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 832/1638] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:23.698682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ed44899e-9c22-4a3b-bc41-cc09a4fbaa6d req-a25db25f-4b98-4191-ae63-cdab6327bef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2db9c1-cdda-45b0-bfe6-7a614dab83e1", "name": "network-vif-plugged", "status": "completed", "tag": "19013a64-d642-41f4-aead-a9679ca6825f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:23.709744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed44899e-9c22-4a3b-bc41-cc09a4fbaa6d req-a25db25f-4b98-4191-ae63-cdab6327bef8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.710498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed44899e-9c22-4a3b-bc41-cc09a4fbaa6d req-a25db25f-4b98-4191-ae63-cdab6327bef8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.711103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed44899e-9c22-4a3b-bc41-cc09a4fbaa6d req-a25db25f-4b98-4191-ae63-cdab6327bef8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.742392 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ed44899e-9c22-4a3b-bc41-cc09a4fbaa6d req-a25db25f-4b98-4191-ae63-cdab6327bef8 service nova] Creating event network-vif-plugged:19013a64-d642-41f4-aead-a9679ca6825f for instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 on n-h1-836830-16 Sep 07 09:51:23.758230 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ed44899e-9c22-4a3b-bc41-cc09a4fbaa6d req-a25db25f-4b98-4191-ae63-cdab6327bef8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068715 Sep 07 09:51:23.761967 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 833/1639] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:23.776297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c74396ca-cd7a-47bb-8f51-2c491e1f1189"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:23.784878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:23.798986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.803260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.804469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:23.806526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:23.809407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:23.810075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:24.473634 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2bb48ffd-2d0b-48eb-a3a5-a68d7ae8a56c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "POST /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709882 Sep 07 09:51:24.476380 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 834/1640] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 09:51:23 2022] POST /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:24.486606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:24.487663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:24.500904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:24.502013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:24.502789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:24.503785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:24.504694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:24.505394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:24.513271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:24.659801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:24.672360 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c2c6b8f4-1656-49cd-baef-89906fae92f5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1317 microversion: 2.1 time: 1.221339 Sep 07 09:51:24.672360 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 807/1641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:23 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1317 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:24.695196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:24.699711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:24.713305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:24.720947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:24.726091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:24.728051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:24.729324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:24.731955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:24.732419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:25.203601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:25.215223 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f1e8077-409a-4e7c-beea-aa6c72c0d170 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.737229 Sep 07 09:51:25.220087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:25.241069 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e3c32c44-2b31-4189-93fe-6b1bc22b039e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1218 microversion: 2.1 time: 0.566649 Sep 07 09:51:25.241412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 835/1642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:24 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:25.246401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:25.247013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:25.251069 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 808/1643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:24 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1218 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:25.272091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:25.272468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:25.272903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:25.285168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:25.285724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:25.286209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:25.391836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-495241600", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:25.477489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:25.777288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:25.791791 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3da68eef-22e9-4d00-a1f8-b02afe5707b0 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1317 microversion: 2.1 time: 0.547923 Sep 07 09:51:25.791791 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 836/1644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:25 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:25.809641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:25.819475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:25.828018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:25.829567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:25.830208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:25.831216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:25.831883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:25.832519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:25.834745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:26.598276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:26.613285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:26.618663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:26.620228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f32ae742-01ed-4d51-9ced-e86775e345ca tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1293 microversion: 2.25 time: 0.827893 Sep 07 09:51:26.621479 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 837/1645] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:25 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1293 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:26.638218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:26.639290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:26.655329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:26.656662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:26.660358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:26.661347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:26.670148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:26.671578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:26.772192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:26.776684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:26.779657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:26.780132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:26.780990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:26.794379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:26.794898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:26.795328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:26.796059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:26.796518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:26.797038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:26.824198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:26.837669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:26.858546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:26.861259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:26.942329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb32746c-f232-42fe-bead-8c506d584b7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690007 Sep 07 09:51:26.944550 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 809/1646] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:26.968670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:26.969952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:26.985129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:26.986027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:26.987072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:26.988193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:26.989422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:26.990579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:27.827174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:27.849092 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4f101cb-207d-4166-b0cd-4d85b245ed0f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 1.224202 Sep 07 09:51:27.867465 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 838/1647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:26 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:27.875238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:27.881233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:27.893065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:27.893588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:27.894223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:27.895087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:27.900188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:27.901553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.038561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:28.057783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-24650d70-53e1-4442-aec4-2143a0874686 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1317 microversion: 2.1 time: 1.111665 Sep 07 09:51:28.058666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 810/1648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:26 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1317 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:28.080853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:28.086644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:28.109233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.110510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.112014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.114076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.115044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.116081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.277639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:28.312026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:28.312561 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9297767-d735-4087-bbb1-f848190794da tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.442435 Sep 07 09:51:28.317138 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 839/1649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:27 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:28.343148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4cd5c37-ac4a-4290-bbce-e02a295c1a54 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1280 microversion: 2.1 time: 0.282773 Sep 07 09:51:28.346722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 811/1650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:28 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:28.369758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-281c1fc4-61cd-4db0-b80c-dd7a1eeaa004 req-85152ca9-051a-4191-83ef-0f626d994e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df62c8a-df0b-4ced-9622-672ef367267a", "tag": "49013a88-e454-4b51-97e1-25fc306b2a50"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:28.385727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d9a454aa-00f5-40a0-ad74-a9f9c42de19e req-275ea899-c011-4576-8188-b3e4cf78873b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839a4577-a9a7-40c2-a837-4ec147ebb4fe", "tag": "e709bf9d-7ef9-45a3-845c-fdc790d7079c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:28.399231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-281c1fc4-61cd-4db0-b80c-dd7a1eeaa004 req-85152ca9-051a-4191-83ef-0f626d994e08 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.401373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-281c1fc4-61cd-4db0-b80c-dd7a1eeaa004 req-85152ca9-051a-4191-83ef-0f626d994e08 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.402039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-281c1fc4-61cd-4db0-b80c-dd7a1eeaa004 req-85152ca9-051a-4191-83ef-0f626d994e08 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.436279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d9a454aa-00f5-40a0-ad74-a9f9c42de19e req-275ea899-c011-4576-8188-b3e4cf78873b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.440169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d9a454aa-00f5-40a0-ad74-a9f9c42de19e req-275ea899-c011-4576-8188-b3e4cf78873b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.440889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d9a454aa-00f5-40a0-ad74-a9f9c42de19e req-275ea899-c011-4576-8188-b3e4cf78873b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.446603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-281c1fc4-61cd-4db0-b80c-dd7a1eeaa004 req-85152ca9-051a-4191-83ef-0f626d994e08 service nova] Creating event network-changed:49013a88-e454-4b51-97e1-25fc306b2a50 for instance 6df62c8a-df0b-4ced-9622-672ef367267a on n-h2-836830-16 Sep 07 09:51:28.457958 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-281c1fc4-61cd-4db0-b80c-dd7a1eeaa004 req-85152ca9-051a-4191-83ef-0f626d994e08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106399 Sep 07 09:51:28.460605 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 812/1651] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:28.483570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:28.485113 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d9a454aa-00f5-40a0-ad74-a9f9c42de19e req-275ea899-c011-4576-8188-b3e4cf78873b service nova] Creating event network-changed:e709bf9d-7ef9-45a3-845c-fdc790d7079c for instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe on n-h1-836830-16 Sep 07 09:51:28.485730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:28.497682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.498546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.499355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.500260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d9a454aa-00f5-40a0-ad74-a9f9c42de19e req-275ea899-c011-4576-8188-b3e4cf78873b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178044 Sep 07 09:51:28.500586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.502061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 840/1652] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:28.514516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.515467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.525318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:28.531163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:28.549074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.550415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.552508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.555210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.560134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.560869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.779944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:28.791616 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb78d512-94ba-477c-8f60-d973311f7332 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1266 microversion: 2.1 time: 0.284727 Sep 07 09:51:28.792565 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 841/1653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:28 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:28.798960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:28.800027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:28.804265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:28.813033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.813846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.814484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:28.815899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:28.816549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:28.817156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.008706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.019520 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c684022-ee5c-4597-bc45-b30fd59f6950 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1507 microversion: 2.1 time: 0.553940 Sep 07 09:51:29.021982 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 813/1654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:28 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:29.036442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:29.037450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:29.052156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.054976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.055431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.057492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.058750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.061313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.309060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.327970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.329895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.331282 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8587f3df-8467-4873-bcba-243f526ea8ec tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1293 microversion: 2.25 time: 0.537496 Sep 07 09:51:29.332098 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 842/1655] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:28 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1293 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:29.363198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:29.364290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:29.383178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.384052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.385339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.386358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.387060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.387721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.499388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.519590 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ecdfa33-ff63-4822-b2b4-d6005742a5d7 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.495748 Sep 07 09:51:29.520541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 814/1656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:29 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:29.531639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:29.538237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:29.546362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.546857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.547295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.549054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.549990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.551123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.857273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.868447 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b568eeae-599c-4916-9125-f0b7ecab3e24 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1507 microversion: 2.1 time: 0.520871 Sep 07 09:51:29.882702 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 843/1657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:29 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:29.908140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:29.910317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:29.922687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.926408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.927484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.928486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:29.929549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:29.930186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:29.939477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:29.954329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12fd17bd-d31d-429a-8363-68a453354b63 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1317 microversion: 2.1 time: 0.431931 Sep 07 09:51:29.967006 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 815/1658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:29 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:29.999374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:30.002061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:30.031344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.032607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.036145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.037588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.040401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.041126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.318871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:30.332520 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37adb98e-4e2f-41d8-9266-54e61fe0f355 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.448258 Sep 07 09:51:30.338277 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 844/1659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:29 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:30.350591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:30.351350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:30.359737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.360253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.360816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.361625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.362106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:30.362569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.362692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.377742 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-437c5f36-d722-41d3-9a9d-dd62a4b7db9e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.409498 Sep 07 09:51:30.393490 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 816/1660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:29 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:30.417447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:30.420705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:30.437031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.437601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.438057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.438772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.439234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.439663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.454904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:30.465638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18892b0c-12ff-47da-a8a5-fb1fc7792f17 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1266 microversion: 2.1 time: 0.130688 Sep 07 09:51:30.479104 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 845/1661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:30 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:30.490922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:30.491808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:30.498667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.499925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.500549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.501491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.502129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.502770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.582604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b68b670-06b4-4a47-b285-d8d62a82600c tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "PUT /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1079 microversion: 2.1 time: 0.187337 Sep 07 09:51:30.585555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 817/1662] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 09:51:30 2022] PUT /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1079 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:30.590497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:30.591123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:30.612080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.612856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.613501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:30.614396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:30.624620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:30.625412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.270146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:31.280832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:31.282696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:31.284233 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21ad00c5-2228-4084-8105-2003ee3ea672 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1293 microversion: 2.25 time: 0.803745 Sep 07 09:51:31.285494 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 846/1663] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:30 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1293 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:31.292952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-78c4bce7-a671-4f31-8a98-a004b7e14a81 req-e2a8a446-ab62-4ab9-9bc7-e5cb45bc2692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9fd1dcd-54f3-40c3-834e-a6bda566c14c", "tag": "b572c985-8b5e-4ce8-8806-bad655c54249"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:31.304574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:31.306794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-78c4bce7-a671-4f31-8a98-a004b7e14a81 req-e2a8a446-ab62-4ab9-9bc7-e5cb45bc2692 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:31.307288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-78c4bce7-a671-4f31-8a98-a004b7e14a81 req-e2a8a446-ab62-4ab9-9bc7-e5cb45bc2692 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:31.307727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-78c4bce7-a671-4f31-8a98-a004b7e14a81 req-e2a8a446-ab62-4ab9-9bc7-e5cb45bc2692 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.312955 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-10861b4f-d39d-47b1-b8a5-74cb7dd20862 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.726254 Sep 07 09:51:31.319684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 818/1664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:30 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:31.326110 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-78c4bce7-a671-4f31-8a98-a004b7e14a81 req-e2a8a446-ab62-4ab9-9bc7-e5cb45bc2692 service nova] Creating event network-changed:b572c985-8b5e-4ce8-8806-bad655c54249 for instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c on n-h2-836830-16 Sep 07 09:51:31.329932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:31.330564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:31.332978 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-78c4bce7-a671-4f31-8a98-a004b7e14a81 req-e2a8a446-ab62-4ab9-9bc7-e5cb45bc2692 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044675 Sep 07 09:51:31.334640 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 847/1665] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:31.343931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f6bbd543-3512-4338-bd14-bf9afd609d15 req-cef5e87f-6a9e-47b2-84a5-267c67f9fa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faa6ea3-74e8-46e7-bec2-3bf266377113", "name": "network-vif-plugged", "status": "completed", "tag": "8aae2f40-c0c3-43d1-abf4-5197e9c32c5a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:31.352112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:31.352630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:31.353140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.353903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:31.354368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:31.354996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.363100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f6bbd543-3512-4338-bd14-bf9afd609d15 req-cef5e87f-6a9e-47b2-84a5-267c67f9fa44 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:31.363589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f6bbd543-3512-4338-bd14-bf9afd609d15 req-cef5e87f-6a9e-47b2-84a5-267c67f9fa44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:31.364020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f6bbd543-3512-4338-bd14-bf9afd609d15 req-cef5e87f-6a9e-47b2-84a5-267c67f9fa44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.379619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f6bbd543-3512-4338-bd14-bf9afd609d15 req-cef5e87f-6a9e-47b2-84a5-267c67f9fa44 service nova] Creating event network-vif-plugged:8aae2f40-c0c3-43d1-abf4-5197e9c32c5a for instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 on n-h1-836830-16 Sep 07 09:51:31.388120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f6bbd543-3512-4338-bd14-bf9afd609d15 req-cef5e87f-6a9e-47b2-84a5-267c67f9fa44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051880 Sep 07 09:51:31.388799 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 848/1666] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:31.395245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:31.395605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:31.404290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:31.404816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:31.405273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.405977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:31.406432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:31.406854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:31.977428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:31.984269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:31.995900 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7a8d0122-067e-4c66-944e-8f70208f9770 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1505 microversion: 2.1 time: 0.674688 Sep 07 09:51:32.000261 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 819/1667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:31 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1505 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:32.001989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c50e8b1-f920-4820-99aa-8d28c9dc4d20 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1317 microversion: 2.1 time: 0.611950 Sep 07 09:51:32.002571 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 849/1668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:31 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:32.015948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:32.016915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:32.028613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:32.031204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:32.031650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.032241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.032787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.033628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.034290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.034818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.042757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.043686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.044295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.045205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.045854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.046448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.077240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:32.465066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:32.483065 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f26274e-9215-41e3-ba28-52cd8434841a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.479233 Sep 07 09:51:32.484445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 850/1669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:32 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:32.491403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:32.492625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:32.503760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.504981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.507422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.509072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.509924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.510814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.512159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:32.520115 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13320630-6c59-41d7-b3bb-734bbc20f632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.517780 Sep 07 09:51:32.520741 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 820/1670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:32 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:32.531587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-459300eb-4126-41f3-a67a-436a57e1d3f4 req-bb6b2610-de6d-44b9-8d97-702145a57d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a95ceab-b418-4e73-b1d1-7a8cc9b2d435", "tag": "2f818bbe-9767-4766-8b4f-518ac10b3abf"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:32.554733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-459300eb-4126-41f3-a67a-436a57e1d3f4 req-bb6b2610-de6d-44b9-8d97-702145a57d77 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.555214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-459300eb-4126-41f3-a67a-436a57e1d3f4 req-bb6b2610-de6d-44b9-8d97-702145a57d77 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.563593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-459300eb-4126-41f3-a67a-436a57e1d3f4 req-bb6b2610-de6d-44b9-8d97-702145a57d77 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.579215 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-459300eb-4126-41f3-a67a-436a57e1d3f4 req-bb6b2610-de6d-44b9-8d97-702145a57d77 service nova] Creating event network-changed:2f818bbe-9767-4766-8b4f-518ac10b3abf for instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 on n-h1-836830-16 Sep 07 09:51:32.590892 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-459300eb-4126-41f3-a67a-436a57e1d3f4 req-bb6b2610-de6d-44b9-8d97-702145a57d77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068160 Sep 07 09:51:32.591781 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 821/1671] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:32.600141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:32.605897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:32.616260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.617150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.617797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.618675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.619296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.619878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.695044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:32.705632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d74c0e9b-0d29-4081-b11e-6adc89524b39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1272 microversion: 2.1 time: 0.219165 Sep 07 09:51:32.717244 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 851/1672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:32 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:32.720404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:32.721907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:32.742519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.745736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.747138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.748460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:32.749527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:32.750995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:32.996398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:33.017726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.028268 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0fb1c41e-9839-44a9-87e4-669ca6ae4bbe tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1505 microversion: 2.1 time: 0.434984 Sep 07 09:51:33.029040 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 822/1673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:32 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:33.035692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:33.036477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.044670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.045411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.046019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.046913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.047691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.048294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.052201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=30 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:33.179432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.188915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.199230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.200445 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cebefef3-1dc0-499f-a045-6549e2f61ab7 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1293 microversion: 2.25 time: 0.489539 Sep 07 09:51:33.206528 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 852/1674] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:32 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1293 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:33.212779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:33.213636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.223104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.225791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.226831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.227783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.228584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.229172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.332866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.350832 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c6feb2a-3f5e-4fb7-888b-8e6ca106558b tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.320228 Sep 07 09:51:33.351588 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 823/1675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:33 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:33.382728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:33.385269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.393940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.394432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.394871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.410256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.412616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.413847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.496973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.506776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:33.511007 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61c61517-1012-458b-abc3-a468d8ca0d33 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1317 microversion: 2.1 time: 0.302874 Sep 07 09:51:33.521728 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 853/1676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:33 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:33.521728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:33.521728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.529279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.529279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.529279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.530996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.530996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.531424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.543747 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4f0ad6f-24f8-4106-9ff4-c4e24535f2dc tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "PUT /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1081 microversion: 2.1 time: 0.165493 Sep 07 09:51:33.557151 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 824/1677] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 09:51:33 2022] PUT /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1081 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:33.565899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:33.567253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.576734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.580516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.581496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.582413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.583052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.584203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.742013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.750549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4e5e10e-2672-4f2f-8e33-3d64cac46615 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.237375 Sep 07 09:51:33.756200 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 854/1678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:33 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:33.756979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:33.758172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.764040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.764683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.765276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.766069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.766619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.767195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.797098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.806569 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f2f0909d-054b-4182-a624-49c88293e6ab tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.244885 Sep 07 09:51:33.822526 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 825/1679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:33 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:33.830441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:33.831150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:33.842213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.842820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.843378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.844152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:33.844751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:33.845288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:33.983613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:33.995487 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cc8fdd8-855b-43cd-8d88-1dfdca93c155 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1507 microversion: 2.1 time: 0.243082 Sep 07 09:51:33.997460 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 855/1680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:33 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:34.034924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:34.035767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:34.043226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:34.044145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:34.045280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:34.046170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:34.046806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:34.047404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:34.217075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:34.226892 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8aab57cb-c6c9-477b-b102-8ea12d7416fc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.401976 Sep 07 09:51:34.250456 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 826/1681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:33 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:34.259031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:34.261869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:34.277093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:34.280076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:34.280531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:34.281294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:34.281757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:34.282191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:34.861773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:34.873801 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-847ab5a0-eeea-4a09-bf43-e95dafbe08cb tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1507 microversion: 2.1 time: 0.842548 Sep 07 09:51:34.882964 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 856/1682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:34 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:34.888403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:34.889252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:34.904435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:34.909291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:34.910238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:34.911170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:34.912658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:34.913535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:34.963934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:34.978553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:34.980032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:34.981397 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a36874e-487d-4b4b-a73c-ffdb05f95a47 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1293 microversion: 2.25 time: 0.729374 Sep 07 09:51:34.984816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 827/1683] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:34 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1293 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:34.992041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:34.992676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:34.999963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.000662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.001713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.002758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.003533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.004112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.339970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:35.348661 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3542d257-02c5-4b41-8593-99733305161d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.464143 Sep 07 09:51:35.349396 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 857/1684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:34 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:35.354383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e96107b4-da35-4827-8461-fda415729956 req-7cd3d5cd-ced3-49b0-afcf-74a6fec7347d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839a4577-a9a7-40c2-a837-4ec147ebb4fe", "name": "network-vif-plugged", "status": "completed", "tag": "e709bf9d-7ef9-45a3-845c-fdc790d7079c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:35.368776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e96107b4-da35-4827-8461-fda415729956 req-7cd3d5cd-ced3-49b0-afcf-74a6fec7347d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.369624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e96107b4-da35-4827-8461-fda415729956 req-7cd3d5cd-ced3-49b0-afcf-74a6fec7347d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.370292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e96107b4-da35-4827-8461-fda415729956 req-7cd3d5cd-ced3-49b0-afcf-74a6fec7347d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.375427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:35.386787 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e96107b4-da35-4827-8461-fda415729956 req-7cd3d5cd-ced3-49b0-afcf-74a6fec7347d service nova] Creating event network-vif-plugged:e709bf9d-7ef9-45a3-845c-fdc790d7079c for instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe on n-h1-836830-16 Sep 07 09:51:35.388924 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-278b0080-953f-436b-a46a-69817b1e193a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1467 microversion: 2.1 time: 0.402973 Sep 07 09:51:35.389877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 828/1685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:34 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1467 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:35.395579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:35.397367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:35.408005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.408796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.409555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.410574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.411038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.411546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.415408 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e96107b4-da35-4827-8461-fda415729956 req-7cd3d5cd-ced3-49b0-afcf-74a6fec7347d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064474 Sep 07 09:51:35.416040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 858/1686] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:35.421284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:35.421995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:35.428538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.429105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.429582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.430290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.430748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.431234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.708427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:35.711691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:35.719723 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0fb7f1dc-534b-4a64-8ff4-0319aa0226f7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.328233 Sep 07 09:51:35.721790 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 829/1687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:35 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:35.724746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-553f9675-0ba6-4d4e-8a25-7c5b5a278043 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.307476 Sep 07 09:51:35.737266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:35.737481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 859/1688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:35 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:35.737588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:35.747089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:35.747396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.747733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:35.751086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.751611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.753699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.760163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.760745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.761756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.762498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.763182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.764191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.765394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.766407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.795654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:51:35.927028 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35630e5b-e870-45cd-b666-6d534e7aa188 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 204 len: 0 microversion: 2.1 time: 0.203956 Sep 07 09:51:35.928797 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 830/1689] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:35 2022] DELETE /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:51:35.942652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:35.945468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:35.955719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.956410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.957084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:35.959636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:35.960688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:35.961350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.076631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:36.086663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-726cda8f-4238-40ef-ad85-649e76c89565 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.348066 Sep 07 09:51:36.087254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 860/1690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:35 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:36.106114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5758a7e3-d1dd-49d4-8f34-33ddabd81bfd req-bfa4adca-6088-4874-b10e-6c6a362f5bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b26249-7d25-4480-bf8f-a7db6232438a", "tag": "2a619711-b498-48d6-850b-9182656ac45d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:36.122240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5758a7e3-d1dd-49d4-8f34-33ddabd81bfd req-bfa4adca-6088-4874-b10e-6c6a362f5bd3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.123091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5758a7e3-d1dd-49d4-8f34-33ddabd81bfd req-bfa4adca-6088-4874-b10e-6c6a362f5bd3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.123727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5758a7e3-d1dd-49d4-8f34-33ddabd81bfd req-bfa4adca-6088-4874-b10e-6c6a362f5bd3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.145107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5758a7e3-d1dd-49d4-8f34-33ddabd81bfd req-bfa4adca-6088-4874-b10e-6c6a362f5bd3 service nova] Creating event network-changed:2a619711-b498-48d6-850b-9182656ac45d for instance 20b26249-7d25-4480-bf8f-a7db6232438a on n-h1-836830-16 Sep 07 09:51:36.151684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5758a7e3-d1dd-49d4-8f34-33ddabd81bfd req-bfa4adca-6088-4874-b10e-6c6a362f5bd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051287 Sep 07 09:51:36.154367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de50784c-3211-4f9f-b2c9-f85d47d835b0 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1620 microversion: 2.1 time: 0.223569 Sep 07 09:51:36.161251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 861/1691] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:36.161867 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 831/1692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:35 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1620 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:36.167259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:36.168123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:36.173607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:36.174506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:36.185101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.186570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.187143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.187841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.188257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.188407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.188708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.189063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.189699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.190662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.192270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.193860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.237661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:51:36.327004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.api [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Instance is already in deleting state, ignoring this request Sep 07 09:51:36.327852 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd9e14fc-6d63-43b0-a9f6-1da91fe7dc18 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 204 len: 0 microversion: 2.1 time: 0.170465 Sep 07 09:51:36.331887 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 862/1693] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:36 2022] DELETE /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:51:36.337861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:36.342273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:36.349802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.350637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.352936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.353898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.354649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.355125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.398273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:36.411136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:36.413253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:36.414764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a7f23e35-f21b-4c93-90bd-e12967597387 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.251464 Sep 07 09:51:36.415793 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 832/1694] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:36 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:36.422238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1056296862", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "311d2586-a4ff-42eb-90c9-bb56ecdd89e4"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:36.497807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:51:36.592798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:36.604211 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a3e2066-892e-4360-839a-69b2d06adb33 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1513 microversion: 2.1 time: 0.270071 Sep 07 09:51:36.605030 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 863/1695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:36 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:36.610194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:36.612598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:36.628919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.629527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.630153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.631553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.632294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.632798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.808587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:36.847084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:51:36.847084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:51:36.847084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:51:36.847766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:51:36.848730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:51:36.852873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:36.863730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.864055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.864495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.865838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.866531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.867031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.868281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:36.877260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ddc523d6-5cfc-403e-8d75-4161c32ff3eb tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.270798 Sep 07 09:51:36.878032 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 864/1696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:36 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:36.883982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:36.884602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:36.893720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.894274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.894720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.895445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.896866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.897600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.901773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:51:36.907553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Getting quotas for user edb48b84ec5e441287e9c43bd918f394 and project 16f96dd538e242b88d17442cb92b3d46. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:51:36.923977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:51:36.926705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:51:36.983227 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85c4318d-01a0-4a3d-974a-e954830e43d1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565350 Sep 07 09:51:36.983894 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 833/1697] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:51:36.988827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:36.989413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:36.997069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.997615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.998043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:36.998802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:36.999263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:36.999730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.153491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.166581 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-927ea04a-dd10-464b-bfa5-28495ff15ea4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.287672 Sep 07 09:51:37.167512 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 865/1698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:36 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:37.175688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b923a429-5803-4c4e-89b7-7ccc179f50dc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:37.176440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b923a429-5803-4c4e-89b7-7ccc179f50dc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:37.242871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.255927 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f33b46ec-8315-4e74-a630-c41741805632 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.270198 Sep 07 09:51:37.257218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 834/1699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:36 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:37.275941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b923a429-5803-4c4e-89b7-7ccc179f50dc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.283309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:37.283934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b923a429-5803-4c4e-89b7-7ccc179f50dc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1217 microversion: 2.1 time: 0.115390 Sep 07 09:51:37.284168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:37.286097 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 866/1700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:37 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:37.298307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.298900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.299336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.300392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.301000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.301591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.431399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b4620da5-a993-48e5-aa58-fda0010d91c4 req-3dd965d5-4b77-4e59-b640-13cf71379ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9fd1dcd-54f3-40c3-834e-a6bda566c14c", "name": "network-vif-plugged", "status": "completed", "tag": "b572c985-8b5e-4ce8-8806-bad655c54249"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:37.447665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b4620da5-a993-48e5-aa58-fda0010d91c4 req-3dd965d5-4b77-4e59-b640-13cf71379ef3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.448165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b4620da5-a993-48e5-aa58-fda0010d91c4 req-3dd965d5-4b77-4e59-b640-13cf71379ef3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.453505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b4620da5-a993-48e5-aa58-fda0010d91c4 req-3dd965d5-4b77-4e59-b640-13cf71379ef3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.468626 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b4620da5-a993-48e5-aa58-fda0010d91c4 req-3dd965d5-4b77-4e59-b640-13cf71379ef3 service nova] Creating event network-vif-plugged:b572c985-8b5e-4ce8-8806-bad655c54249 for instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c on n-h2-836830-16 Sep 07 09:51:37.475586 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b4620da5-a993-48e5-aa58-fda0010d91c4 req-3dd965d5-4b77-4e59-b640-13cf71379ef3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048117 Sep 07 09:51:37.476348 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 867/1701] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:51:37.483266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:37.484585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:37.492058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.492764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.494237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.495218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.495884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.496531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.602425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.607825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:37.617112 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-399ec8aa-bdfa-4c60-9525-fe8ab46286f7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.343559 Sep 07 09:51:37.618352 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 835/1702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:37 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:37.638263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:37.641820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:37.652492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.652991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.653461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.654228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.654717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.655181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.904140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.914203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.915706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.916891 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e00b34ea-5b26-4e38-8a46-9802158e8f4a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.439277 Sep 07 09:51:37.926379 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 868/1703] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:37 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:37.931627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:37.932330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:37.944445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.945433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.945944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.947311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:37.947858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:37.948421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:37.984922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:37.998326 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f14a2c1b-8dbb-4dda-b790-959a765fbf34 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1513 microversion: 2.1 time: 0.372905 Sep 07 09:51:37.999308 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 836/1704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:37 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:51:38.194774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:38.195675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:38.202900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:38.203670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:38.204296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:38.204921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:38.205776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:38.206411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:38.207024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:38.213971 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33b60a6c-dc97-41c2-8743-0675cb004572 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.286676 Sep 07 09:51:38.232583 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 869/1705] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:37 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:38.288671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:38.289496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:38.302820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:38.304042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:38.304715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:38.305661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:38.306298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:38.306920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:38.919205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:38.926868 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01e0050d-a5e6-4ec7-86d7-5676d8d6ac30 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.737078 Sep 07 09:51:38.927598 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 837/1706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:38 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:38.938908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:38.939532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:38.954504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:38.955006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:38.955453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:38.956159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:38.956623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:38.957058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.014548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.029935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-434d6375-632a-48c7-a116-6853226eba25 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.746510 Sep 07 09:51:39.031507 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 870/1707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:38 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:39.039115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f7226b10-f2a2-4ca7-ad2c-135e226a1952 req-aa0103db-8181-44ca-b0d5-d70e27398cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2db9c1-cdda-45b0-bfe6-7a614dab83e1", "name": "network-vif-deleted", "tag": "19013a64-d642-41f4-aead-a9679ca6825f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:39.052977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7226b10-f2a2-4ca7-ad2c-135e226a1952 req-aa0103db-8181-44ca-b0d5-d70e27398cf8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.053675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7226b10-f2a2-4ca7-ad2c-135e226a1952 req-aa0103db-8181-44ca-b0d5-d70e27398cf8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.054113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7226b10-f2a2-4ca7-ad2c-135e226a1952 req-aa0103db-8181-44ca-b0d5-d70e27398cf8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.067054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.069979 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f7226b10-f2a2-4ca7-ad2c-135e226a1952 req-aa0103db-8181-44ca-b0d5-d70e27398cf8 service nova] Creating event network-vif-deleted:19013a64-d642-41f4-aead-a9679ca6825f for instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 on n-h1-836830-16 Sep 07 09:51:39.076298 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f7226b10-f2a2-4ca7-ad2c-135e226a1952 req-aa0103db-8181-44ca-b0d5-d70e27398cf8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042783 Sep 07 09:51:39.077080 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 871/1708] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:39.080346 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e78eb56f-7a9b-4ff5-9a46-6acd466af1e4 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1269 microversion: 2.1 time: 0.151785 Sep 07 09:51:39.084753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:39.085758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:39.090384 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 838/1709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:38 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:39.098184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.100260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:39.100862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.101394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.101959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:39.102157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.102622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.103085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.109511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.110097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.110599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.111381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.111932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.112429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.320811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.324892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:39.329276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.337656 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-815304e9-6919-4a89-b579-2ba69354dba1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.258757 Sep 07 09:51:39.338245 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 872/1710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:39 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:39.339202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.340686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.342026 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f377c56-d04a-40e6-9935-fa2021769933 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.250387 Sep 07 09:51:39.343147 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 839/1711] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:39 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:39.345790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:39.346597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:39.347743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:39.348462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:39.355178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.355989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.356963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.357876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.358482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.359064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.368009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.373826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.374498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.375391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.381624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.382068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.409588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.410495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.411105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.412505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lazy-loading 'fault' on Instance uuid 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:39.513010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.524199 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4c5ce357-1713-4802-8c11-afe3d8bdd61d tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1307 microversion: 2.1 time: 0.184732 Sep 07 09:51:39.539677 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 873/1712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:39 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:39.547414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6b6d6817-efb9-465d-8fd8-ed319b1f2b09 req-5ef7c542-0cb4-4af3-a708-d8275e103194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a95ceab-b418-4e73-b1d1-7a8cc9b2d435", "name": "network-vif-plugged", "status": "completed", "tag": "2f818bbe-9767-4766-8b4f-518ac10b3abf"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:39.567011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6b6d6817-efb9-465d-8fd8-ed319b1f2b09 req-5ef7c542-0cb4-4af3-a708-d8275e103194 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.567809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6b6d6817-efb9-465d-8fd8-ed319b1f2b09 req-5ef7c542-0cb4-4af3-a708-d8275e103194 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.568916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6b6d6817-efb9-465d-8fd8-ed319b1f2b09 req-5ef7c542-0cb4-4af3-a708-d8275e103194 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.586367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6b6d6817-efb9-465d-8fd8-ed319b1f2b09 req-5ef7c542-0cb4-4af3-a708-d8275e103194 service nova] Creating event network-vif-plugged:2f818bbe-9767-4766-8b4f-518ac10b3abf for instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 on n-h1-836830-16 Sep 07 09:51:39.588873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:39.595787 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6b6d6817-efb9-465d-8fd8-ed319b1f2b09 req-5ef7c542-0cb4-4af3-a708-d8275e103194 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054124 Sep 07 09:51:39.597672 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8380f408-31f5-421c-9ad3-6fa65c4c26ce tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1323 microversion: 2.1 time: 0.253446 Sep 07 09:51:39.598771 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 840/1713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:39 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:39.603253 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 874/1714] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:39.950821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:39.951497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:39.954013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:39.960564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.961043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.961902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:39.962633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:39.963094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:39.963734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.057948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:40.058662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.065626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.066114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.066559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.067260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.067769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.068532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.132906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.140839 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bad67a1c-d5d3-43df-8d2f-e18afc751f94 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.194070 Sep 07 09:51:40.141729 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 841/1715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:39 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:40.163106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:40.163783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.171936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.172821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.173402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.174254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.174762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.175425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.299728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.316811 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f69c29da-f91a-4740-bf6d-22fe98204c24 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1277 microversion: 2.1 time: 0.161946 Sep 07 09:51:40.319803 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 842/1716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:40 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:40.321911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.331204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77277f4d-820d-470f-84a5-2c267c8d95ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.277734 Sep 07 09:51:40.336161 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 875/1717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:40 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:40.393592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:40.401886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:40.402519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.405013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.413545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.414369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.416103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.416723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.418206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.418206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.419274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.420154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.421420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.423942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.424510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.425150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.660423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.672710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f504c251-f513-480d-916f-6718f789b2a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.286199 Sep 07 09:51:40.673633 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 876/1718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:40 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:40.679345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:40.680215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.681437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.689199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.690038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.690744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.691684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.691811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.692505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.693724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.699836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.701011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee1bbc48-58da-4756-896d-dae125a04ba0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.317058 Sep 07 09:51:40.708305 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 843/1719] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:40 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:40.720559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:40.720559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.729806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.730237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.730676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.731376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.731829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.732380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.747226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.747827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.748353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.748889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lazy-loading 'fault' on Instance uuid 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:40.819151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b88725326c244f6a10260dc710f2e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e63b735a19d488d95553ff9f6acc846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.827328 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-917f24df-0b0e-4850-961c-87a065158446 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 200 len: 1307 microversion: 2.1 time: 0.152480 Sep 07 09:51:40.828468 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 877/1720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:40 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:40.896770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:40.907345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00894e70-71bc-4416-b3d2-1e17514c0429 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 200 len: 1518 microversion: 2.1 time: 0.197469 Sep 07 09:51:40.908443 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 844/1721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:40 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:40.932216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'action', calling method: .version_select at 0x7f14b3883280>, body: {"addFloatingIp": {"address": "172.25.3.108"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:40.935163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:40.941964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.943345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.944122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:40.944850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:40.945349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:40.945780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:41.019568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:51:41.020262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquired lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:51:41.166912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:41.167534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:41.174534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:41.175026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:41.175469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:41.176174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:41.176639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:41.177699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:41.552106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:41.561481 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc842d5a-c51e-4f47-93d7-25b0c184da69 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1322 microversion: 2.1 time: 0.399609 Sep 07 09:51:41.562114 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 845/1722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:41 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:51:41.570460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:41.571076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:41.577773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:41.578254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:41.578686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:41.579397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:41.579835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:41.580256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:41.689313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:41.698855 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-edce7a24-e829-4633-8428-0a3bdb169b3e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1275 microversion: 2.1 time: 0.135702 Sep 07 09:51:41.707710 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 846/1723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:41 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:41.707710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:41.707710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:41.711510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:41.711999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:41.712438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:41.713330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:41.713653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:41.714085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:42.222841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:42.231858 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4966b69-4395-4869-9b74-d5abc0d87d00 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.531026 Sep 07 09:51:42.232465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 847/1724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:41 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:42.249099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:42.249741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:42.256973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:42.257589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:42.258056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:42.259149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:42.259614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:42.260060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:42.625040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:42.633847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e546db10-2abb-49dd-a31e-88ee416b00f8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.400328 Sep 07 09:51:42.649584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 848/1725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:42 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:42.654740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:42.655477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:42.662300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:42.662832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:42.663370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:42.664325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:42.664759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:42.666020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:43.288849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:43.297725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:43.299178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:43.300297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-252d6545-3a90-495e-b3d0-a5a688fb82ea tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.649613 Sep 07 09:51:43.300849 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 849/1726] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:42 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:43.322474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:43.323147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:43.329658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:43.330081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:43.330520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:43.331208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:43.331665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:43.332083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:43.347746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] HTTP exception thrown: Instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 could not be found. Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Request method failure captured: Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 HTTP/1.1 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGkC7Nniu1A4pGA_nZhMsFJWhnhUUGBmRkD1ESt4OtqJ8PNBC_omW2Tn4f4Bz059TKo5PxN-jQEHMMGlMWob5vzbf5BwswS3QeSyGEofH8F6FoOoOoElnIBaeT_nTlWBb7Z-wS8xDouSPXvtnjpxPe98SQd6N9yBvJqAfz2yBSZV_P8 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e63b735a19d488d95553ff9f6acc846", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0b88725326c244f6a10260dc710f2e55 Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 could not be found. Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5b2db9c1-cdda-45b0-bfe6-7a614dab83e1'} Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 could not be found. Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 could not be found. Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:43.350840 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 could not be found. Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Returning 404 to user: Instance 5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f2cce09-76a5-4986-a382-ce2cb4b66b53 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1" status: 404 len: 111 microversion: 2.1 time: 0.033944 Sep 07 09:51:43.358466 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 850/1727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:43 2022] GET /compute/v2.1/servers/5b2db9c1-cdda-45b0-bfe6-7a614dab83e1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:51:43.360360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:43.360977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:43.367300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:43.368412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:43.368412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:43.368911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:43.369415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:43.369841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:43.710921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:43.720433 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9fb22974-3e5f-4c86-8670-7800b6832466 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1515 microversion: 2.1 time: 0.363604 Sep 07 09:51:43.721159 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 851/1728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:43 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:43.739906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:43.745868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:43.753383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:43.754224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:43.754765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:43.756597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:43.757358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:43.757888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.106176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Building network info cache for instance {{(pid=128833) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:51:44.129618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:44.141739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae23394d-0299-4017-842c-d61fe6bec48f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.404465 Sep 07 09:51:44.157021 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 852/1729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:43 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:44.158642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:44.163812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:44.178970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.179604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.180233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.181369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.181939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.182453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.187065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:44.219357 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-17de9ec1-ade3-45f7-acfd-5a19a3800b0e tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073211 Sep 07 09:51:44.220736 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 853/1730] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:51:44 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:44.226258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:44.227234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:44.233869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.234594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.235201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.236383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.237027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.237651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.608569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:44.628010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b4d6ee7f-9576-4739-b7ab-1c9a9d38fa01 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.405828 Sep 07 09:51:44.648287 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 854/1731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:44 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:44.654726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:44.655566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:44.664664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.665575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.666528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.667565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.668369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.668998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.687816 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] HTTP exception thrown: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Request method failure captured: Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb HTTP/1.1 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGkC7Nniu1A4pGA_nZhMsFJWhnhUUGBmRkD1ESt4OtqJ8PNBC_omW2Tn4f4Bz059TKo5PxN-jQEHMMGlMWob5vzbf5BwswS3QeSyGEofH8F6FoOoOoElnIBaeT_nTlWBb7Z-wS8xDouSPXvtnjpxPe98SQd6N9yBvJqAfz2yBSZV_P8 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e63b735a19d488d95553ff9f6acc846", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0b88725326c244f6a10260dc710f2e55 Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'af481ffe-3355-44b6-bd98-139ea86dabeb'} Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:51:44.690184 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:44.695488 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:44.698541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Returning 404 to user: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:44.700910 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-501bbeaf-fddb-4040-8bce-10add4bae7a4 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 404 len: 111 microversion: 2.1 time: 0.050676 Sep 07 09:51:44.705295 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 855/1732] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:44 2022] DELETE /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:51:44.713587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:44.715575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:44.725837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.726561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.727270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:44.728162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:44.728957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:44.729678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.104213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:45.114160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b29b969-6368-4b91-b568-06e9b776b164 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.407514 Sep 07 09:51:45.115011 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 856/1733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:44 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:45.140040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:45.142890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:45.151802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.152568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.153267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.154217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.154972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.155793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.184060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'flavor' on Instance uuid 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:45.277585 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4bad6c10-bc83-41a5-80e7-6ee0ca9d3c63 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action" status: 200 len: 32 microversion: 2.1 time: 0.160758 Sep 07 09:51:45.278574 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 857/1734] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:51:45 2022] POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:51:45.285131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-67963c60-976b-401e-b2c2-bbed01c059e1 req-63b5acc8-8c9e-4a72-be79-f056e7dd3cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:45.296399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67963c60-976b-401e-b2c2-bbed01c059e1 req-63b5acc8-8c9e-4a72-be79-f056e7dd3cdf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.297216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67963c60-976b-401e-b2c2-bbed01c059e1 req-63b5acc8-8c9e-4a72-be79-f056e7dd3cdf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.297848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67963c60-976b-401e-b2c2-bbed01c059e1 req-63b5acc8-8c9e-4a72-be79-f056e7dd3cdf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.309076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Updating instance_info_cache with network_info: [{"id": "75036fbc-e507-4ead-a669-2ba09f7b17a3", "address": "fa:16:3e:2c:d3:46", "network": {"id": "ee662ca7-2394-47b2-9487-d69b5736a12f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-259036580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "11f073a8bdbe4ac89c7beeb82fe458ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap75036fbc-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128833) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:51:45.316616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-67963c60-976b-401e-b2c2-bbed01c059e1 req-63b5acc8-8c9e-4a72-be79-f056e7dd3cdf service nova] Creating event network-changed:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:51:45.323980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-67963c60-976b-401e-b2c2-bbed01c059e1 req-63b5acc8-8c9e-4a72-be79-f056e7dd3cdf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043536 Sep 07 09:51:45.325328 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 858/1735] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:45.335128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:45.335819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:45.344814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.345331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.345763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.346486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.346626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Releasing lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:51:45.347076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.347423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.348495 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00f8a166-ac6b-437e-9cf8-736d573af12a tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action" status: 202 len: 0 microversion: 2.1 time: 4.421423 Sep 07 09:51:45.349671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 878/1736] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:51:40 2022] POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action => generated 0 bytes in 4423 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:51:45.358232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:45.358922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:45.371092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.372249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.373573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.375970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.376767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.377572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.465173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lazy-loading 'services' on Instance uuid 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:45.549437 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b051546-604d-4c4d-b2bb-8608a39b0d5c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments/c74396ca-cd7a-47bb-8f51-2c491e1f1189" status: 202 len: 0 microversion: 2.1 time: 0.221976 Sep 07 09:51:45.550687 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 859/1737] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 09:51:45 2022] DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments/c74396ca-cd7a-47bb-8f51-2c491e1f1189 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:51:45.558181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:45.559341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: af481ffe-3355-44b6-bd98-139ea86dabeb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:45.567613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.570734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.571673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.572731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.573533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.574424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.594802 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] HTTP exception thrown: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Request method failure captured: Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb HTTP/1.1 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGkC7Nniu1A4pGA_nZhMsFJWhnhUUGBmRkD1ESt4OtqJ8PNBC_omW2Tn4f4Bz059TKo5PxN-jQEHMMGlMWob5vzbf5BwswS3QeSyGEofH8F6FoOoOoElnIBaeT_nTlWBb7Z-wS8xDouSPXvtnjpxPe98SQd6N9yBvJqAfz2yBSZV_P8 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e63b735a19d488d95553ff9f6acc846", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0b88725326c244f6a10260dc710f2e55 Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'af481ffe-3355-44b6-bd98-139ea86dabeb'} Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:45.597489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. Sep 07 09:51:45.603397 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:45.605254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Returning 404 to user: Instance af481ffe-3355-44b6-bd98-139ea86dabeb could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:45.606370 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b8e8862-aa40-421c-b016-aa469e4feb65 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb" status: 404 len: 111 microversion: 2.1 time: 0.052884 Sep 07 09:51:45.607143 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 860/1738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:45 2022] GET /compute/v2.1/servers/af481ffe-3355-44b6-bd98-139ea86dabeb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:51:45.612323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7c259dbb-1bde-4e14-b539-0a6d1cdaaa01 req-0bbb3206-23aa-4496-a76f-c96bc01d3b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b26249-7d25-4480-bf8f-a7db6232438a", "name": "network-vif-plugged", "status": "completed", "tag": "2a619711-b498-48d6-850b-9182656ac45d"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:45.625802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7c259dbb-1bde-4e14-b539-0a6d1cdaaa01 req-0bbb3206-23aa-4496-a76f-c96bc01d3b10 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.626872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7c259dbb-1bde-4e14-b539-0a6d1cdaaa01 req-0bbb3206-23aa-4496-a76f-c96bc01d3b10 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.627529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7c259dbb-1bde-4e14-b539-0a6d1cdaaa01 req-0bbb3206-23aa-4496-a76f-c96bc01d3b10 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.671507 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7c259dbb-1bde-4e14-b539-0a6d1cdaaa01 req-0bbb3206-23aa-4496-a76f-c96bc01d3b10 service nova] Creating event network-vif-plugged:2a619711-b498-48d6-850b-9182656ac45d for instance 20b26249-7d25-4480-bf8f-a7db6232438a on n-h1-836830-16 Sep 07 09:51:45.679500 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7c259dbb-1bde-4e14-b539-0a6d1cdaaa01 req-0bbb3206-23aa-4496-a76f-c96bc01d3b10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069986 Sep 07 09:51:45.680419 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 861/1739] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:45.686806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:45.687514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:45.704526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.705486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.706127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.707197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.707846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.708518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.744162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:45.753038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:45.759007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:45.760404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c92b5c3d-08d4-4869-ac96-3a79882c0d15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.409623 Sep 07 09:51:45.761287 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 879/1740] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:45 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:45.766741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:45.768406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:45.775240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.776464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.777347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:45.778282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:45.778933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:45.779562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.005547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:46.017976 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9d98d8e-d290-47b8-a68d-173ce8df9625 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.335396 Sep 07 09:51:46.018854 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 862/1741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:45 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:46.025614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'action', calling method: .version_select at 0x7f14b3863c10>, body: {"addFloatingIp": {"address": "172.25.3.108"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:46.029208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:46.033922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:46.043432 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-683a6701-324f-41de-ae8b-c5a036745483 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.280903 Sep 07 09:51:46.043664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.044020 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 880/1742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:45 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:46.044232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.044684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.045837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.045967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.046302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.049467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:46.050171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:46.056528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.057283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.057889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.058910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.059532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.060125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.076251 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] HTTP exception thrown: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Request method failure captured: Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 HTTP/1.1 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGkC7Nniu1A4pGA_nZhMsFJWhnhUUGBmRkD1ESt4OtqJ8PNBC_omW2Tn4f4Bz059TKo5PxN-jQEHMMGlMWob5vzbf5BwswS3QeSyGEofH8F6FoOoOoElnIBaeT_nTlWBb7Z-wS8xDouSPXvtnjpxPe98SQd6N9yBvJqAfz2yBSZV_P8 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e63b735a19d488d95553ff9f6acc846", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0b88725326c244f6a10260dc710f2e55 Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '18fc57f6-b30c-4a88-bd29-12a3b7036a45'} Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:51:46.077864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.084957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.087345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Returning 404 to user: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:46.088399 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-32b6e698-3024-431a-a0ca-39f97c9cbe11 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "DELETE /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 404 len: 111 microversion: 2.1 time: 0.042912 Sep 07 09:51:46.089524 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 881/1743] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:46 2022] DELETE /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:51:46.094424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:46.095277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:46.102486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.102981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.103420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.104153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.104657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.105085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.131505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "refresh_cache-c9fd1dcd-54f3-40c3-834e-a6bda566c14c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:51:46.131918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquired lock "refresh_cache-c9fd1dcd-54f3-40c3-834e-a6bda566c14c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:51:46.509938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:46.518147 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b535af16-85b2-4257-9951-8624e0a5a0b5 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.427378 Sep 07 09:51:46.518808 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 882/1744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:46 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:46.525708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:46.527597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] [instance: 18fc57f6-b30c-4a88-bd29-12a3b7036a45] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:46.541698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.542288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.542799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.543727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.544669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.545220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.563854 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] HTTP exception thrown: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Request method failure captured: Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 HTTP/1.1 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGkC7Nniu1A4pGA_nZhMsFJWhnhUUGBmRkD1ESt4OtqJ8PNBC_omW2Tn4f4Bz059TKo5PxN-jQEHMMGlMWob5vzbf5BwswS3QeSyGEofH8F6FoOoOoElnIBaeT_nTlWBb7Z-wS8xDouSPXvtnjpxPe98SQd6N9yBvJqAfz2yBSZV_P8 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e63b735a19d488d95553ff9f6acc846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e63b735a19d488d95553ff9f6acc846", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8e63b735a19d488d95553ff9f6acc846 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1696907212 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0b88725326c244f6a10260dc710f2e55 Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerDiskConfigTestJSON-1696907212-project Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '18fc57f6-b30c-4a88-bd29-12a3b7036a45'} Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:46.565538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] Returning 404 to user: Instance 18fc57f6-b30c-4a88-bd29-12a3b7036a45 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29ab22a8-d62a-4957-b8cb-55f7c889bef7 tempest-ServerDiskConfigTestJSON-1696907212 tempest-ServerDiskConfigTestJSON-1696907212-project] 10.222.0.60 "GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45" status: 404 len: 111 microversion: 2.1 time: 0.046930 Sep 07 09:51:46.571857 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 883/1745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:46 2022] GET /compute/v2.1/servers/18fc57f6-b30c-4a88-bd29-12a3b7036a45 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:51:46.574518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:46.575208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:46.581552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.584063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.584624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.586366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:46.587013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:46.587610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:46.874760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:46.916064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:47.284228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:47.367436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:47.377742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f3b04eb-f52d-4d1e-b15b-1c81861eabd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1314 microversion: 2.1 time: 0.807658 Sep 07 09:51:47.378988 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 884/1746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:46 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:47.385133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:47.386071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:47.392883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:47.393876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:47.394565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:47.406289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:47.407128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:47.419678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:47.763852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:47.778966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:47.784567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:47.790341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f46d4e4f-a3ff-479a-bcf2-8b4fb33864fb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.408252 Sep 07 09:51:47.795627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 885/1747] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:47 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:47.809605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:47.812104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:47.822957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:47.825750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:47.829737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:47.830671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:47.831481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:47.832710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:48.230033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:48.246713 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c36314c8-9aa7-406b-85c8-0a28cdfc8565 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.449873 Sep 07 09:51:48.249976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 886/1748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:47 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:48.262240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:48.263073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:48.269612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:48.270412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:48.272977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:48.273941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:48.274611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:48.275216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:48.866683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:48.877296 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb543a79-22e2-4f3f-a477-cdfed152b7f3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.625377 Sep 07 09:51:48.890497 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 887/1749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:48 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:48.901965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-86369435-3981-446f-9cbf-6eb0e1b30e63 req-6d20b833-1c18-4a26-aeaa-72081babb200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2717c69b-bd75-49f0-a800-a1af1885c602", "tag": "f4ea11e2-e449-4d81-97b6-6bb8deecff99"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:48.914509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-86369435-3981-446f-9cbf-6eb0e1b30e63 req-6d20b833-1c18-4a26-aeaa-72081babb200 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:48.915184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-86369435-3981-446f-9cbf-6eb0e1b30e63 req-6d20b833-1c18-4a26-aeaa-72081babb200 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:48.915785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-86369435-3981-446f-9cbf-6eb0e1b30e63 req-6d20b833-1c18-4a26-aeaa-72081babb200 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:48.932090 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-86369435-3981-446f-9cbf-6eb0e1b30e63 req-6d20b833-1c18-4a26-aeaa-72081babb200 service nova] Creating event network-changed:f4ea11e2-e449-4d81-97b6-6bb8deecff99 for instance 2717c69b-bd75-49f0-a800-a1af1885c602 on n-h2-836830-16 Sep 07 09:51:48.938281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-86369435-3981-446f-9cbf-6eb0e1b30e63 req-6d20b833-1c18-4a26-aeaa-72081babb200 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046156 Sep 07 09:51:48.939662 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 888/1750] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:48.947106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:48.948178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:48.955079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:48.957350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:48.958745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:48.959625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:48.960596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:48.962517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:48.963245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:49.376128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:49.409782 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fb7af08e-f898-4415-83a4-78c7978342f6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.467717 Sep 07 09:51:49.410666 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 889/1751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:48 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:49.443930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ef632b7b-4612-4cbd-a292-1284cb218585 req-9ee48a55-33b9-46f8-92a0-607c99e7d0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df62c8a-df0b-4ced-9622-672ef367267a", "name": "network-vif-plugged", "status": "completed", "tag": "49013a88-e454-4b51-97e1-25fc306b2a50"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:49.454940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ef632b7b-4612-4cbd-a292-1284cb218585 req-9ee48a55-33b9-46f8-92a0-607c99e7d0cf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:49.455714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ef632b7b-4612-4cbd-a292-1284cb218585 req-9ee48a55-33b9-46f8-92a0-607c99e7d0cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:49.456374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ef632b7b-4612-4cbd-a292-1284cb218585 req-9ee48a55-33b9-46f8-92a0-607c99e7d0cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:49.470296 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ef632b7b-4612-4cbd-a292-1284cb218585 req-9ee48a55-33b9-46f8-92a0-607c99e7d0cf service nova] Creating event network-vif-plugged:49013a88-e454-4b51-97e1-25fc306b2a50 for instance 6df62c8a-df0b-4ced-9622-672ef367267a on n-h2-836830-16 Sep 07 09:51:49.476684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ef632b7b-4612-4cbd-a292-1284cb218585 req-9ee48a55-33b9-46f8-92a0-607c99e7d0cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061742 Sep 07 09:51:49.478146 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 890/1752] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:49.483683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:49.484673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:49.501943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:49.502915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:49.503586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:49.504556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:49.505953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:49.506644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:49.539801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:49.856682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:49.866505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8acb42f-a164-416a-8eb8-704a38b45864 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1500 microversion: 2.1 time: 0.386787 Sep 07 09:51:49.869529 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 891/1753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:49 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1500 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:49.876832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:49.881504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:49.895105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:49.904566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:49.905437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:49.910524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:49.911129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:49.913071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:50.664695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:50.684458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:50.688368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:50.691604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5269cbdf-3cdc-4130-a19d-ba1c99365884 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1281 microversion: 2.25 time: 0.819668 Sep 07 09:51:50.708039 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 892/1754] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:49 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1281 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:50.714501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:50.716470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:50.731028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:50.731720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:50.736805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:50.749980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:50.752626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:50.753102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.203661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:51.254322 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-600f4759-875f-478f-9cca-2b9a86a69a16 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.534675 Sep 07 09:51:51.255550 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 893/1755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:50 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:51.266709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f9252dff-2492-404e-b3a3-7842abba4f95 req-e5298282-42b8-4c41-9dd5-945608b8b0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891829aa-74cd-42e3-a67c-eb136af6b32c", "name": "network-vif-unplugged", "status": "completed", "tag": "b2432ae8-6727-4d23-b5bf-863869d42ff6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:51.291425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f9252dff-2492-404e-b3a3-7842abba4f95 req-e5298282-42b8-4c41-9dd5-945608b8b0f3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.292217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f9252dff-2492-404e-b3a3-7842abba4f95 req-e5298282-42b8-4c41-9dd5-945608b8b0f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.292825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f9252dff-2492-404e-b3a3-7842abba4f95 req-e5298282-42b8-4c41-9dd5-945608b8b0f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.336282 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f9252dff-2492-404e-b3a3-7842abba4f95 req-e5298282-42b8-4c41-9dd5-945608b8b0f3 service nova] Creating event network-vif-unplugged:b2432ae8-6727-4d23-b5bf-863869d42ff6 for instance 891829aa-74cd-42e3-a67c-eb136af6b32c on n-h2-836830-16 Sep 07 09:51:51.350099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f9252dff-2492-404e-b3a3-7842abba4f95 req-e5298282-42b8-4c41-9dd5-945608b8b0f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090723 Sep 07 09:51:51.365955 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 894/1756] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:51.373903 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.neutron [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] re-assign floating IP 172.25.3.108 from instance 2c062b98-2f52-4320-aa74-b05a253c1809 Sep 07 09:51:51.375415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:51.378787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:51.396278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.396761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.397441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.398335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.398952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.406151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.431439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:51:51.466123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:51:51.610170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ea3d3a9-5f79-408c-9db0-e86980c3d0f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 204 len: 0 microversion: 2.1 time: 0.239561 Sep 07 09:51:51.614757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 895/1757] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:51 2022] DELETE /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:51:51.621417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:51.622365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:51.629035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.630499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.631168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.632066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.632687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.633331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.838722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:51.854277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-946e298d-9a43-44bb-9f19-a4de3fd420fc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.237294 Sep 07 09:51:51.855459 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 896/1758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:51 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:51.860246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:51.863010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:51.878445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.879033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.879542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:51.881069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:51.881936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:51.890342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:52.155801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:52.164934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c5f2ca7-db5f-4480-bff7-f1c55abfbea1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.308241 Sep 07 09:51:52.185127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 897/1759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:51 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:52.197769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4af99b37-5de6-4108-a848-89ff1adaa1de req-d4162518-8972-48ab-b5be-b4f903a2241d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:52.215213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4af99b37-5de6-4108-a848-89ff1adaa1de req-d4162518-8972-48ab-b5be-b4f903a2241d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:52.215851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4af99b37-5de6-4108-a848-89ff1adaa1de req-d4162518-8972-48ab-b5be-b4f903a2241d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:52.216207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4af99b37-5de6-4108-a848-89ff1adaa1de req-d4162518-8972-48ab-b5be-b4f903a2241d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:52.238952 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4af99b37-5de6-4108-a848-89ff1adaa1de req-d4162518-8972-48ab-b5be-b4f903a2241d service nova] Creating event network-changed:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:51:52.252742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4af99b37-5de6-4108-a848-89ff1adaa1de req-d4162518-8972-48ab-b5be-b4f903a2241d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062649 Sep 07 09:51:52.253837 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 898/1760] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:52.259875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:52.267469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:52.277491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:52.278089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:52.278744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:52.279695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:52.280968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:52.281638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:52.654267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:52.687723 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4fccb5ce-9ba2-409f-b76f-e9be45042a9b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1506 microversion: 2.1 time: 0.429765 Sep 07 09:51:52.689783 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 899/1761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:52 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:52.695046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:52.695764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:52.713664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:52.714579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:52.715298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:52.716269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:52.716991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:52.717677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:53.035054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:53.035653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Updating instance_info_cache with network_info: [{"id": "75036fbc-e507-4ead-a669-2ba09f7b17a3", "address": "fa:16:3e:2c:d3:46", "network": {"id": "ee662ca7-2394-47b2-9487-d69b5736a12f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-259036580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "11f073a8bdbe4ac89c7beeb82fe458ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap75036fbc-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:51:53.050098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:53.053172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:53.054842 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb527f41-7c83-46d7-9491-3e72df72bb15 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1478 microversion: 2.25 time: 0.364065 Sep 07 09:51:53.066167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:51:53.066842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 900/1762] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:52 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1478 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:53.084409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:53.085904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:53.094236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:53.095104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:53.095771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:53.096864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:53.097861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:53.102291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:53.495591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:53.504685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6fe8b029-e7a4-4e40-bb8b-103fbd5b5d2f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.426607 Sep 07 09:51:53.516871 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 901/1763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:53 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:53.524437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:53.525208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:53.539914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:53.540403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:53.540843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:53.541630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:53.542093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:53.542526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:53.971888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:53.984584 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c2fd131-b73e-4355-bab9-10b070ba849a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.466304 Sep 07 09:51:53.985196 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 902/1764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:53 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:54.346655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:54.347280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:54.358994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.359515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.360118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.361022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.361578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.362079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.506305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Updating instance_info_cache with network_info: [{"id": "b572c985-8b5e-4ce8-8806-bad655c54249", "address": "fa:16:3e:a9:e5:e3", "network": {"id": "ee662ca7-2394-47b2-9487-d69b5736a12f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-259036580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "11f073a8bdbe4ac89c7beeb82fe458ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb572c985-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:51:54.523427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Releasing lock "refresh_cache-c9fd1dcd-54f3-40c3-834e-a6bda566c14c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:51:54.525535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-084099eb-eece-417c-b73a-8e1adce62454 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c/action" status: 202 len: 0 microversion: 2.1 time: 8.505294 Sep 07 09:51:54.525909 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 863/1765] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:51:46 2022] POST /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c/action => generated 0 bytes in 8507 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:51:54.532882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:54.533850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:54.542668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.543452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.544265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.545245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.545676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.546284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.557569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 6df62c8a-df0b-4ced-9622-672ef367267a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:54.579212 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-431f0f89-349e-44d5-9860-3b44ea77e073 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1973 microversion: 2.25 time: 0.575596 Sep 07 09:51:54.580320 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 903/1766] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:54 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1973 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:54.586753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-096245fb-984e-487d-ade4-2380b7d72e06 req-47e2e6b7-1022-464b-9839-43de4d108a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891829aa-74cd-42e3-a67c-eb136af6b32c", "tag": "b2432ae8-6727-4d23-b5bf-863869d42ff6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:54.596830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-096245fb-984e-487d-ade4-2380b7d72e06 req-47e2e6b7-1022-464b-9839-43de4d108a20 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.597367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-096245fb-984e-487d-ade4-2380b7d72e06 req-47e2e6b7-1022-464b-9839-43de4d108a20 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.597797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-096245fb-984e-487d-ade4-2380b7d72e06 req-47e2e6b7-1022-464b-9839-43de4d108a20 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.611501 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-096245fb-984e-487d-ade4-2380b7d72e06 req-47e2e6b7-1022-464b-9839-43de4d108a20 service nova] Creating event network-changed:b2432ae8-6727-4d23-b5bf-863869d42ff6 for instance 891829aa-74cd-42e3-a67c-eb136af6b32c on n-h2-836830-16 Sep 07 09:51:54.617559 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-096245fb-984e-487d-ade4-2380b7d72e06 req-47e2e6b7-1022-464b-9839-43de4d108a20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036017 Sep 07 09:51:54.618504 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 904/1767] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:54.624062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:54.626745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:54.634822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.635509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.636235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.637209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.637898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.638566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.687576 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9cf2637-ff5c-4fc9-b8ce-45c644c48465 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067623 Sep 07 09:51:54.688581 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 905/1768] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:51:54 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:51:54.695530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:54.696525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:54.704899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.705426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.706063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.706776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.707262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.707764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.755858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:54.765900 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5fec6f2-1aa9-41a5-af64-5401fcdd3f16 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.236591 Sep 07 09:51:54.766702 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 864/1769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:54 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:54.772539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-78e77d95-d8c0-431b-b6d5-d59b875fe6c0 req-ff3e9a81-1257-4224-a675-35511b08948f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9fd1dcd-54f3-40c3-834e-a6bda566c14c", "tag": "b572c985-8b5e-4ce8-8806-bad655c54249"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:54.784289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-78e77d95-d8c0-431b-b6d5-d59b875fe6c0 req-ff3e9a81-1257-4224-a675-35511b08948f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.784711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-78e77d95-d8c0-431b-b6d5-d59b875fe6c0 req-ff3e9a81-1257-4224-a675-35511b08948f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.785122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-78e77d95-d8c0-431b-b6d5-d59b875fe6c0 req-ff3e9a81-1257-4224-a675-35511b08948f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.799145 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-78e77d95-d8c0-431b-b6d5-d59b875fe6c0 req-ff3e9a81-1257-4224-a675-35511b08948f service nova] Creating event network-changed:b572c985-8b5e-4ce8-8806-bad655c54249 for instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c on n-h2-836830-16 Sep 07 09:51:54.804543 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-78e77d95-d8c0-431b-b6d5-d59b875fe6c0 req-ff3e9a81-1257-4224-a675-35511b08948f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036696 Sep 07 09:51:54.805687 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 865/1770] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:54.812614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:54.813743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:54.822115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.822919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.823579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:54.824553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:54.825231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:54.825859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:55.230512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:55.258853 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77355dd0-bd64-4b1c-808f-d6375541eb6a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 200 len: 1506 microversion: 2.1 time: 0.568882 Sep 07 09:51:55.262992 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 906/1771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:54 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:55.274315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'action', calling method: .version_select at 0x7f14b38833a0>, body: {"removeFloatingIp": {"address": "172.25.3.108"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:55.471148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:55.492251 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-626b3329-6f48-4499-81bc-6153c7ef0f5d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.685066 Sep 07 09:51:55.498197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:55.499930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 866/1772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:54 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:55.505882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:55.506522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:55.507359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:55.508235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:55.509145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:55.510004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:55.516965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:55.520217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:55.536233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:55.536801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:55.542724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:55.543647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:55.545901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:55.546253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.449165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 6df62c8a-df0b-4ced-9622-672ef367267a {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:56.454579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] HTTP exception thrown: Floating IP 172.25.3.108 is not associated with instance 2c062b98-2f52-4320-aa74-b05a253c1809. Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Request method failure captured: Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action HTTP/1.1 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 49 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlxR_v-OoPITFb5Ohrwvd1tUrUsWWCUkflF0pfrsk4-BQjGvtVcmVdZY3iU-UuNBLDkOPKzSn3xNZzVBrN_B0HSufvjzZ56j6hfBVBHBmfucX-5W8cQFLvMEqbZeZtMxxj-OfDpNySBZiKd1P9qcJZhGqhfbPcOKG0uv30YnnSAYio Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11f073a8bdbe4ac89c7beeb82fe458ce", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 46e1e110e1c74e4cb394d94906fd3c52 Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: {"removeFloatingIp": {"address": "172.25.3.108"}} Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: exception: Floating IP 172.25.3.108 is not associated with instance 2c062b98-2f52-4320-aa74-b05a253c1809. Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2c062b98-2f52-4320-aa74-b05a253c1809', 'body': {'removeFloatingIp': {'address': '172.25.3.108'}}} Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.108 is not associated with instance 2c062b98-2f52-4320-aa74-b05a253c1809. Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.108 is not associated with instance 2c062b98-2f52-4320-aa74-b05a253c1809. Sep 07 09:51:56.456113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:51:56.466083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Returning 409 to user: Floating IP 172.25.3.108 is not associated with instance 2c062b98-2f52-4320-aa74-b05a253c1809. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:56.466083 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-100e5ff2-732b-4469-89fb-10a352659d3d tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action" status: 409 len: 146 microversion: 2.1 time: 1.195882 Sep 07 09:51:56.466083 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 907/1773] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:51:55 2022] POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action => generated 146 bytes in 1197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:51:56.469561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:56.471779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:56.476200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:56.482233 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-813c6d76-f26f-4b65-b6bc-ffd720ffabcb tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1973 microversion: 2.25 time: 0.981198 Sep 07 09:51:56.483600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 867/1774] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:51:55 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1973 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:51:56.489772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:56.490814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:56.502147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.502993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.503790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.505725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.506691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.507480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.521275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.521966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.522425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.523158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.526496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.527052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.559380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:51:56.610404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-154b5640-f2ba-4a47-8623-41e96a89b4ee tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148492 Sep 07 09:51:56.611318 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 908/1775] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:51:56 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:51:56.621547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:56.622177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:56.638496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.639512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.640134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.641033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.641708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.642303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.929091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:56.933349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:56.942112 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05fa5abf-3645-46cd-aa2b-a583f711fcfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.456976 Sep 07 09:51:56.953335 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 868/1776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:56 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:56.954120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-023c09b2-cab6-4ede-8eb8-a706d4716925 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.331775 Sep 07 09:51:56.955168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:56.958806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:56.961982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 909/1777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:56 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:56.971523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.972254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.974133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.975614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:56.976415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:56.977044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:56.984489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ae23871b-9ea2-42f7-be90-ef990d022a31 req-681f6c70-35b3-4e46-8df0-bd2c637b8773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2717c69b-bd75-49f0-a800-a1af1885c602", "name": "network-vif-plugged", "status": "completed", "tag": "f4ea11e2-e449-4d81-97b6-6bb8deecff99"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:56.996101 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a HTTP/1.1 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '20b26249-7d25-4480-bf8f-a7db6232438a'} Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:51:56.998574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:51:57.003767 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:51:57.006462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:51:57.008492 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-97b67e88-62c4-4b71-8935-87025946c8b7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 404 len: 111 microversion: 2.1 time: 0.061103 Sep 07 09:51:57.008817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ae23871b-9ea2-42f7-be90-ef990d022a31 req-681f6c70-35b3-4e46-8df0-bd2c637b8773 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.009339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ae23871b-9ea2-42f7-be90-ef990d022a31 req-681f6c70-35b3-4e46-8df0-bd2c637b8773 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.010161 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 869/1778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:56 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:51:57.015076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'action', calling method: .version_select at 0x7f14b3863b80>, body: {"removeFloatingIp": {"address": "172.25.3.108"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:57.016029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ae23871b-9ea2-42f7-be90-ef990d022a31 req-681f6c70-35b3-4e46-8df0-bd2c637b8773 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.032468 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ae23871b-9ea2-42f7-be90-ef990d022a31 req-681f6c70-35b3-4e46-8df0-bd2c637b8773 service nova] Creating event network-vif-plugged:f4ea11e2-e449-4d81-97b6-6bb8deecff99 for instance 2717c69b-bd75-49f0-a800-a1af1885c602 on n-h2-836830-16 Sep 07 09:51:57.039087 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ae23871b-9ea2-42f7-be90-ef990d022a31 req-681f6c70-35b3-4e46-8df0-bd2c637b8773 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075747 Sep 07 09:51:57.040344 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 910/1779] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:57.049508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:57.055217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.056142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.057123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.058755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.059507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.060311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.093119 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3175ec52-b450-4f4f-8a7d-c2a9b7de9bf5 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.050467 Sep 07 09:51:57.103242 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 911/1780] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 7 09:51:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:51:57.121534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:57.125085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:57.144219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.144725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.145381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.158249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.160019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.160697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.354338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:57.362544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.363326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.363772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.365448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.366241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.367111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.570300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:51:57.580009 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36fc2aab-626b-4b8c-bda7-2e9a0b9a3ea0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1317 microversion: 2.1 time: 0.466598 Sep 07 09:51:57.581142 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 912/1781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:51:57 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:51:57.595024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3b019d6b-3011-4d9a-bb2b-ff2bd75bc2a1 req-44f27e2d-998e-4b55-b0b8-ecc9d2fce55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b26249-7d25-4480-bf8f-a7db6232438a", "name": "network-vif-deleted", "tag": "2a619711-b498-48d6-850b-9182656ac45d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:57.616988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b019d6b-3011-4d9a-bb2b-ff2bd75bc2a1 req-44f27e2d-998e-4b55-b0b8-ecc9d2fce55f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.620226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b019d6b-3011-4d9a-bb2b-ff2bd75bc2a1 req-44f27e2d-998e-4b55-b0b8-ecc9d2fce55f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.620895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b019d6b-3011-4d9a-bb2b-ff2bd75bc2a1 req-44f27e2d-998e-4b55-b0b8-ecc9d2fce55f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.648844 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3b019d6b-3011-4d9a-bb2b-ff2bd75bc2a1 req-44f27e2d-998e-4b55-b0b8-ecc9d2fce55f service nova] Creating event network-vif-deleted:2a619711-b498-48d6-850b-9182656ac45d for instance 20b26249-7d25-4480-bf8f-a7db6232438a on n-h1-836830-16 Sep 07 09:51:57.660326 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3b019d6b-3011-4d9a-bb2b-ff2bd75bc2a1 req-44f27e2d-998e-4b55-b0b8-ecc9d2fce55f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069963 Sep 07 09:51:57.661873 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 913/1782] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:51:57.668854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:51:57.669597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:57.679480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.682017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.682760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.683789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.684445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.685831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.716241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:51:57.753485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "refresh_cache-c9fd1dcd-54f3-40c3-834e-a6bda566c14c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:51:57.754770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquired lock "refresh_cache-c9fd1dcd-54f3-40c3-834e-a6bda566c14c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:51:57.877363 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aafd1de1-1e03-4313-b6f1-5c266035f40f tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 204 len: 0 microversion: 2.1 time: 0.212973 Sep 07 09:51:57.878375 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 914/1783] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:51:57 2022] DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:51:57.886199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-16", "block_migration": "auto"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:57.893922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:51:57.904789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.909573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.912130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.913219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:51:57.913910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:51:57.914574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:51:57.959330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'flavor' on Instance uuid 6df62c8a-df0b-4ced-9622-672ef367267a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:51:57.980332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Going to try to live migrate instance to n-h1-836830-16 {{(pid=128833) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 09:51:58.739223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:51:59.557632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Updating instance_info_cache with network_info: [{"id": "b572c985-8b5e-4ce8-8806-bad655c54249", "address": "fa:16:3e:a9:e5:e3", "network": {"id": "ee662ca7-2394-47b2-9487-d69b5736a12f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-259036580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "11f073a8bdbe4ac89c7beeb82fe458ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb572c985-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:51:59.574807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Releasing lock "refresh_cache-c9fd1dcd-54f3-40c3-834e-a6bda566c14c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:51:59.576616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-59267db1-3cf9-4d11-9321-180895a87434 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c/action" status: 202 len: 0 microversion: 2.1 time: 2.564392 Sep 07 09:51:59.582591 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 870/1784] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:51:57 2022] POST /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c/action => generated 0 bytes in 2571 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:51:59.589544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1386103181", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:51:59.670999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:52:00.338823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:52:00.339375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:52:00.339827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:52:00.340312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:52:00.340937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:52:00.352835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:00.353537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:00.354427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:00.355316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:00.355850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:00.356537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:00.376675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:00.385692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:00.424211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:52:00.427956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:52:00.503139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3515820c-552b-4090-9f19-7e1d7c914e44 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918983 Sep 07 09:52:00.508669 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 871/1785] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:52:00.518646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:00.521767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:00.535463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:00.540698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:00.541324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:00.545652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:00.546272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:00.546982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:00.758845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:00.768529 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cca35774-0307-42ef-a24d-b9ee21d609ae tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1680 microversion: 2.1 time: 0.258466 Sep 07 09:52:00.771770 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 872/1786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:00 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:00.778901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:00.780636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:00.788682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:00.789552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:00.800970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:00.802696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:00.803283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:00.803796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.011526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:01.033280 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4f8b694-b900-48a3-8ccc-82ff827fbab1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.260048 Sep 07 09:52:01.036204 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 873/1787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:00 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:01.057899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:01.058889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:01.070416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.070952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.071423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.072122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.074967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.075925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.282906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:01.295810 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-efe6c6d9-4d66-49ec-b79e-4b8038e700b6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1392 microversion: 2.1 time: 0.245450 Sep 07 09:52:01.297729 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 874/1788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:01 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:01.317875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:01.319091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:01.328486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.329109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.329613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.331402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.331882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.332317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.509210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:01.521827 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa2d71bf-4846-48c0-9135-eaca6cee6aba tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1467 microversion: 2.1 time: 0.209301 Sep 07 09:52:01.523133 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 875/1789] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:01 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1467 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:01.530350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8a92a4c2-13b9-4b08-ba05-48449439a513 req-43dfa970-6fa5-4f38-a7f5-8ec1cdf431c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9fd1dcd-54f3-40c3-834e-a6bda566c14c", "tag": "b572c985-8b5e-4ce8-8806-bad655c54249"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:01.555892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8a92a4c2-13b9-4b08-ba05-48449439a513 req-43dfa970-6fa5-4f38-a7f5-8ec1cdf431c6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.557569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8a92a4c2-13b9-4b08-ba05-48449439a513 req-43dfa970-6fa5-4f38-a7f5-8ec1cdf431c6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.559106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8a92a4c2-13b9-4b08-ba05-48449439a513 req-43dfa970-6fa5-4f38-a7f5-8ec1cdf431c6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.576216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8a92a4c2-13b9-4b08-ba05-48449439a513 req-43dfa970-6fa5-4f38-a7f5-8ec1cdf431c6 service nova] Creating event network-changed:b572c985-8b5e-4ce8-8806-bad655c54249 for instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c on n-h2-836830-16 Sep 07 09:52:01.581819 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8a92a4c2-13b9-4b08-ba05-48449439a513 req-43dfa970-6fa5-4f38-a7f5-8ec1cdf431c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057190 Sep 07 09:52:01.582471 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 876/1790] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:01.589867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:01.590660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:01.598117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.599262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.600236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.601339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.601970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.602610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.639478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:01.794624 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ec6d1dd2-64b7-46f2-ab16-e710b08864b8 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 204 len: 0 microversion: 2.1 time: 0.209821 Sep 07 09:52:01.798651 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 877/1791] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:01 2022] DELETE /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:01.809640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:01.811946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:01.827466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.829861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.832159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.835652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:01.837464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:01.838052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:01.985376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:01.998074 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9aff1d84-11bc-4ed9-a26b-9d6f71409d4d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1267 microversion: 2.1 time: 0.197966 Sep 07 09:52:02.001773 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 878/1792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:01 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:02.018493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:02.021962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:02.038716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.039508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.040051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.041321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.042061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.042680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.195480 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00fbc242-6b54-4e47-a300-21462337a0d4 tempest-ServersOnMultiNodesTest-866268236 tempest-ServersOnMultiNodesTest-866268236-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1620 microversion: 2.1 time: 0.192127 Sep 07 09:52:02.201253 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 879/1793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:02 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1620 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:02.211352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:02.211962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:02.219576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.220331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.221061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.221930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.222591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.223019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.405534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:02.420726 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a6871ef-e4e3-4f26-877f-f8be85e8b7c6 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1680 microversion: 2.1 time: 0.212183 Sep 07 09:52:02.422746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 880/1794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:02 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:02.430577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.108"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:02.433578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:02.437284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:02.444765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.445723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.446612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.447397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.448037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.448696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.496302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:52:02.496707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquired lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:52:02.696142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6499946-d760-464f-881f-f3752c84e312 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a/action" status: 202 len: 0 microversion: 2.25 time: 4.816109 Sep 07 09:52:02.708819 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 915/1795] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:51:57 2022] POST /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a/action => generated 0 bytes in 4829 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:02.727225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:02.728953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:02.746466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.747362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.748837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:02.752327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:02.753693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:02.754377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:03.690305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:03.714548 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2f049c2-0e1a-4e07-9f63-b791c8558616 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 1.000195 Sep 07 09:52:03.715953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 916/1796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:02 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:03.729001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:03.729691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:03.754572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:03.755892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:03.756697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:03.759524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:03.760563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:03.761296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:03.857307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:04.085594 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fff39ed0-c048-4f62-9ffc-2ed34bdc3743 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 204 len: 0 microversion: 2.1 time: 0.365708 Sep 07 09:52:04.086773 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 917/1797] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:03 2022] DELETE /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:04.099231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:04.107329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:04.127598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:04.128223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:04.130599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:04.131713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:04.133461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:04.134264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:04.728952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:04.740188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01244020-d8e1-4913-8c57-da553813625d tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1382 microversion: 2.1 time: 0.651238 Sep 07 09:52:04.754595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 918/1798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:04 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1382 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:04.760612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:04.761568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:04.768611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:04.769349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:04.769900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:04.771980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:04.772587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:04.773128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:05.298287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:05.323620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:05.327237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:05.328563 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c828f13-5c8d-4127-822d-36a67a4f23cf tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.572375 Sep 07 09:52:05.330377 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 919/1799] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:04 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:05.336426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:05.337406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:05.351685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:05.352608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:05.353362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:05.354891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:05.355375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:05.355974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:06.512561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:06.524180 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8f23b3c-a5d0-4136-a381-2e4adb4efeae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1315 microversion: 2.1 time: 1.192448 Sep 07 09:52:06.526842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 920/1800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:05 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1315 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:06.551005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:06.552240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:06.563361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:06.564266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:06.565290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:06.567273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:06.567273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:06.567861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:06.670329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:06.671088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:06.671925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:06.673128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lazy-loading 'fault' on Instance uuid 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:06.679114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:06.782674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b84fc9a49f4f73b2f09265acbbea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9db3020244360892d02bb7d28aef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:06.804950 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e7234d64-8cf7-4333-9c62-08cf98b90ebf tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 200 len: 1331 microversion: 2.1 time: 0.276936 Sep 07 09:52:06.811106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 921/1801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:06 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 1331 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:06.822534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-df5a17f6-48c3-4707-93d4-490879a56107 req-6db7ed11-8dea-47aa-a215-4410d36f5920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181cfb61-0e63-4cdb-91ba-06af35fa0dc1", "name": "network-vif-deleted", "tag": "2529a441-5992-438d-88ea-625e2e882c5a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:06.846899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df5a17f6-48c3-4707-93d4-490879a56107 req-6db7ed11-8dea-47aa-a215-4410d36f5920 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:06.847546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df5a17f6-48c3-4707-93d4-490879a56107 req-6db7ed11-8dea-47aa-a215-4410d36f5920 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:06.847983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df5a17f6-48c3-4707-93d4-490879a56107 req-6db7ed11-8dea-47aa-a215-4410d36f5920 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:06.878686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-df5a17f6-48c3-4707-93d4-490879a56107 req-6db7ed11-8dea-47aa-a215-4410d36f5920 service nova] Creating event network-vif-deleted:2529a441-5992-438d-88ea-625e2e882c5a for instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 on n-h2-836830-16 Sep 07 09:52:06.893979 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-df5a17f6-48c3-4707-93d4-490879a56107 req-6db7ed11-8dea-47aa-a215-4410d36f5920 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079803 Sep 07 09:52:06.905518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 922/1802] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:06.914022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:06.920217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:06.934996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:06.937413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:06.940858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:06.942654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:06.943565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:06.946080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:07.072025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:07.188918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:07.215122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:52:07.232110 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3dd1be87-b80d-402e-91f7-f5f26880fa75 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 200 len: 1302 microversion: 2.1 time: 0.321534 Sep 07 09:52:07.232775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 923/1803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:06 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 1302 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:07.356242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-535552841", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "32065a7e-e356-4f31-b2ca-926bc2a7016c"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:07.479561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] validate_networks() for [('32065a7e-e356-4f31-b2ca-926bc2a7016c', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:52:09.632310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:52:09.632911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:52:09.633062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:52:09.633503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:52:09.633915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:52:09.644793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.645549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.646378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.647224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.647690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.648121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.667483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Getting quotas for project ec3f5d14bd094e1b80baadc786ee4210. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:09.672130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:09.673941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Getting quotas for user a6d9f9ab444f49cd95c63dda1087bcb9 and project ec3f5d14bd094e1b80baadc786ee4210. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:09.691606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:52:09.695303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:52:09.753465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Updating instance_info_cache with network_info: [{"id": "75036fbc-e507-4ead-a669-2ba09f7b17a3", "address": "fa:16:3e:2c:d3:46", "network": {"id": "ee662ca7-2394-47b2-9487-d69b5736a12f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-259036580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "11f073a8bdbe4ac89c7beeb82fe458ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap75036fbc-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:52:09.766259 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a78eb3ca-ec05-4654-b7c7-64d20499b8b7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.531614 Sep 07 09:52:09.768152 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 924/1804] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:52:09.772930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Releasing lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:52:09.774118 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8299598-f9e6-4e02-840a-3b7a2fe59751 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action" status: 202 len: 0 microversion: 2.1 time: 7.350086 Sep 07 09:52:09.774923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:09.775549 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 881/1805] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:02 2022] POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action => generated 0 bytes in 7352 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:52:09.775918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:09.780670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db7ae44e-6fde-45dd-aebc-10953a223a33 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '.version_select at 0x7f14b24f1af0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:09.784227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db7ae44e-6fde-45dd-aebc-10953a223a33 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.784714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db7ae44e-6fde-45dd-aebc-10953a223a33 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.785154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db7ae44e-6fde-45dd-aebc-10953a223a33 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.789909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.790417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.791037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.794007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.794508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.797426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.800956 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db7ae44e-6fde-45dd-aebc-10953a223a33 tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 3120 microversion: 2.1 time: 0.023868 Sep 07 09:52:09.819076 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 882/1806] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:52:09 2022] GET /compute/v2.1/os-migrations => generated 3120 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:09.827759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b405645f-7757-4631-9973-cf047540b91f req-ceaa3b5a-263d-4618-a546-14952f14d453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9fd1dcd-54f3-40c3-834e-a6bda566c14c", "name": "network-vif-deleted", "tag": "b572c985-8b5e-4ce8-8806-bad655c54249"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:09.841514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b405645f-7757-4631-9973-cf047540b91f req-ceaa3b5a-263d-4618-a546-14952f14d453 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.842000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b405645f-7757-4631-9973-cf047540b91f req-ceaa3b5a-263d-4618-a546-14952f14d453 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.842526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b405645f-7757-4631-9973-cf047540b91f req-ceaa3b5a-263d-4618-a546-14952f14d453 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.867335 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b405645f-7757-4631-9973-cf047540b91f req-ceaa3b5a-263d-4618-a546-14952f14d453 service nova] Creating event network-vif-deleted:b572c985-8b5e-4ce8-8806-bad655c54249 for instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c on n-h2-836830-16 Sep 07 09:52:09.880082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b405645f-7757-4631-9973-cf047540b91f req-ceaa3b5a-263d-4618-a546-14952f14d453 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057474 Sep 07 09:52:09.884733 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 883/1807] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:09.890900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:09.891839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:09.904831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.905677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.906292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.907873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:09.908659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:09.909297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:09.953149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:10.275902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:10.287766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4da5717d-7171-4da0-8ecb-747f4c6d0101 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.518007 Sep 07 09:52:10.289091 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 925/1808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:09 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:10.294028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:10.295240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:10.303452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.304240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.304949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.305824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.306519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.307182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.359087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:10.368647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:10.388465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:10.390354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:10.391998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ff2d8666-968e-4e0f-8655-fd5d8b6f577a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.505881 Sep 07 09:52:10.393823 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 884/1809] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:09 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:10.401170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:10.402169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:10.405164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:10.416915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.417891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.419202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.420245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.422148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.423691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.441758 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] HTTP exception thrown: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Request method failure captured: Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 HTTP/1.1 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGkPv8Vm-I2XtrqnrTHjA2qWDqXyEgjyrjlO02cbHykeBNdUvm4kviDdZyHJHWcdbgPFTznYFXt6dHnzda7F0pWbpU3Qo3l2rIYmlt4qOwoWPj6t6_ook8m4A2E1rRPNwNWfoqL9Sp1py8fofLmXkKC50ApeSsRHJEiCIQu9f-_bGvU Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f8a9db3020244360892d02bb7d28aef6 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f8a9db3020244360892d02bb7d28aef6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f8a9db3020244360892d02bb7d28aef6 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachSCSIVolumeTestJSON-2111812821-project Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5b84fc9a49f4f73b2f09265acbbea35 Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2111812821-project Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '181cfb61-0e63-4cdb-91ba-06af35fa0dc1'} Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:10.445159 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:10.452595 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.454719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Returning 404 to user: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:10.456058 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-76d2da4c-97d5-402d-88fa-1f9fe97764cb tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 404 len: 111 microversion: 2.1 time: 0.060764 Sep 07 09:52:10.457171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 885/1810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:10 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:10.465145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:10.466125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 2717c69b-bd75-49f0-a800-a1af1885c602] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:10.474365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.475416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.476118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.477094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.477749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.478553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.496724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 2717c69b-bd75-49f0-a800-a1af1885c602 could not be found. Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 HTTP/1.1 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 2717c69b-bd75-49f0-a800-a1af1885c602 could not be found. Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2717c69b-bd75-49f0-a800-a1af1885c602'} Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2717c69b-bd75-49f0-a800-a1af1885c602 could not be found. Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2717c69b-bd75-49f0-a800-a1af1885c602 could not be found. Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:10.498524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2717c69b-bd75-49f0-a800-a1af1885c602 could not be found. Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:10.504190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 2717c69b-bd75-49f0-a800-a1af1885c602 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:10.505273 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a90a5fa6-4da1-4b0e-8329-38d0cb61dfc1 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602" status: 404 len: 111 microversion: 2.1 time: 0.043704 Sep 07 09:52:10.511605 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 886/1811] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:10 2022] GET /compute/v2.1/servers/2717c69b-bd75-49f0-a800-a1af1885c602 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:10.517705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2610561a-aac0-4fda-87de-517369a40eaa req-1cd79831-fd03-4063-a4c7-a2bd0b58ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2717c69b-bd75-49f0-a800-a1af1885c602", "name": "network-vif-deleted", "tag": "f4ea11e2-e449-4d81-97b6-6bb8deecff99"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:10.528349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2610561a-aac0-4fda-87de-517369a40eaa req-1cd79831-fd03-4063-a4c7-a2bd0b58ad5f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.529271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2610561a-aac0-4fda-87de-517369a40eaa req-1cd79831-fd03-4063-a4c7-a2bd0b58ad5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.529952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2610561a-aac0-4fda-87de-517369a40eaa req-1cd79831-fd03-4063-a4c7-a2bd0b58ad5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.546554 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2610561a-aac0-4fda-87de-517369a40eaa req-1cd79831-fd03-4063-a4c7-a2bd0b58ad5f service nova] Creating event network-vif-deleted:f4ea11e2-e449-4d81-97b6-6bb8deecff99 for instance 2717c69b-bd75-49f0-a800-a1af1885c602 on n-h2-836830-16 Sep 07 09:52:10.554121 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2610561a-aac0-4fda-87de-517369a40eaa req-1cd79831-fd03-4063-a4c7-a2bd0b58ad5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041384 Sep 07 09:52:10.555857 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 887/1812] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:10.563882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c47caf51-1fcc-49bb-81ed-cc35a89bc152 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:10.564995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c47caf51-1fcc-49bb-81ed-cc35a89bc152 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:10.675338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c47caf51-1fcc-49bb-81ed-cc35a89bc152 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:10.681083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:10.695225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3854cb1-3797-440b-a1ba-3fe44687df8a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1315 microversion: 2.1 time: 0.404701 Sep 07 09:52:10.695817 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 926/1813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:10 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:10.697675 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c47caf51-1fcc-49bb-81ed-cc35a89bc152 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1224 microversion: 2.1 time: 0.139727 Sep 07 09:52:10.698984 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 888/1814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:10 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:10.705451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:10.706330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:10.714894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e99d4e1-df27-4e6c-8744-ff708bb9b805 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '.version_select at 0x7f14b13bc700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:10.725749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.726511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.727149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:10.728042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:10.728657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:10.729317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.113255 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f2518bb-37ec-4abf-9f60-74f701da682b tempest-LiveMigrationTest-1916141443 tempest-LiveMigrationTest-1916141443-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1535 microversion: 2.1 time: 0.411635 Sep 07 09:52:11.132714 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 927/1815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:10 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1535 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:11.143347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f21f094a-95b3-4e82-b4f6-5aee6812d8f7 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '.version_select at 0x7f14b1842550>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:11.161259 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e99d4e1-df27-4e6c-8744-ff708bb9b805 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/b06fc6ee-afdb-4a7f-aad1-6f24c4f16859" status: 200 len: 184 microversion: 2.1 time: 0.460340 Sep 07 09:52:11.165401 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 889/1816] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:52:10 2022] GET /compute/v2.1/os-floating-ips/b06fc6ee-afdb-4a7f-aad1-6f24c4f16859 => generated 184 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:11.171034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:11.172408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:11.177906 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f21f094a-95b3-4e82-b4f6-5aee6812d8f7 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620481638" status: 202 len: 0 microversion: 2.1 time: 0.043318 Sep 07 09:52:11.179191 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 928/1817] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 09:52:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620481638 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:52:11.184447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.184713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:11.185319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:11.185524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.186149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.187042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.187969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.188577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.192721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.194092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.194816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.195737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.196563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.198798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.232322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:11.264014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:11.367515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c6982cb-9139-4688-a23b-31e6cc749e13 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 204 len: 0 microversion: 2.1 time: 0.185432 Sep 07 09:52:11.369885 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 929/1818] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:11 2022] DELETE /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:11.378119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.108"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:11.430034 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-47b976b3-0270-42a0-be75-54b3b92bd9ed tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 204 len: 0 microversion: 2.1 time: 0.263047 Sep 07 09:52:11.430875 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 890/1819] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:11 2022] DELETE /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:11.437811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:11.444218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:11.453063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.453913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.454338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.455118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.456173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.456711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.689391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:11.698336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.699120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.699740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.700624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.701271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.701875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.735221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:11.745803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3bb98260-fb23-425a-bf55-a310d2c35ed2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.313284 Sep 07 09:52:11.746718 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 891/1820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:11 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:11.769498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:11.770771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:11.791212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.793861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.794603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:11.807057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:11.813232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:11.813842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:12.113521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:52:12.114263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquired lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:52:12.309558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:12.325998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4f0fc13-10fa-45d0-9c62-58f49f8e3b32 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1388 microversion: 2.1 time: 0.565379 Sep 07 09:52:12.344157 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 892/1821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:11 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1388 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:12.359479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:12.361611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:12.376006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:12.376778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:12.378130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:12.379081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:12.380711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:12.381762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:12.702924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:12.715287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:12.718198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:12.719593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3389835c-8693-49b7-994c-06567f15f1fa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.373951 Sep 07 09:52:12.733058 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 893/1822] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:12 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:12.746189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:12.747282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:12.755707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:12.756615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:12.757416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:12.758294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:12.758977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:12.759790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:13.461615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:13.481152 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1ecb419-424b-4905-99ef-f9724504485f tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1473 microversion: 2.1 time: 0.746429 Sep 07 09:52:13.482396 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 894/1823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:12 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1473 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:13.492736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:13.493766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:13.503710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:13.504334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:13.505074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:13.513468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:13.513975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:13.514474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:13.771414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Building network info cache for instance {{(pid=128833) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:52:13.809386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:13.822819 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4327fc11-0fcd-42b0-a8ed-399e5866219c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1315 microversion: 2.1 time: 0.337068 Sep 07 09:52:13.825144 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 895/1824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:13 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:13.837952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:13.839165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:13.856986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:13.858934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:13.862330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:13.863317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:13.864028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:13.867292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:14.390849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:14.406978 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a955a5b-0470-446d-b105-1033d81babef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1324 microversion: 2.1 time: 0.577122 Sep 07 09:52:14.407572 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 896/1825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:13 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:14.425089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}, {"name": "network-changed", "server_uuid": "798bd295-ae8f-4655-9822-59beb0f4feec", "tag": "c9834ece-ee40-42d8-8586-dc75ffb96cc1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:14.440079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:14.440568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:14.441004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:14.476658 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] Creating event network-changed:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:52:14.477915 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] Creating event network-changed:c9834ece-ee40-42d8-8586-dc75ffb96cc1 for instance 798bd295-ae8f-4655-9822-59beb0f4feec on n-h1-836830-16 Sep 07 09:52:14.492796 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-55216563-4271-4147-b4be-3cd57c0fc979 req-5acec7fb-38bc-4a4f-83fa-9f998786e679 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083595 Sep 07 09:52:14.494164 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 897/1826] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:14.500198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:14.502069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:14.510236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:14.511131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:14.512337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:14.513296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:14.514081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:14.514889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:15.379492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:15.398667 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e3420c2-9243-482b-b684-4ce1bcd894d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.902779 Sep 07 09:52:15.413869 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 898/1827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:14 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:15.423268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:15.424168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:15.432916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:15.433691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:15.434365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:15.435285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:15.436431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:15.437033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:15.710296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:15.721887 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1bdf05df-a632-4659-9b57-696efa313df6 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1346 microversion: 2.1 time: 0.304091 Sep 07 09:52:15.722521 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 899/1828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:15 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1346 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:15.731368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:15.731981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:15.749748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:15.750245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:15.750682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:15.751476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:15.751934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:15.755318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.266080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Updating instance_info_cache with network_info: [{"id": "75036fbc-e507-4ead-a669-2ba09f7b17a3", "address": "fa:16:3e:2c:d3:46", "network": {"id": "ee662ca7-2394-47b2-9487-d69b5736a12f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-259036580-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "11f073a8bdbe4ac89c7beeb82fe458ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap75036fbc-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128833) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:52:16.283022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:16.298031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:16.299882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:16.301798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c676365a-d05d-4290-9a1e-4d8874cd45fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.577134 Sep 07 09:52:16.304031 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 900/1829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:15 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:16.309410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:16.310151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:16.321290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Releasing lock "refresh_cache-2c062b98-2f52-4320-aa74-b05a253c1809" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:52:16.322314 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dd7c385f-f41e-4931-ba3b-63b4076e5c08 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action" status: 202 len: 0 microversion: 2.1 time: 4.950809 Sep 07 09:52:16.325378 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 930/1830] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:11 2022] POST /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809/action => generated 0 bytes in 4954 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:52:16.339763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:16.340305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:16.350068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.350882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.351631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.352684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.353435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.354149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.371590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.373988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.375620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.378954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.382990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.384053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.507179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:16.522772 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f98d4473-438e-44c2-8632-f7f693830ea5 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 200 len: 1431 microversion: 2.1 time: 0.217648 Sep 07 09:52:16.523654 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 901/1831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:16 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 1431 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:16.529689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-062d790c-277a-4a1e-909f-d18647a0fb2c req-3ab2e555-1ee1-4d55-b3d9-17d0ce9c3d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd64d978-145d-4111-9586-e54b09d4a507", "tag": "a4a3031d-fcbf-4cb1-afc9-f3e8a5fb7e84"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:16.543360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-062d790c-277a-4a1e-909f-d18647a0fb2c req-3ab2e555-1ee1-4d55-b3d9-17d0ce9c3d43 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.544092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-062d790c-277a-4a1e-909f-d18647a0fb2c req-3ab2e555-1ee1-4d55-b3d9-17d0ce9c3d43 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.544724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-062d790c-277a-4a1e-909f-d18647a0fb2c req-3ab2e555-1ee1-4d55-b3d9-17d0ce9c3d43 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.563711 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-062d790c-277a-4a1e-909f-d18647a0fb2c req-3ab2e555-1ee1-4d55-b3d9-17d0ce9c3d43 service nova] Creating event network-changed:a4a3031d-fcbf-4cb1-afc9-f3e8a5fb7e84 for instance dd64d978-145d-4111-9586-e54b09d4a507 on n-h2-836830-16 Sep 07 09:52:16.570356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-062d790c-277a-4a1e-909f-d18647a0fb2c req-3ab2e555-1ee1-4d55-b3d9-17d0ce9c3d43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045317 Sep 07 09:52:16.573417 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 902/1832] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:16.581112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:16.583020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:16.591334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.593486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.594262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.595005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.595675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.596287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.841836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:16.852350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cb97031-76d2-48c4-b075-291a4b9ecbc6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1315 microversion: 2.1 time: 0.525767 Sep 07 09:52:16.852937 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 931/1833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:16 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:16.876758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:16.878566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:16.909694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.910416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.911335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.912747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:16.913431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:16.914032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:16.968876 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] HTTP exception thrown: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Request method failure captured: Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c HTTP/1.1 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGlxR_v-OoPITFb5Ohrwvd1tUrUsWWCUkflF0pfrsk4-BQjGvtVcmVdZY3iU-UuNBLDkOPKzSn3xNZzVBrN_B0HSufvjzZ56j6hfBVBHBmfucX-5W8cQFLvMEqbZeZtMxxj-OfDpNySBZiKd1P9qcJZhGqhfbPcOKG0uv30YnnSAYio Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11f073a8bdbe4ac89c7beeb82fe458ce", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 46e1e110e1c74e4cb394d94906fd3c52 Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'c9fd1dcd-54f3-40c3-834e-a6bda566c14c'} Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:16.975133 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Returning 404 to user: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:16.981095 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60dda4ac-3de7-4e79-8a7f-ba4ebe6691d1 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 404 len: 111 microversion: 2.1 time: 0.124770 Sep 07 09:52:16.985041 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 932/1834] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:16 2022] DELETE /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:17.003580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:17.005931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:17.020376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.020872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.021442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.022160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.022615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.023024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.054249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:17.080596 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d4a7631-743d-4935-a4e8-3fe444c4dabf tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1324 microversion: 2.1 time: 0.503990 Sep 07 09:52:17.082790 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 903/1835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:16 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:17.094989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-52e75fa4-b56a-4843-af51-d0f2d3e942fe req-517542fb-b63e-48b6-b4dc-11b9a1f6d004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:17.118266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-52e75fa4-b56a-4843-af51-d0f2d3e942fe req-517542fb-b63e-48b6-b4dc-11b9a1f6d004 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.118753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-52e75fa4-b56a-4843-af51-d0f2d3e942fe req-517542fb-b63e-48b6-b4dc-11b9a1f6d004 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.121354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-52e75fa4-b56a-4843-af51-d0f2d3e942fe req-517542fb-b63e-48b6-b4dc-11b9a1f6d004 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.164192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-52e75fa4-b56a-4843-af51-d0f2d3e942fe req-517542fb-b63e-48b6-b4dc-11b9a1f6d004 service nova] Creating event network-changed:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:52:17.171023 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-52e75fa4-b56a-4843-af51-d0f2d3e942fe req-517542fb-b63e-48b6-b4dc-11b9a1f6d004 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086002 Sep 07 09:52:17.172252 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 904/1836] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:17.179388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:17.180611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:17.189169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.189991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.190739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.192353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.193228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.194177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.232118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:17.436201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:17.455050 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46b74ab5-596d-4f84-8a42-da31139aea81 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1184 microversion: 2.1 time: 0.276914 Sep 07 09:52:17.459782 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 905/1837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:17 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1184 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:17.469962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:17.470964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: c9fd1dcd-54f3-40c3-834e-a6bda566c14c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:17.479660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.480526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.481312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.482322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.483014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.483701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.504085 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] HTTP exception thrown: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Request method failure captured: Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c HTTP/1.1 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGlxR_v-OoPITFb5Ohrwvd1tUrUsWWCUkflF0pfrsk4-BQjGvtVcmVdZY3iU-UuNBLDkOPKzSn3xNZzVBrN_B0HSufvjzZ56j6hfBVBHBmfucX-5W8cQFLvMEqbZeZtMxxj-OfDpNySBZiKd1P9qcJZhGqhfbPcOKG0uv30YnnSAYio Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11f073a8bdbe4ac89c7beeb82fe458ce", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46e1e110e1c74e4cb394d94906fd3c52 Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'c9fd1dcd-54f3-40c3-834e-a6bda566c14c'} Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:17.506270 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. Sep 07 09:52:17.511168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:17.514778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Returning 404 to user: Instance c9fd1dcd-54f3-40c3-834e-a6bda566c14c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:17.516712 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d5b727e-6272-411d-a573-d7fca807a7cd tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c" status: 404 len: 111 microversion: 2.1 time: 0.054908 Sep 07 09:52:17.517990 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 906/1838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:17 2022] GET /compute/v2.1/servers/c9fd1dcd-54f3-40c3-834e-a6bda566c14c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:17.537537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:17.541408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:17.571981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.574088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.577123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.578213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:17.584891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:17.585538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:17.641860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:17.663135 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a57f57a-31f2-44a1-9514-6d75ea0e0954 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.678124 Sep 07 09:52:17.676884 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 933/1839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:16 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:17.691475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4019a81d-dc18-4b38-af8e-4797a3f6f122 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '.version_select at 0x7f14b17bd8b0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:18.702723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:18.712012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:18.723723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:18.725079 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc107d6c-b990-4daf-bb5c-428ea68dcd63 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 1.205694 Sep 07 09:52:18.725784 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 907/1840] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:17 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:18.738341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:18.739867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6faa6ea3-74e8-46e7-bec2-3bf266377113] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:18.751363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:18.752080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:18.752735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:18.753674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:18.754980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:18.755695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:18.772747 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 could not be found. Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 HTTP/1.1 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 could not be found. Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6faa6ea3-74e8-46e7-bec2-3bf266377113'} Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 could not be found. Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 could not be found. Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:18.774606 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 could not be found. Sep 07 09:52:18.779889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:18.780477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:18.780847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d86d3e76-7990-450c-8edb-6eb218e89d5e tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113" status: 404 len: 111 microversion: 2.1 time: 0.053874 Sep 07 09:52:18.781895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 908/1841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:18 2022] GET /compute/v2.1/servers/6faa6ea3-74e8-46e7-bec2-3bf266377113 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:18.789538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-87f2638b-6041-4da9-9390-3d9638c3476d req-80bc98f6-7e62-46bf-af11-8ae7df914ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798bd295-ae8f-4655-9822-59beb0f4feec", "name": "network-vif-plugged", "status": "completed", "tag": "c9834ece-ee40-42d8-8586-dc75ffb96cc1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:18.800069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87f2638b-6041-4da9-9390-3d9638c3476d req-80bc98f6-7e62-46bf-af11-8ae7df914ee4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:18.800549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87f2638b-6041-4da9-9390-3d9638c3476d req-80bc98f6-7e62-46bf-af11-8ae7df914ee4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:18.800981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87f2638b-6041-4da9-9390-3d9638c3476d req-80bc98f6-7e62-46bf-af11-8ae7df914ee4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:18.813584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-87f2638b-6041-4da9-9390-3d9638c3476d req-80bc98f6-7e62-46bf-af11-8ae7df914ee4 service nova] Creating event network-vif-plugged:c9834ece-ee40-42d8-8586-dc75ffb96cc1 for instance 798bd295-ae8f-4655-9822-59beb0f4feec on n-h1-836830-16 Sep 07 09:52:18.823297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-87f2638b-6041-4da9-9390-3d9638c3476d req-80bc98f6-7e62-46bf-af11-8ae7df914ee4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039945 Sep 07 09:52:18.824762 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 909/1842] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:18.832413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:18.833766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:18.841777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:18.842315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:18.842824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:18.843658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:18.844137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:18.844564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:19.330650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:19.344785 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe733582-f4ff-4451-a88e-8dee15b5e76f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1315 microversion: 2.1 time: 0.518373 Sep 07 09:52:19.346252 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 910/1843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:18 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:19.355024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:19.356061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:19.365582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:19.366435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:19.367082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:19.370678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:19.371847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:19.372475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:19.656537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:19.684139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:19.905429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:19.915720 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6182583-40e1-4b7d-8275-433f7ced22af tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1324 microversion: 2.1 time: 0.567892 Sep 07 09:52:19.929636 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 911/1844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:19 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:19.949466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:19.950462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:19.959652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:19.960580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:19.961324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:19.962305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:19.963027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:19.963770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.134502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:20.146791 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9fef710f-8230-4cfb-af42-8093536aa957 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1184 microversion: 2.1 time: 0.214888 Sep 07 09:52:20.148327 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 912/1845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:19 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1184 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:20.154123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-231b51e3-5ed2-4768-8dab-5581d01c5d77 req-eb0943a5-103f-4de8-9b8b-a605ac6fa763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891829aa-74cd-42e3-a67c-eb136af6b32c", "name": "network-vif-deleted", "tag": "b2432ae8-6727-4d23-b5bf-863869d42ff6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:20.198859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-231b51e3-5ed2-4768-8dab-5581d01c5d77 req-eb0943a5-103f-4de8-9b8b-a605ac6fa763 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.200177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-231b51e3-5ed2-4768-8dab-5581d01c5d77 req-eb0943a5-103f-4de8-9b8b-a605ac6fa763 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.201005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-231b51e3-5ed2-4768-8dab-5581d01c5d77 req-eb0943a5-103f-4de8-9b8b-a605ac6fa763 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.226716 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-231b51e3-5ed2-4768-8dab-5581d01c5d77 req-eb0943a5-103f-4de8-9b8b-a605ac6fa763 service nova] Creating event network-vif-deleted:b2432ae8-6727-4d23-b5bf-863869d42ff6 for instance 891829aa-74cd-42e3-a67c-eb136af6b32c on n-h1-836830-16 Sep 07 09:52:20.238791 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-231b51e3-5ed2-4768-8dab-5581d01c5d77 req-eb0943a5-103f-4de8-9b8b-a605ac6fa763 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087292 Sep 07 09:52:20.241042 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 913/1846] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:20.252107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:20.253650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:20.266936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.268298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.269414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.272709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.274381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.275086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.682445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:20.686153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4019a81d-dc18-4b38-af8e-4797a3f6f122 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/b06fc6ee-afdb-4a7f-aad1-6f24c4f16859" status: 202 len: 0 microversion: 2.1 time: 2.998337 Sep 07 09:52:20.686826 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 934/1847] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:52:17 2022] DELETE /compute/v2.1/os-floating-ips/b06fc6ee-afdb-4a7f-aad1-6f24c4f16859 => generated 0 bytes in 3009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:52:20.695550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:20.697855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:20.700242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:20.712398 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72c3e145-37c5-4382-8ecd-3f657a9aa99b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.467311 Sep 07 09:52:20.713438 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 914/1848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:20 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:20.720351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.721932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.723641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.726149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.726875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.728727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.738406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6c112c60-9389-4190-aefa-09b8304cba15 req-a888f71e-c1af-4ca2-926e-482c360bf38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faa6ea3-74e8-46e7-bec2-3bf266377113", "name": "network-vif-deleted", "tag": "8aae2f40-c0c3-43d1-abf4-5197e9c32c5a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:20.752609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6c112c60-9389-4190-aefa-09b8304cba15 req-a888f71e-c1af-4ca2-926e-482c360bf38c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.753675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6c112c60-9389-4190-aefa-09b8304cba15 req-a888f71e-c1af-4ca2-926e-482c360bf38c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.755688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6c112c60-9389-4190-aefa-09b8304cba15 req-a888f71e-c1af-4ca2-926e-482c360bf38c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.777808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6c112c60-9389-4190-aefa-09b8304cba15 req-a888f71e-c1af-4ca2-926e-482c360bf38c service nova] Creating event network-vif-deleted:8aae2f40-c0c3-43d1-abf4-5197e9c32c5a for instance 6faa6ea3-74e8-46e7-bec2-3bf266377113 on n-h1-836830-16 Sep 07 09:52:20.783522 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6c112c60-9389-4190-aefa-09b8304cba15 req-a888f71e-c1af-4ca2-926e-482c360bf38c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061902 Sep 07 09:52:20.784771 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 915/1849] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:20.793391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:20.795595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:20.795736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:20.802795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.803636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.804357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.805344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.806126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.807077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.927287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-87738a2a-1eba-4883-a4e7-7d95e2e17073 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 204 len: 0 microversion: 2.1 time: 0.237692 Sep 07 09:52:20.928759 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 935/1850] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:20 2022] DELETE /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:20.936062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:20.937096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:20.946506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.947450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.948219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:20.949577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:20.950254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:20.951066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.026390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.042902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.045889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.047229 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f37f8af-94ae-460f-9d84-60383e05747d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.259263 Sep 07 09:52:21.048727 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 916/1851] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:20 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:21.059251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.060129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.072559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.073054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.073530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.074229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.074678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.075134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.106882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:21.130001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.139886 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cc68d14-1dd2-421c-8255-ce42fcad2155 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1315 microversion: 2.1 time: 0.209651 Sep 07 09:52:21.141695 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 936/1852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:20 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:21.147867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.148690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.155789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.156920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.157646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.158610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.159294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.159801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.178555 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] HTTP exception thrown: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Request method failure captured: Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 HTTP/1.1 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGkPv8Vm-I2XtrqnrTHjA2qWDqXyEgjyrjlO02cbHykeBNdUvm4kviDdZyHJHWcdbgPFTznYFXt6dHnzda7F0pWbpU3Qo3l2rIYmlt4qOwoWPj6t6_ook8m4A2E1rRPNwNWfoqL9Sp1py8fofLmXkKC50ApeSsRHJEiCIQu9f-_bGvU Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f8a9db3020244360892d02bb7d28aef6 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f8a9db3020244360892d02bb7d28aef6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f8a9db3020244360892d02bb7d28aef6 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachSCSIVolumeTestJSON-2111812821-project Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5b84fc9a49f4f73b2f09265acbbea35 Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2111812821-project Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '181cfb61-0e63-4cdb-91ba-06af35fa0dc1'} Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:21.180730 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.186196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Returning 404 to user: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:21.187240 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-847800f8-6027-4998-abaa-c47e4aac8150 tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 404 len: 111 microversion: 2.1 time: 0.041316 Sep 07 09:52:21.188139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 937/1853] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:21 2022] DELETE /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:21.196718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.197815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.205574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.206317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.206939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.208067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.209007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.209824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.227425 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b91ee2d-7f06-43f0-8577-3c73ff0b38ec tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 204 len: 0 microversion: 2.1 time: 0.173229 Sep 07 09:52:21.231043 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 917/1854] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:21 2022] DELETE /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:21.239515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.240319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.246824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:21.249209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.251946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.252703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.253624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.253905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.254392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.475258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.491016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b8f1511-b819-4319-baa9-87593e87e401 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1473 microversion: 2.1 time: 0.300663 Sep 07 09:52:21.493082 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 938/1855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:21 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:21.494680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.498858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.499985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.504317 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79aeca10-b1b0-46e9-a07d-fa5ebeefb0c0 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1324 microversion: 2.1 time: 0.274799 Sep 07 09:52:21.508934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.509793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.510494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.511430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.512128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.513742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.518174 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 918/1856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:21 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:21.527078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.527708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] [instance: 181cfb61-0e63-4cdb-91ba-06af35fa0dc1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.536166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.536669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.537148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.537898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.538360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.538791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.554681 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] HTTP exception thrown: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Request method failure captured: Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 HTTP/1.1 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGkPv8Vm-I2XtrqnrTHjA2qWDqXyEgjyrjlO02cbHykeBNdUvm4kviDdZyHJHWcdbgPFTznYFXt6dHnzda7F0pWbpU3Qo3l2rIYmlt4qOwoWPj6t6_ook8m4A2E1rRPNwNWfoqL9Sp1py8fofLmXkKC50ApeSsRHJEiCIQu9f-_bGvU Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f8a9db3020244360892d02bb7d28aef6 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8a9db3020244360892d02bb7d28aef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f8a9db3020244360892d02bb7d28aef6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f8a9db3020244360892d02bb7d28aef6 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2111812821 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachSCSIVolumeTestJSON-2111812821-project Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5b84fc9a49f4f73b2f09265acbbea35 Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2111812821-project Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '181cfb61-0e63-4cdb-91ba-06af35fa0dc1'} Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:21.556497 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] Returning 404 to user: Instance 181cfb61-0e63-4cdb-91ba-06af35fa0dc1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e67ef3e-4c7f-4bb8-8908-0de540d7735c tempest-AttachSCSIVolumeTestJSON-2111812821 tempest-AttachSCSIVolumeTestJSON-2111812821-project] 10.222.0.60 "GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1" status: 404 len: 111 microversion: 2.1 time: 0.038153 Sep 07 09:52:21.561039 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 919/1857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:21 2022] GET /compute/v2.1/servers/181cfb61-0e63-4cdb-91ba-06af35fa0dc1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:21.564281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.564913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.586727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.593296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.594001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.594765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.595233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.595671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.633815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.643012 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90da7573-c4d4-48e3-aba0-8da830596d76 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1184 microversion: 2.1 time: 0.148596 Sep 07 09:52:21.646823 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 939/1858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:21 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1184 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:21.735992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:21.738291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:21.746461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.747738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.749439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.750352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:21.751599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:21.752232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:21.886464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.900358 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f382c8bf-857c-4e44-856a-06998f37565f tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1525 microversion: 2.1 time: 0.339962 Sep 07 09:52:21.901816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 920/1859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:21 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1525 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:21.962204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:21.974093 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f98749fa-85e7-4c3d-ae11-884ed1604373 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1521 microversion: 2.1 time: 0.241090 Sep 07 09:52:21.989864 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 940/1860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:21 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:52:22.073902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:22.074510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:22.089972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.090747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.091372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.092267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.092909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.093372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.166876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:22.167493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:22.176124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.176829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.177284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.188311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.188926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.189422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.344599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:22.359221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:22.360936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:22.362309 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-919b5fa4-e556-4f9d-81a0-d48b7bc5a8d5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.292285 Sep 07 09:52:22.363416 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 921/1861] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:22 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:22.396655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:22.405546 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8142c121-d52b-4c82-b984-b6217eed495c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1502 microversion: 2.1 time: 0.242515 Sep 07 09:52:22.407990 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 941/1862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:22 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:52:22.519253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:22.520542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:22.530010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.530715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.531157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.532288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.532636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:22.532901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.533509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:22.533774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.540871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.541572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.542094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.542887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.543592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.544264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.811656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:22.824992 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e9bd8060-7aed-4abc-a027-028ca39fa382 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1473 microversion: 2.1 time: 0.312543 Sep 07 09:52:22.832960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:22.840027 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 922/1863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:22 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:22.842714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cae15008-e666-419f-882c-bffc97de9592 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1324 microversion: 2.1 time: 0.315284 Sep 07 09:52:22.847543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:22.861865 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 942/1864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:22 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:22.869074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:22.886002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.888573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.890580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.893771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.895278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.896595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.926822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:22.928012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:22.937305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.937783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.938228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:22.939004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:22.939532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:22.940065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:23.610868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:23.626466 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82ebb48b-bf02-4975-9f11-10c761d279ad tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 200 len: 1184 microversion: 2.1 time: 0.782380 Sep 07 09:52:23.637721 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 923/1865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:22 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 1184 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:23.653448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:23.654440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:23.673886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:23.680002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:23.680706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:23.681903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:23.683556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:23.687588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:23.729107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:24.092400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:24.101445 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2f141b0-81a2-446f-9c71-d38fc18e1944 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1525 microversion: 2.1 time: 1.179380 Sep 07 09:52:24.109105 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 943/1866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:22 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1525 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:24.117687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:24.122521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:24.144693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.146180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.146899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:24.147905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.148600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.149301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:24.567958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:24.579340 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36b03824-d872-442d-9c31-0fa3663d541d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1501 microversion: 2.1 time: 0.936934 Sep 07 09:52:24.580587 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 924/1867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:23 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1501 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:24.587702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-27f4ba5d-a1c8-4134-8d7e-233f8c81f529 req-17e0d729-c258-4ae2-8eb7-1f0a821570cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd64d978-145d-4111-9586-e54b09d4a507", "name": "network-vif-plugged", "status": "completed", "tag": "a4a3031d-fcbf-4cb1-afc9-f3e8a5fb7e84"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:24.601009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-27f4ba5d-a1c8-4134-8d7e-233f8c81f529 req-17e0d729-c258-4ae2-8eb7-1f0a821570cf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.601900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-27f4ba5d-a1c8-4134-8d7e-233f8c81f529 req-17e0d729-c258-4ae2-8eb7-1f0a821570cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.603135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-27f4ba5d-a1c8-4134-8d7e-233f8c81f529 req-17e0d729-c258-4ae2-8eb7-1f0a821570cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:24.626563 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-27f4ba5d-a1c8-4134-8d7e-233f8c81f529 req-17e0d729-c258-4ae2-8eb7-1f0a821570cf service nova] Creating event network-vif-plugged:a4a3031d-fcbf-4cb1-afc9-f3e8a5fb7e84 for instance dd64d978-145d-4111-9586-e54b09d4a507 on n-h2-836830-16 Sep 07 09:52:24.632996 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-27f4ba5d-a1c8-4134-8d7e-233f8c81f529 req-17e0d729-c258-4ae2-8eb7-1f0a821570cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050701 Sep 07 09:52:24.633979 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 925/1868] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:24.641318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:24.642830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:24.646860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:24.651770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.652551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.653164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:24.654212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.654850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.656029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:24.661754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:24.675310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:24.679291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:24.683753 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9747b82a-1eec-45fe-b424-0fb95db84e3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.573182 Sep 07 09:52:24.686624 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 944/1869] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:24 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:24.694599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:24.702318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:24.716941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.717767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.718434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:24.719361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:24.720021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:24.720633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:25.463628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:25.471454 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c39ae177-08ec-4325-9832-89318fdece7d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1473 microversion: 2.1 time: 0.835129 Sep 07 09:52:25.485602 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 926/1870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:24 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1473 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:25.492978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:25.493847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:25.500650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:25.501472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:25.502134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:25.503004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:25.503622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:25.504767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:25.694317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:25.703929 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d00ee9aa-050b-496c-98f3-80b3d8bb44a4 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1324 microversion: 2.1 time: 1.015982 Sep 07 09:52:25.704606 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 945/1871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:24 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1324 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:25.712323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:25.713216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 891829aa-74cd-42e3-a67c-eb136af6b32c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:25.719963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:25.720741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:25.721482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:25.733223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:25.735229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:25.735647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:25.755721 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] HTTP exception thrown: Instance 891829aa-74cd-42e3-a67c-eb136af6b32c could not be found. Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Request method failure captured: Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c HTTP/1.1 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgU8Dq8llGl0zZ4fUfEsLIYqnR5cZ0B3FD1FHdnkRd8e1cdtfpLeVGYIvZZQNTr-aXsxz36ysIFJYaU7YINgKS3xa5moTFRudGphi_UwJ0MbLSVFT5jeY0cX6L6HsE8ppcpHdR01-AhjdwDW8dHQwNqfl-Owp1xq72P8lRysHThu6I Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_913dc4cafc574c08a81d9f473a935e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveMigrationTest-7365876 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveMigrationTest-7365876-project Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 224142a6fa7e4702b1780f4aaeb3f93f Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveMigrationTest-7365876-project Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 891829aa-74cd-42e3-a67c-eb136af6b32c could not be found. Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '891829aa-74cd-42e3-a67c-eb136af6b32c'} Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 891829aa-74cd-42e3-a67c-eb136af6b32c could not be found. Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 891829aa-74cd-42e3-a67c-eb136af6b32c could not be found. Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:25.759144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:25.766521 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:25.766521 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:25.766521 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:25.766521 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:25.766521 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 891829aa-74cd-42e3-a67c-eb136af6b32c could not be found. Sep 07 09:52:25.766521 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:25.768471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Returning 404 to user: Instance 891829aa-74cd-42e3-a67c-eb136af6b32c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:25.770744 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6b7d9ea-97d4-43ad-b41b-ebd75cf8a71e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c" status: 404 len: 111 microversion: 2.1 time: 0.063908 Sep 07 09:52:25.771960 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 946/1872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:25 2022] GET /compute/v2.1/servers/891829aa-74cd-42e3-a67c-eb136af6b32c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:25.779418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:25.780622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:25.788756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:25.790218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:25.791915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:25.793960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:25.795088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:25.796276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:26.123887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:26.154385 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1feefb6e-75c2-49b2-9b6a-1b5df1302819 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1483 microversion: 2.1 time: 0.380332 Sep 07 09:52:26.154986 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 947/1873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:25 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1483 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:26.199662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:26.203385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de669398-5342-400a-90db-b6460503375b"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:26.208424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:26.224165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:26.225106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:26.226160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:26.227208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:26.229977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:26.233562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:26.250674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-32a279b4-41cf-4300-8850-bd2c79e62ec0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1513 microversion: 2.1 time: 0.763582 Sep 07 09:52:26.258192 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 927/1874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:25 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1513 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:26.298657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:26.304714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:26.323041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:26.334232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:26.338007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:26.343120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:26.346125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:26.349030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:26.954006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:26.967329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:26.968813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:26.972574 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e59670ad-ecf4-42af-99d3-52e9da1b994b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.691878 Sep 07 09:52:26.976253 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 928/1875] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:26 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:26.994445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3e4fc9db-0d96-441b-85a5-2b20b4ab5781 req-f5361ffb-ecdf-4f24-8446-e9bcacad8bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df62c8a-df0b-4ced-9622-672ef367267a", "name": "network-vif-unplugged", "status": "completed", "tag": "49013a88-e454-4b51-97e1-25fc306b2a50"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:27.046560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e4fc9db-0d96-441b-85a5-2b20b4ab5781 req-f5361ffb-ecdf-4f24-8446-e9bcacad8bb5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.059518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e4fc9db-0d96-441b-85a5-2b20b4ab5781 req-f5361ffb-ecdf-4f24-8446-e9bcacad8bb5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.059973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e4fc9db-0d96-441b-85a5-2b20b4ab5781 req-f5361ffb-ecdf-4f24-8446-e9bcacad8bb5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.110377 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3e4fc9db-0d96-441b-85a5-2b20b4ab5781 req-f5361ffb-ecdf-4f24-8446-e9bcacad8bb5 service nova] Creating event network-vif-unplugged:49013a88-e454-4b51-97e1-25fc306b2a50 for instance 6df62c8a-df0b-4ced-9622-672ef367267a on n-h2-836830-16 Sep 07 09:52:27.163646 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3e4fc9db-0d96-441b-85a5-2b20b4ab5781 req-f5361ffb-ecdf-4f24-8446-e9bcacad8bb5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176803 Sep 07 09:52:27.164051 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 929/1876] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:27.214639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-edd11331-8bcd-4d07-8d61-972d50e1439e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:27.263355 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c4befd1-acca-432b-aa1f-fb0fe68d8738 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081900 Sep 07 09:52:27.273069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-edd11331-8bcd-4d07-8d61-972d50e1439e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:27.277474 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 948/1877] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 09:52:26 2022] POST /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec/os-volume_attachments => generated 194 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:27.325496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-edd11331-8bcd-4d07-8d61-972d50e1439e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Instance 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5 could not be found. Sep 07 09:52:27.332020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:27.340272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-edd11331-8bcd-4d07-8d61-972d50e1439e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5/action HTTP/1.1 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 14 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: {"rescue": {}} Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5 could not be found. Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5', 'body': {'rescue': {}}} Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5 could not be found. Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5 could not be found. Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:27.353544 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5 could not be found. Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-edd11331-8bcd-4d07-8d61-972d50e1439e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 404 to user: Instance 52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:27.358314 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-edd11331-8bcd-4d07-8d61-972d50e1439e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5/action" status: 404 len: 111 microversion: 2.1 time: 0.191287 Sep 07 09:52:27.362751 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 930/1878] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:27 2022] POST /compute/v2.1/servers/52e38eb4-0bd9-42ba-b0d7-3dc1c6fc9cd5/action => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:27.376309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.376814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.381774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:27.383939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:27.399812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.401439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.401957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.408698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.430428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.432901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.437897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.440671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.441199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.444988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.552990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.553961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.555545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.557331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lazy-loading 'fault' on Instance uuid 087d933a-f15a-4ec9-a0cb-c02cc0afa064 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:27.821647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:27.838890 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed100f02-e097-4a97-aa67-3574768a8430 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 200 len: 1307 microversion: 2.1 time: 0.553652 Sep 07 09:52:27.844599 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 949/1879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:27 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 1307 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:27.852091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:27.852857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:27.872252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.874763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.875340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.876227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.877839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.879604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.922204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:27.935184 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c85b9e04-fdf4-4dc5-8c6e-ec3acafe74f7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1521 microversion: 2.1 time: 0.571275 Sep 07 09:52:27.936376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 931/1880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:27 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:27.941202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:27.945994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.946819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.946978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:27.947692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.948600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lazy-loading 'fault' on Instance uuid 2c062b98-2f52-4320-aa74-b05a253c1809 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:27.961518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.962010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.962475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:27.963222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:27.963883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:27.965796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.032504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e1e110e1c74e4cb394d94906fd3c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f073a8bdbe4ac89c7beeb82fe458ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:28.048006 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-747ea6fa-2a15-4c58-b336-ad8ae716d3ed tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 200 len: 1314 microversion: 2.1 time: 0.200939 Sep 07 09:52:28.049973 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 950/1881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:27 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:28.078161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.081639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:28.107012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.108349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.110664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.115219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.117011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.118531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.169103 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-11ad78b7-5d1c-49c7-8e23-8f3e0478fbd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action" status: 202 len: 0 microversion: 2.1 time: 0.229059 Sep 07 09:52:28.177866 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 932/1882] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:27 2022] POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:52:28.197674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.202056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:28.228523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.230013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.231394 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] HTTP exception thrown: Action 999 not found Sep 07 09:52:28.231908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.234698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.236583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Request method failure captured: Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507/os-instance-actions/999 HTTP/1.1 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGnE5bjH6OmDy1cqoUCecAuVGBoZWAkRFc95GaPIw0Jzyb2xc_aPzZvNoLjIVkY_aTeOXXTzkBz-RPbSOF2MkTKUBMMpcvA20CyDu6Etx3H0slo6ck9SX8rs0bo5JNGln89bAby2RmHmfsCD2OKFvQH7ZPwHLSLhXG0kuxmWx6PB9Xg Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ec3f5d14bd094e1b80baadc786ee4210 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec3f5d14bd094e1b80baadc786ee4210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ec3f5d14bd094e1b80baadc786ee4210 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-InstanceActionsNegativeTestJSON-1113189521-project Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a6d9f9ab444f49cd95c63dda1087bcb9 Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1113189521-project Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: exception: Action 999 not found Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': 'dd64d978-145d-4111-9586-e54b09d4a507', 'id': '999'} Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 07 09:52:28.237653 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.243394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.246409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Returning 404 to user: Action 999 not found {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:28.247559 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b71676c-9fbd-4fdc-abc6-e64f301c71c7 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.196406 Sep 07 09:52:28.249389 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 951/1883] 10.222.0.60 () {58 vars in 1308 bytes} [Wed Sep 7 09:52:28 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507/os-instance-actions/999 => generated 66 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:52:28.267656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.272485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:28.290445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.293498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.294225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.295486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.300313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.301116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.839469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:28.867231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:28.869635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:28.872364 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13bc281e-37b4-4bf4-b3e5-5bc222ee85d3 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.692871 Sep 07 09:52:28.874664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:28.892090 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 933/1884] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:28 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:28.898506 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91647365-6905-4d75-9d4a-7969cbbb399c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1518 microversion: 2.1 time: 0.647624 Sep 07 09:52:28.899605 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 952/1885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:28 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1518 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:28.911866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.912814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 087d933a-f15a-4ec9-a0cb-c02cc0afa064] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:28.924554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee80de06-3ab4-412e-bfa2-42558b69e9ce tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '.version_select at 0x7f14b133b3a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.925671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ee80de06-3ab4-412e-bfa2-42558b69e9ce tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: e46cb376-a400-4606-bc3c-b9bc1a5cfc51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:28.931974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.932472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.932918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.933658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:28.934233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:28.934669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:28.938253 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ee80de06-3ab4-412e-bfa2-42558b69e9ce tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] HTTP exception thrown: Instance e46cb376-a400-4606-bc3c-b9bc1a5cfc51 could not be found. Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee80de06-3ab4-412e-bfa2-42558b69e9ce tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Request method failure captured: Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e46cb376-a400-4606-bc3c-b9bc1a5cfc51/os-instance-actions HTTP/1.1 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGnE5bjH6OmDy1cqoUCecAuVGBoZWAkRFc95GaPIw0Jzyb2xc_aPzZvNoLjIVkY_aTeOXXTzkBz-RPbSOF2MkTKUBMMpcvA20CyDu6Etx3H0slo6ck9SX8rs0bo5JNGln89bAby2RmHmfsCD2OKFvQH7ZPwHLSLhXG0kuxmWx6PB9Xg Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: ec3f5d14bd094e1b80baadc786ee4210 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec3f5d14bd094e1b80baadc786ee4210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: ec3f5d14bd094e1b80baadc786ee4210 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-InstanceActionsNegativeTestJSON-1113189521-project Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a6d9f9ab444f49cd95c63dda1087bcb9 Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1113189521-project Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e46cb376-a400-4606-bc3c-b9bc1a5cfc51 could not be found. Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': 'e46cb376-a400-4606-bc3c-b9bc1a5cfc51'} Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46cb376-a400-4606-bc3c-b9bc1a5cfc51 could not be found. Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:28.946236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46cb376-a400-4606-bc3c-b9bc1a5cfc51 could not be found. Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46cb376-a400-4606-bc3c-b9bc1a5cfc51 could not be found. Sep 07 09:52:28.952612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.959334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee80de06-3ab4-412e-bfa2-42558b69e9ce tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Returning 404 to user: Instance e46cb376-a400-4606-bc3c-b9bc1a5cfc51 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:28.962869 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee80de06-3ab4-412e-bfa2-42558b69e9ce tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/e46cb376-a400-4606-bc3c-b9bc1a5cfc51/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.055679 Sep 07 09:52:28.964829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 934/1886] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 7 09:52:28 2022] GET /compute/v2.1/servers/e46cb376-a400-4606-bc3c-b9bc1a5cfc51/os-instance-actions => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:28.966006 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 could not be found. Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 HTTP/1.1 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 could not be found. Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '087d933a-f15a-4ec9-a0cb-c02cc0afa064'} Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 could not be found. Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 could not be found. Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:28.971832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 could not be found. Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf92c39f-8520-4d16-b568-7b9da1eb0a58 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064" status: 404 len: 111 microversion: 2.1 time: 0.073182 Sep 07 09:52:28.981642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 953/1887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:28 2022] GET /compute/v2.1/servers/087d933a-f15a-4ec9-a0cb-c02cc0afa064 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:28.988183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.990324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:28.990945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:28.994368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:29.007413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.007913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.008353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.009065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.009557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.009982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.033460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.038735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.041928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.043751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.045899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.048169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.058771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:29.082643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:29.127723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:29.253230 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1cf41185-ab1b-412a-ac0c-031a33857eef tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 204 len: 0 microversion: 2.1 time: 0.282194 Sep 07 09:52:29.254629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 935/1888] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:28 2022] DELETE /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:29.260224 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b8b0b06-2e0d-4808-84dc-d2901ce22fc3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 204 len: 0 microversion: 2.1 time: 0.280486 Sep 07 09:52:29.261582 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 954/1889] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:28 2022] DELETE /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:29.268841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c062b98-2f52-4320-aa74-b05a253c1809", "name": "network-vif-deleted", "tag": "75036fbc-e507-4ead-a669-2ba09f7b17a3"}, {"server_uuid": "087d933a-f15a-4ec9-a0cb-c02cc0afa064", "name": "network-vif-deleted", "tag": "55e5a7c5-09b3-4fcb-9164-c25c06510811"}, {"name": "network-changed", "server_uuid": "6df62c8a-df0b-4ced-9622-672ef367267a", "tag": "49013a88-e454-4b51-97e1-25fc306b2a50"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:29.274493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:29.276817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] [instance: 2c062b98-2f52-4320-aa74-b05a253c1809] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:29.285098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.286603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.287202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.288011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.288679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.289325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.291282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.291772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.292219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.309428 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Creating event network-vif-deleted:75036fbc-e507-4ead-a669-2ba09f7b17a3 for instance 2c062b98-2f52-4320-aa74-b05a253c1809 on n-h2-836830-16 Sep 07 09:52:29.310343 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] HTTP exception thrown: Instance 2c062b98-2f52-4320-aa74-b05a253c1809 could not be found. Sep 07 09:52:29.310582 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Creating event network-vif-deleted:55e5a7c5-09b3-4fcb-9164-c25c06510811 for instance 087d933a-f15a-4ec9-a0cb-c02cc0afa064 on n-h1-836830-16 Sep 07 09:52:29.311404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] Creating event network-changed:49013a88-e454-4b51-97e1-25fc306b2a50 for instance 6df62c8a-df0b-4ced-9622-672ef367267a on n-h2-836830-16 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Request method failure captured: Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 HTTP/1.1 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGlxR_v-OoPITFb5Ohrwvd1tUrUsWWCUkflF0pfrsk4-BQjGvtVcmVdZY3iU-UuNBLDkOPKzSn3xNZzVBrN_B0HSufvjzZ56j6hfBVBHBmfucX-5W8cQFLvMEqbZeZtMxxj-OfDpNySBZiKd1P9qcJZhGqhfbPcOKG0uv30YnnSAYio Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11f073a8bdbe4ac89c7beeb82fe458ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11f073a8bdbe4ac89c7beeb82fe458ce", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 11f073a8bdbe4ac89c7beeb82fe458ce Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-907513493 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46e1e110e1c74e4cb394d94906fd3c52 Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-907513493-project Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 2c062b98-2f52-4320-aa74-b05a253c1809 could not be found. Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2c062b98-2f52-4320-aa74-b05a253c1809'} Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c062b98-2f52-4320-aa74-b05a253c1809 could not be found. Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c062b98-2f52-4320-aa74-b05a253c1809 could not be found. Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:29.314976 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c062b98-2f52-4320-aa74-b05a253c1809 could not be found. Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] Returning 404 to user: Instance 2c062b98-2f52-4320-aa74-b05a253c1809 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:29.320724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54c5178d-9e55-4265-b7ae-4d174f0c96d0 tempest-FloatingIPsAssociationTestJSON-907513493 tempest-FloatingIPsAssociationTestJSON-907513493-project] 10.222.0.60 "GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809" status: 404 len: 111 microversion: 2.1 time: 0.064120 Sep 07 09:52:29.324656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 936/1890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:29 2022] GET /compute/v2.1/servers/2c062b98-2f52-4320-aa74-b05a253c1809 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:29.336749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:29.340292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:29.352332 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bc2da5b6-2320-4e75-9213-91596391b459 req-ef14c894-73dc-4c19-a6be-be46e045ab51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.069096 Sep 07 09:52:29.354012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.354506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.354948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.355647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.356026 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 955/1891] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:29.360761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.361455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.367472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:29.368089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:29.380063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.380636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.381211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.388405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.388913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.389543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.457309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:29.670014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:29.695177 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d82a367e-f134-458e-923a-4b0884c894b7 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 204 len: 0 microversion: 2.1 time: 0.336536 Sep 07 09:52:29.697286 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 956/1892] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:29 2022] DELETE /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:29.713463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:29.717352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:29.734797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.738219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.740116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:29.741106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:29.744705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:29.746703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:30.017031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:30.030421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f738e14-d80a-40e7-b169-59857c1e3abb tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1527 microversion: 2.1 time: 0.703415 Sep 07 09:52:30.031658 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 937/1893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:29 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1527 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:30.040526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:30.041657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:30.049626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:30.051666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:30.054344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:30.056176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:30.056965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:30.057851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:30.469990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:30.480349 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f14da440-39d5-4b6d-9c61-8644e47ec0d2 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 200 len: 1471 microversion: 2.1 time: 0.778532 Sep 07 09:52:30.480943 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 957/1894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:29 2022] GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 1471 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:30.507523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:30.508180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:30.531302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:30.534551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:30.534998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:30.536606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:30.537075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:30.537539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:30.802864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:30.816971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:30.823914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:30.825749 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3224cd08-e784-4ede-9c3f-f4bc24a2bafb tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.791435 Sep 07 09:52:30.828368 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 938/1895] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:30 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:31.058140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:31.059199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:31.073756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:31.079967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:31.080731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:31.082017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:31.084916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:31.085629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:31.590870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:31.621836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-107d13aa-957c-43ba-86c2-71deb53bc880 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1498 microversion: 2.1 time: 1.139673 Sep 07 09:52:31.643969 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 958/1896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:30 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1498 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:31.651278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:31.652306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:31.659777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:31.661323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:31.661958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:31.662895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:31.663605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:31.664207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:31.937249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:31.955226 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e481b9ce-9393-40c6-b912-41b7804ddc8f tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1527 microversion: 2.1 time: 0.901657 Sep 07 09:52:31.957835 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 939/1897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:31 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1527 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:52:31.966574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:31.975279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:31.992354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:31.997060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:31.997843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:31.998769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:31.999402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:32.000009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:32.086911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'flavor' on Instance uuid 839a4577-a9a7-40c2-a837-4ec147ebb4fe {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:32.121343 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Cannot 'rescue' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state paused Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action HTTP/1.1 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 14 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: {"rescue": {}} Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'rescue' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state paused Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '839a4577-a9a7-40c2-a837-4ec147ebb4fe', 'body': {'rescue': {}}} Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe in vm_state paused. Cannot rescue while the instance is in this state. Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state paused Sep 07 09:52:32.125598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state paused Sep 07 09:52:32.134576 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:32.137409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 409 to user: Cannot 'rescue' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state paused {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:32.140101 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-97492381-80a0-4463-bb02-4ee3bd228291 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action" status: 409 len: 144 microversion: 2.1 time: 0.180913 Sep 07 09:52:32.146192 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 940/1898] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:31 2022] POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action => generated 144 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:52:32.159614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:32.162485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:32.178871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:32.180720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:32.185145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:32.186142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:32.187211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:32.188070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:32.866625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:32.882904 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e768fba-98f8-48a1-9d81-e3703a61af26 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 200 len: 1471 microversion: 2.1 time: 1.230810 Sep 07 09:52:32.884185 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 959/1899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:31 2022] GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 1471 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:32.892794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:32.893662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:32.915347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:32.915860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:32.916307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:32.917315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:32.917645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:32.918072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:33.034277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99446763-1afb-400a-8cc1-42c2cf10575e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action" status: 202 len: 0 microversion: 2.1 time: 0.148575 Sep 07 09:52:33.037245 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 960/1900] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:32 2022] POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:52:33.044935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:33.047799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:33.063821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:33.064701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:33.065409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:33.066926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:33.069662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:33.070179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:33.173004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:33.185551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:33.195916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:33.197417 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e75ef03b-10ab-419b-91f0-9cbfc7db4728 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 1.046647 Sep 07 09:52:33.198082 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 941/1901] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:32 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:33.224550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:33.225582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:33.233145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:33.234170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:33.234884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:33.235797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:33.236649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:33.237432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:33.266515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:34.515018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:34.525685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aec43cc0-f9f7-4bcb-8366-8596ba2a7dff tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1527 microversion: 2.1 time: 1.488624 Sep 07 09:52:34.542053 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 961/1902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:33 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1527 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:34.548694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-60566534-ce5e-481f-bb6b-90facc300f4e req-8d77f0ab-b266-4890-89f4-c7c37fe60d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398b237-89ef-407c-9937-6a8bbde72eef", "name": "network-vif-deleted", "tag": "bc230a1c-79f0-4163-b758-2f68baee50c0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:34.558539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-60566534-ce5e-481f-bb6b-90facc300f4e req-8d77f0ab-b266-4890-89f4-c7c37fe60d6e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:34.559264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-60566534-ce5e-481f-bb6b-90facc300f4e req-8d77f0ab-b266-4890-89f4-c7c37fe60d6e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:34.560035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-60566534-ce5e-481f-bb6b-90facc300f4e req-8d77f0ab-b266-4890-89f4-c7c37fe60d6e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:34.572995 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-60566534-ce5e-481f-bb6b-90facc300f4e req-8d77f0ab-b266-4890-89f4-c7c37fe60d6e service nova] Creating event network-vif-deleted:bc230a1c-79f0-4163-b758-2f68baee50c0 for instance a398b237-89ef-407c-9937-6a8bbde72eef on n-h2-836830-16 Sep 07 09:52:34.578836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-60566534-ce5e-481f-bb6b-90facc300f4e req-8d77f0ab-b266-4890-89f4-c7c37fe60d6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035483 Sep 07 09:52:34.580076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 962/1903] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:34.590335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:34.591471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:34.599021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:34.600124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:34.600814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:34.601836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:34.602599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:34.603473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:34.641304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:34.642417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:34.643180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:34.643867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lazy-loading 'fault' on Instance uuid a398b237-89ef-407c-9937-6a8bbde72eef {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:34.698107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:34.727424 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60ed4de5-4ec0-44fa-8dbf-6b2cdbf7a0a1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1505 microversion: 2.1 time: 1.511469 Sep 07 09:52:34.729324 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 942/1904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:33 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1505 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:34.742553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:34.745823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:34.755188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:34.757158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:34.758256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:34.760123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:34.760970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:34.761860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:34.837927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:34.877828 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4eb7f2fc-216b-4670-a38c-86f13156c288 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 200 len: 1307 microversion: 2.1 time: 0.292948 Sep 07 09:52:34.880445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 963/1905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:34 2022] GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:35.107703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f77d5252-c1e3-4e1d-bb30-54713d9f9c98 req-e5b7660f-7576-4080-bf95-54c6936684a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910000d6-f1b1-40df-b861-69549ab9bf94", "name": "network-vif-deleted", "tag": "ec6299a7-4107-4800-9b04-2c6a7cfa98b4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:35.118278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f77d5252-c1e3-4e1d-bb30-54713d9f9c98 req-e5b7660f-7576-4080-bf95-54c6936684a0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.118727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f77d5252-c1e3-4e1d-bb30-54713d9f9c98 req-e5b7660f-7576-4080-bf95-54c6936684a0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.119212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f77d5252-c1e3-4e1d-bb30-54713d9f9c98 req-e5b7660f-7576-4080-bf95-54c6936684a0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.131915 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f77d5252-c1e3-4e1d-bb30-54713d9f9c98 req-e5b7660f-7576-4080-bf95-54c6936684a0 service nova] Creating event network-vif-deleted:ec6299a7-4107-4800-9b04-2c6a7cfa98b4 for instance 910000d6-f1b1-40df-b861-69549ab9bf94 on n-h1-836830-16 Sep 07 09:52:35.137116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f77d5252-c1e3-4e1d-bb30-54713d9f9c98 req-e5b7660f-7576-4080-bf95-54c6936684a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033439 Sep 07 09:52:35.137900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 964/1906] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:52:35.403763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:35.419707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:35.424169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:35.430783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60efb6ab-e272-4f58-8824-f0534f96a8fc tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.698848 Sep 07 09:52:35.434314 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 943/1907] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:34 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:35.550064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:35.553521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:35.569640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.575085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.575814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.579240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.580607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.581764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.755520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:35.756854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:35.768845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.771150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.771967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.773286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.774312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.774947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.913406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:35.922359 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8875dd2a-3c38-4db1-8f9b-b3b49f9d207b tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1485 microversion: 2.1 time: 0.377111 Sep 07 09:52:35.949948 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 965/1908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:35 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1485 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:35.955457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:35.956084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: a398b237-89ef-407c-9937-6a8bbde72eef] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:35.972923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.973454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.973986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.974698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:35.975153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:35.975581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:35.998916 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance a398b237-89ef-407c-9937-6a8bbde72eef could not be found. Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef HTTP/1.1 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance a398b237-89ef-407c-9937-6a8bbde72eef could not be found. Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a398b237-89ef-407c-9937-6a8bbde72eef'} Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a398b237-89ef-407c-9937-6a8bbde72eef could not be found. Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a398b237-89ef-407c-9937-6a8bbde72eef could not be found. Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:36.000452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a398b237-89ef-407c-9937-6a8bbde72eef could not be found. Sep 07 09:52:36.007321 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:36.022417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance a398b237-89ef-407c-9937-6a8bbde72eef could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:36.023511 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75d6e9d0-d53c-49d9-9dfb-ac53c899528d tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef" status: 404 len: 111 microversion: 2.1 time: 0.072304 Sep 07 09:52:36.024305 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 966/1909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:35 2022] GET /compute/v2.1/servers/a398b237-89ef-407c-9937-6a8bbde72eef => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:36.032352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:36.035886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:36.049970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.050554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.054291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.055135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.055672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.056328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.475790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:36.484619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-498fc299-6e89-474a-810a-ddf5e313afc9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1431 microversion: 2.1 time: 0.456043 Sep 07 09:52:36.486166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 967/1910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:36 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1431 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:52:36.492637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:36.493371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:36.502938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.503661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.505457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.506829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.507814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.508835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.561437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:36.605125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:36.616634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:36.631492 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-125e4a05-0c76-4286-9ee3-b6a8c5a273a9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1505 microversion: 2.1 time: 0.877030 Sep 07 09:52:36.632508 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 944/1911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:35 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:36.642290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:36.647524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:36.666254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.667810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.669814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.676709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.678253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.679763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.758602 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e028a87-65ea-40d9-8a81-b541a585bad1 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 204 len: 0 microversion: 2.1 time: 0.270788 Sep 07 09:52:36.762930 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 968/1912] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:36 2022] DELETE /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:36.772513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:36.773842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:36.789998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.790863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.792022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:36.794808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:36.795980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:36.797652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.533987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:37.544750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76b23577-7ef3-46b1-90c9-b7e1e156f10a tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1669 microversion: 2.1 time: 0.780315 Sep 07 09:52:37.545375 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 969/1913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:36 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1669 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:37.557585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:37.558197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:37.565670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:37.578363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:37.579789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.580878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.581608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.583244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:37.584417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.584573 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-542b6a5b-b8b2-4d32-bba8-121e465ebd87 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.949758 Sep 07 09:52:37.584883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.585738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.588553 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 945/1914] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:36 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:37.595382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4bbd21c3-06c4-4606-9504-1ebdbdf7fb3d req-8e89c879-bf31-4d59-89c4-5d8d847688c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd64d978-145d-4111-9586-e54b09d4a507", "name": "network-vif-deleted", "tag": "a4a3031d-fcbf-4cb1-afc9-f3e8a5fb7e84"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:37.606707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4bbd21c3-06c4-4606-9504-1ebdbdf7fb3d req-8e89c879-bf31-4d59-89c4-5d8d847688c3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.607616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4bbd21c3-06c4-4606-9504-1ebdbdf7fb3d req-8e89c879-bf31-4d59-89c4-5d8d847688c3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.608266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4bbd21c3-06c4-4606-9504-1ebdbdf7fb3d req-8e89c879-bf31-4d59-89c4-5d8d847688c3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.623670 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4bbd21c3-06c4-4606-9504-1ebdbdf7fb3d req-8e89c879-bf31-4d59-89c4-5d8d847688c3 service nova] Creating event network-vif-deleted:a4a3031d-fcbf-4cb1-afc9-f3e8a5fb7e84 for instance dd64d978-145d-4111-9586-e54b09d4a507 on n-h2-836830-16 Sep 07 09:52:37.630403 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4bbd21c3-06c4-4606-9504-1ebdbdf7fb3d req-8e89c879-bf31-4d59-89c4-5d8d847688c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039577 Sep 07 09:52:37.631704 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 946/1915] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:37.634505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.636976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.638344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.640323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lazy-loading 'fault' on Instance uuid dd64d978-145d-4111-9586-e54b09d4a507 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:37.653982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:37.654640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:37.661688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.662170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.662606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.663296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.663742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.664159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.732293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d9f9ab444f49cd95c63dda1087bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f5d14bd094e1b80baadc786ee4210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:37.743703 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b35835b0-dcd5-44d0-a781-edef85e2a470 tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 200 len: 1314 microversion: 2.1 time: 0.194119 Sep 07 09:52:37.744807 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 970/1916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:37 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:37.768833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:37.770251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:37.778070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.778834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.779653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.780545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:37.781174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:37.781793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:37.867498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:37.890931 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86edf1ea-7d63-46ca-8910-adc9e19ccd0b tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1431 microversion: 2.1 time: 0.257448 Sep 07 09:52:37.898663 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 947/1917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:37 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1431 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:38.180245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:38.191187 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-659d0cba-78c3-4a91-b365-d9a1fe828d91 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1505 microversion: 2.1 time: 0.426146 Sep 07 09:52:38.196619 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 971/1918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:37 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:38.569158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:38.569855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:38.589989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:38.590858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:38.594696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:38.601101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:38.601956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:38.603319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:38.622159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:38.623505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:38.637256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:38.639656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:38.641921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:38.642936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:38.645470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:38.646279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.545036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:39.557848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:39.560193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:39.561759 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff6f5714-b112-4bb7-869f-de294b160ed5 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 0.944524 Sep 07 09:52:39.563781 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 972/1919] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:38 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:52:39.570994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:39.580303 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71102f66-a020-4dbf-be43-40996346ca61 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1669 microversion: 2.1 time: 1.016016 Sep 07 09:52:39.584132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:39.585823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] [instance: dd64d978-145d-4111-9586-e54b09d4a507] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:39.600337 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 948/1920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:38 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1669 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:39.606002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.606596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.607112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.607603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:39.607973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.608582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.608777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:39.609141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.618248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.618817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.619058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.620214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.621019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.621852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.648340 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] HTTP exception thrown: Instance dd64d978-145d-4111-9586-e54b09d4a507 could not be found. Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Request method failure captured: Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 HTTP/1.1 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGnE5bjH6OmDy1cqoUCecAuVGBoZWAkRFc95GaPIw0Jzyb2xc_aPzZvNoLjIVkY_aTeOXXTzkBz-RPbSOF2MkTKUBMMpcvA20CyDu6Etx3H0slo6ck9SX8rs0bo5JNGln89bAby2RmHmfsCD2OKFvQH7ZPwHLSLhXG0kuxmWx6PB9Xg Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ec3f5d14bd094e1b80baadc786ee4210 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec3f5d14bd094e1b80baadc786ee4210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec3f5d14bd094e1b80baadc786ee4210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ec3f5d14bd094e1b80baadc786ee4210 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1113189521 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-InstanceActionsNegativeTestJSON-1113189521-project Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a6d9f9ab444f49cd95c63dda1087bcb9 Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1113189521-project Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance dd64d978-145d-4111-9586-e54b09d4a507 could not be found. Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'dd64d978-145d-4111-9586-e54b09d4a507'} Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd64d978-145d-4111-9586-e54b09d4a507 could not be found. Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd64d978-145d-4111-9586-e54b09d4a507 could not be found. Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:39.655921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd64d978-145d-4111-9586-e54b09d4a507 could not be found. Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] Returning 404 to user: Instance dd64d978-145d-4111-9586-e54b09d4a507 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:39.662279 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6a1d0999-d870-4dc7-945f-30c7df91867c tempest-InstanceActionsNegativeTestJSON-1113189521 tempest-InstanceActionsNegativeTestJSON-1113189521-project] 10.222.0.60 "GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507" status: 404 len: 111 microversion: 2.1 time: 0.092486 Sep 07 09:52:39.670077 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 973/1921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:39 2022] GET /compute/v2.1/servers/dd64d978-145d-4111-9586-e54b09d4a507 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:39.678614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:39.686697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:39.691204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.692790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.693331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.694117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lazy-loading 'fault' on Instance uuid 910000d6-f1b1-40df-b861-69549ab9bf94 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:39.713992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.715051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.716633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:39.717564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:39.718306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:39.719369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:40.063102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:40.074363 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e097d6e-e069-42d8-925b-cd2e6ec91455 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 200 len: 1307 microversion: 2.1 time: 0.471030 Sep 07 09:52:40.092297 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 949/1922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:39 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:40.398786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-623f5a2b-f47e-4d9e-a161-06ffa6aaa4d0 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:40.413030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-623f5a2b-f47e-4d9e-a161-06ffa6aaa4d0 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.326025 Sep 07 09:52:40.421574 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 950/1923] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:52:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:40.511513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:40.536045 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42b0d427-e62e-4ba0-b540-b9879f0d7df0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1513 microversion: 2.1 time: 0.863628 Sep 07 09:52:40.537972 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 974/1924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:39 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1513 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:40.590607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:40.591158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:40.607811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:40.608438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:40.612963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:40.613696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:40.614145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:40.614890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:40.620307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:40.622873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:40.625317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:40.626367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:40.626832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:40.627662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:40.628130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:40.628563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:40.944083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:40.966677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cda09cb7-b577-4e69-863c-bb7e9400362e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1601 microversion: 2.1 time: 0.363287 Sep 07 09:52:40.989234 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 975/1925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:40 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1601 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:40.991856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f5f5c493-b159-4453-ab08-5c6040c072e9 req-b6b2759c-722c-4656-9b13-2285f1413c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc44587-4609-4b49-84a9-761bdb462451", "name": "network-vif-deleted", "tag": "0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:41.052799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f5f5c493-b159-4453-ab08-5c6040c072e9 req-b6b2759c-722c-4656-9b13-2285f1413c92 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:41.056530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f5f5c493-b159-4453-ab08-5c6040c072e9 req-b6b2759c-722c-4656-9b13-2285f1413c92 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:41.057065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f5f5c493-b159-4453-ab08-5c6040c072e9 req-b6b2759c-722c-4656-9b13-2285f1413c92 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:41.101369 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f5f5c493-b159-4453-ab08-5c6040c072e9 req-b6b2759c-722c-4656-9b13-2285f1413c92 service nova] Creating event network-vif-deleted:0dfc6ff9-b1b3-42f1-a68c-2bc6409a3021 for instance ddc44587-4609-4b49-84a9-761bdb462451 on n-h2-836830-16 Sep 07 09:52:41.110161 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f5f5c493-b159-4453-ab08-5c6040c072e9 req-b6b2759c-722c-4656-9b13-2285f1413c92 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132993 Sep 07 09:52:41.112820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 976/1926] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:41.123126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:41.125702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 910000d6-f1b1-40df-b861-69549ab9bf94] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:41.139005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:41.140988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:41.158328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:41.162777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:41.163627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:41.166169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:41.201766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 910000d6-f1b1-40df-b861-69549ab9bf94 could not be found. Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 HTTP/1.1 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 910000d6-f1b1-40df-b861-69549ab9bf94 could not be found. Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '910000d6-f1b1-40df-b861-69549ab9bf94'} Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910000d6-f1b1-40df-b861-69549ab9bf94 could not be found. Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910000d6-f1b1-40df-b861-69549ab9bf94 could not be found. Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:41.208927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910000d6-f1b1-40df-b861-69549ab9bf94 could not be found. Sep 07 09:52:41.214101 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:41.220087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 910000d6-f1b1-40df-b861-69549ab9bf94 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:41.221583 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-984e469e-f218-46fb-bbcd-c7b7dbbbee0c tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94" status: 404 len: 111 microversion: 2.1 time: 0.105616 Sep 07 09:52:41.228305 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 977/1927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:41 2022] GET /compute/v2.1/servers/910000d6-f1b1-40df-b861-69549ab9bf94 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:41.236097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96759d4c-6f8c-4e1d-9d31-4460172406cc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:41.345056 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96759d4c-6f8c-4e1d-9d31-4460172406cc tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/3c6dcc26-7542-4d4a-bd5f-b52aaa21076f" status: 204 len: 0 microversion: 2.1 time: 0.114527 Sep 07 09:52:41.349984 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 978/1928] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 09:52:41 2022] DELETE /compute/v2.1/os-server-groups/3c6dcc26-7542-4d4a-bd5f-b52aaa21076f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:41.357956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:41.361549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:41.379702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:41.380451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:41.381025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:41.381885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:41.382555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:41.383474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:41.473588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:41.649905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2def04cd-1a48-4f4c-ab7a-3b64f6b89d5a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 204 len: 0 microversion: 2.1 time: 0.297617 Sep 07 09:52:41.655376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 979/1929] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:41 2022] DELETE /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:41.662650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8294ba3f-441c-478e-be68-90303956b4e9 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1126077515", "imageRef": "b1c33561-4d80-41b4-a459-af4cd3b3c7df", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:41.742928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-8294ba3f-441c-478e-be68-90303956b4e9 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:52:42.089601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:42.103833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:42.106322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:42.107874 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bed8523e-e381-4cd8-b0d8-6e9b5da91575 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1488 microversion: 2.25 time: 1.522006 Sep 07 09:52:42.109079 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 951/1930] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:40 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1488 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:42.116436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:42.117268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:42.127201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.128011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.128642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.130785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.131427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.132089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.165819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:42.300957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4cf039a-72d7-4ef4-85e4-923be134dff9 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 204 len: 0 microversion: 2.1 time: 0.189399 Sep 07 09:52:42.302191 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 952/1931] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:42 2022] DELETE /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:42.309499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:42.311236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:42.322624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.323469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.325660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.327711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.329052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.330641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.383311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.384206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.384666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.385224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lazy-loading 'fault' on Instance uuid ddc44587-4609-4b49-84a9-761bdb462451 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:42.569037 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-8294ba3f-441c-478e-be68-90303956b4e9 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8294ba3f-441c-478e-be68-90303956b4e9 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] Request method failure captured: Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 143 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGnn01oJiFwvM5IUd3W12fpT5BYFJQgSN4Y9jgWAjq_qbPAgGWokpgd7qiQRqsCmiJAQ0QcNz-C8DfGtXB3W1FOKhpsCkPbptsOJfw9SrhEUu4JIg5uaI8iSSFLrBZ4BHX6-y0ZdJPOxhpyUkjiRBKV-zZlmxT4tEEwPDERDrhX2wBw Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 22f9ece332fd448f9578bbd5116fe2cd Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FlavorsV2NegativeTest-1799393744 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22f9ece332fd448f9578bbd5116fe2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22f9ece332fd448f9578bbd5116fe2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22f9ece332fd448f9578bbd5116fe2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22f9ece332fd448f9578bbd5116fe2cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FlavorsV2NegativeTest-1799393744 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 22f9ece332fd448f9578bbd5116fe2cd Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1799393744 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FlavorsV2NegativeTest-1799393744-project Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: df74d7f7115747f7b30f671bd32c6469 Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FlavorsV2NegativeTest-1799393744-project Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1126077515", "imageRef": "b1c33561-4d80-41b4-a459-af4cd3b3c7df", "flavorRef": "452"}} Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: exception: Flavor's memory is too small for requested image. Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1126077515', 'imageRef': 'b1c33561-4d80-41b4-a459-af4cd3b3c7df', 'flavorRef': '452'}}} Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:52:42.571557 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 07 09:52:42.576668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:42.578901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8294ba3f-441c-478e-be68-90303956b4e9 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:42.580016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8294ba3f-441c-478e-be68-90303956b4e9 tempest-FlavorsV2NegativeTest-1799393744 tempest-FlavorsV2NegativeTest-1799393744-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.922906 Sep 07 09:52:42.581671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 980/1932] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:52:41 2022] POST /compute/v2.1/servers => generated 93 bytes in 926 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 09:52:42.590900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:42.591944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:42.595511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:42.601616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.602769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.603386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.604302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:42.607374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:42.612668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:42.623115 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae531c6c-4af6-4baf-bef6-2b38a4df389f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1324 microversion: 2.1 time: 0.317875 Sep 07 09:52:42.638246 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 953/1933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:42 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:43.037754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:43.052365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2e735a8-b037-4a89-9e32-e3fdce04e804 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1474 microversion: 2.1 time: 0.468778 Sep 07 09:52:43.067513 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 981/1934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:42 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1474 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:43.140501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:43.141277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:43.151729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.157969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.158707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.159569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.160683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.161911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.511811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:43.523497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:43.525794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:43.527105 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c71cba6f-7868-4c7a-976d-312573363b4d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1478 microversion: 2.25 time: 0.390884 Sep 07 09:52:43.541643 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 954/1935] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:43 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1478 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:43.553169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97aa0dc0-a57c-4932-832d-f7f4ad425041 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '.version_select at 0x7f14b5fe4f70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:43.556807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97aa0dc0-a57c-4932-832d-f7f4ad425041 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.557334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97aa0dc0-a57c-4932-832d-f7f4ad425041 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.557772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97aa0dc0-a57c-4932-832d-f7f4ad425041 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.579542 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97aa0dc0-a57c-4932-832d-f7f4ad425041 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 3228 microversion: 2.25 time: 0.030041 Sep 07 09:52:43.581311 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 982/1936] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 7 09:52:43 2022] GET /compute/v2.1/os-migrations => generated 3228 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:43.599656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:43.601020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:43.611408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.612124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.612761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.618068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.618559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.618997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.663464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:43.664791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:43.671919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.672759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.673466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.674504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.675196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.676032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.727225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.728227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.729117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.730643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lazy-loading 'fault' on Instance uuid ddc44587-4609-4b49-84a9-761bdb462451 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:43.858903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:43.868620 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f08c5e9-3e5b-46f7-927d-97ffd3ac440b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1324 microversion: 2.1 time: 0.217657 Sep 07 09:52:43.869420 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 983/1937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:43 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:43.875065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:43.883154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:43.893819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.895104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.896245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.897015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:43.897536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:43.898127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:43.931478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'flavor' on Instance uuid 839a4577-a9a7-40c2-a837-4ec147ebb4fe {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:44.026737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:44.037413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] Lazy-loading 'services' on Instance uuid 6df62c8a-df0b-4ced-9622-672ef367267a {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:44.062024 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a16c5d96-8276-44ad-80a5-d1da92184f11 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action" status: 200 len: 32 microversion: 2.1 time: 0.189961 Sep 07 09:52:44.064802 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 984/1938] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:52:43 2022] POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:44.070886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08e5c692-d2a9-4ad8-9139-e5ce6aa5da31 tempest-LiveAutoBlockMigrationV225Test-23375272 tempest-LiveAutoBlockMigrationV225Test-23375272-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1973 microversion: 2.25 time: 0.475725 Sep 07 09:52:44.076494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:44.077052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:44.077929 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 955/1939] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:43 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1973 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:44.087251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.087993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.088770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.093430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:44.094271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:44.100513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.103265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.105204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.112527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.113802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.114396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.115284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.115815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.116254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.576968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:44.590875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54a7e13a-016c-4047-a9cd-3ceb89072cf0 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1474 microversion: 2.1 time: 0.519370 Sep 07 09:52:44.593000 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 985/1940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:44 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1474 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:52:44.600095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:44.601114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:44.614757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.615756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.616215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.617213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.618208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.618208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.684154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:44.825665 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80dbae2c-b82d-4389-91ed-7647445a439e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 204 len: 0 microversion: 2.25 time: 0.230786 Sep 07 09:52:44.829220 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 986/1941] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:44 2022] DELETE /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:52:44.836479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:44.837168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:44.843475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.843989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.844395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.845475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.846127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.846830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.853532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:44.861566 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c62194ef-b3e5-4d04-acfe-969f740109ec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.781260 Sep 07 09:52:44.862147 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 956/1942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:44 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:44.894001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:44.896257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:44.913229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.913229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.913229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.913229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.913583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.914068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.951316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:44.952271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:44.952886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:44.953756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lazy-loading 'fault' on Instance uuid ddc44587-4609-4b49-84a9-761bdb462451 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:45.449734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:45.453506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:45.457723 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08bf5a6d-27a1-4980-9d03-799558155143 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 200 len: 1324 microversion: 2.1 time: 0.567472 Sep 07 09:52:45.458306 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 957/1943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:44 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:45.509670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:45.510492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:45.517219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:45.517985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:45.518662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:45.520245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:45.521356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:45.522183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:45.560108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:45.699641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-253f6df2-6525-415d-be66-e2cde9b7dbd0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 204 len: 0 microversion: 2.1 time: 0.193451 Sep 07 09:52:45.701605 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 958/1944] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:45 2022] DELETE /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:52:45.713920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:45.717354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:45.732561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:45.733730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:45.734441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:45.736515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:45.737265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:45.737945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:45.987410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:46.016836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:46.018350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:46.031063 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-38245428-381c-4e14-a478-cccd39e175c0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1484 microversion: 2.25 time: 1.199790 Sep 07 09:52:46.050070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 987/1945] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:44 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1484 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:52:46.063903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:46.064844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:46.074573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:46.075334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:46.075976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:46.077694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:46.078364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:46.078967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:46.386259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:46.394917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8292903e-60c2-4068-be9b-a66d5aa452ee tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1474 microversion: 2.1 time: 0.690570 Sep 07 09:52:46.410941 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 959/1946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:45 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1474 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:46.419233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:46.420231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:46.426682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:46.427490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:46.428166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:46.429107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:46.429862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:46.430633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:46.569855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:46.580337 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67bd6c16-317a-4dfa-9a8b-47030072e6e9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1554 microversion: 2.1 time: 0.527617 Sep 07 09:52:46.581154 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 988/1947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:46 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1554 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:46.586878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc667c67-5c78-48e7-9926-cc4233dae284 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b5f6baf0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:46.644384 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc667c67-5c78-48e7-9926-cc4233dae284 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73" status: 200 len: 636 microversion: 2.1 time: 0.061210 Sep 07 09:52:46.645490 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 989/1948] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:52:46 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73 => generated 636 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:46.650761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:46.651722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: ddc44587-4609-4b49-84a9-761bdb462451] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:46.667354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:46.667995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:46.668559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:46.669405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:46.669956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:46.670478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:46.685676 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] HTTP exception thrown: Instance ddc44587-4609-4b49-84a9-761bdb462451 could not be found. Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Request method failure captured: Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 HTTP/1.1 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgU8Dq8llGl0zZ4fUfEsLIYqnR5cZ0B3FD1FHdnkRd8e1cdtfpLeVGYIvZZQNTr-aXsxz36ysIFJYaU7YINgKS3xa5moTFRudGphi_UwJ0MbLSVFT5jeY0cX6L6HsE8ppcpHdR01-AhjdwDW8dHQwNqfl-Owp1xq72P8lRysHThu6I Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_913dc4cafc574c08a81d9f473a935e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveMigrationTest-7365876 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveMigrationTest-7365876-project Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 224142a6fa7e4702b1780f4aaeb3f93f Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveMigrationTest-7365876-project Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ddc44587-4609-4b49-84a9-761bdb462451 could not be found. Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ddc44587-4609-4b49-84a9-761bdb462451'} Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc44587-4609-4b49-84a9-761bdb462451 could not be found. Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc44587-4609-4b49-84a9-761bdb462451 could not be found. Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:46.687999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:46.696285 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:46.696285 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:46.696285 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:46.696285 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:46.696285 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc44587-4609-4b49-84a9-761bdb462451 could not be found. Sep 07 09:52:46.696285 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:46.699247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Returning 404 to user: Instance ddc44587-4609-4b49-84a9-761bdb462451 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:46.701059 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3785f876-9f70-4e7c-a5fe-aa03af561e1f tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451" status: 404 len: 111 microversion: 2.1 time: 0.054062 Sep 07 09:52:46.705173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 990/1949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:46 2022] GET /compute/v2.1/servers/ddc44587-4609-4b49-84a9-761bdb462451 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:46.712673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7503094d-6189-4a62-bb2b-06c77d645ffe tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b5fa4ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:46.799287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7503094d-6189-4a62-bb2b-06c77d645ffe tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:46.810242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7503094d-6189-4a62-bb2b-06c77d645ffe tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:46.813375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:46.868034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:46.880508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e63d3550-3316-4516-898e-7f3f12b09a0e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.468102 Sep 07 09:52:46.882345 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 960/1950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:46 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:46.891158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b03b002-f935-43b0-af77-becb018c24cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '.version_select at 0x7f14b12b7160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:46.947972 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b03b002-f935-43b0-af77-becb018c24cd tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062363125" status: 202 len: 0 microversion: 2.1 time: 0.064376 Sep 07 09:52:46.952906 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 961/1951] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 09:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062363125 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:52:47.079152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:47.081414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:47.088737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:47.089469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:47.090747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:47.096429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:47.097817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:47.100135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:47.248557 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7503094d-6189-4a62-bb2b-06c77d645ffe tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.541796 Sep 07 09:52:47.249321 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 991/1952] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:46 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:47.259923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb9ec083-6236-4a5f-b23b-229e506a8e04 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b5fcea60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:47.746202 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb9ec083-6236-4a5f-b23b-229e506a8e04 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "DELETE /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.490378 Sep 07 09:52:47.746741 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 992/1953] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 7 09:52:47 2022] DELETE /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata/os_version => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:52:47.752595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:47.753792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:47.775803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:47.777384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:47.777968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:47.780459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:47.781305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:47.782049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:47.903987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:47.930491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:47.931561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:47.932829 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9bab4c15-153a-4a09-aab3-bfb552565495 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1484 microversion: 2.25 time: 0.868249 Sep 07 09:52:47.934313 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 962/1954] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:47 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1484 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:47.954378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4d3bd612-e77d-4fbd-83f8-cfd5f225af19 req-e8028781-3922-49be-aa59-5edbbadbefe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6290e549-3bbe-4969-b781-2336c21bf568", "name": "network-vif-deleted", "tag": "f72fbdcf-2318-4e62-b4c1-c4145dfc9f9f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:47.972796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:47.986372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d3bd612-e77d-4fbd-83f8-cfd5f225af19 req-e8028781-3922-49be-aa59-5edbbadbefe8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:47.987233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d3bd612-e77d-4fbd-83f8-cfd5f225af19 req-e8028781-3922-49be-aa59-5edbbadbefe8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:47.990437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d3bd612-e77d-4fbd-83f8-cfd5f225af19 req-e8028781-3922-49be-aa59-5edbbadbefe8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:48.021389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d3bd612-e77d-4fbd-83f8-cfd5f225af19 req-e8028781-3922-49be-aa59-5edbbadbefe8 service nova] Creating event network-vif-deleted:f72fbdcf-2318-4e62-b4c1-c4145dfc9f9f for instance 6290e549-3bbe-4969-b781-2336c21bf568 on n-h2-836830-16 Sep 07 09:52:48.038609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4d3bd612-e77d-4fbd-83f8-cfd5f225af19 req-e8028781-3922-49be-aa59-5edbbadbefe8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102800 Sep 07 09:52:48.039134 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 963/1955] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:48.052885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:48.053918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:48.070901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:48.073162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:48.073652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:48.074408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:48.078036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:48.078240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:48.141055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:48.155451 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9041891-34d5-4914-b39e-7382e02c06e3 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 200 len: 1432 microversion: 2.1 time: 0.407576 Sep 07 09:52:48.156051 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 993/1956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:47 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 1432 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:48.178562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95d8a762-eaa2-474c-b2c8-79108ec41127 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b180b3a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:48.283186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95d8a762-eaa2-474c-b2c8-79108ec41127 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 37 microversion: 2.1 time: 0.119307 Sep 07 09:52:48.296070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 994/1957] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:52:48 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 37 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:48.307971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:48.311386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:48.335544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:48.336196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:48.336741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:48.343599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:48.346236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:48.346633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:48.890064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:48.904073 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcd3f7a1-db2d-4535-bb7e-7a42055a3fad tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1554 microversion: 2.1 time: 0.861002 Sep 07 09:52:48.905715 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 964/1958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:48 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1554 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:48.922907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d957e8a-9974-491c-a42a-537d5555342a tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b12b7790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:49.016664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-7d957e8a-9974-491c-a42a-537d5555342a tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:49.030725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-7d957e8a-9974-491c-a42a-537d5555342a tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:49.431899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d957e8a-9974-491c-a42a-537d5555342a tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.524653 Sep 07 09:52:49.438000 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 965/1959] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:48 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:49.446787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:49.447785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:49.455258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:49.456148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:49.457588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:49.458759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:49.459468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:49.460300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:49.770114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:49.785417 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-023720ee-fceb-4c29-a718-de5a0e6a3435 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 1.487715 Sep 07 09:52:49.790862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 995/1960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:48 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:49.810222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:49.818081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 663137aa-8113-4d52-a3c8-224bc7bee2df] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:49.829823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:49.829956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:49.833803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:49.840459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:49.841345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:49.844772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:49.880916 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 663137aa-8113-4d52-a3c8-224bc7bee2df could not be found. Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df HTTP/1.1 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 663137aa-8113-4d52-a3c8-224bc7bee2df could not be found. Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '663137aa-8113-4d52-a3c8-224bc7bee2df'} Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663137aa-8113-4d52-a3c8-224bc7bee2df could not be found. Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663137aa-8113-4d52-a3c8-224bc7bee2df could not be found. Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:49.883136 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663137aa-8113-4d52-a3c8-224bc7bee2df could not be found. Sep 07 09:52:49.888799 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:49.893552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 663137aa-8113-4d52-a3c8-224bc7bee2df could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:49.893552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f983d048-68c5-450c-a986-0222fdd8fbcb tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df" status: 404 len: 111 microversion: 2.1 time: 0.095453 Sep 07 09:52:49.893552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 996/1961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:49 2022] GET /compute/v2.1/servers/663137aa-8113-4d52-a3c8-224bc7bee2df => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:49.899251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c4bc74d-4a25-448a-b694-a75451f1a60a tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b5f691f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:50.000105 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c4bc74d-4a25-448a-b694-a75451f1a60a tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.107036 Sep 07 09:52:50.000680 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 997/1962] 10.222.0.60 () {58 vars in 1290 bytes} [Wed Sep 7 09:52:49 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata/os_distro => generated 33 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:50.014172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:50.018543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 6290e549-3bbe-4969-b781-2336c21bf568] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:50.045042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.046116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.046693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.048247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.048844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.049551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.068545 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 6290e549-3bbe-4969-b781-2336c21bf568 could not be found. Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 HTTP/1.1 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 6290e549-3bbe-4969-b781-2336c21bf568 could not be found. Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6290e549-3bbe-4969-b781-2336c21bf568'} Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6290e549-3bbe-4969-b781-2336c21bf568 could not be found. Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6290e549-3bbe-4969-b781-2336c21bf568 could not be found. Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:50.070852 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6290e549-3bbe-4969-b781-2336c21bf568 could not be found. Sep 07 09:52:50.076505 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:50.078841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 6290e549-3bbe-4969-b781-2336c21bf568 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:50.080067 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62c109e2-3f0d-466f-9961-db1cfc692297 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568" status: 404 len: 111 microversion: 2.1 time: 0.078391 Sep 07 09:52:50.081208 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 998/1963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:50 2022] GET /compute/v2.1/servers/6290e549-3bbe-4969-b781-2336c21bf568 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:50.086440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8bb25a75-36ef-4035-a939-fb3d5458a225 req-8fcaff8f-f884-4535-b8f1-4b0b0229b1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798bd295-ae8f-4655-9822-59beb0f4feec", "name": "network-vif-deleted", "tag": "c9834ece-ee40-42d8-8586-dc75ffb96cc1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:50.099723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8bb25a75-36ef-4035-a939-fb3d5458a225 req-8fcaff8f-f884-4535-b8f1-4b0b0229b1f3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.100672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8bb25a75-36ef-4035-a939-fb3d5458a225 req-8fcaff8f-f884-4535-b8f1-4b0b0229b1f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.101441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8bb25a75-36ef-4035-a939-fb3d5458a225 req-8fcaff8f-f884-4535-b8f1-4b0b0229b1f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.118085 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8bb25a75-36ef-4035-a939-fb3d5458a225 req-8fcaff8f-f884-4535-b8f1-4b0b0229b1f3 service nova] Creating event network-vif-deleted:c9834ece-ee40-42d8-8586-dc75ffb96cc1 for instance 798bd295-ae8f-4655-9822-59beb0f4feec on n-h1-836830-16 Sep 07 09:52:50.125213 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8bb25a75-36ef-4035-a939-fb3d5458a225 req-8fcaff8f-f884-4535-b8f1-4b0b0229b1f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042268 Sep 07 09:52:50.127323 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 999/1964] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:50.184031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:50.184903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:50.213831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.215742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.216381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.219396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.220236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.220851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.511475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:50.526426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9a807e7-3c60-4690-b67b-ba1afb7b1344 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1346 microversion: 2.1 time: 0.397471 Sep 07 09:52:50.531191 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1000/1965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:50 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1346 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:50.552265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2aa572a5-05e5-4fce-876a-6899a586d90d tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b5ff85e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:50.660699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2aa572a5-05e5-4fce-876a-6899a586d90d tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:50.670900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2aa572a5-05e5-4fce-876a-6899a586d90d tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:50.769534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:50.787339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:50.789083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:50.790902 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c0e71a0-638e-45f1-9d07-9096d0912820 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1484 microversion: 2.25 time: 1.351328 Sep 07 09:52:50.792231 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 966/1966] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:49 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1484 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:50.798368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92482877-2bc5-4ca6-9a17-a1d1b09ac587 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:50.841358 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92482877-2bc5-4ca6-9a17-a1d1b09ac587 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/b758ceea-36ad-4eef-b15d-83bcf1c199a4" status: 204 len: 0 microversion: 2.1 time: 0.047637 Sep 07 09:52:50.842374 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 967/1967] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 09:52:50 2022] DELETE /compute/v2.1/os-server-groups/b758ceea-36ad-4eef-b15d-83bcf1c199a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:50.849730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-67124463-75ef-42f9-a84e-ea71b6f16616 req-91f83b20-db9a-4b94-9808-3cad31483591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663137aa-8113-4d52-a3c8-224bc7bee2df", "name": "network-vif-deleted", "tag": "7c0dcf2b-018a-48f2-933b-9c3a731a9729"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:50.864863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67124463-75ef-42f9-a84e-ea71b6f16616 req-91f83b20-db9a-4b94-9808-3cad31483591 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.865645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67124463-75ef-42f9-a84e-ea71b6f16616 req-91f83b20-db9a-4b94-9808-3cad31483591 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.866528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67124463-75ef-42f9-a84e-ea71b6f16616 req-91f83b20-db9a-4b94-9808-3cad31483591 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.882750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-67124463-75ef-42f9-a84e-ea71b6f16616 req-91f83b20-db9a-4b94-9808-3cad31483591 service nova] Creating event network-vif-deleted:7c0dcf2b-018a-48f2-933b-9c3a731a9729 for instance 663137aa-8113-4d52-a3c8-224bc7bee2df on n-h2-836830-16 Sep 07 09:52:50.897250 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-67124463-75ef-42f9-a84e-ea71b6f16616 req-91f83b20-db9a-4b94-9808-3cad31483591 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053118 Sep 07 09:52:50.898780 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 968/1968] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:50.909168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:50.910986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:50.926456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.927269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.927917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:50.928846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:50.929532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:50.930337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.046450 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2aa572a5-05e5-4fce-876a-6899a586d90d tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.513684 Sep 07 09:52:51.052771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1001/1969] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:50 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:51.059565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:51.062840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:51.076127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:51.077046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:51.084228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.085909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:51.087539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:51.087970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.158909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:51.326578 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5824c66-bb7d-47d1-a5f3-f9d29ce7c31a tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "DELETE /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 204 len: 0 microversion: 2.1 time: 0.269964 Sep 07 09:52:51.327628 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1002/1970] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:51 2022] DELETE /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:51.343557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2fe1b195-39cc-4c78-b6e5-fcf30ec392b5 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b5f69f70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:51.409193 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2fe1b195-39cc-4c78-b6e5-fcf30ec392b5 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.073745 Sep 07 09:52:51.410942 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1003/1971] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:52:51 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:51.421789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:51.423833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:51.440208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:51.440701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:51.444620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.447066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:51.449275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:51.450445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.508773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:51.509218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:51.522517 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c8d100b7-9114-47a5-8f6c-d789204bcd73 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.621802 Sep 07 09:52:51.523696 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 969/1972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:50 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:51.534019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:51.534639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:51.561327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:51.561827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:51.562379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.563088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:51.563551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:51.563978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:51.681830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7eb3d638-64b6-47da-a7af-0e6c9a133bc9 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 204 len: 0 microversion: 2.1 time: 0.260572 Sep 07 09:52:51.687047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1004/1973] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:51 2022] DELETE /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:52:51.710341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c48eebb-57c0-4cce-b503-b876bd24efc3 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b180b9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:51.833415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-8c48eebb-57c0-4cce-b503-b876bd24efc3 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:51.844646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-8c48eebb-57c0-4cce-b503-b876bd24efc3 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:51.969498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:51.981302 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6386cb69-b8a8-4bf7-8281-b8d1e003f501 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1472 microversion: 2.1 time: 0.455353 Sep 07 09:52:51.995859 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 970/1974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:51 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:52.008651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:52.010469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:52.027386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.031554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.032328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.034287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.039289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.039912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.085472 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c48eebb-57c0-4cce-b503-b876bd24efc3 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.395735 Sep 07 09:52:52.087139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1005/1975] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:51 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:52.092540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:52.094601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:52.101944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.102798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.103486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.104533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.105265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.105929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.228529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:52.248159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3267030-0c39-4509-b5c9-ca62e20bccb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1346 microversion: 2.1 time: 0.238081 Sep 07 09:52:52.249341 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 971/1976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:51 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1346 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:52.255607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:52.258236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:52.272848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.274251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.274898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.275985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.277233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.277843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.428534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:52.451760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:52.454955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:52.455487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:52.460529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:52.465114 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85654b13-8107-4acb-b015-ba3a32a50971 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1485 microversion: 2.1 time: 0.376630 Sep 07 09:52:52.465504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ad9f6fc-912b-4289-abe7-c9598fd81407 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.213560 Sep 07 09:52:52.467659 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 972/1977] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:52 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:52.468523 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1006/1978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:52 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1485 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:52.475685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a9eff45-f103-416b-ad23-8ce80fa7676c tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b13570d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:52.549245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:52.550109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:52.557531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.558126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.558595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.559327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:52.559789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:52.560220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:52.598672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2a9eff45-f103-416b-ad23-8ce80fa7676c tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:52.608469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2a9eff45-f103-416b-ad23-8ce80fa7676c tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:52.945951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:52.976180 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29e5c133-e53c-4207-bc7c-e91e8bdbd4ce tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.430601 Sep 07 09:52:53.012693 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1007/1979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:52 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:53.034538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:53.041546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:53.065128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:53.069067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:53.069773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:53.072093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:53.072515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:53.075651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:53.255678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a9eff45-f103-416b-ad23-8ce80fa7676c tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 64 microversion: 2.1 time: 0.784969 Sep 07 09:52:53.257303 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 973/1980] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:52 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 64 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:53.278924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-20d9ab18-7924-4a41-b177-f58283bdf09b req-fce4fa34-56c9-411a-8a41-24c9fa548565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df62c8a-df0b-4ced-9622-672ef367267a", "name": "network-vif-deleted", "tag": "49013a88-e454-4b51-97e1-25fc306b2a50"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:53.299336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-20d9ab18-7924-4a41-b177-f58283bdf09b req-fce4fa34-56c9-411a-8a41-24c9fa548565 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:53.300203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-20d9ab18-7924-4a41-b177-f58283bdf09b req-fce4fa34-56c9-411a-8a41-24c9fa548565 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:53.307820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-20d9ab18-7924-4a41-b177-f58283bdf09b req-fce4fa34-56c9-411a-8a41-24c9fa548565 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:53.337509 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-20d9ab18-7924-4a41-b177-f58283bdf09b req-fce4fa34-56c9-411a-8a41-24c9fa548565 service nova] Creating event network-vif-deleted:49013a88-e454-4b51-97e1-25fc306b2a50 for instance 6df62c8a-df0b-4ced-9622-672ef367267a on n-h1-836830-16 Sep 07 09:52:53.345335 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-20d9ab18-7924-4a41-b177-f58283bdf09b req-fce4fa34-56c9-411a-8a41-24c9fa548565 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078894 Sep 07 09:52:53.346463 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 974/1981] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:53.358714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-33432233-5c04-47d9-b36f-6e8cdb339ff0 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b12d7280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:53.428906 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-33432233-5c04-47d9-b36f-6e8cdb339ff0 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 64 microversion: 2.1 time: 0.077898 Sep 07 09:52:53.429521 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 975/1982] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:52:53 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 64 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:53.449029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:53.449845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:53.456267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:53.457101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:53.457980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:53.458849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:53.459808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:53.460399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:53.760915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:53.782441 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-29fdc49e-ab13-4704-beac-8e3f70c005a3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1346 microversion: 2.1 time: 0.339030 Sep 07 09:52:53.783255 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 976/1983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:53 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1346 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:53.796867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb107d78-1048-44d0-9926-ae7f2cc83a4b tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b12d7d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:53.903798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-cb107d78-1048-44d0-9926-ae7f2cc83a4b tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:53.929580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-cb107d78-1048-44d0-9926-ae7f2cc83a4b tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:53.939921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:53.951184 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f329209-e97f-481f-88d3-292fca00edbe tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1472 microversion: 2.1 time: 0.936888 Sep 07 09:52:53.981236 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1008/1984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:53 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1472 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:54.023576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:54.033521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:54.059074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:54.060221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:54.060839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:54.061742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:54.062350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:54.062931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:54.579419 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb107d78-1048-44d0-9926-ae7f2cc83a4b tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.794515 Sep 07 09:52:54.580331 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 977/1985] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:53 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:54.587429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:54.588057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:54.606766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:54.610362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:54.611033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:54.612684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:54.615044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:54.615738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:54.732677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:54.741223 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d30894ad-004c-4566-9c55-1e639399a425 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1485 microversion: 2.1 time: 0.758830 Sep 07 09:52:54.741809 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1009/1986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:53 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1485 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:54.759056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:54.759942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:54.777067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:54.778701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:54.779673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:54.780627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:54.781326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:54.781993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:54.896284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:54.915266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:54.916786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:54.917996 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb57a402-f9a4-436f-9061-0fbb20003f3e tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.336556 Sep 07 09:52:54.918895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 978/1987] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:54 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:54.937670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df041588-2d36-498c-902c-b1f823658b44 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update', calling method: .version_select at 0x7f14b12d7430>, body: {"meta": {"os_version": "alt"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:55.013023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-df041588-2d36-498c-902c-b1f823658b44 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:55.022926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-df041588-2d36-498c-902c-b1f823658b44 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:55.143229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:55.159432 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4385bf48-7b99-41a8-8ecd-fee921124312 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.404340 Sep 07 09:52:55.166405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1010/1988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:54 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:55.182971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:55.183608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:55.203626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:55.208281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:55.213678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:55.214444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:55.215530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:55.216205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:55.323268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:55.337653 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f012c288-a406-4c50-aec7-ecd402fd2941 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1346 microversion: 2.1 time: 0.168839 Sep 07 09:52:55.353162 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1011/1989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:55 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:55.365815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:55.366876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:55.383394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:55.384124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:55.384746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:55.385731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:55.386351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:55.387086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:55.470741 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df041588-2d36-498c-902c-b1f823658b44 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.550399 Sep 07 09:52:55.478472 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 979/1990] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Sep 7 09:52:54 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata/os_version => generated 31 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:55.486555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e99c46b0-03fa-4488-8d03-91947c1b9435 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b13075e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:55.551239 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e99c46b0-03fa-4488-8d03-91947c1b9435 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 58 microversion: 2.1 time: 0.068745 Sep 07 09:52:55.554788 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 980/1991] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:52:55 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 58 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:55.576656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a87249b8-0a78-4ecb-aefc-409a86209b42 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'update_all', calling method: .version_select at 0x7f14b12d9790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:55.656527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a87249b8-0a78-4ecb-aefc-409a86209b42 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:55.665306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a87249b8-0a78-4ecb-aefc-409a86209b42 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:56.026097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b84ec5e441287e9c43bd918f394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f96dd538e242b88d17442cb92b3d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:56.067676 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c26a666-98d9-4641-b91c-3ec289c78229 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 200 len: 1472 microversion: 2.1 time: 0.708118 Sep 07 09:52:56.068367 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1012/1992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:55 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 1472 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:56.081482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:56.086206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:56.104295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.104831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.105304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.109809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.112144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.112604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.193937 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a87249b8-0a78-4ecb-aefc-409a86209b42 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 61 microversion: 2.1 time: 0.631554 Sep 07 09:52:56.194697 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 981/1993] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:52:55 2022] PUT /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 61 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 09:52:56.211774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:56.220370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:56.250203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.255334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.261044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.261927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.262404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.264527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.608315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:56.614067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:56.622829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d615b15-9ac9-46e8-88b9-b84da8756d2e tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 200 len: 1281 microversion: 2.1 time: 0.551169 Sep 07 09:52:56.623441 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1013/1994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:56 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 1281 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:56.637026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8c6212c5-728e-48a1-841e-06c6bd2b7956 req-f23f7642-ef9b-46df-8404-20bbf1eddfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3a254c-8c21-419d-8c5d-2590f40228cb", "name": "network-vif-deleted", "tag": "c1c00cd9-f1f7-4e61-a58e-1a21d22d498e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:56.639959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:56.644813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:56.649117 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d6263fd5-909f-4a18-96b5-cd0064d0cdd9 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.453037 Sep 07 09:52:56.652210 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 982/1995] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:56 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:56.659106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:56.661077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:56.667688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c6212c5-728e-48a1-841e-06c6bd2b7956 req-f23f7642-ef9b-46df-8404-20bbf1eddfaa service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.668412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c6212c5-728e-48a1-841e-06c6bd2b7956 req-f23f7642-ef9b-46df-8404-20bbf1eddfaa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.669024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c6212c5-728e-48a1-841e-06c6bd2b7956 req-f23f7642-ef9b-46df-8404-20bbf1eddfaa service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.679916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.682658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.683225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.685172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:56.686757 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8c6212c5-728e-48a1-841e-06c6bd2b7956 req-f23f7642-ef9b-46df-8404-20bbf1eddfaa service nova] Creating event network-vif-deleted:c1c00cd9-f1f7-4e61-a58e-1a21d22d498e for instance 5d3a254c-8c21-419d-8c5d-2590f40228cb on n-h2-836830-16 Sep 07 09:52:56.686911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:56.688153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:56.700111 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8c6212c5-728e-48a1-841e-06c6bd2b7956 req-f23f7642-ef9b-46df-8404-20bbf1eddfaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073857 Sep 07 09:52:56.701045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1014/1996] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:56.713663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b197d81e-e5ce-41d5-ac98-84a68060e900 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Action: 'create', calling method: .version_select at 0x7f14b5fe4310>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:56.834251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b197d81e-e5ce-41d5-ac98-84a68060e900 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:52:56.857467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b197d81e-e5ce-41d5-ac98-84a68060e900 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Getting quotas for user bd975b6659a546a0bc84665216d9917a and project 801a432d60cf4029a0520711b80c9ceb. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:52:57.553073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b197d81e-e5ce-41d5-ac98-84a68060e900 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "POST /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 85 microversion: 2.1 time: 0.844992 Sep 07 09:52:57.554472 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1015/1997] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Sep 7 09:52:56 2022] POST /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 85 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:57.560374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:57.565796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:57.597790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.600409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.601022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:57.614070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.617361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.618342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:57.678004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:57.682587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:52:57.695912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a120740f-24b0-4a8c-a9e7-700f8277a8d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 1.037434 Sep 07 09:52:57.707372 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 983/1998] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:56 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:57.724007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:57.726209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] [instance: 311d2586-a4ff-42eb-90c9-bb56ecdd89e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:57.740606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.741528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.742152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:57.744050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'fault' on Instance uuid 798bd295-ae8f-4655-9822-59beb0f4feec {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:52:57.758161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.758667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.759115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:57.759835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.764863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.765564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:57.784495 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] HTTP exception thrown: Instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 could not be found. Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Request method failure captured: Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 HTTP/1.1 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGj5Wk2qkcPpuHQiCBViSBv4aRgTBNnSxdG38XH773Vb15nEwpsPBTQn5Os5OuGsnZvSnidEpZOfURPci3ECl9iz2M9qMTq4VOL1yLQvKfa7SAKI0CrnNM3IYlgmCnuTbEi5D8H4f2TOpPRyetZVYDtDf9EmNnHgq7eU_wnVcmA4px4 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16f96dd538e242b88d17442cb92b3d46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16f96dd538e242b88d17442cb92b3d46", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16f96dd538e242b88d17442cb92b3d46 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1537253775 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: edb48b84ec5e441287e9c43bd918f394 Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersOnMultiNodesTest-1537253775-project Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 could not be found. Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '311d2586-a4ff-42eb-90c9-bb56ecdd89e4'} Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 could not be found. Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 could not be found. Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:57.786949 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 could not be found. Sep 07 09:52:57.792381 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:57.794742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] Returning 404 to user: Instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:57.795785 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d5430f8-609a-4dfb-a6f6-2cc5c1b04475 tempest-ServersOnMultiNodesTest-1537253775 tempest-ServersOnMultiNodesTest-1537253775-project] 10.222.0.60 "GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4" status: 404 len: 111 microversion: 2.1 time: 0.084971 Sep 07 09:52:57.796516 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 984/1999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:57 2022] GET /compute/v2.1/servers/311d2586-a4ff-42eb-90c9-bb56ecdd89e4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:57.802357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68b52fdc-a7da-414f-a184-6443ac5052d8 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] Calling method '.version_select at 0x7f14b134bca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:57.882818 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68b52fdc-a7da-414f-a184-6443ac5052d8 tempest-ImagesMetadataTestJSON-1346792578 tempest-ImagesMetadataTestJSON-1346792578-project] 10.222.0.60 "GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata" status: 200 len: 85 microversion: 2.1 time: 0.085014 Sep 07 09:52:57.960662 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 985/2000] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:52:57 2022] GET /compute/v2.1/images/ee219ac1-acd2-4837-b703-8e594e187e73/metadata => generated 85 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:52:57.960662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:57.960662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: 5d3a254c-8c21-419d-8c5d-2590f40228cb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:57.968067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.968410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.969320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:57.969809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:57.970321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:57.970796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.012910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:58.032112 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-af4a7681-8028-4a93-9163-ea84c6533b1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 200 len: 1351 microversion: 2.1 time: 0.476235 Sep 07 09:52:58.046866 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1016/2001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:57 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 1351 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:58.061412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:58.064117 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] HTTP exception thrown: Instance 5d3a254c-8c21-419d-8c5d-2590f40228cb could not be found. Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Request method failure captured: Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb HTTP/1.1 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGgU8Dq8llGl0zZ4fUfEsLIYqnR5cZ0B3FD1FHdnkRd8e1cdtfpLeVGYIvZZQNTr-aXsxz36ysIFJYaU7YINgKS3xa5moTFRudGphi_UwJ0MbLSVFT5jeY0cX6L6HsE8ppcpHdR01-AhjdwDW8dHQwNqfl-Owp1xq72P8lRysHThu6I Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_913dc4cafc574c08a81d9f473a935e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-LiveMigrationTest-7365876 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-LiveMigrationTest-7365876-project Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 224142a6fa7e4702b1780f4aaeb3f93f Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-LiveMigrationTest-7365876-project Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5d3a254c-8c21-419d-8c5d-2590f40228cb could not be found. Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5d3a254c-8c21-419d-8c5d-2590f40228cb'} Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3a254c-8c21-419d-8c5d-2590f40228cb could not be found. Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3a254c-8c21-419d-8c5d-2590f40228cb could not be found. Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:58.066396 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:58.069560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:58.069560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:58.069560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:58.069560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:58.069560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3a254c-8c21-419d-8c5d-2590f40228cb could not be found. Sep 07 09:52:58.069560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:52:58.070569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Returning 404 to user: Instance 5d3a254c-8c21-419d-8c5d-2590f40228cb could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:58.071730 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e35dc239-1b83-4574-9fee-99b594ec3fd8 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb" status: 404 len: 111 microversion: 2.1 time: 0.185239 Sep 07 09:52:58.072429 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 986/2002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:57 2022] GET /compute/v2.1/servers/5d3a254c-8c21-419d-8c5d-2590f40228cb => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:58.073910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:58.089883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.090390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.090837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.091433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:58.093543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:58.099176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.099720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.100232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.103106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.103750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.104424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.105378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.106280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.107335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.159096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:52:58.270976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:58.318581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:58.321442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:58.325462 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6782a24d-2d87-4e35-9c7f-743ae0ad3067 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.277348 Sep 07 09:52:58.327551 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1017/2003] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:58 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:52:58.449624 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-319d1b8f-6822-4fdd-b7c4-859cb41ee26b tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 204 len: 0 microversion: 2.1 time: 0.370733 Sep 07 09:52:58.450221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 987/2004] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:52:58 2022] DELETE /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:52:58.461695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:58.463020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:58.480357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.483747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.484406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.486600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.489514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.490180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.809495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:58.820821 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3d7e24fe-1020-4ab9-825c-2096bc2d8565 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1501 microversion: 2.1 time: 0.364571 Sep 07 09:52:58.822068 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1018/2005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:58 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1501 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:58.829454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:58.830851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:58.839901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.840630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.841311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.842193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:58.842806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:58.844535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:58.952339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0059a66-50cb-4d58-b17a-17e62074f068 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Action: 'create', calling method: .version_select at 0x7f14b13329d0>, body: {"pool": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:59.459950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:52:59.468863 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9eca144d-179f-4c9b-bd38-2acd0e9a1549 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.645522 Sep 07 09:52:59.474130 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1019/2006] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:58 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:52:59.479227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3bae7975-6bd5-48e0-820a-d4f0a6fbbcad req-00210eac-722d-4510-9a9d-9c2ab158403a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311d2586-a4ff-42eb-90c9-bb56ecdd89e4", "name": "network-vif-deleted", "tag": "92d34c8a-9571-4fd5-b485-acd13e1cfef5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:52:59.515064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3bae7975-6bd5-48e0-820a-d4f0a6fbbcad req-00210eac-722d-4510-9a9d-9c2ab158403a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:59.516106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3bae7975-6bd5-48e0-820a-d4f0a6fbbcad req-00210eac-722d-4510-9a9d-9c2ab158403a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:59.516685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3bae7975-6bd5-48e0-820a-d4f0a6fbbcad req-00210eac-722d-4510-9a9d-9c2ab158403a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:59.553314 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3bae7975-6bd5-48e0-820a-d4f0a6fbbcad req-00210eac-722d-4510-9a9d-9c2ab158403a service nova] Creating event network-vif-deleted:92d34c8a-9571-4fd5-b485-acd13e1cfef5 for instance 311d2586-a4ff-42eb-90c9-bb56ecdd89e4 on n-h2-836830-16 Sep 07 09:52:59.573915 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3bae7975-6bd5-48e0-820a-d4f0a6fbbcad req-00210eac-722d-4510-9a9d-9c2ab158403a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097653 Sep 07 09:52:59.574552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1020/2007] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:52:59.594168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:59.600803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:59.621719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:59.622210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:59.622646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:59.623344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:59.638244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:59.641721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:59.692384 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec HTTP/1.1 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '798bd295-ae8f-4655-9822-59beb0f4feec'} Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:52:59.696098 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:52:59.699064 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:52:59.703068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:52:59.706160 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2b68087-f8b6-47e5-9e7b-0038a5616143 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 404 len: 111 microversion: 2.1 time: 0.125948 Sep 07 09:52:59.709634 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1021/2008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:52:59 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:52:59.723671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:52:59.738224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:52:59.747649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:59.748305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:59.750159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:52:59.751953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:52:59.753956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:52:59.754591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:00.161847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:00.182754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:00.187359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:00.189680 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb12777d-b340-4f84-8c00-e78dfe032292 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.478054 Sep 07 09:53:00.193039 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1022/2009] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:52:59 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:00.202713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:00.207609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:00.221373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:00.223698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:00.224306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:00.225029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:00.227672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:00.229298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:00.819135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224142a6fa7e4702b1780f4aaeb3f93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913dc4cafc574c08a81d9f473a935e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:00.828632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2177794b-c0bb-462d-a282-9dc38fafee62 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 200 len: 1501 microversion: 2.1 time: 0.633946 Sep 07 09:53:00.834538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1023/2010] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:00 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 1501 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:00.848559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:00.856716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:00.869997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:00.875370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:00.876055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:00.876993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:00.877807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:00.878966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:00.910315 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec/os-volume_attachments HTTP/1.1 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '798bd295-ae8f-4655-9822-59beb0f4feec'} Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:00.916620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:53:00.919554 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:00.926069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:00.927480 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df34ddbb-da2b-4e80-a61f-c52fc03e0bc3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.091510 Sep 07 09:53:00.928617 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1024/2011] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:53:00 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:00.938931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:00.942740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:00.961257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:00.962628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:00.967416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:00.968384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:00.969040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:00.969678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:01.414277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:01.423271 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-72a1f3b9-665e-4a23-85b9-02a8b275a1c9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.493319 Sep 07 09:53:01.429361 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1025/2012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:00 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:01.450817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:01.455445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:01.477223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:01.477955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:01.478579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:01.481050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:01.484109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:01.485495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:01.762768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:01.770128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:01.780795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:01.782345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:01.787023 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2349067-4eec-4626-8c72-e7ae7a8c357b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.353198 Sep 07 09:53:01.787876 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1026/2013] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:01 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:01.797815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1173955362", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:01.919982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:02.640324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:02.641718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:02.642399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:02.644293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:02.645088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:02.655672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:02.694412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:02.697023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:02.698384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:02.699975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:02.700644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:02.702348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:02.771690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:02.777759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:02.793786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:02.805658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:02.954785 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68f8469d-2553-4538-b726-ffcd3b021dd8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165521 Sep 07 09:53:02.957519 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1027/2014] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:02.967379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2d6c1902-7325-4609-9409-a0a2c4ec6f24 req-87d4bcf8-4270-4818-9e0b-9153b4958d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3597056-9689-447d-be91-becbca131e60", "name": "network-vif-deleted", "tag": "a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:02.995966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2d6c1902-7325-4609-9409-a0a2c4ec6f24 req-87d4bcf8-4270-4818-9e0b-9153b4958d47 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:02.997155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2d6c1902-7325-4609-9409-a0a2c4ec6f24 req-87d4bcf8-4270-4818-9e0b-9153b4958d47 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:02.999013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2d6c1902-7325-4609-9409-a0a2c4ec6f24 req-87d4bcf8-4270-4818-9e0b-9153b4958d47 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:03.033886 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2d6c1902-7325-4609-9409-a0a2c4ec6f24 req-87d4bcf8-4270-4818-9e0b-9153b4958d47 service nova] Creating event network-vif-deleted:a04e03f7-f9c9-4ee3-bf8d-adaedb10cc89 for instance d3597056-9689-447d-be91-becbca131e60 on n-h2-836830-16 Sep 07 09:53:03.053781 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2d6c1902-7325-4609-9409-a0a2c4ec6f24 req-87d4bcf8-4270-4818-9e0b-9153b4958d47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091280 Sep 07 09:53:03.054907 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1028/2015] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:03.069993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:03.074091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] [instance: d3597056-9689-447d-be91-becbca131e60] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:03.092870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:03.093425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:03.093884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:03.099091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:03.101319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:03.101686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:03.139768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] HTTP exception thrown: Instance d3597056-9689-447d-be91-becbca131e60 could not be found. Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Request method failure captured: Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 HTTP/1.1 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGgU8Dq8llGl0zZ4fUfEsLIYqnR5cZ0B3FD1FHdnkRd8e1cdtfpLeVGYIvZZQNTr-aXsxz36ysIFJYaU7YINgKS3xa5moTFRudGphi_UwJ0MbLSVFT5jeY0cX6L6HsE8ppcpHdR01-AhjdwDW8dHQwNqfl-Owp1xq72P8lRysHThu6I Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/913dc4cafc574c08a81d9f473a935e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_913dc4cafc574c08a81d9f473a935e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveMigrationTest-7365876 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 913dc4cafc574c08a81d9f473a935e5e Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveMigrationTest-7365876 Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveMigrationTest-7365876-project Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 224142a6fa7e4702b1780f4aaeb3f93f Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveMigrationTest-7365876-project Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance d3597056-9689-447d-be91-becbca131e60 could not be found. Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'd3597056-9689-447d-be91-becbca131e60'} Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3597056-9689-447d-be91-becbca131e60 could not be found. Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3597056-9689-447d-be91-becbca131e60 could not be found. Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:03.145279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3597056-9689-447d-be91-becbca131e60 could not be found. Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] Returning 404 to user: Instance d3597056-9689-447d-be91-becbca131e60 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a02391d8-e01f-4a79-9921-b0dd8250b592 tempest-LiveMigrationTest-7365876 tempest-LiveMigrationTest-7365876-project] 10.222.0.60 "GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60" status: 404 len: 111 microversion: 2.1 time: 0.090335 Sep 07 09:53:03.149384 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1029/2016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:03 2022] GET /compute/v2.1/servers/d3597056-9689-447d-be91-becbca131e60 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:03.165345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:03.166170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:03.185797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:03.186349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:03.191697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:03.196086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:03.196644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:03.199654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:03.952175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:03.965041 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0e342d6-5e36-444c-b724-ccd9359e4751 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.812552 Sep 07 09:53:03.968856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1030/2017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:03 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:03.984626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:03.985534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:04.008139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.010218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.013496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.014520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.015205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.015880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.250510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:04.267076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:04.268493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:04.277490 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49bcbd40-8ffe-46e6-84ef-574693907c72 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.307213 Sep 07 09:53:04.281723 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1031/2018] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:03 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:04.304266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:04.317321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:04.336526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.340855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.341518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.342414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.348558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.349012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.568989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:04.581259 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3feea4d2-8c5a-4b7e-b00f-41c464e3f221 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1219 microversion: 2.1 time: 0.293956 Sep 07 09:53:04.587147 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1032/2019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:04 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1219 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:04.612340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:04.613451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:04.631029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.631546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.631981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.637837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.638339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.638788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.713643 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0059a66-50cb-4d58-b17a-17e62074f068 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.181326 Sep 07 09:53:04.715330 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 988/2020] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:52:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:04.715892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:53:04.728497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:04.728991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:04.730501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:04.736090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c091e3c-d37b-4176-bae6-798b18e37d5e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Calling method '.version_select at 0x7f14b126e1f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:04.883895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'flavor' on Instance uuid 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:53:04.970161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'system_metadata' on Instance uuid 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:53:05.304113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0c091e3c-d37b-4176-bae6-798b18e37d5e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/626cf907-fd60-40f4-bd28-64a5bb94f0c9" status: 200 len: 141 microversion: 2.1 time: 0.580281 Sep 07 09:53:05.305436 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 989/2021] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:53:04 2022] GET /compute/v2.1/os-floating-ips/626cf907-fd60-40f4-bd28-64a5bb94f0c9 => generated 141 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:53:05.310562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:05.311704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:05.343269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:05.345888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:05.346587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:05.348140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:05.350832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:05.353413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:06.073235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'metadata' on Instance uuid 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:53:06.186032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=20 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:06.382528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:06.383037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:06.383485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:06.695129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:06.705965 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-941ba6fd-8ea7-41ad-88d9-e01a448fbb29 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 204 len: 0 microversion: 2.1 time: 2.096952 Sep 07 09:53:06.707258 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1033/2022] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:53:04 2022] DELETE /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 0 bytes in 2099 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 09:53:06.711678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92958d81-45fd-4b0e-8b65-20f57aa65fd2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 1.404700 Sep 07 09:53:06.712913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 990/2023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:05 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:06.718323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:06.719055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:06.721085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41f05914-ed43-4858-b09a-a9de6a1d9d08 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Calling method '.version_select at 0x7f14b12a9040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:06.738628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:06.739341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:06.739795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:06.746517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:06.750273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:06.750871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:06.875455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:06.891875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:06.895945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:06.897302 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f8513aa-d085-4caa-b67a-01698b1bf8cd tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 200 len: 1266 microversion: 2.25 time: 0.188781 Sep 07 09:53:06.898054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1034/2024] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:06 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:07.101300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41f05914-ed43-4858-b09a-a9de6a1d9d08 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.387074 Sep 07 09:53:07.102028 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 991/2025] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:53:06 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:07.108322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:07.109098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:07.122086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:07.123283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:07.125324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:07.126121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:07.134194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:07.135009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:07.163286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:07.168008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:07.169557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:07.171811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:07.172844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:07.173544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:07.174740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:07.213382 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e12ae0c3-926a-4b62-a4dc-b3d4013c5f7d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.312669 Sep 07 09:53:07.214263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1035/2026] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:53:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:07.220501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f956906-8c87-46bc-860e-d142894e9563 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Calling method '.version_select at 0x7f14b1890820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:07.867477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:07.875067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa1b1be0-99b5-4404-a7a8-163ad90247d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1273 microversion: 2.1 time: 0.770317 Sep 07 09:53:07.882427 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 992/2027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:07 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1273 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:07.887651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:07.894909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:07.895393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:07.895833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:07.896569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:07.897020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:07.897471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:07.973267 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c31b4f3-9af3-4831-b95d-6dbc13e2af57 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.089659 Sep 07 09:53:07.974057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 993/2028] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 7 09:53:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:08.094749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1402867422", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "398b57df-c81f-4226-821e-361eaefc682b"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:08.185568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] validate_networks() for [('398b57df-c81f-4226-821e-361eaefc682b', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:09.782004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:09.782575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:09.782904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:09.783321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:09.783756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:09.798674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:09.799167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:09.803563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:09.806609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:09.810239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:09.811184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:09.890469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Getting quotas for project 7b1075d112444e1c94a368b8639aee66. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:09.900163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:09.908173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Getting quotas for user 1cdb75ae4a3449cbbafb944f29aaf852 and project 7b1075d112444e1c94a368b8639aee66. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:09.954660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:09.960555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:10.056134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99b6cb51-b3ea-48d0-8945-2a0396b45617 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.080434 Sep 07 09:53:10.063751 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 994/2029] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:10.069657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:10.070548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:10.078977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.079818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.084575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.086298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.087177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.087975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.352096 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f956906-8c87-46bc-860e-d142894e9563 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/626cf907-fd60-40f4-bd28-64a5bb94f0c9" status: 202 len: 0 microversion: 2.1 time: 3.136220 Sep 07 09:53:10.353310 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1036/2030] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:53:07 2022] DELETE /compute/v2.1/os-floating-ips/626cf907-fd60-40f4-bd28-64a5bb94f0c9 => generated 0 bytes in 3138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:53:10.362724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:10.363400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 6df62c8a-df0b-4ced-9622-672ef367267a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:10.392987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.395241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.398558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.399877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.400506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.401086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.430478 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] HTTP exception thrown: Instance 6df62c8a-df0b-4ced-9622-672ef367267a could not be found. Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Request method failure captured: Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a HTTP/1.1 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhWUlEb9INozZJYgPXh93RU0vW5Ixy7JkVXFZ24hxs_T0WvOQd9HT46lPPIA-asPcSNsSgDoxYgg6pW9xyMnfImbL7ErMuX1tilK_mmsk5XTjyl9etstda8-wDZ_StvhFcqD9mXSCslr2NVxAjyhaZbHIfbsd2lc9I4GQybFMooCes Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_607bcf1927e94f8a959bb30fce95ca8f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 21737ade68344e3298131ce9189f5d8a Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 6df62c8a-df0b-4ced-9622-672ef367267a could not be found. Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6df62c8a-df0b-4ced-9622-672ef367267a'} Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df62c8a-df0b-4ced-9622-672ef367267a could not be found. Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df62c8a-df0b-4ced-9622-672ef367267a could not be found. Sep 07 09:53:10.437825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df62c8a-df0b-4ced-9622-672ef367267a could not be found. Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:10.441964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Returning 404 to user: Instance 6df62c8a-df0b-4ced-9622-672ef367267a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:10.450060 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5574811f-50c2-4f0b-8f45-0ee3a00046f0 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a" status: 404 len: 111 microversion: 2.25 time: 0.094841 Sep 07 09:53:10.450664 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1037/2031] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:10 2022] GET /compute/v2.1/servers/6df62c8a-df0b-4ced-9622-672ef367267a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:53:10.457172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:10.465009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.465611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.466133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.466966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.471961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.473445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.537706 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-998b3b87-40c9-4534-87fc-8ecd5ef81016 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.085888 Sep 07 09:53:10.547397 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1038/2032] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:53:10 2022] GET /compute/v2.1/os-services => generated 949 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:10.561471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bfaeefa3-fdbc-4ae5-961a-9a148af8cb18 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b17f1dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:10.660415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bfaeefa3-fdbc-4ae5-961a-9a148af8cb18 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/8341f27e-344b-4edc-b22e-e55fda1f0eca" status: 200 len: 661 microversion: 2.1 time: 0.107074 Sep 07 09:53:10.671265 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1039/2033] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:10 2022] GET /compute/v2.1/images/8341f27e-344b-4edc-b22e-e55fda1f0eca => generated 661 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:10.688501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:10.689255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:10.702217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.703142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.704555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.708277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:10.710786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:10.711389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:10.861434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:10.883381 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71b23b30-dec4-438b-8673-9fe98f2c18e9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.815247 Sep 07 09:53:10.886774 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 995/2034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:10 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:10.901758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d9302f6-d4c6-4f34-8544-0dcbe7fc8dd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:10.902651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d9302f6-d4c6-4f34-8544-0dcbe7fc8dd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:11.236318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d9302f6-d4c6-4f34-8544-0dcbe7fc8dd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:11.247327 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d9302f6-d4c6-4f34-8544-0dcbe7fc8dd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1225 microversion: 2.1 time: 0.357182 Sep 07 09:53:11.250651 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 996/2035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:10 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1225 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:11.262587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b24229e-ba66-43d5-96bd-664c08020783 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Action: 'create', calling method: .version_select at 0x7f14b5d95550>, body: {"pool": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:11.706047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:11.714894 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ba00b06-663a-4d4f-8a09-48dd335dc97c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1315 microversion: 2.1 time: 1.040009 Sep 07 09:53:11.720779 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1040/2036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:10 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:11.746048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:11.775508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:11.776854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:11.777378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:11.778220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:11.789694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:11.792367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:11.960475 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f61c5c8-a2aa-4b90-8d41-74cf7eae1432 tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-836830-16&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.238206 Sep 07 09:53:11.963541 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1041/2037] 10.222.0.60 () {58 vars in 1196 bytes} [Wed Sep 7 09:53:11 2022] GET /compute/v2.1/os-services?host=n-d-836830-16&binary=xxx => generated 16 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:53:11.984303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7b2b725-1e39-426f-af5c-2f0e428983a7 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1890ee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:12.092631 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7b2b725-1e39-426f-af5c-2f0e428983a7 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/8341f27e-344b-4edc-b22e-e55fda1f0eca" status: 200 len: 661 microversion: 2.1 time: 0.127551 Sep 07 09:53:12.093261 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1042/2038] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:11 2022] GET /compute/v2.1/images/8341f27e-344b-4edc-b22e-e55fda1f0eca => generated 661 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:12.134488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:12.135135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:12.154118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:12.159169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:12.161645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:12.162893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:12.165912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:12.166614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:12.794156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=22 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:13.362261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:13.379727 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d558d2c9-69fd-418f-8b1a-aa93ca07e397 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 1.265021 Sep 07 09:53:13.405870 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1043/2039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:12 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:13.423923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:13.434237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:13.436642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:13.438011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:13.459051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:13.461172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:13.463381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:13.553784 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-22f78eb3-4b07-4e87-9da3-9519005bc81d tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.146499 Sep 07 09:53:13.555349 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1044/2040] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:53:13 2022] GET /compute/v2.1/os-services => generated 949 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:13.569711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:13.573663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:13.596667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:13.597812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:13.597970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:13.598706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:13.599177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:13.603054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.148895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:14.158166 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b3ff75a-40c9-4067-a10c-7a9feb041c2a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1283 microversion: 2.1 time: 0.601555 Sep 07 09:53:14.175597 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1045/2041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:13 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1283 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:14.175597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6c25136d-0e6c-403f-bf8b-8c9c1da4fa67 req-4318da0b-d456-46ec-a504-430875fde693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eda8ab4-7762-4e34-9ea3-e64fba33d3a7", "tag": "b0164910-79c6-40b3-a68b-fbf118925571"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:14.194177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c25136d-0e6c-403f-bf8b-8c9c1da4fa67 req-4318da0b-d456-46ec-a504-430875fde693 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.194668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c25136d-0e6c-403f-bf8b-8c9c1da4fa67 req-4318da0b-d456-46ec-a504-430875fde693 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.195109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c25136d-0e6c-403f-bf8b-8c9c1da4fa67 req-4318da0b-d456-46ec-a504-430875fde693 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.225463 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6c25136d-0e6c-403f-bf8b-8c9c1da4fa67 req-4318da0b-d456-46ec-a504-430875fde693 service nova] Creating event network-changed:b0164910-79c6-40b3-a68b-fbf118925571 for instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 on n-h2-836830-16 Sep 07 09:53:14.243187 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6c25136d-0e6c-403f-bf8b-8c9c1da4fa67 req-4318da0b-d456-46ec-a504-430875fde693 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072402 Sep 07 09:53:14.244080 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1046/2042] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:14.249508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:14.250242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:14.271642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.272153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.272610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.273372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.273840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.274677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.516903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:14.524175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:14.526482 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-313d0b3a-45eb-4839-b1b0-691a427696df tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1315 microversion: 2.1 time: 0.281226 Sep 07 09:53:14.541573 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1047/2043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:14 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:14.546787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:14.551091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.551779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.552234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.552986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.560699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.561231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.616204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b5a6237d-fda5-4988-97a4-e7c03db259dc tempest-ServicesAdminNegativeTestJSON-2000212960 tempest-ServicesAdminNegativeTestJSON-2000212960-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.073369 Sep 07 09:53:14.624129 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1048/2044] 10.222.0.60 () {58 vars in 1198 bytes} [Wed Sep 7 09:53:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:53:14.630196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3914688a-fecd-441c-846a-b1da89f7792d tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b18cde50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:14.703484 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3914688a-fecd-441c-846a-b1da89f7792d tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/717add26-ae8f-45ec-bcab-f86a4bd654aa" status: 200 len: 660 microversion: 2.1 time: 0.078161 Sep 07 09:53:14.704947 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1049/2045] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:14 2022] GET /compute/v2.1/images/717add26-ae8f-45ec-bcab-f86a4bd654aa => generated 660 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:14.719150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:14.731461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:14.742909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.743597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.744189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:14.745063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:14.745771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:14.746359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:15.351696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:15.363669 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6202866e-bcee-4394-92ec-c2d3ebee9488 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.647655 Sep 07 09:53:15.380798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1050/2046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:14 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:15.697533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dcee6e4-3bed-4a5c-a4d3-9d9b0eabb2bc tempest-ServicesAdminNegativeTestJSON-685052261 tempest-ServicesAdminNegativeTestJSON-685052261-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:15.701468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dcee6e4-3bed-4a5c-a4d3-9d9b0eabb2bc tempest-ServicesAdminNegativeTestJSON-685052261 tempest-ServicesAdminNegativeTestJSON-685052261-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c177d2c97b5b4d57a480c1f750cc9e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e490d7a89941f0bc7f68be3bb191cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dcee6e4-3bed-4a5c-a4d3-9d9b0eabb2bc tempest-ServicesAdminNegativeTestJSON-685052261 tempest-ServicesAdminNegativeTestJSON-685052261-project] Request method failure captured: Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoA967JyisN-X8ldV3ajDpex9NxFfEfGx_DODnHqkrOpTLj6lUc4C5ihveoiDobn7101m2_lRvJ1B3KDPBOLUfyHvo-wDdz-QufaoaXwSDjAdcY2NViRSrHnWJmhRpcWcfqsT-29AzBE8_s44VKomNCBUVfyXRznrHba5we1nOOrqk Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f0e490d7a89941f0bc7f68be3bb191cf Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-685052261 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f0e490d7a89941f0bc7f68be3bb191cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f0e490d7a89941f0bc7f68be3bb191cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f0e490d7a89941f0bc7f68be3bb191cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f0e490d7a89941f0bc7f68be3bb191cf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-685052261 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f0e490d7a89941f0bc7f68be3bb191cf Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-685052261 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServicesAdminNegativeTestJSON-685052261-project Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: c177d2c97b5b4d57a480c1f750cc9e87 Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-685052261-project Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: action_args: {} Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 09:53:15.703314 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dcee6e4-3bed-4a5c-a4d3-9d9b0eabb2bc tempest-ServicesAdminNegativeTestJSON-685052261 tempest-ServicesAdminNegativeTestJSON-685052261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:15.707861 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8dcee6e4-3bed-4a5c-a4d3-9d9b0eabb2bc tempest-ServicesAdminNegativeTestJSON-685052261 tempest-ServicesAdminNegativeTestJSON-685052261-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.332331 Sep 07 09:53:15.718584 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1051/2047] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:53:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 347 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:15.735022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00dc8a23-f121-46b5-a8c1-c14e91a4ba2b tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b17caa60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:15.808103 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00dc8a23-f121-46b5-a8c1-c14e91a4ba2b tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/717add26-ae8f-45ec-bcab-f86a4bd654aa" status: 200 len: 660 microversion: 2.1 time: 0.087693 Sep 07 09:53:15.812067 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1052/2048] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:15 2022] GET /compute/v2.1/images/717add26-ae8f-45ec-bcab-f86a4bd654aa => generated 660 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:15.824116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:15.827333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:15.839878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:15.845859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:15.846689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:15.847668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:15.848299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:15.848889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:16.452446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:16.462131 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bda5d67c-ca2f-4245-9e2b-aeba6fb19b51 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.648570 Sep 07 09:53:16.472208 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1053/2049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:15 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:16.482285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:16.482285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:16.488595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:16.489105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:16.489617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:16.490347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:16.490815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:16.491757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:17.197374 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b24229e-ba66-43d5-96bd-664c08020783 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.942914 Sep 07 09:53:17.207516 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 997/2050] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:53:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:17.209388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:17.212299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:17.237195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:17.245554 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f02c494b-48bd-449a-9f3b-5f3c1986d028 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1315 microversion: 2.1 time: 0.772905 Sep 07 09:53:17.270538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1054/2051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:16 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:17.272261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:17.277628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:17.278481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:17.290289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:17.290825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:17.291543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:17.296624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:17.299758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:17.301597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:17.302389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:17.303505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:17.304171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:17.304751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:17.307257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:17.398982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:53:17.574728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad61bdfb-0444-41ab-addb-f8a386f82474 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 204 len: 0 microversion: 2.25 time: 0.373820 Sep 07 09:53:17.576304 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 998/2052] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:53:17 2022] DELETE /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:53:17.585251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55d7e4f2-5096-47cc-9bb0-c967ef24a1fa tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Calling method '.version_select at 0x7f14b13c9dc0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:18.009615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:18.028663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f55f678-7721-44b7-9819-7372dd530e08 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.756683 Sep 07 09:53:18.030965 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1055/2053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:17 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:18.037723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:18.038941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:18.074433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:18.077642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:18.078365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:18.079360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:18.081555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:18.084048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:18.759274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:18.769710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-235a6084-8898-4218-973a-8792790b73b1 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.736932 Sep 07 09:53:18.770953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1056/2054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:18 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:18.776042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:18.776852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:18.793523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:18.797265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:18.797667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:18.799712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:18.800266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:18.800707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:19.568151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:19.591404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:19.599910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:19.602488 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fcdf4289-b0c8-440e-977b-b9d6158203d6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1732 microversion: 2.25 time: 0.830038 Sep 07 09:53:19.604149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1057/2055] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:18 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1732 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:19.613283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04a57f20-f3ed-4743-b041-8ae368e9a6d0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b206f0d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:19.717416 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04a57f20-f3ed-4743-b041-8ae368e9a6d0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/0128c2aa-4899-400b-a5cd-0719007d952e" status: 200 len: 662 microversion: 2.1 time: 0.110547 Sep 07 09:53:19.722521 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1058/2056] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:19 2022] GET /compute/v2.1/images/0128c2aa-4899-400b-a5cd-0719007d952e => generated 662 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:19.742361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:19.743484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:19.755539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:19.758238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:19.759258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:19.760643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:19.761871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:19.762927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:19.854309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:20.277939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:20.291509 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e82cefb2-c10e-4d9b-8176-c1450b43bff2 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1315 microversion: 2.1 time: 0.566057 Sep 07 09:53:20.292719 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1059/2057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:19 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:20.298861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:20.300358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:20.307313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:20.308029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:20.309023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:20.309935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:20.310404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:20.311125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:20.821071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:20.829065 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-038a3d12-649b-4984-8f34-9bd3c99b65b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.535246 Sep 07 09:53:20.829905 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1060/2058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:20 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:20.835605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91e6a1c2-1ada-498f-8bd6-f6091a8d6339 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1b54940>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:20.886033 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91e6a1c2-1ada-498f-8bd6-f6091a8d6339 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/0128c2aa-4899-400b-a5cd-0719007d952e" status: 200 len: 662 microversion: 2.1 time: 0.054882 Sep 07 09:53:20.886713 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1061/2059] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:20 2022] GET /compute/v2.1/images/0128c2aa-4899-400b-a5cd-0719007d952e => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:20.891226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:20.891916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:20.899477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:20.899477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:20.900166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:20.901007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:20.901580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:20.902086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.013490 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55d7e4f2-5096-47cc-9bb0-c967ef24a1fa tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a" status: 202 len: 0 microversion: 2.1 time: 3.435680 Sep 07 09:53:21.014168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 999/2060] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:53:17 2022] DELETE /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a => generated 0 bytes in 3437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:53:21.019771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-92e7fef1-7ef2-4d98-a8bd-8e56447c2fba req-0c30180c-a7e3-439e-b157-64c8cd0714e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eda8ab4-7762-4e34-9ea3-e64fba33d3a7", "name": "network-vif-plugged", "status": "completed", "tag": "b0164910-79c6-40b3-a68b-fbf118925571"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:21.029755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-92e7fef1-7ef2-4d98-a8bd-8e56447c2fba req-0c30180c-a7e3-439e-b157-64c8cd0714e3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.030246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-92e7fef1-7ef2-4d98-a8bd-8e56447c2fba req-0c30180c-a7e3-439e-b157-64c8cd0714e3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.030847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-92e7fef1-7ef2-4d98-a8bd-8e56447c2fba req-0c30180c-a7e3-439e-b157-64c8cd0714e3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.043657 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-92e7fef1-7ef2-4d98-a8bd-8e56447c2fba req-0c30180c-a7e3-439e-b157-64c8cd0714e3 service nova] Creating event network-vif-plugged:b0164910-79c6-40b3-a68b-fbf118925571 for instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 on n-h2-836830-16 Sep 07 09:53:21.049825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-92e7fef1-7ef2-4d98-a8bd-8e56447c2fba req-0c30180c-a7e3-439e-b157-64c8cd0714e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034279 Sep 07 09:53:21.055929 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1000/2061] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:21.063398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8ed5e693-5da0-4074-8469-3393858bc9df req-c585cd31-dba2-4ea7-826c-85bd4f12ef81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968bb749-d5fe-4bec-ad1b-f2092f9c67aa", "tag": "2398da42-c782-40e3-8857-b50dc5bb4d67"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:21.076624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ed5e693-5da0-4074-8469-3393858bc9df req-c585cd31-dba2-4ea7-826c-85bd4f12ef81 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.077386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ed5e693-5da0-4074-8469-3393858bc9df req-c585cd31-dba2-4ea7-826c-85bd4f12ef81 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.078099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ed5e693-5da0-4074-8469-3393858bc9df req-c585cd31-dba2-4ea7-826c-85bd4f12ef81 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.091951 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8ed5e693-5da0-4074-8469-3393858bc9df req-c585cd31-dba2-4ea7-826c-85bd4f12ef81 service nova] Creating event network-changed:2398da42-c782-40e3-8857-b50dc5bb4d67 for instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa on n-h2-836830-16 Sep 07 09:53:21.097644 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8ed5e693-5da0-4074-8469-3393858bc9df req-c585cd31-dba2-4ea7-826c-85bd4f12ef81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039774 Sep 07 09:53:21.098518 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1001/2062] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:21.245935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:21.385212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:21.395586 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67cd5f2c-b3e1-49ce-934d-e0735bdfa26a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.507680 Sep 07 09:53:21.403612 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1062/2063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:20 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:21.422665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:21.423755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:21.430979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.431707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.432510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.433583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.434248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.435196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.473258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Calling method '.version_select at 0x7f14b12f1700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:21.486333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.486823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.487941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.488864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.489381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.489797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.513208 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87664eec-48a3-4f8c-b09d-4c271914cc10 tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.412875 Sep 07 09:53:21.514098 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1002/2064] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 7 09:53:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:21.519759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6b0d74e-74b5-4815-8bd5-370c93ea2d6e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Calling method '.version_select at 0x7f14b5d7f940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:21.687382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-f6b0d74e-74b5-4815-8bd5-370c93ea2d6e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5b90c9ee-7cd0-4f66-8874-c90b336b266a could not be found", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:53:21.687564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:21.688100 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f6b0d74e-74b5-4815-8bd5-370c93ea2d6e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] HTTP exception thrown: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6b0d74e-74b5-4815-8bd5-370c93ea2d6e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Request method failure captured: Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a HTTP/1.1 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGn6Gp877bhZiRiAJtXah3lTi0F7tDwzdaagvApMXuGYwC2vKuJeKKdUNMbMHxtM2D_OzbnOkVQ2MaGXB_mYmlvSVzfnpYjFMmV2cuGhgMtdrZwQb6iEEdAZlXkpDAfZ9ojCUv9wW-_C6tXdemUVMBjt1iRcxgG8gSMzpaVWUe86whY Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 3d0109b4508c499ab1e5048aecfac3a7 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsTestJSON-1331154367 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3d0109b4508c499ab1e5048aecfac3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3d0109b4508c499ab1e5048aecfac3a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3d0109b4508c499ab1e5048aecfac3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3d0109b4508c499ab1e5048aecfac3a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsTestJSON-1331154367 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 3d0109b4508c499ab1e5048aecfac3a7 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1331154367 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsTestJSON-1331154367-project Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e6014fb6a3054747a2d87890e427eda1 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsTestJSON-1331154367-project Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: exception: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5b90c9ee-7cd0-4f66-8874-c90b336b266a'} Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5b90c9ee-7cd0-4f66-8874-c90b336b266a could not be found Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56f9db89-bffd-434f-abe7-6dc12581b126'] Sep 07 09:53:21.692562 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a. Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6b0d74e-74b5-4815-8bd5-370c93ea2d6e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Returning 404 to user: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6b0d74e-74b5-4815-8bd5-370c93ea2d6e tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a" status: 404 len: 111 microversion: 2.1 time: 0.178905 Sep 07 09:53:21.696746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1003/2065] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:53:21 2022] GET /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:21.703739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:21.706597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1313543153", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:21.706835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:21.708181 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c04350e3-9d97-4cce-b94e-30e28e9835a6 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 200 len: 1664 microversion: 2.25 time: 0.303321 Sep 07 09:53:21.714891 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1063/2066] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:21 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 1664 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:21.723941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:21.724981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:21.751018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.751489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.751965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.753071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:21.754007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:21.755563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:21.807117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:22.040306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:22.048314 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61a5f1ba-8da3-4007-9feb-7f7601a568d8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1315 microversion: 2.1 time: 0.331970 Sep 07 09:53:22.049075 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1064/2067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:21 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:22.120912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:22.121555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:22.121830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:22.122262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:22.122671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:22.133097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:22.133616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:22.134212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:22.135687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:22.136233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:22.136809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:22.157257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Getting quotas for project 22c907cee7e14aaaa5d0e145c1c682b1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:22.177426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Getting quotas for user 05f721b5776f4323911a52b3708c6bd3 and project 22c907cee7e14aaaa5d0e145c1c682b1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:22.201021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:22.205395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:22.232713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1672063645", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:22.293409 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25734c68-1fad-48b7-b30c-c8d8841e77b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594416 Sep 07 09:53:22.294851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1004/2068] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:22.300432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-845601038", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:22.338942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:22.419733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:23.200145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:23.201432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:23.202081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:23.202642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:23.203066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:23.217377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Getting quotas for project a3dd8806dfa9480bad69f5aef6eb39b8. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:23.227647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Getting quotas for user c3bb6f1c36034cbdadba40c90f5736bd and project a3dd8806dfa9480bad69f5aef6eb39b8. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:23.245159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 07 09:53:23.246933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Request method failure captured: Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 1751 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGoQ3U7gng-90Ko9Ou8jsi3sY-TCiRr2QcLyGNgWpCp4mnNliv4snqEt3fVSFf1bfFY36Jw0OnGE9lRF-_41Wgm8xVbvwqPh4acasKetjW8TF_ARhaz4K3SPuheu-kMJJ3KIaruWBdmvU1ozaE1DC-wTjhxfjk-pu_DRGwnzJNZO3rU Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: a3dd8806dfa9480bad69f5aef6eb39b8 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-809903435 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a3dd8806dfa9480bad69f5aef6eb39b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3dd8806dfa9480bad69f5aef6eb39b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3dd8806dfa9480bad69f5aef6eb39b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a3dd8806dfa9480bad69f5aef6eb39b8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-809903435 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: a3dd8806dfa9480bad69f5aef6eb39b8 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-809903435 Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-809903435-project Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: c3bb6f1c36034cbdadba40c90f5736bd Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-809903435-project Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-845601038", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:53:23.248368 n-d-836830-16 devstack@n-api.service[128832]: exception: Maximum number of metadata items exceeds 128 Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-845601038', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:23.250165 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 07 09:53:23.252311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.253731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:23.253731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:23.253731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:23.253731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:23.255527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:23.256421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:23.257660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-343ebfd1-29b3-4aab-9e4d-a7041bd85cee tempest-AbsoluteLimitsNegativeTestJSON-809903435 tempest-AbsoluteLimitsNegativeTestJSON-809903435-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.961151 Sep 07 09:53:23.258590 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1005/2069] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Sep 7 09:53:22 2022] POST /compute/v2.1/servers => generated 87 bytes in 963 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:53:23.269777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5e4360b-151f-4632-8907-c45e650ae830 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Calling method '.version_select at 0x7f14b1932b80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:23.310056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Getting quotas for project 5e3d627af5d143a3b9a1d459d9c38cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:23.312832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:23.323521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Getting quotas for user 4ab5920bb33b4fd6989e01e5c9c6d98d and project 5e3d627af5d143a3b9a1d459d9c38cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:23.347734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:23.351668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:23.407438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-a5e4360b-151f-4632-8907-c45e650ae830 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5b90c9ee-7cd0-4f66-8874-c90b336b266a could not be found", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a5e4360b-151f-4632-8907-c45e650ae830 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] HTTP exception thrown: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5e4360b-151f-4632-8907-c45e650ae830 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Request method failure captured: Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a HTTP/1.1 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGn6Gp877bhZiRiAJtXah3lTi0F7tDwzdaagvApMXuGYwC2vKuJeKKdUNMbMHxtM2D_OzbnOkVQ2MaGXB_mYmlvSVzfnpYjFMmV2cuGhgMtdrZwQb6iEEdAZlXkpDAfZ9ojCUv9wW-_C6tXdemUVMBjt1iRcxgG8gSMzpaVWUe86whY Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 3d0109b4508c499ab1e5048aecfac3a7 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsTestJSON-1331154367 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3d0109b4508c499ab1e5048aecfac3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3d0109b4508c499ab1e5048aecfac3a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3d0109b4508c499ab1e5048aecfac3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3d0109b4508c499ab1e5048aecfac3a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsTestJSON-1331154367 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 3d0109b4508c499ab1e5048aecfac3a7 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1331154367 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsTestJSON-1331154367-project Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e6014fb6a3054747a2d87890e427eda1 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsTestJSON-1331154367-project Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: exception: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5b90c9ee-7cd0-4f66-8874-c90b336b266a'} Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:53:23.413313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5b90c9ee-7cd0-4f66-8874-c90b336b266a could not be found Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c58527e-b67b-4329-bb2c-97d5066e427d'] Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a. Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5e4360b-151f-4632-8907-c45e650ae830 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] Returning 404 to user: Floating IP not found for ID 5b90c9ee-7cd0-4f66-8874-c90b336b266a {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5e4360b-151f-4632-8907-c45e650ae830 tempest-FloatingIPsTestJSON-1331154367 tempest-FloatingIPsTestJSON-1331154367-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a" status: 404 len: 111 microversion: 2.1 time: 0.152156 Sep 07 09:53:23.416467 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1006/2070] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:53:23 2022] DELETE /compute/v2.1/os-floating-ips/5b90c9ee-7cd0-4f66-8874-c90b336b266a => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:23.423901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:23.427253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:23.437839 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1e1b0ad-670d-46dc-b1e0-a53495bfe119 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387460 Sep 07 09:53:23.438569 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1065/2071] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:23.443550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:23.444378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:23.444887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:23.445779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:23.446420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:23.446914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:23.450776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:23.451743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:23.470230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:23.471167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:23.490178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:23.492249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:23.493897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:23.495498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:23.959724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:23.971454 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94ad42f3-7e3f-4237-a6e3-54d990af1fb2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1499 microversion: 2.1 time: 0.556689 Sep 07 09:53:23.972293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1007/2072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:23 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1499 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:23.983335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2039971837", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:23.984460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:23.994978 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3719302b-0575-4464-a3b2-f64fdd76a392 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.555346 Sep 07 09:53:24.007240 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1066/2073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:23 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:24.020021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:24.020851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: 1c670f25-8fd6-4cb0-8f33-b8544182fa74] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:24.037912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.038603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.039152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:24.039986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.040546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.056553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:24.075663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] HTTP exception thrown: Instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 could not be found. Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Request method failure captured: Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 HTTP/1.1 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhWUlEb9INozZJYgPXh93RU0vW5Ixy7JkVXFZ24hxs_T0WvOQd9HT46lPPIA-asPcSNsSgDoxYgg6pW9xyMnfImbL7ErMuX1tilK_mmsk5XTjyl9etstda8-wDZ_StvhFcqD9mXSCslr2NVxAjyhaZbHIfbsd2lc9I4GQybFMooCes Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_607bcf1927e94f8a959bb30fce95ca8f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 21737ade68344e3298131ce9189f5d8a Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 could not be found. Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1c670f25-8fd6-4cb0-8f33-b8544182fa74'} Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 could not be found. Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 could not be found. Sep 07 09:53:24.076874 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 could not be found. Sep 07 09:53:24.080965 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:24.081713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Returning 404 to user: Instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:24.082696 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a543016e-1d2f-468a-8cf2-785a76c556db tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74" status: 404 len: 111 microversion: 2.25 time: 0.076366 Sep 07 09:53:24.083366 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1067/2074] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:24 2022] GET /compute/v2.1/servers/1c670f25-8fd6-4cb0-8f33-b8544182fa74 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:53:24.088582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:24.089334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:24.097553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.098239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.099044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:24.100203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.102002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.102915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:24.118356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:24.770398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:24.782768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f5bae99-8685-4cfb-98ec-37fc353676c0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1315 microversion: 2.1 time: 0.698070 Sep 07 09:53:24.794374 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1068/2075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:24 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:24.806956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-69a37fbb-26bc-4798-83f4-0036ab47f82e req-d75350b4-4cfb-477a-bea6-85773bdefa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c670f25-8fd6-4cb0-8f33-b8544182fa74", "name": "network-vif-deleted", "tag": "3089b6fa-f731-4eac-8874-7cddb46b3a8d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:24.820527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-69a37fbb-26bc-4798-83f4-0036ab47f82e req-d75350b4-4cfb-477a-bea6-85773bdefa89 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.821510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-69a37fbb-26bc-4798-83f4-0036ab47f82e req-d75350b4-4cfb-477a-bea6-85773bdefa89 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.823166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-69a37fbb-26bc-4798-83f4-0036ab47f82e req-d75350b4-4cfb-477a-bea6-85773bdefa89 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:24.839992 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-69a37fbb-26bc-4798-83f4-0036ab47f82e req-d75350b4-4cfb-477a-bea6-85773bdefa89 service nova] Creating event network-vif-deleted:3089b6fa-f731-4eac-8874-7cddb46b3a8d for instance 1c670f25-8fd6-4cb0-8f33-b8544182fa74 on n-h1-836830-16 Sep 07 09:53:24.861803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-69a37fbb-26bc-4798-83f4-0036ab47f82e req-d75350b4-4cfb-477a-bea6-85773bdefa89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066021 Sep 07 09:53:24.869509 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1069/2076] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:24.880183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:24.881029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:24.889270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.891005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.891689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:24.892647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:24.893406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:24.895491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.069175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:25.082224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:25.082719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:25.083229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:25.083694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:25.083963 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61274169-9e9d-42b4-bf11-caf592e219a2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1274 microversion: 2.1 time: 0.211446 Sep 07 09:53:25.084286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:25.097215 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1070/2077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:24 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:25.099356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc06e8c9-5599-41c9-afd9-00601825f761"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:25.100674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.101534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.102389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.103287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.103924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.104637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.108925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:25.127060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.129237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.129944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.131891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.133850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.136187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.172449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Getting quotas for project 22c907cee7e14aaaa5d0e145c1c682b1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:25.177850 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Cannot 'attach_volume' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state rescued Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/os-volume_attachments HTTP/1.1 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 74 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: {"volumeAttachment": {"volumeId": "bc06e8c9-5599-41c9-afd9-00601825f761"}} Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot 'attach_volume' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state rescued Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '839a4577-a9a7-40c2-a837-4ec147ebb4fe', 'body': {'volumeAttachment': {'volumeId': 'bc06e8c9-5599-41c9-afd9-00601825f761'}}} Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 09:53:25.179994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state rescued Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state rescued Sep 07 09:53:25.183339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:25.186481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 409 to user: Cannot 'attach_volume' instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe while it is in vm_state rescued {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:25.187718 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ce5b758-1bb3-4a48-a9d7-a96177f9f1d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.100740 Sep 07 09:53:25.187826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Getting quotas for user 05f721b5776f4323911a52b3708c6bd3 and project 22c907cee7e14aaaa5d0e145c1c682b1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:25.192892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1071/2078] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 09:53:25 2022] POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/os-volume_attachments => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:53:25.199730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1b0d87d-1650-4758-b421-7536cbcb0a8c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '.version_select at 0x7f14b18cdee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:25.203260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:25.205475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:25.234549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1b0d87d-1650-4758-b421-7536cbcb0a8c tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202538004" status: 204 len: 0 microversion: 2.25 time: 0.039527 Sep 07 09:53:25.241261 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1072/2079] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 7 09:53:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202538004 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:53:25.252781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:25.254402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:25.270728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.271637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.274058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.276910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.278354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.278990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.314105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:25.319764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0da3a538-a45b-440b-8f02-937e683bf199 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345170 Sep 07 09:53:25.320365 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1008/2080] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:25.330774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:25.332321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:25.346036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.348050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.348665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.349646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.353553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.354393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.491722 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e3f63267-a9a4-4447-8594-ad3da461e552 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action" status: 202 len: 0 microversion: 2.1 time: 0.167401 Sep 07 09:53:25.494681 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1009/2081] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:53:25 2022] POST /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:53:25.517851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f2e0c57f-1539-4a31-b16b-97656b7d6663 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:25.520329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f2e0c57f-1539-4a31-b16b-97656b7d6663 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:25.811304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f2e0c57f-1539-4a31-b16b-97656b7d6663 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:25.821552 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f2e0c57f-1539-4a31-b16b-97656b7d6663 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1218 microversion: 2.1 time: 0.325147 Sep 07 09:53:25.826349 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1010/2082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:25 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1218 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:25.841158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:25.841844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:25.860522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.861729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.862403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:25.866397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:25.867070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:25.868902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:26.047645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:26.065296 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8bdcaab4-c000-4870-8bcf-80a133c2cfcc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.819936 Sep 07 09:53:26.082630 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1073/2083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:25 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:26.098360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:26.099104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:26.127265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:26.128740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:26.129332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:26.130079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:26.130548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:26.131260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:26.684296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:26.717287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e6070b6-c53a-4873-9810-9026873a0338 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1294 microversion: 2.1 time: 0.618709 Sep 07 09:53:26.717997 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1074/2084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:26 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1294 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:26.737067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:26.739223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:26.748049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:26.751009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:26.751612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:26.752514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:26.753159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:26.753968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.132481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:27.141617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:27.147811 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8de77028-9828-45fc-bc3e-7ce611aa9665 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1507 microversion: 2.1 time: 1.319192 Sep 07 09:53:27.150128 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1011/2085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:25 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1507 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:27.168153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:27.169053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:27.174265 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e32946ac-7c38-4a37-afc3-627c7050b5ed tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1280 microversion: 2.1 time: 0.455001 Sep 07 09:53:27.182739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.183577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.185398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.189836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.191372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.192038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.195695 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1075/2086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:26 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1280 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:27.200746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c96f56ce-5497-4d76-96d6-7faf63b63e23 req-4737de76-af11-4777-ba92-638825d186e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eda8ab4-7762-4e34-9ea3-e64fba33d3a7", "name": "network-vif-deleted", "tag": "b0164910-79c6-40b3-a68b-fbf118925571"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:27.221703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c96f56ce-5497-4d76-96d6-7faf63b63e23 req-4737de76-af11-4777-ba92-638825d186e4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.229261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c96f56ce-5497-4d76-96d6-7faf63b63e23 req-4737de76-af11-4777-ba92-638825d186e4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.230086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c96f56ce-5497-4d76-96d6-7faf63b63e23 req-4737de76-af11-4777-ba92-638825d186e4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.247801 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c96f56ce-5497-4d76-96d6-7faf63b63e23 req-4737de76-af11-4777-ba92-638825d186e4 service nova] Creating event network-vif-deleted:b0164910-79c6-40b3-a68b-fbf118925571 for instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 on n-h2-836830-16 Sep 07 09:53:27.263518 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c96f56ce-5497-4d76-96d6-7faf63b63e23 req-4737de76-af11-4777-ba92-638825d186e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066283 Sep 07 09:53:27.264412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1076/2087] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:27.270995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:27.271982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:27.287743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.288536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.289536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.290493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.291167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.291828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.820824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:27.841955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:27.847103 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57347587-30d6-4a65-9eaf-20a0ece5e39e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1270 microversion: 2.1 time: 0.694067 Sep 07 09:53:27.859669 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1012/2088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:27 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1270 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:27.877210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:27.880271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:27.908108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.909081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.909898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:27.912990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:27.913564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:27.914071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.094638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:28.103071 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-effa2b8d-ac58-4683-a3d5-2e47fd172bdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1294 microversion: 2.1 time: 0.242138 Sep 07 09:53:28.117620 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1013/2089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:27 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1294 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:28.124083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ee588b55-19e9-4b79-acd7-863ddc5ebdcc req-b2e7015c-cc40-4291-8d25-8d5c6db3b579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968bb749-d5fe-4bec-ad1b-f2092f9c67aa", "name": "network-vif-plugged", "status": "completed", "tag": "2398da42-c782-40e3-8857-b50dc5bb4d67"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:28.136084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee588b55-19e9-4b79-acd7-863ddc5ebdcc req-b2e7015c-cc40-4291-8d25-8d5c6db3b579 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.137299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee588b55-19e9-4b79-acd7-863ddc5ebdcc req-b2e7015c-cc40-4291-8d25-8d5c6db3b579 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.137912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee588b55-19e9-4b79-acd7-863ddc5ebdcc req-b2e7015c-cc40-4291-8d25-8d5c6db3b579 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.149279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:28.152540 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ee588b55-19e9-4b79-acd7-863ddc5ebdcc req-b2e7015c-cc40-4291-8d25-8d5c6db3b579 service nova] Creating event network-vif-plugged:2398da42-c782-40e3-8857-b50dc5bb4d67 for instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa on n-h2-836830-16 Sep 07 09:53:28.158393 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ee588b55-19e9-4b79-acd7-863ddc5ebdcc req-b2e7015c-cc40-4291-8d25-8d5c6db3b579 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 Sep 07 09:53:28.163709 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0668438-c915-4e06-9408-507f4cf4ebd3 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.897670 Sep 07 09:53:28.165320 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1014/2090] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:28.166006 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1077/2091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:27 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:28.180050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:28.181022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:28.189021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.189545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.189985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.190726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.191184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.191925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.203356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:28.204448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:28.212388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.212892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.213387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.214485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.215098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.215731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.624457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:28.633388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:28.653477 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d21b4bf7-7737-4877-8d30-ba1a4bb88bef tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.450349 Sep 07 09:53:28.654234 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1078/2092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:28 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:28.654890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a51430c2-3806-465c-8321-1b28129c5e50 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1507 microversion: 2.1 time: 0.478815 Sep 07 09:53:28.655767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1015/2093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:28 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:28.872522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:28.875565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:28.890900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.891479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.891933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.892655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:28.893117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:28.894140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:28.969962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:28.980725 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53040c00-e5ed-4942-ae40-a49e5e324e75 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1276 microversion: 2.1 time: 0.110801 Sep 07 09:53:28.980725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1079/2094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:28 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:29.042709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:29.051995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:29.089064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.093791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.099130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.102281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.105269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.106202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.129632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:29.130386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:29.163050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.168716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.169635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.171437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.173101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.173875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.179771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:53:29.328898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:29.357533 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa7fab16-200a-4b69-b86e-a545ec650a28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1294 microversion: 2.1 time: 0.232615 Sep 07 09:53:29.359047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1080/2095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:29 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1294 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:29.368484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:29.371625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:29.383487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.384425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.386728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.387819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.388549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.389195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.391187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:29.412925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-453b64d0-9a85-4392-915f-dec27f092723 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 204 len: 0 microversion: 2.25 time: 0.378406 Sep 07 09:53:29.418733 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1016/2096] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:53:29 2022] DELETE /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:53:29.429922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:29.430654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:29.452506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.454031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.455001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.456568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.457836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.458556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.773935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:29.788443 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15e6553a-5f66-4020-8ffa-0006388545c6 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1325 microversion: 2.1 time: 0.427584 Sep 07 09:53:29.792684 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1081/2097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:29 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:29.811179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:29.812652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:29.821292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:29.832459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.833234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.833925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.834836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.835317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:29.835657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.836265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.838248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:29.840270 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92881e1d-1525-4655-95a5-f6a50b5bc94b tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1549 microversion: 2.25 time: 0.419224 Sep 07 09:53:29.840851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1017/2098] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:29 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1549 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:29.856126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:29.856801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:29.871898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.872396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.873014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:29.873951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:29.874448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:29.875053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.439961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:30.451633 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6c464a4-6b7e-44f1-919b-86ba1feca09d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1507 microversion: 2.1 time: 0.607462 Sep 07 09:53:30.452420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1018/2099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:29 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:30.476943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:30.486565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:30.495832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:30.502856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.505615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.507449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.508247 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f8b6b0f-6fee-4271-ad41-ddcda2272310 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.713784 Sep 07 09:53:30.509308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.509604 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1082/2100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:29 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:30.510613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.511074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.515130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:30.515825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:30.524119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.524907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.525566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.526460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.527104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.527702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.567882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.568381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.569292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.570094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'fault' on Instance uuid 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:53:30.758392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:30.775311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-40593c0e-9194-4b0a-9275-14d1a3d4b784 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 200 len: 1305 microversion: 2.1 time: 0.264391 Sep 07 09:53:30.777112 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1083/2101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:30 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 1305 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:30.833997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:30.835276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:30.852855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.853762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.855063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:30.856375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:30.856845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:30.857295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.106151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:31.114043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-864683e0-8d97-4301-827d-a981a7861b4c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.660739 Sep 07 09:53:31.115165 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1019/2102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:30 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:31.120032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:31.121647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:31.129564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.130266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.130931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.131859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.132520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.135636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.345853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:31.365459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2452a3c4-ddf3-4b2d-9b4d-7fda86f635a2 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1522 microversion: 2.1 time: 0.540691 Sep 07 09:53:31.365459 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1084/2103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:30 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:31.392086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:31.392938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:31.403284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.403780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.404444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.405174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.405684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.406300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.436770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] HTTP exception thrown: Instance is not a member of specified network Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Request method failure captured: Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa/ips/invalid HTTP/1.1 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoDSvjdQjFD58m2q6vCiZI7aPY5SvvwvthX39kAgP_JrcEWNOCYjZRLM8RXpW309R8f9oMOC54QaE9FkMiDsUGXJnOsNHEJVrC2t7FYnm1GXtLTqeYxb8HtLAW9WLSK8w0QSrECuFXudJbVCgjCaQ-fP5-3RBo4-s4zCvmIDh1uvJU Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7b1075d112444e1c94a368b8639aee66 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7b1075d112444e1c94a368b8639aee66", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7b1075d112444e1c94a368b8639aee66 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerAddressesNegativeTestJSON-1612907379-project Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 1cdb75ae4a3449cbbafb944f29aaf852 Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1612907379-project Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance is not a member of specified network Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '968bb749-d5fe-4bec-ad1b-f2092f9c67aa', 'id': 'invalid'} Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 07 09:53:31.442408 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.447514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:31.448586 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-111ed88d-5cf9-4fe9-87c6-5bb3d2f81fb5 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.062735 Sep 07 09:53:31.449479 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1085/2104] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:53:31 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa/ips/invalid => generated 91 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:53:31.463201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96f724b9-826f-4cc9-a569-4b9ab361fdbc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:31.464182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96f724b9-826f-4cc9-a569-4b9ab361fdbc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Failed to fetch instance by id 999 {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 09:53:31.464830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-96f724b9-826f-4cc9-a569-4b9ab361fdbc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] HTTP exception thrown: Instance 999 could not be found. Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96f724b9-826f-4cc9-a569-4b9ab361fdbc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Request method failure captured: Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoDSvjdQjFD58m2q6vCiZI7aPY5SvvwvthX39kAgP_JrcEWNOCYjZRLM8RXpW309R8f9oMOC54QaE9FkMiDsUGXJnOsNHEJVrC2t7FYnm1GXtLTqeYxb8HtLAW9WLSK8w0QSrECuFXudJbVCgjCaQ-fP5-3RBo4-s4zCvmIDh1uvJU Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7b1075d112444e1c94a368b8639aee66 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7b1075d112444e1c94a368b8639aee66", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7b1075d112444e1c94a368b8639aee66 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerAddressesNegativeTestJSON-1612907379-project Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 1cdb75ae4a3449cbbafb944f29aaf852 Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1612907379-project Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 999 could not be found. Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '999'} Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 07 09:53:31.466468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:31.471495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96f724b9-826f-4cc9-a569-4b9ab361fdbc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:31.472673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96f724b9-826f-4cc9-a569-4b9ab361fdbc tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017846 Sep 07 09:53:31.473410 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1086/2105] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:53:31 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:53:31.487920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:31.494181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:31.516894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.520278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.531066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.537203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.538208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.539924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.823186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:31.843884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:31.848834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:31.851263 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-146a286e-0013-4ed7-8ef4-6ab1d45e9a91 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1549 microversion: 2.25 time: 0.733864 Sep 07 09:53:31.852660 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1020/2106] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:31 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1549 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:31.859065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:31.859571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:31.869082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.869664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.870108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.871949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.872483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.874350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.879821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:31.889885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c1fd19c-8e57-4305-b8ad-e40c132688ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1513 microversion: 2.1 time: 0.415286 Sep 07 09:53:31.890486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1087/2107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:31 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:31.906120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:31.906746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:31.926383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:53:31.937856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.938356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.938814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:31.939517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:31.939971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:31.940961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:32.060021 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd3302b7-439d-4e8d-8a9b-04eb46d3edff tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "DELETE /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 204 len: 0 microversion: 2.1 time: 0.204503 Sep 07 09:53:32.060636 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1021/2108] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:53:31 2022] DELETE /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:53:32.067985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:32.070349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:32.078763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:32.080677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:32.083584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:32.084554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:32.087220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:32.087681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:32.116865 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 HTTP/1.1 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4eda8ab4-7762-4e34-9ea3-e64fba33d3a7'} Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:32.119619 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9adfe9cd-0faf-433c-8f2f-3d30f2e12f7b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 404 len: 111 microversion: 2.1 time: 0.059041 Sep 07 09:53:32.122868 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1022/2109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:32 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:32.133711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:32.134409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:32.142926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:32.145367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:32.145878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:32.150212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:32.150398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:32.150698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:33.029594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:33.041260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2011b0d0-9aac-4964-9740-47176b037843 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 1.149614 Sep 07 09:53:33.043133 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1088/2110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:31 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:33.062270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:33.068518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:33.082184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:33.084204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:33.084829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:33.090295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:33.091059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:33.092430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:33.135513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:33.151207 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-372311b8-c006-4b2d-b39b-5529cf614528 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1528 microversion: 2.1 time: 1.021830 Sep 07 09:53:33.152160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1023/2111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:32 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1528 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:33.172204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1256941432", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:33.297000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:33.324034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:33.340435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:33.813411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:33.825912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7f36dc8-6844-470a-85d5-73a486ab1ac8 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.780204 Sep 07 09:53:33.829912 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1089/2112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:33 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:33.845332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e29b4109-87d0-4a27-9a00-83a80ce3d1fb req-9eb5a668-dc3e-45c5-9aae-f986f8aeb82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d205ab-f172-4948-a082-79120721efa9", "tag": "39a29db1-2fe8-41e0-a748-cde32f878586"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:33.874630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e29b4109-87d0-4a27-9a00-83a80ce3d1fb req-9eb5a668-dc3e-45c5-9aae-f986f8aeb82a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:33.875302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e29b4109-87d0-4a27-9a00-83a80ce3d1fb req-9eb5a668-dc3e-45c5-9aae-f986f8aeb82a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:33.875920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e29b4109-87d0-4a27-9a00-83a80ce3d1fb req-9eb5a668-dc3e-45c5-9aae-f986f8aeb82a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:33.917072 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e29b4109-87d0-4a27-9a00-83a80ce3d1fb req-9eb5a668-dc3e-45c5-9aae-f986f8aeb82a service nova] Creating event network-changed:39a29db1-2fe8-41e0-a748-cde32f878586 for instance 27d205ab-f172-4948-a082-79120721efa9 on n-h2-836830-16 Sep 07 09:53:33.929758 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e29b4109-87d0-4a27-9a00-83a80ce3d1fb req-9eb5a668-dc3e-45c5-9aae-f986f8aeb82a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096784 Sep 07 09:53:33.930866 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1090/2113] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:33.953267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:33.954283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:33.975346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:33.979415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:33.980083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:33.981043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:33.982872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:33.983603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:34.086069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:34.086637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:34.086992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:34.096394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lazy-loading 'fault' on Instance uuid f456e92c-4ff9-4278-9391-9ca4253df6d6 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:53:34.286041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:34.296050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:34.300524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:34.314382 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c611b8f2-6aad-46d7-9144-e7a1e343f73a tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 200 len: 1352 microversion: 2.25 time: 0.381167 Sep 07 09:53:34.315384 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1091/2114] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:33 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 1352 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:34.321978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8c52dad2-5482-4338-bc21-202ab76c9086 req-23895e66-ca50-4048-bbbd-eaf8a720dbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f456e92c-4ff9-4278-9391-9ca4253df6d6", "name": "network-vif-deleted", "tag": "e440e054-f02d-4b47-8e0e-ee98e0f5d85e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:34.345392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c52dad2-5482-4338-bc21-202ab76c9086 req-23895e66-ca50-4048-bbbd-eaf8a720dbe9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:34.345843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c52dad2-5482-4338-bc21-202ab76c9086 req-23895e66-ca50-4048-bbbd-eaf8a720dbe9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:34.346288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c52dad2-5482-4338-bc21-202ab76c9086 req-23895e66-ca50-4048-bbbd-eaf8a720dbe9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:34.352156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:34.374220 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8c52dad2-5482-4338-bc21-202ab76c9086 req-23895e66-ca50-4048-bbbd-eaf8a720dbe9 service nova] Creating event network-vif-deleted:e440e054-f02d-4b47-8e0e-ee98e0f5d85e for instance f456e92c-4ff9-4278-9391-9ca4253df6d6 on n-h1-836830-16 Sep 07 09:53:34.383380 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8c52dad2-5482-4338-bc21-202ab76c9086 req-23895e66-ca50-4048-bbbd-eaf8a720dbe9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065758 Sep 07 09:53:34.384798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1092/2115] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:34.390592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:34.391727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:34.399849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:34.400602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:34.401486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:34.402593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:34.403243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:34.403862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.117224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:35.148672 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67144f90-a90b-4300-b629-8dd2ee08d41f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.758255 Sep 07 09:53:35.154228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:35.166749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1093/2116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:34 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:35.171698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:35.172326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:35.199109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.200582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.201321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.203760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.205087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.207847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.341969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdb75ae4a3449cbbafb944f29aaf852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1075d112444e1c94a368b8639aee66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:35.353905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95614d77-fedd-481b-8f88-8d7f28722972 tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 200 len: 1486 microversion: 2.1 time: 0.186040 Sep 07 09:53:35.355588 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1094/2117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:35 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 1486 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:35.360495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76412f7b-5bf6-4acd-8c1b-6a0f319472e1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'create', calling method: .version_select at 0x7f14b226e700>, body: {"keypair": {"name": "tempest-keypair-933097232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL63fanglO1Ig2aoJc0iWt8Bl3apF47xelnw0Mo5B21x8Q5XTflQVXAF27kg6IcIOG82r5XlUm0hnbVBjrdn38t8H770mcq5uuYvz82Dfsr/CKtjFucbeqivbr08+bWBqA=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:35.377016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-76412f7b-5bf6-4acd-8c1b-6a0f319472e1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:35.383042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-76412f7b-5bf6-4acd-8c1b-6a0f319472e1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for user 46ddb24f5e0f46d4a1a6f228af0fbe8e and project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:35.419534 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76412f7b-5bf6-4acd-8c1b-6a0f319472e1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062603 Sep 07 09:53:35.420206 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1095/2118] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:53:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:35.429392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:35.429815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:35.430667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:35.431089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:35.431500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:35.432158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:35.432797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:35.443106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.444271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.445698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.446804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.447549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.447687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.448038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.448646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.448756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.449439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.452143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.452759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.496933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:35.511158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:35.526777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:35.529067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:35.581847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f4a0eba-e185-43c6-a68a-2886e7ef191f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.428474 Sep 07 09:53:35.582506 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1024/2119] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:35.589669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:35.590582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: f456e92c-4ff9-4278-9391-9ca4253df6d6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:35.598510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.599354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.600095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.601221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.601849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.602420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.623672 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] HTTP exception thrown: Instance f456e92c-4ff9-4278-9391-9ca4253df6d6 could not be found. Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Request method failure captured: Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 HTTP/1.1 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGhWUlEb9INozZJYgPXh93RU0vW5Ixy7JkVXFZ24hxs_T0WvOQd9HT46lPPIA-asPcSNsSgDoxYgg6pW9xyMnfImbL7ErMuX1tilK_mmsk5XTjyl9etstda8-wDZ_StvhFcqD9mXSCslr2NVxAjyhaZbHIfbsd2lc9I4GQybFMooCes Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_607bcf1927e94f8a959bb30fce95ca8f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 21737ade68344e3298131ce9189f5d8a Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f456e92c-4ff9-4278-9391-9ca4253df6d6 could not be found. Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f456e92c-4ff9-4278-9391-9ca4253df6d6'} Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f456e92c-4ff9-4278-9391-9ca4253df6d6 could not be found. Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f456e92c-4ff9-4278-9391-9ca4253df6d6 could not be found. Sep 07 09:53:35.625305 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f456e92c-4ff9-4278-9391-9ca4253df6d6 could not be found. Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Returning 404 to user: Instance f456e92c-4ff9-4278-9391-9ca4253df6d6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:35.630231 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f73f585b-49c1-45f5-b17e-1e5dd8376907 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6" status: 404 len: 111 microversion: 2.25 time: 0.043172 Sep 07 09:53:35.632925 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1025/2120] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:35 2022] GET /compute/v2.1/servers/f456e92c-4ff9-4278-9391-9ca4253df6d6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:53:35.638169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1a6288ba-dbc8-4373-8112-cb38f5aa42a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:35.638790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1a6288ba-dbc8-4373-8112-cb38f5aa42a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:35.831818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1a6288ba-dbc8-4373-8112-cb38f5aa42a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:35.840912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1a6288ba-dbc8-4373-8112-cb38f5aa42a8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1215 microversion: 2.1 time: 0.206737 Sep 07 09:53:35.860221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1026/2121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:35 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1215 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:35.874527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:35.875042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:35.901898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.903458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.903950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.904896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:35.905396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:35.906039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:35.958456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:53:36.112016 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60af693b-2bbf-4b6c-9459-23cd0dbea983 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 204 len: 0 microversion: 2.25 time: 0.245793 Sep 07 09:53:36.114197 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1027/2122] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:53:35 2022] DELETE /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:53:36.124005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:36.125033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:36.134792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.135739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.136483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.137563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.138222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.138859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.162028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:36.254204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:36.266865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e02bebab-639a-4ae7-854f-cc79f8d4f58a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.845131 Sep 07 09:53:36.281244 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1096/2123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:35 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:36.287636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:36.290222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:36.299317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.300649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.301383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.302716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.303437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.303905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.629506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:36.645660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:36.652803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:36.655786 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6aa36a6a-4f92-4df1-80ff-7d8d6d8fb414 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1565 microversion: 2.25 time: 0.537066 Sep 07 09:53:36.659741 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1028/2124] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:36 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1565 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:36.668615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c32ff152-ede7-467b-827d-972c379ad1d4 req-4ce70881-c4c5-4cdb-9363-6f1df7aefb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bd1d3e-70c6-4d04-8f7e-43b82a37515b", "tag": "b12bc190-ba6f-4910-823e-fabfc4f68991"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:36.692607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c32ff152-ede7-467b-827d-972c379ad1d4 req-4ce70881-c4c5-4cdb-9363-6f1df7aefb9e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.701631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c32ff152-ede7-467b-827d-972c379ad1d4 req-4ce70881-c4c5-4cdb-9363-6f1df7aefb9e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.702531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c32ff152-ede7-467b-827d-972c379ad1d4 req-4ce70881-c4c5-4cdb-9363-6f1df7aefb9e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.728564 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c32ff152-ede7-467b-827d-972c379ad1d4 req-4ce70881-c4c5-4cdb-9363-6f1df7aefb9e service nova] Creating event network-changed:b12bc190-ba6f-4910-823e-fabfc4f68991 for instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b on n-h1-836830-16 Sep 07 09:53:36.733694 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c32ff152-ede7-467b-827d-972c379ad1d4 req-4ce70881-c4c5-4cdb-9363-6f1df7aefb9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071869 Sep 07 09:53:36.734606 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1029/2125] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:36.742255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:36.743217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] [instance: 968bb749-d5fe-4bec-ad1b-f2092f9c67aa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:36.758905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.769249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.774128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.776191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.776836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.777463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.806810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:36.815620 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] HTTP exception thrown: Instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa could not be found. Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Request method failure captured: Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa HTTP/1.1 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGoDSvjdQjFD58m2q6vCiZI7aPY5SvvwvthX39kAgP_JrcEWNOCYjZRLM8RXpW309R8f9oMOC54QaE9FkMiDsUGXJnOsNHEJVrC2t7FYnm1GXtLTqeYxb8HtLAW9WLSK8w0QSrECuFXudJbVCgjCaQ-fP5-3RBo4-s4zCvmIDh1uvJU Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 7b1075d112444e1c94a368b8639aee66 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7b1075d112444e1c94a368b8639aee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7b1075d112444e1c94a368b8639aee66", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 7b1075d112444e1c94a368b8639aee66 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1612907379 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerAddressesNegativeTestJSON-1612907379-project Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 1cdb75ae4a3449cbbafb944f29aaf852 Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1612907379-project Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa could not be found. Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '968bb749-d5fe-4bec-ad1b-f2092f9c67aa'} Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa could not be found. Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa could not be found. Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:36.818236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa could not be found. Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] Returning 404 to user: Instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:36.822343 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3400464c-a669-4ad6-b762-b130d108188a tempest-ServerAddressesNegativeTestJSON-1612907379 tempest-ServerAddressesNegativeTestJSON-1612907379-project] 10.222.0.60 "GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa" status: 404 len: 111 microversion: 2.1 time: 0.083124 Sep 07 09:53:36.822838 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-811a77b4-a2d6-449f-9451-12a3fc96bc9e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.542570 Sep 07 09:53:36.822838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1097/2126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:36 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:36.829600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1030/2127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:36 2022] GET /compute/v2.1/servers/968bb749-d5fe-4bec-ad1b-f2092f9c67aa => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:36.833165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}, {"server_uuid": "968bb749-d5fe-4bec-ad1b-f2092f9c67aa", "name": "network-vif-deleted", "tag": "2398da42-c782-40e3-8857-b50dc5bb4d67"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:36.867713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:36.868900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:36.869399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.869916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.870364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.882554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.883693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.884949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.886349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:36.888058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:36.889110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:36.897276 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] Creating event network-changed:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:53:36.897571 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] Creating event network-vif-deleted:2398da42-c782-40e3-8857-b50dc5bb4d67 for instance 968bb749-d5fe-4bec-ad1b-f2092f9c67aa on n-h2-836830-16 Sep 07 09:53:36.922588 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-58d4e7e3-1822-4528-9052-70396d3948a4 req-dc21b6d1-14b8-41ec-9f12-3ddbed99f5a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098194 Sep 07 09:53:36.923537 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1098/2128] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:37.073473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:37.089208 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ac0d6d1-7e00-4b35-85d1-38a1109b63a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1211 microversion: 2.1 time: 0.225455 Sep 07 09:53:37.090168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1031/2129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:36 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1211 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:37.295072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:37.295807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:37.309898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:37.313355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:37.313355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:37.313355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:37.313355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:37.314153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:37.693708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:37.695455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:37.733103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:37.734897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:37.735864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:37.738402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:37.739202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:37.741216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:37.777724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:37.790436 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01426255-2057-4afd-b0b6-e68f67d9ec61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.500534 Sep 07 09:53:37.791042 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1099/2130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:37 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:37.844491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:37.845133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:37.858855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:37.859363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:37.859811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:37.860539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:37.861206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:37.863667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:38.293362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:38.309968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:38.312065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:38.314023 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-282579b6-a768-4dac-8c78-9b863ed83c55 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1565 microversion: 2.25 time: 0.626432 Sep 07 09:53:38.325284 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1032/2131] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:37 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1565 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:38.341881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:38.343198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:38.354721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:38.355306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:38.355749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:38.368406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:38.369097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:38.370143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:38.438375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:38.448156 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ec742282-4780-4341-b793-f62b97a288c8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.607976 Sep 07 09:53:38.469271 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1100/2132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:37 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:38.535324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:38.556404 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4becea4b-1e76-4bee-8f02-759fa512f5e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1267 microversion: 2.1 time: 0.227606 Sep 07 09:53:38.565280 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1033/2133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:38 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:38.832766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:38.837424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:38.863355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:38.864046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:38.864640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:38.865552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:38.866149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:38.866715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:39.342782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:39.354621 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ca5deb8-64c2-419c-a288-f89450c527e9 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.541157 Sep 07 09:53:39.362989 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1101/2134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:38 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:39.372239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:39.374483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:39.415708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:39.416326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:39.417745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:39.424907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:39.425462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:39.425923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:39.472674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:39.474048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:39.486580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:39.487670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:39.488399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:39.489350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:39.489956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:39.490938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:39.817515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:39.851071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:39.864319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:39.865970 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7f7cd4a-2cea-4029-8d73-6e7741bdaeaa tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1523 microversion: 2.25 time: 0.524566 Sep 07 09:53:39.870035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1034/2135] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:39 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1523 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:39.891471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:39.892263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:39.900644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:39.901535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:39.902229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:39.903187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:39.903877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:39.904578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.298401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:40.314113 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff9bdeee-63cc-4137-98c2-d076aac1fd46 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.843702 Sep 07 09:53:40.315662 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1102/2136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:39 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:40.332081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3fceee80-87b1-4bab-915b-e1ab8b201683 req-c41b2212-897d-48b2-8271-b100b1c0b903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32c33bb-7f8e-4a60-8857-37805be90773", "name": "network-vif-deleted", "tag": "091bfdd5-5dac-4645-a4d1-c4854d2a82e1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:40.350859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3fceee80-87b1-4bab-915b-e1ab8b201683 req-c41b2212-897d-48b2-8271-b100b1c0b903 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:40.356925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3fceee80-87b1-4bab-915b-e1ab8b201683 req-c41b2212-897d-48b2-8271-b100b1c0b903 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:40.363545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3fceee80-87b1-4bab-915b-e1ab8b201683 req-c41b2212-897d-48b2-8271-b100b1c0b903 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.383137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:40.397163 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3fceee80-87b1-4bab-915b-e1ab8b201683 req-c41b2212-897d-48b2-8271-b100b1c0b903 service nova] Creating event network-vif-deleted:091bfdd5-5dac-4645-a4d1-c4854d2a82e1 for instance e32c33bb-7f8e-4a60-8857-37805be90773 on n-h1-836830-16 Sep 07 09:53:40.419297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a6b71cc-f9f2-44ba-ba85-5894a585e92b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1273 microversion: 2.1 time: 0.546507 Sep 07 09:53:40.421259 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1035/2137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:39 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1273 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:40.433316 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3fceee80-87b1-4bab-915b-e1ab8b201683 req-c41b2212-897d-48b2-8271-b100b1c0b903 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114765 Sep 07 09:53:40.434199 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1103/2138] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:40.442087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:40.445109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:40.468994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:40.470972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:40.474356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.476968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:40.477643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:40.486995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.871340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ee68a0dd-fb88-4e4a-9dcb-3446bc566823 req-e78acb50-8138-4f97-8429-68ed0aa46a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d205ab-f172-4948-a082-79120721efa9", "name": "network-vif-plugged", "status": "completed", "tag": "39a29db1-2fe8-41e0-a748-cde32f878586"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:40.875723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:40.885585 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ba1370f-c2e6-4ebb-8c81-706bab2804b6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.456574 Sep 07 09:53:40.902496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1036/2139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:40 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:40.912446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:40.913326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:40.914697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:40.921025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ee68a0dd-fb88-4e4a-9dcb-3446bc566823 req-e78acb50-8138-4f97-8429-68ed0aa46a9f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:40.921888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ee68a0dd-fb88-4e4a-9dcb-3446bc566823 req-e78acb50-8138-4f97-8429-68ed0aa46a9f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:40.922551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ee68a0dd-fb88-4e4a-9dcb-3446bc566823 req-e78acb50-8138-4f97-8429-68ed0aa46a9f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.931578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:40.932090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:40.937556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.938431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:40.939014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:40.939459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:40.970426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ee68a0dd-fb88-4e4a-9dcb-3446bc566823 req-e78acb50-8138-4f97-8429-68ed0aa46a9f service nova] Creating event network-vif-plugged:39a29db1-2fe8-41e0-a748-cde32f878586 for instance 27d205ab-f172-4948-a082-79120721efa9 on n-h2-836830-16 Sep 07 09:53:41.001148 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ee68a0dd-fb88-4e4a-9dcb-3446bc566823 req-e78acb50-8138-4f97-8429-68ed0aa46a9f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131685 Sep 07 09:53:41.006235 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1104/2140] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:41.032832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.033997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.034996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:41.035534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lazy-loading 'fault' on Instance uuid e32c33bb-7f8e-4a60-8857-37805be90773 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:53:41.187712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:41.206102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:41.214402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21737ade68344e3298131ce9189f5d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607bcf1927e94f8a959bb30fce95ca8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:41.217664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c6b03cfa-1447-47ee-a041-8ec54310d685 tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 200 len: 1352 microversion: 2.25 time: 0.312610 Sep 07 09:53:41.220166 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1037/2141] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:40 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 1352 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:53:41.347256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:41.348852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:41.367347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.368163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.368969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:41.369887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.373159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.373816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:41.447361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:41.447978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:41.467091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.469766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.470368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:41.477240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.477942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.478525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:41.665635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:41.673708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c6f81766-c346-40f5-8698-56469ffb10aa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1273 microversion: 2.1 time: 0.230580 Sep 07 09:53:41.677908 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1038/2142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:41 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:41.869205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:41.884659 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd8e115b-bb00-4442-b3b6-22a14bb1b764 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1322 microversion: 2.1 time: 0.545420 Sep 07 09:53:41.886930 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1105/2143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:41 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:41.917167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:41.917991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:41.927240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.930450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.932662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:41.934414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:41.936206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:41.936876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:42.249704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:42.250208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] [instance: e32c33bb-7f8e-4a60-8857-37805be90773] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:42.257668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:42.258430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:42.259027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:42.259902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:42.261742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:42.265467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:42.306651 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] HTTP exception thrown: Instance e32c33bb-7f8e-4a60-8857-37805be90773 could not be found. Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Request method failure captured: Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 HTTP/1.1 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGhWUlEb9INozZJYgPXh93RU0vW5Ixy7JkVXFZ24hxs_T0WvOQd9HT46lPPIA-asPcSNsSgDoxYgg6pW9xyMnfImbL7ErMuX1tilK_mmsk5XTjyl9etstda8-wDZ_StvhFcqD9mXSCslr2NVxAjyhaZbHIfbsd2lc9I4GQybFMooCes Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/607bcf1927e94f8a959bb30fce95ca8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_607bcf1927e94f8a959bb30fce95ca8f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 607bcf1927e94f8a959bb30fce95ca8f Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093 Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 21737ade68344e3298131ce9189f5d8a Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1111907093-project Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e32c33bb-7f8e-4a60-8857-37805be90773 could not be found. Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e32c33bb-7f8e-4a60-8857-37805be90773'} Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32c33bb-7f8e-4a60-8857-37805be90773 could not be found. Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32c33bb-7f8e-4a60-8857-37805be90773 could not be found. Sep 07 09:53:42.309426 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32c33bb-7f8e-4a60-8857-37805be90773 could not be found. Sep 07 09:53:42.312950 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.316331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] Returning 404 to user: Instance e32c33bb-7f8e-4a60-8857-37805be90773 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:42.317522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c66f6c8-3b42-4359-88e0-1736b0c0b40d tempest-LiveAutoBlockMigrationV225Test-1111907093 tempest-LiveAutoBlockMigrationV225Test-1111907093-project] 10.222.0.60 "GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773" status: 404 len: 111 microversion: 2.25 time: 0.071910 Sep 07 09:53:42.329913 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1106/2144] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:53:42 2022] GET /compute/v2.1/servers/e32c33bb-7f8e-4a60-8857-37805be90773 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:53:42.363622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:42.392960 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b9d1f72f-877c-4719-b3a4-1c527d97e9dd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.479534 Sep 07 09:53:42.394438 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1039/2145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:41 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:42.523968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1025174840", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24d4319a-518f-45ca-b50d-c0f83b0724bf"}], "security_groups": [{"name": "tempest-securitygroup--1498099577"}], "key_name": "tempest-keypair-933097232", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:42.720560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] validate_networks() for [('24d4319a-518f-45ca-b50d-c0f83b0724bf', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:42.786952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Calling method '.version_select at 0x7f14b1ec3ca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:42.915469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:53:42.916418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Neutron security group 54b7b79c-6952-4906-9600-ab4841320282 not found {{(pid=128832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:53:42.917123 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] HTTP exception thrown: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.917123 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Request method failure captured: Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-security-groups/54b7b79c-6952-4906-9600-ab4841320282 HTTP/1.1 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGomwfRIpbN5gvEnopN7Rs4XBba3YWsrI_o4mz63o-OW2IQzungl1YbvxV9mIQAmEVlmAxGpTW3k0KLwGvMMcVdxnT3rznpCF5JzGwbKQvBiNk-xEEutT_GB2E3_um-A09wjiM11FOFNsLLI0hMAxzd9D5b5ApXniIpr_ks0uIG_snY Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_13e1a2aea968413e91fa6e7f00b63ab7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 29737cf68011425197a450418091b751 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: exception: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '54b7b79c-6952-4906-9600-ab4841320282'} Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:53:42.919965 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] Sep 07 09:53:42.923637 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:42.928444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Returning 404 to user: Security group 54b7b79c-6952-4906-9600-ab4841320282 does not exist Sep 07 09:53:42.928444 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-812989ed-7961-45e1-bee4-428153fcda37'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:42.929679 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0c6ef214-98c1-47da-af37-9abe3ed6a7eb tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/54b7b79c-6952-4906-9600-ab4841320282" status: 404 len: 194 microversion: 2.1 time: 0.297790 Sep 07 09:53:42.932299 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1040/2146] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:53:42 2022] DELETE /compute/v2.1/os-security-groups/54b7b79c-6952-4906-9600-ab4841320282 => generated 194 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:42.949334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:42.950287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:42.958201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:42.958980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:42.959619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:42.960544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:42.961226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:42.961848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.099403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:43.123492 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-427e29f2-c6f5-445d-93cf-3ea4009b963f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1273 microversion: 2.1 time: 0.189862 Sep 07 09:53:43.125445 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1041/2147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:42 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:43.131900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:43.132994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:43.143591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:43.144414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:43.145430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.146388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:43.147070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:43.147818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.482122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:43.498271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94f75a14-13c0-4e42-936d-dcdc8ae2bc71 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1472 microversion: 2.1 time: 0.371496 Sep 07 09:53:43.504735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:43.505302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:43.505742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:43.506256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:43.506753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:43.519445 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1042/2148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:43 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:43.521973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:43.522690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:43.523147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.524793 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f86591d8-f127-4453-bf82-b79315988da8 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004172 Sep 07 09:53:43.524914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:43.525965 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1043/2149] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 7 09:53:43 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 09:53:43.532995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:43.533266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:43.534517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:43.537277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.541589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:43.542281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:43.542875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.543782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:43.544428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:43.545007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:43.595199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:43.601814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Getting quotas for user 46ddb24f5e0f46d4a1a6f228af0fbe8e and project 32a0a655407f4a0581de17ee2c7f8710. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:43.617398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:43.619987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:43.693236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-56dc4948-498e-4213-8203-de74d927fcdf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.173631 Sep 07 09:53:43.695154 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1107/2150] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 09:53:43.833705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:43.850781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e27474e-2283-4a55-b939-594ae5c622ba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.318176 Sep 07 09:53:43.852082 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1044/2151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:43 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:43.863820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4ed3cd98-5db8-4b1f-bfd4-509ad97de447 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Calling method '.version_select at 0x7f14b1fa2040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:44.012606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd339493-3af5-49af-8e20-03fbab684480 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:44.013336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd339493-3af5-49af-8e20-03fbab684480 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] [instance: f4788dfa-b30d-4b2c-989d-9cd82f5badd5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:44.019573 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-fd339493-3af5-49af-8e20-03fbab684480 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] HTTP exception thrown: Instance f4788dfa-b30d-4b2c-989d-9cd82f5badd5 could not be found. Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd339493-3af5-49af-8e20-03fbab684480 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Request method failure captured: Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/f4788dfa-b30d-4b2c-989d-9cd82f5badd5/action HTTP/1.1 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 15 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoR_nT74Ij4Cev5ebwRz0qPSFiteBSKw9id6dhTNJyRiWoqS3bFF5GxgjmBgZu8CgUNN9lUj34WdGoMa81L_R43KD5pTV7vGQEHBY01fWk-PX8PoWJnLd40lWoWrfvMpkkmem-XSIiwah3kf9NIIMZ0bTP9OHXJORe3I4gwpq2koQU Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63755be6a6fc4652a6323fca82357053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63755be6a6fc4652a6323fca82357053", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 56620cef55c54e31932fda7f681770ac Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: {"migrate": {}} Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance f4788dfa-b30d-4b2c-989d-9cd82f5badd5 could not be found. Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'f4788dfa-b30d-4b2c-989d-9cd82f5badd5', 'body': {'migrate': {}}} Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4788dfa-b30d-4b2c-989d-9cd82f5badd5 could not be found. Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4788dfa-b30d-4b2c-989d-9cd82f5badd5 could not be found. Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:44.033565 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4788dfa-b30d-4b2c-989d-9cd82f5badd5 could not be found. Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd339493-3af5-49af-8e20-03fbab684480 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Returning 404 to user: Instance f4788dfa-b30d-4b2c-989d-9cd82f5badd5 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:44.038366 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd339493-3af5-49af-8e20-03fbab684480 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f4788dfa-b30d-4b2c-989d-9cd82f5badd5/action" status: 404 len: 111 microversion: 2.1 time: 0.341298 Sep 07 09:53:44.050326 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1108/2152] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:53:43 2022] POST /compute/v2.1/servers/f4788dfa-b30d-4b2c-989d-9cd82f5badd5/action => generated 111 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:44.059809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11aa1871-b2e9-4624-9c72-91d46b8a6527 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:44.062725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11aa1871-b2e9-4624-9c72-91d46b8a6527 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:44.180048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11aa1871-b2e9-4624-9c72-91d46b8a6527 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:44.188152 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11aa1871-b2e9-4624-9c72-91d46b8a6527 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1245 microversion: 2.1 time: 0.136842 Sep 07 09:53:44.189779 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1109/2153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:44 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:44.202226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:44.203783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:44.228209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:44.229049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:44.230408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:44.231197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:44.232139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:44.233249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:44.243401 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4ed3cd98-5db8-4b1f-bfd4-509ad97de447 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.388888 Sep 07 09:53:44.244269 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1045/2154] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:53:43 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:44.259805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-747020089", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:44.359700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:44.953878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:44.966515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8b0326d-87ab-43c0-9241-2ca113d928f4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.773626 Sep 07 09:53:44.967111 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1110/2155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:44 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:44.973726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8e1e400-b922-4f4c-869e-b647fe4d64bc tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Calling method '.version_select at 0x7f14b260da60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:45.188931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:53:45.190178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:53:45.190904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:53:45.191700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:53:45.193372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:53:45.213670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.214211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.217300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.218396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.222066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.223590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.276191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-d8e1e400-b922-4f4c-869e-b647fe4d64bc tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:53:45.277717 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d8e1e400-b922-4f4c-869e-b647fe4d64bc tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 07 09:53:45.277717 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] Sep 07 09:53:45.279115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Getting quotas for project 5e3d627af5d143a3b9a1d459d9c38cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8e1e400-b922-4f4c-869e-b647fe4d64bc tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Request method failure captured: Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/0f4602bb-a2d1-4ea0-a3d3-72a1f32d6f83 HTTP/1.1 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGomwfRIpbN5gvEnopN7Rs4XBba3YWsrI_o4mz63o-OW2IQzungl1YbvxV9mIQAmEVlmAxGpTW3k0KLwGvMMcVdxnT3rznpCF5JzGwbKQvBiNk-xEEutT_GB2E3_um-A09wjiM11FOFNsLLI0hMAxzd9D5b5ApXniIpr_ks0uIG_snY Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_13e1a2aea968413e91fa6e7f00b63ab7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 29737cf68011425197a450418091b751 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: exception: Insufficient rights for removing default security group. Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '0f4602bb-a2d1-4ea0-a3d3-72a1f32d6f83'} Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:53:45.289585 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] Sep 07 09:53:45.295421 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.305532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8e1e400-b922-4f4c-869e-b647fe4d64bc tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 07 09:53:45.305532 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-65fad604-a416-494a-bc7e-e257e7404253'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:45.307513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Getting quotas for user 4ab5920bb33b4fd6989e01e5c9c6d98d and project 5e3d627af5d143a3b9a1d459d9c38cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:53:45.309646 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8e1e400-b922-4f4c-869e-b647fe4d64bc tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0f4602bb-a2d1-4ea0-a3d3-72a1f32d6f83" status: 400 len: 182 microversion: 2.1 time: 0.338550 Sep 07 09:53:45.311004 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1111/2156] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:53:44 2022] DELETE /compute/v2.1/os-security-groups/0f4602bb-a2d1-4ea0-a3d3-72a1f32d6f83 => generated 182 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:53:45.325882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d099d912-93b5-4325-812d-83d79b43508c req-b651dd4e-7141-40a3-b448-6843f54d5fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bd1d3e-70c6-4d04-8f7e-43b82a37515b", "name": "network-vif-plugged", "status": "completed", "tag": "b12bc190-ba6f-4910-823e-fabfc4f68991"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:45.343083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:53:45.347560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d099d912-93b5-4325-812d-83d79b43508c req-b651dd4e-7141-40a3-b448-6843f54d5fd3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.348320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d099d912-93b5-4325-812d-83d79b43508c req-b651dd4e-7141-40a3-b448-6843f54d5fd3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.348906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d099d912-93b5-4325-812d-83d79b43508c req-b651dd4e-7141-40a3-b448-6843f54d5fd3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.353211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:53:45.363997 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d099d912-93b5-4325-812d-83d79b43508c req-b651dd4e-7141-40a3-b448-6843f54d5fd3 service nova] Creating event network-vif-plugged:b12bc190-ba6f-4910-823e-fabfc4f68991 for instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b on n-h1-836830-16 Sep 07 09:53:45.369567 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d099d912-93b5-4325-812d-83d79b43508c req-b651dd4e-7141-40a3-b448-6843f54d5fd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057025 Sep 07 09:53:45.370430 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1112/2157] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:45.376459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:45.378122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:45.386458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.387288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.388087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.389029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.389698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.390416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.465915 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09fddd15-39f3-4460-b3c9-20fe2b9847a5 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219721 Sep 07 09:53:45.472668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1046/2158] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:53:45.490395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:45.491664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:45.506745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:45.515009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.517007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.517637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.519683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:45.520329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:45.521045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:45.630874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:45.650201 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a34681a-4af0-4ae5-bbde-7f170cc2ddfb tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1297 microversion: 2.1 time: 0.170577 Sep 07 09:53:45.665318 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1047/2159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:45 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1297 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:45.665318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Calling method '.version_select at 0x7f14b12f1a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:45.693095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:53:45.693759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Neutron security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a not found {{(pid=128832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:53:45.694518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] HTTP exception thrown: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.694518 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Request method failure captured: Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-security-groups/7d424597-6e18-4e4d-8ad9-438cbfe0f59a HTTP/1.1 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGomwfRIpbN5gvEnopN7Rs4XBba3YWsrI_o4mz63o-OW2IQzungl1YbvxV9mIQAmEVlmAxGpTW3k0KLwGvMMcVdxnT3rznpCF5JzGwbKQvBiNk-xEEutT_GB2E3_um-A09wjiM11FOFNsLLI0hMAxzd9D5b5ApXniIpr_ks0uIG_snY Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_13e1a2aea968413e91fa6e7f00b63ab7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 29737cf68011425197a450418091b751 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: exception: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7d424597-6e18-4e4d-8ad9-438cbfe0f59a'} Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:53:45.696449 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Returning 404 to user: Security group 7d424597-6e18-4e4d-8ad9-438cbfe0f59a does not exist Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-a8d3ab7e-e7ec-475f-b950-b9af4646c387'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e712e695-3748-4300-a6f2-b5aec65cd630 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/7d424597-6e18-4e4d-8ad9-438cbfe0f59a" status: 404 len: 194 microversion: 2.1 time: 0.045822 Sep 07 09:53:45.699772 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1048/2160] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:53:45 2022] GET /compute/v2.1/os-security-groups/7d424597-6e18-4e4d-8ad9-438cbfe0f59a => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:45.709620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5a85600-9671-4bdc-8348-4983e7e564eb tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:45.710267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a5a85600-9671-4bdc-8348-4983e7e564eb tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:45.716258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:45.727349 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aea65dae-e7e0-4932-83dc-67964f398d65 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.355442 Sep 07 09:53:45.733282 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1113/2161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:45 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:45.761323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Action: 'update', calling method: .version_select at 0x7f14b203b940>, body: {"security_group": {"name": "tempest-sg-1309272370", "description": "tempest-description-1233739729"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:45.856014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5a85600-9671-4bdc-8348-4983e7e564eb tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:45.881220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:53:45.882044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Neutron security group 0dabc915-33f4-4e34-9cf6-a6f64746357e not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:53:45.882760 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] HTTP exception thrown: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.882760 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Request method failure captured: Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/os-security-groups/0dabc915-33f4-4e34-9cf6-a6f64746357e HTTP/1.1 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 102 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGomwfRIpbN5gvEnopN7Rs4XBba3YWsrI_o4mz63o-OW2IQzungl1YbvxV9mIQAmEVlmAxGpTW3k0KLwGvMMcVdxnT3rznpCF5JzGwbKQvBiNk-xEEutT_GB2E3_um-A09wjiM11FOFNsLLI0hMAxzd9D5b5ApXniIpr_ks0uIG_snY Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/13e1a2aea968413e91fa6e7f00b63ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_13e1a2aea968413e91fa6e7f00b63ab7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 13e1a2aea968413e91fa6e7f00b63ab7 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-157441111 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 29737cf68011425197a450418091b751 Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-157441111-project Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: {"security_group": {"name": "tempest-sg-1309272370", "description": "tempest-description-1233739729"}} Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '0dabc915-33f4-4e34-9cf6-a6f64746357e', 'body': {'security_group': {'name': 'tempest-sg-1309272370', 'description': 'tempest-description-1233739729'}}} Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:53:45.885445 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] Sep 07 09:53:45.888974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:53:45.891050 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5a85600-9671-4bdc-8348-4983e7e564eb tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1221 microversion: 2.1 time: 0.184712 Sep 07 09:53:45.893056 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1049/2162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:45 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:45.898193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] Returning 404 to user: Security group 0dabc915-33f4-4e34-9cf6-a6f64746357e does not exist Sep 07 09:53:45.898193 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-e1f8d648-b911-4506-9a04-7418d09050c4'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:53:45.899403 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-db54427d-3e5c-4fa3-941e-33056ffd9742 tempest-SecurityGroupsNegativeTestJSON-157441111 tempest-SecurityGroupsNegativeTestJSON-157441111-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/0dabc915-33f4-4e34-9cf6-a6f64746357e" status: 404 len: 194 microversion: 2.1 time: 0.165085 Sep 07 09:53:45.901208 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1114/2163] 10.222.0.60 () {60 vars in 1290 bytes} [Wed Sep 7 09:53:45 2022] PUT /compute/v2.1/os-security-groups/0dabc915-33f4-4e34-9cf6-a6f64746357e => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:53:45.991659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:45.994669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:46.013420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.014225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.014854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.015764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.016413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.017031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.441770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:46.467105 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30aaad60-f48b-4d43-a330-016236c80afa tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.476725 Sep 07 09:53:46.489265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1050/2164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:45 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:46.680553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:46.681905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:46.697712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.698471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.699184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.700130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.700810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.701480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.758972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:46.759597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:46.771783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.772284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.772725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.773466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.773924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.774354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.808324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:46.881025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:46.894381 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df00ec1b-17f0-404e-aaf2-d6c32b0536dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1303 microversion: 2.1 time: 0.220352 Sep 07 09:53:46.915749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1115/2165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:46 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:46.919686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:46.920722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:46.950037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.950539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.950983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:46.959479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:46.960004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:46.960542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:47.153691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:47.167857 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62024ccc-f552-452d-90ea-146349fcc075 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1273 microversion: 2.1 time: 0.255456 Sep 07 09:53:47.169051 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1116/2166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:46 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:47.333109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:47.364987 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f03f9bd2-2d5e-4049-82a0-00765a0bdf92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1318 microversion: 2.1 time: 0.599339 Sep 07 09:53:47.366294 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1051/2167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:46 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:47.477770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5b57b1a3-7273-47c0-995c-b592b2a3f506 req-55f8e5c7-9f7e-4aad-b2f7-cd9080671823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "name": "network-vif-plugged", "status": "completed", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:47.492934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:47.494177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:47.496878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b57b1a3-7273-47c0-995c-b592b2a3f506 req-55f8e5c7-9f7e-4aad-b2f7-cd9080671823 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:47.497818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b57b1a3-7273-47c0-995c-b592b2a3f506 req-55f8e5c7-9f7e-4aad-b2f7-cd9080671823 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:47.498466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b57b1a3-7273-47c0-995c-b592b2a3f506 req-55f8e5c7-9f7e-4aad-b2f7-cd9080671823 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:47.509589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:47.510208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:47.510664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:47.519265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:47.524874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:47.525599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:47.529892 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5b57b1a3-7273-47c0-995c-b592b2a3f506 req-55f8e5c7-9f7e-4aad-b2f7-cd9080671823 service nova] Creating event network-vif-plugged:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:53:47.548266 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5b57b1a3-7273-47c0-995c-b592b2a3f506 req-55f8e5c7-9f7e-4aad-b2f7-cd9080671823 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074959 Sep 07 09:53:47.549839 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1117/2168] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:47.925139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:47.925897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:47.937047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:47.940845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:47.942253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:47.945252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:47.945974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:47.948841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:47.960797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:47.974173 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d83b14bd-552e-4454-8bb2-592db2914140 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.484974 Sep 07 09:53:47.975160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1052/2169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:47 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:48.089774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:48.105776 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58c32155-205c-48d1-8f52-10c702e7b9ca tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1303 microversion: 2.1 time: 0.185123 Sep 07 09:53:48.108840 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1118/2170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:47 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:48.194401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:48.195026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:48.201162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:48.201877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:48.202506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:48.203384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:48.203997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:48.204579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:48.309581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:48.350021 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12f936a3-93e1-4b90-920e-68bbb6ed5591 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1279 microversion: 2.1 time: 0.149437 Sep 07 09:53:48.352575 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1053/2171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:48 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:48.393657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:48.394625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:48.402495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:48.403264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:48.403862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:48.405077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:48.405706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:48.406305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:48.410827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:48.765396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:48.780309 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-765031d0-56f0-4e82-93ca-3cc2fafe1c5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1468 microversion: 2.1 time: 0.391397 Sep 07 09:53:48.781551 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1119/2172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:48 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1468 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:48.805146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:48.805948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:48.816357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:48.820822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:48.824964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:48.825832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:48.826501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:48.827116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.000404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:49.001035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:49.017924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.019328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.021332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.022288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.023129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.023788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.568721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:49.581355 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a350bcfe-b8c3-4245-a0b0-33498083020f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1318 microversion: 2.1 time: 0.779951 Sep 07 09:53:49.582453 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1054/2173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:48 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:49.589503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:49.590699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:49.609967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.610570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.611034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.616179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.617553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.618178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.668975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:49.678505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9b246e6f-b89e-4f24-901e-01451a482d9f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.682208 Sep 07 09:53:49.679278 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1120/2174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:48 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:49.694488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:49.695236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:49.705429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.712734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.713394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.714335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.714962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.715544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.850876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:49.863261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08862a18-fc4f-496f-84bb-d35a1ceeaa77 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1279 microversion: 2.1 time: 0.176863 Sep 07 09:53:49.863856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1121/2175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:49 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:49.883426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2767ff47-a298-4f49-be7e-4fc8dec71cf5 req-1290a234-d894-4fc8-9b4f-e73698fc6ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e39a880-c107-479a-ac03-1bea990c81f8", "tag": "c0fa3e6e-43fe-4979-9873-8a407b925c45"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:49.898259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2767ff47-a298-4f49-be7e-4fc8dec71cf5 req-1290a234-d894-4fc8-9b4f-e73698fc6ff0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:49.900076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2767ff47-a298-4f49-be7e-4fc8dec71cf5 req-1290a234-d894-4fc8-9b4f-e73698fc6ff0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:49.901668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2767ff47-a298-4f49-be7e-4fc8dec71cf5 req-1290a234-d894-4fc8-9b4f-e73698fc6ff0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:49.921826 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2767ff47-a298-4f49-be7e-4fc8dec71cf5 req-1290a234-d894-4fc8-9b4f-e73698fc6ff0 service nova] Creating event network-changed:c0fa3e6e-43fe-4979-9873-8a407b925c45 for instance 7e39a880-c107-479a-ac03-1bea990c81f8 on n-h1-836830-16 Sep 07 09:53:49.929606 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2767ff47-a298-4f49-be7e-4fc8dec71cf5 req-1290a234-d894-4fc8-9b4f-e73698fc6ff0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064514 Sep 07 09:53:49.930964 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1122/2176] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:50.220529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:50.230997 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-419dac0f-bb8c-4ef5-868b-7480360c1bfc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1371 microversion: 2.1 time: 0.646165 Sep 07 09:53:50.245991 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1055/2177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:49 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1371 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:50.606103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:50.606804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:50.615140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:50.615637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:50.616074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:50.616782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:50.617257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:50.617880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:50.708590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:50.711154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:50.719622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:50.737995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:50.738672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:50.739688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:50.740361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:50.741296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.070831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:51.088660 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c022380f-f486-4098-b648-84bc27be5a63 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1468 microversion: 2.1 time: 0.486699 Sep 07 09:53:51.095075 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1123/2178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:50 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1468 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:51.104919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:51.106424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:51.110388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:51.133919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.134424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.134874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.135597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.136062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.136498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.140405 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7537618-f915-4f81-a090-efdc7201ece0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.437206 Sep 07 09:53:51.146910 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1056/2179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:50 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:51.157065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1005213196"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:51.177000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:51.195643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.196432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.197531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.198276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.198749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.199346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.239664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:51.250842 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-da1df04b-fc6f-44c2-9fbd-1d2f111b4638 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1279 microversion: 2.1 time: 0.149529 Sep 07 09:53:51.254508 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1124/2180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:51 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:51.262127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:51.262765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:51.275416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.275930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.276376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.277114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.277570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.278002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.602124 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-613e011e-43b7-47c6-bdd1-9d23812139a1 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "POST /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be/action" status: 202 len: 0 microversion: 2.1 time: 0.452441 Sep 07 09:53:51.603723 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1057/2181] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:53:51 2022] POST /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:53:51.606700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:51.610106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-407fc35c-95bc-4a14-8c98-b772d4709e5b req-0de40695-049c-4624-a71b-e0e1a96cf11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a9cd8e-0a42-4622-9b8d-885638580dbf", "tag": "e95a1e84-34bf-408e-a698-11c49deef067"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:51.622469 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-827e700d-9993-4202-bf2b-3deb43a597ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1371 microversion: 2.1 time: 0.366668 Sep 07 09:53:51.624369 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1125/2182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:51 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:51.630883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a3976a19-0900-4bb3-9bcc-10b5872e1c92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b17f13a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:51.631433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-407fc35c-95bc-4a14-8c98-b772d4709e5b req-0de40695-049c-4624-a71b-e0e1a96cf11c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:51.632193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-407fc35c-95bc-4a14-8c98-b772d4709e5b req-0de40695-049c-4624-a71b-e0e1a96cf11c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:51.633407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-407fc35c-95bc-4a14-8c98-b772d4709e5b req-0de40695-049c-4624-a71b-e0e1a96cf11c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:51.657904 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-407fc35c-95bc-4a14-8c98-b772d4709e5b req-0de40695-049c-4624-a71b-e0e1a96cf11c service nova] Creating event network-changed:e95a1e84-34bf-408e-a698-11c49deef067 for instance 35a9cd8e-0a42-4622-9b8d-885638580dbf on n-h2-836830-16 Sep 07 09:53:51.684946 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-407fc35c-95bc-4a14-8c98-b772d4709e5b req-0de40695-049c-4624-a71b-e0e1a96cf11c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079167 Sep 07 09:53:51.691220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1058/2183] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:51.718581 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a3976a19-0900-4bb3-9bcc-10b5872e1c92 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.092884 Sep 07 09:53:51.725761 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1126/2184] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:51 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:52.170154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:52.171216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:52.180938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:52.182855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:52.183279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:52.184351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:52.184824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:52.185961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:52.281826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:52.282776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:52.291321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:52.292918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:52.298679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:52.301239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:52.301980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:52.302630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:52.344709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:52.357049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-52c4e2c3-f6ec-4412-9f67-6ca9772569af tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.192676 Sep 07 09:53:52.358987 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1059/2185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:52 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:52.655974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:52.656650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:52.665374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:52.665995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:52.666508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:52.667511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:52.669907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:52.670442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:52.917150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:52.960225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8d57ff3-a52a-41b8-9b7b-7ac6eae3cfec tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 0.682345 Sep 07 09:53:52.961545 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1127/2186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:52 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:52.977884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01c21d63-e151-4d2c-be7d-03402470ab7e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1848040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:53.038811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:53.047172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9fef703b-add6-48ec-b166-1ceaf0a818d7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1371 microversion: 2.1 time: 0.399029 Sep 07 09:53:53.047940 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1060/2187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:52 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:53.062341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01c21d63-e151-4d2c-be7d-03402470ab7e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.099006 Sep 07 09:53:53.063478 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1128/2188] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:52 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:53.388451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:53.389159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:53.417518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:53.418126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:53.418677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:53.421282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:53.421905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:53.422455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:53.880002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:53.904438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-852b8b7b-9787-449b-bd1c-9d726240fee3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.519850 Sep 07 09:53:53.905926 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1061/2189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:53 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:53.997765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:53.999321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:54.008965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:54.028031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:54.030659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:54.031223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:54.033832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:54.035037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:54.036090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:54.073945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:54.074783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:54.089659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:54.090657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:54.091364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:54.092434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:54.093100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:54.093756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:54.188011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:54.455382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:54.465410 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a04c577-1219-4b77-9ef4-a7450e192d9d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1371 microversion: 2.1 time: 0.396659 Sep 07 09:53:54.482623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1062/2190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:54 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:54.488668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6cc13ad0-ee53-4e94-97f1-549355e7d6f3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1ffb4c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:54.542907 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6cc13ad0-ee53-4e94-97f1-549355e7d6f3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.058878 Sep 07 09:53:54.544195 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1063/2191] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:54 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:54.702504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:54.714153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f8fac0e0-349e-4fa2-b704-5551f8026e1f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 0.731093 Sep 07 09:53:54.720405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1129/2192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:53 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:54.929826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:54.930606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:54.938388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:54.939272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:54.940365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:54.941334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:54.942009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:54.942642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:55.250643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:55.264526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:55.275634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd963049-f65e-4ebf-8a98-7bea30e1bc5f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.351200 Sep 07 09:53:55.291789 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1064/2193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:54 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:55.489702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:55.490339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:55.506794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:55.509706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:55.510270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:55.511083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:55.512731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:55.513265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:55.561720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e47ef17-c12f-41f9-b2bf-4d7c48d60d0a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b13c9e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:55.614456 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e47ef17-c12f-41f9-b2bf-4d7c48d60d0a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.056656 Sep 07 09:53:55.615234 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1065/2194] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:55 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:55.739233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:55.740060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:55.748781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:55.749996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:55.750457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:55.751215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:55.751688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:55.753340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:55.883470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=36 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:56.019830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:56.069831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:56.089453 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c94b1cc-32a6-4e9e-aba1-5f56a3c076fe tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1371 microversion: 2.1 time: 0.578899 Sep 07 09:53:56.092339 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1130/2195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:55 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1371 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:56.093299 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0f16ba4-beaf-4bec-a0c4-9510e24c5061 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 0.359012 Sep 07 09:53:56.096684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1066/2196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:55 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:56.302213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:56.302841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:56.312844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:56.315921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:56.317806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:56.319096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:56.321378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:56.322982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:56.632271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d64308d9-1a49-4eea-a405-76723cf4426c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b24f1f70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:56.718394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d64308d9-1a49-4eea-a405-76723cf4426c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.091990 Sep 07 09:53:56.723398 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1067/2197] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:56 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:53:56.782237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:56.798574 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-34670347-533c-4414-bbb3-d3adb1bde9e5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.499667 Sep 07 09:53:56.800199 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1131/2198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:56 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:56.989122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-09ab6ab8-ede9-46ff-9b87-c2beccf92df2 req-06c1e12c-89df-49e0-aa75-21f6f3c3ba68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a9cd8e-0a42-4622-9b8d-885638580dbf", "name": "network-vif-plugged", "status": "completed", "tag": "e95a1e84-34bf-408e-a698-11c49deef067"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:57.019210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-09ab6ab8-ede9-46ff-9b87-c2beccf92df2 req-06c1e12c-89df-49e0-aa75-21f6f3c3ba68 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:57.021859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-09ab6ab8-ede9-46ff-9b87-c2beccf92df2 req-06c1e12c-89df-49e0-aa75-21f6f3c3ba68 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:57.022457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-09ab6ab8-ede9-46ff-9b87-c2beccf92df2 req-06c1e12c-89df-49e0-aa75-21f6f3c3ba68 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:57.055501 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-09ab6ab8-ede9-46ff-9b87-c2beccf92df2 req-06c1e12c-89df-49e0-aa75-21f6f3c3ba68 service nova] Creating event network-vif-plugged:e95a1e84-34bf-408e-a698-11c49deef067 for instance 35a9cd8e-0a42-4622-9b8d-885638580dbf on n-h2-836830-16 Sep 07 09:53:57.072805 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-09ab6ab8-ede9-46ff-9b87-c2beccf92df2 req-06c1e12c-89df-49e0-aa75-21f6f3c3ba68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087830 Sep 07 09:53:57.076410 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1068/2199] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:57.113487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:57.114939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:57.128149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:57.128952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:57.129804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:57.131005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:57.131207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:57.131793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:57.133552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:57.133969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:57.154133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:57.155708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:57.156380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:57.157850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:57.161067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:57.163974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:58.579342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:58.600082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d32d2b96-211c-4441-9160-30042dec34c2 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 1.474551 Sep 07 09:53:58.601122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:58.613172 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d11a6b91-c51c-4ee3-8e76-f783c3c7ac72 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1371 microversion: 2.1 time: 1.502526 Sep 07 09:53:58.613711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1069/2200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:57 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:58.617320 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1132/2201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:57 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1371 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:58.621040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-defb7f81-af2a-4817-aafe-9fdc1498b973 req-90007581-9549-41f0-900e-88289a81a530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca", "tag": "050189cc-e370-4b38-9feb-a8c04b44cb6c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:58.662626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-defb7f81-af2a-4817-aafe-9fdc1498b973 req-90007581-9549-41f0-900e-88289a81a530 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:58.664132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-defb7f81-af2a-4817-aafe-9fdc1498b973 req-90007581-9549-41f0-900e-88289a81a530 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:58.665297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-defb7f81-af2a-4817-aafe-9fdc1498b973 req-90007581-9549-41f0-900e-88289a81a530 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:58.698249 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-defb7f81-af2a-4817-aafe-9fdc1498b973 req-90007581-9549-41f0-900e-88289a81a530 service nova] Creating event network-changed:050189cc-e370-4b38-9feb-a8c04b44cb6c for instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca on n-h2-836830-16 Sep 07 09:53:58.712089 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-defb7f81-af2a-4817-aafe-9fdc1498b973 req-90007581-9549-41f0-900e-88289a81a530 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094967 Sep 07 09:53:58.714092 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1070/2202] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:53:58.730958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b5277779-d089-4626-a79f-b6fb2c5cc23e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b24f1d30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:58.833135 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b5277779-d089-4626-a79f-b6fb2c5cc23e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.112453 Sep 07 09:53:58.842689 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1071/2203] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:53:58 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:58.850779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:58.856264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:58.871407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:58.875384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:58.875954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:58.878587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:58.879349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:58.880754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:59.071662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1556366663", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "52c60bdb-1b30-4879-bd45-435a7208ebc2"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:53:59.177426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] validate_networks() for [('52c60bdb-1b30-4879-bd45-435a7208ebc2', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:53:59.756541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:53:59.770200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:53:59.779889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6bf492d8-b99d-4dc3-b226-16e4dc308bf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 0.934498 Sep 07 09:53:59.784145 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1072/2204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:58 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:53:59.795618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:53:59.799899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:53:59.824821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:59.826439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:59.828098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:53:59.835033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:53:59.837242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:53:59.838313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.078774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:01.102439 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bab7827a-2054-4115-a2e4-74ea0601fff8 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 1.316346 Sep 07 09:54:01.103822 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1073/2205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:53:59 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:01.110506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:01.111429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:01.120294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.122009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.122905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.123777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.124268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.125724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.172968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:54:01.174769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:54:01.175462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:54:01.176622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:54:01.177141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:54:01.212726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.213682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.216968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.218597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.222493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.225352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.321584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Getting quotas for project 62b2af63da0a4b70b07255424c743450. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:54:01.358237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Getting quotas for user 633cd5fd9f084704837e49c5667576ab and project 62b2af63da0a4b70b07255424c743450. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:54:01.405539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:54:01.412469 n-d-836830-16 devstack@n-api.service[128833]: WARNING nova.utils [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1556366663 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-155636666 Sep 07 09:54:01.415420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:54:01.559221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:01.561794 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b1929b06-dff7-4077-a9bd-e8aff160fc5d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.942844 Sep 07 09:54:01.562668 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1133/2206] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:54:01.575889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6fe10165-f767-44b6-85bb-85b97333110b tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b25ef820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:01.596326 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c15a1f9c-7795-4cb8-9869-f870ce267a5d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1563 microversion: 2.1 time: 0.490578 Sep 07 09:54:01.618211 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1074/2207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:01 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1563 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:01.630060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d3d4f769-b6a1-4505-9bef-5e592ae2ea30 req-cffcbd18-29d9-4666-b364-9813cfce1e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e39a880-c107-479a-ac03-1bea990c81f8", "name": "network-vif-plugged", "status": "completed", "tag": "c0fa3e6e-43fe-4979-9873-8a407b925c45"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:01.668462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d3d4f769-b6a1-4505-9bef-5e592ae2ea30 req-cffcbd18-29d9-4666-b364-9813cfce1e7c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.669036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d3d4f769-b6a1-4505-9bef-5e592ae2ea30 req-cffcbd18-29d9-4666-b364-9813cfce1e7c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.669506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d3d4f769-b6a1-4505-9bef-5e592ae2ea30 req-cffcbd18-29d9-4666-b364-9813cfce1e7c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.697440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d3d4f769-b6a1-4505-9bef-5e592ae2ea30 req-cffcbd18-29d9-4666-b364-9813cfce1e7c service nova] Creating event network-vif-plugged:c0fa3e6e-43fe-4979-9873-8a407b925c45 for instance 7e39a880-c107-479a-ac03-1bea990c81f8 on n-h1-836830-16 Sep 07 09:54:01.712217 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d3d4f769-b6a1-4505-9bef-5e592ae2ea30 req-cffcbd18-29d9-4666-b364-9813cfce1e7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092369 Sep 07 09:54:01.713061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1075/2208] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:01.719311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:01.723283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:01.759436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.760196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.763450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.766645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:01.768539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:01.777424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:01.791945 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6fe10165-f767-44b6-85bb-85b97333110b tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.227300 Sep 07 09:54:01.792529 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1134/2209] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:01 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:01.797076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c14829f-d23d-46a0-b7d0-f884d4f39bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:01.816515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c14829f-d23d-46a0-b7d0-f884d4f39bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:02.328316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c14829f-d23d-46a0-b7d0-f884d4f39bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:02.355324 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c14829f-d23d-46a0-b7d0-f884d4f39bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1232 microversion: 2.1 time: 0.552594 Sep 07 09:54:02.358925 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1135/2210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:01 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1232 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:02.376581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:02.377723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:02.417590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:02.418418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:02.419108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:02.420073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:02.420540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:02.420974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:03.123143 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6e30e227-d874-4741-a329-e63800ef0bb3 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.762836 Sep 07 09:54:03.123749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1136/2211] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:54:02 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-interface => generated 284 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:03.136061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:03.142379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:03.164620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:03.165141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:03.175773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:03.182557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:03.183152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:03.183507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:03.195077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:03.208326 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-95f909aa-a58b-459d-88f0-29105f7286c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1315 microversion: 2.1 time: 1.493822 Sep 07 09:54:03.212285 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1076/2212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:01 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1315 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:03.220603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-52df6bae-6d0c-4789-99e5-a5c8501ff22e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1bb10d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:03.370807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-52df6bae-6d0c-4789-99e5-a5c8501ff22e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.157127 Sep 07 09:54:03.372005 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1077/2213] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:03 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:03.426561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:03.430490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:03.481204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:03.487841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:03.494808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:03.498125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:03.500760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:03.504056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:04.556482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:04.569956 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-435e5dc1-7282-4469-a38d-1c7a61a5379f tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1284 microversion: 2.1 time: 1.177588 Sep 07 09:54:04.572452 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1078/2214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:03 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1284 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:04.587991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b20b3a7a-bc8a-42ff-83ac-77f4ad446547 req-1b6a4621-f8a6-476c-a1db-a99fb47d3e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "name": "network-vif-plugged", "status": "completed", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:04.615418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b20b3a7a-bc8a-42ff-83ac-77f4ad446547 req-1b6a4621-f8a6-476c-a1db-a99fb47d3e42 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:04.615916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b20b3a7a-bc8a-42ff-83ac-77f4ad446547 req-1b6a4621-f8a6-476c-a1db-a99fb47d3e42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:04.616355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b20b3a7a-bc8a-42ff-83ac-77f4ad446547 req-1b6a4621-f8a6-476c-a1db-a99fb47d3e42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:04.637674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b20b3a7a-bc8a-42ff-83ac-77f4ad446547 req-1b6a4621-f8a6-476c-a1db-a99fb47d3e42 service nova] Creating event network-vif-plugged:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:54:04.649032 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b20b3a7a-bc8a-42ff-83ac-77f4ad446547 req-1b6a4621-f8a6-476c-a1db-a99fb47d3e42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073363 Sep 07 09:54:04.656915 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1079/2215] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:04.665526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:04.666638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:04.680625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:04.689508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:04.690356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:04.691357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:04.692076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:04.692741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:04.919498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:04.938151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-deaf0a42-d89b-48c1-a84d-3b9cfc4b2004 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 1.813302 Sep 07 09:54:04.942371 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1137/2216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:03 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:04.953030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ace1713f-d68b-4772-aa13-083f817f2d58 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b206f310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:05.038909 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ace1713f-d68b-4772-aa13-083f817f2d58 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.093681 Sep 07 09:54:05.040175 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1138/2217] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:04 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:05.599508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:05.600319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:05.620935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:05.623933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:05.623933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:05.623933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:05.623933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:05.623933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:05.674736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:05.688496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c091ab4b-7fa6-405a-9cd5-1001f14db832 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1501 microversion: 2.1 time: 1.029892 Sep 07 09:54:05.709563 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1080/2218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:04 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1501 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:05.715291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:05.716237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:05.723860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:05.724743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:05.725457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:05.726441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:05.727135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:05.727791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:05.858210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23ef153f-29f2-4571-a87e-066e38987210 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8/action" status: 202 len: 0 microversion: 2.1 time: 0.146815 Sep 07 09:54:05.862757 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1081/2219] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:05 2022] POST /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:54:05.868812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:05.870556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:05.877592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:05.878333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:05.878940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:05.879819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:05.880432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:05.881031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:05.964700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:05.980367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-923c0e48-a3a9-4d0a-babc-c1bd05f4fcce tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1290 microversion: 2.1 time: 0.386043 Sep 07 09:54:05.993206 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1139/2220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:05 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1290 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:54:06.002421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:06.002421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:06.016843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:06.017364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:06.018734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:06.027932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:06.028424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:06.028872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:06.631336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:06.648298 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be6c9565-fb6c-48d4-8c06-1d3b2fe75b09 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1506 microversion: 2.1 time: 0.778922 Sep 07 09:54:06.649576 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1082/2221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:05 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:06.660420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96f5d9da-6a37-4cde-938f-59a625145b3f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b2310040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:06.826926 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96f5d9da-6a37-4cde-938f-59a625145b3f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.174528 Sep 07 09:54:06.831575 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1083/2222] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:06 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:06.840822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c8a8bd35-a42e-418b-b3d1-8b6d3b1ef74e req-412d255a-232a-49a0-b6fa-b34e32430799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca", "name": "network-vif-plugged", "status": "completed", "tag": "050189cc-e370-4b38-9feb-a8c04b44cb6c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:06.868747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c8a8bd35-a42e-418b-b3d1-8b6d3b1ef74e req-412d255a-232a-49a0-b6fa-b34e32430799 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:06.869828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c8a8bd35-a42e-418b-b3d1-8b6d3b1ef74e req-412d255a-232a-49a0-b6fa-b34e32430799 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:06.870439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c8a8bd35-a42e-418b-b3d1-8b6d3b1ef74e req-412d255a-232a-49a0-b6fa-b34e32430799 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:06.891765 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c8a8bd35-a42e-418b-b3d1-8b6d3b1ef74e req-412d255a-232a-49a0-b6fa-b34e32430799 service nova] Creating event network-vif-plugged:050189cc-e370-4b38-9feb-a8c04b44cb6c for instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca on n-h2-836830-16 Sep 07 09:54:06.905607 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c8a8bd35-a42e-418b-b3d1-8b6d3b1ef74e req-412d255a-232a-49a0-b6fa-b34e32430799 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072516 Sep 07 09:54:06.907418 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1084/2223] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:06.998409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-74ae537e-e7ad-49c1-af77-a17b1ef488cb req-b024515e-7718-46ed-a51d-ffb331030ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a9cd8e-0a42-4622-9b8d-885638580dbf", "tag": "e95a1e84-34bf-408e-a698-11c49deef067"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:07.023127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:07.042002 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41d1bdbf-5658-432d-90c2-26afad339bc3 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 1.059888 Sep 07 09:54:07.053206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-74ae537e-e7ad-49c1-af77-a17b1ef488cb req-b024515e-7718-46ed-a51d-ffb331030ae1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:07.053206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-74ae537e-e7ad-49c1-af77-a17b1ef488cb req-b024515e-7718-46ed-a51d-ffb331030ae1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:07.053206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-74ae537e-e7ad-49c1-af77-a17b1ef488cb req-b024515e-7718-46ed-a51d-ffb331030ae1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:07.053578 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1140/2224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:05 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:07.060155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:07.070044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:07.085754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:07.086274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:07.086715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:07.087419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:07.089336 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-74ae537e-e7ad-49c1-af77-a17b1ef488cb req-b024515e-7718-46ed-a51d-ffb331030ae1 service nova] Creating event network-changed:e95a1e84-34bf-408e-a698-11c49deef067 for instance 35a9cd8e-0a42-4622-9b8d-885638580dbf on n-h2-836830-16 Sep 07 09:54:07.095633 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-74ae537e-e7ad-49c1-af77-a17b1ef488cb req-b024515e-7718-46ed-a51d-ffb331030ae1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103803 Sep 07 09:54:07.098061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1085/2225] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:54:07.099110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:07.106518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:07.680376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:07.681460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:07.708988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:07.712914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:07.712914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:07.712914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:07.712914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:07.712914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:07.803847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:07.813984 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c575ece-f4ce-4233-a5e9-5097f2150db5 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1290 microversion: 2.1 time: 0.763131 Sep 07 09:54:07.817642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1141/2226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:07 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1290 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:07.847815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c248f18-db11-4802-9021-89efa331fb7c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b26080d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:07.928865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c248f18-db11-4802-9021-89efa331fb7c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.081008 Sep 07 09:54:07.930137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1142/2227] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:07 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:54:08.073389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:08.076870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:08.094438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:08.095755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:08.096839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:08.097648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:08.098111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:08.098541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:08.157003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:08.800258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:08.821411 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b682e9d-e15f-4a8b-9252-550ebfcd2495 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1486 microversion: 2.1 time: 1.145932 Sep 07 09:54:08.824481 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1086/2228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:07 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1486 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:08.839964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:08.840849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:08.863656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:08.864321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:08.864973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:08.866270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:08.867000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:08.867593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:09.145265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:09.155811 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d73174a1-4c30-4165-9687-cca2b973eff1 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1321 microversion: 2.1 time: 1.088110 Sep 07 09:54:09.161742 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1143/2229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:08 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1321 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:09.170358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:09.172117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:09.186082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:09.195484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:09.196261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:09.196885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:09.197795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:09.198402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:09.198991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:09.244058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:54:09.360182 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d639286d-6f9a-4ce5-861d-5c53e3bad604 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 204 len: 0 microversion: 2.1 time: 0.196713 Sep 07 09:54:09.361532 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1144/2230] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:54:09 2022] DELETE /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:54:09.370778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7550fd86-a138-4202-9b6d-e270e0398358 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b26c0550>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:09.466387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7550fd86-a138-4202-9b6d-e270e0398358 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.102738 Sep 07 09:54:09.468211 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1145/2231] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:09 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:09.481776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:09.483989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:09.504011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:09.517339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:09.518047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:09.525023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:09.530154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:09.531107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:10.866299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:10.877096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b2995f2-7ace-4952-b66e-8dca0c76df86 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 2.040815 Sep 07 09:54:10.886027 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1087/2232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:08 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:54:10.912056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:10.912702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:10.949756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:10.953785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:10.959112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:10.960187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:10.963412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:10.966936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:11.273481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:11.293736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:11.319163 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-22eaf59c-18e5-4bf4-b143-66ea8b5bb37b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1492 microversion: 2.1 time: 1.845654 Sep 07 09:54:11.327588 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1146/2233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:09 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1492 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:11.362180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a761d9bd-8dac-4793-af34-a995e2f21dd3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b25204c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:11.475640 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a761d9bd-8dac-4793-af34-a995e2f21dd3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.146576 Sep 07 09:54:11.476760 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1147/2234] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:11 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:11.804758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:11.819212 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bf46e8dc-1524-4438-a6f4-34c6c4091cbc tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1470 microversion: 2.1 time: 0.932003 Sep 07 09:54:11.849325 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1088/2235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:10 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1470 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:11.852517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:11.853248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:11.874948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:11.875558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:11.876022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:11.876810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:11.882876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:11.884522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:11.915376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:11.916676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:11.928655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:11.935654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:11.936255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:11.937033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:11.937551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:11.937992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:11.957698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lazy-loading 'flavor' on Instance uuid dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:54:12.141732 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31e82d01-12de-4a6c-b819-b4c9eb7d44a2 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca/action" status: 202 len: 0 microversion: 2.1 time: 0.293382 Sep 07 09:54:12.149920 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1148/2236] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:11 2022] POST /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:54:12.156134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:12.157101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:12.165981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:12.167009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:12.167789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:12.168792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:12.169689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:12.170495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:12.339304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:12.875894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:12.890366 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eeecf2ee-9c5d-498d-8d52-1404c4562fdd tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 0.980162 Sep 07 09:54:12.894283 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1089/2237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:11 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:54:12.906609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4c43c845-a6d8-4586-bfce-d2de500259e2 req-e20e0e01-3f44-4a08-adce-1459adb9e6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b08c201-3210-4230-b246-f21ca1c22c1b", "tag": "c9c7774f-158c-43a8-a86a-d5d016f73ded"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:12.920170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8da1c77-6c3e-48d0-82d9-d7eed0223a3a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1631 microversion: 2.1 time: 0.767317 Sep 07 09:54:12.921913 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1149/2238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:12 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1631 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:12.936415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:12.937286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:12.944804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c43c845-a6d8-4586-bfce-d2de500259e2 req-e20e0e01-3f44-4a08-adce-1459adb9e6f3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:12.952044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c43c845-a6d8-4586-bfce-d2de500259e2 req-e20e0e01-3f44-4a08-adce-1459adb9e6f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:12.953662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c43c845-a6d8-4586-bfce-d2de500259e2 req-e20e0e01-3f44-4a08-adce-1459adb9e6f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:12.955330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:12.956178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:12.956797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:12.957904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:12.962219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:12.962829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:12.995106 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4c43c845-a6d8-4586-bfce-d2de500259e2 req-e20e0e01-3f44-4a08-adce-1459adb9e6f3 service nova] Creating event network-changed:c9c7774f-158c-43a8-a86a-d5d016f73ded for instance 3b08c201-3210-4230-b246-f21ca1c22c1b on n-h2-836830-16 Sep 07 09:54:13.019057 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4c43c845-a6d8-4586-bfce-d2de500259e2 req-e20e0e01-3f44-4a08-adce-1459adb9e6f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121060 Sep 07 09:54:13.020207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1090/2239] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:13.045695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f27ba371-1940-4ad5-9ace-430e9a09cb5f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b2317f70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:13.181146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f27ba371-1940-4ad5-9ace-430e9a09cb5f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.155927 Sep 07 09:54:13.194013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1091/2240] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:13 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:13.402592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:13.411846 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d73cd0c7-4cc0-4596-98f2-c8c949e3fbdc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1492 microversion: 2.1 time: 0.488012 Sep 07 09:54:13.429568 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1150/2241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:12 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1492 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:13.876950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-232c13a6-f35b-4507-89ab-8d737c3c301b req-5784a26a-fea8-4145-97f8-b835ae1c8837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e39a880-c107-479a-ac03-1bea990c81f8", "name": "network-vif-deleted", "tag": "c0fa3e6e-43fe-4979-9873-8a407b925c45"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:13.903133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-232c13a6-f35b-4507-89ab-8d737c3c301b req-5784a26a-fea8-4145-97f8-b835ae1c8837 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:13.903747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-232c13a6-f35b-4507-89ab-8d737c3c301b req-5784a26a-fea8-4145-97f8-b835ae1c8837 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:13.904199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-232c13a6-f35b-4507-89ab-8d737c3c301b req-5784a26a-fea8-4145-97f8-b835ae1c8837 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:13.918226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:13.919059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:13.923070 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-232c13a6-f35b-4507-89ab-8d737c3c301b req-5784a26a-fea8-4145-97f8-b835ae1c8837 service nova] Creating event network-vif-deleted:c0fa3e6e-43fe-4979-9873-8a407b925c45 for instance 7e39a880-c107-479a-ac03-1bea990c81f8 on n-h1-836830-16 Sep 07 09:54:13.931735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:13.935793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:13.937275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:13.938611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:13.940689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:13.941365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:13.943282 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-232c13a6-f35b-4507-89ab-8d737c3c301b req-5784a26a-fea8-4145-97f8-b835ae1c8837 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067831 Sep 07 09:54:13.945330 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1092/2242] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:13.950509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:13.951223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:13.982892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:13.983393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:13.983830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:13.999554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.000332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.000931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.254638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:14.295914 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-399d1177-8f94-433f-b958-5251424ce0ec tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 0.381113 Sep 07 09:54:14.309875 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1151/2243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:13 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:14.325850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0935f109-8c3a-4482-85a1-7072173916a6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b25814c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:14.412918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6bd999fb-5084-4561-85af-f605d2e42788 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1614 microversion: 2.1 time: 0.453462 Sep 07 09:54:14.412918 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1093/2244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:13 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1614 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:14.414999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0935f109-8c3a-4482-85a1-7072173916a6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.103782 Sep 07 09:54:14.416985 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1152/2245] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:14 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:14.428496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:14.429926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:14.459782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:14.459782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:14.465430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.465430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.465430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.465430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.465430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.465430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.482588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.482588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.482588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.482588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.482588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.482588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.527349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.534300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.535032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.535651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'fault' on Instance uuid 7e39a880-c107-479a-ac03-1bea990c81f8 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:54:14.611934 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] HTTP exception thrown: Cannot 'migrate' instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca while it is in vm_state suspended Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Request method failure captured: Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca/action HTTP/1.1 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 15 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGoR_nT74Ij4Cev5ebwRz0qPSFiteBSKw9id6dhTNJyRiWoqS3bFF5GxgjmBgZu8CgUNN9lUj34WdGoMa81L_R43KD5pTV7vGQEHBY01fWk-PX8PoWJnLd40lWoWrfvMpkkmem-XSIiwah3kf9NIIMZ0bTP9OHXJORe3I4gwpq2koQU Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63755be6a6fc4652a6323fca82357053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63755be6a6fc4652a6323fca82357053", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 56620cef55c54e31932fda7f681770ac Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: {"migrate": {}} Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'migrate' instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca while it is in vm_state suspended Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca', 'body': {'migrate': {}}} Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca in vm_state suspended. Cannot resize while the instance is in this state. Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:54:14.614513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca while it is in vm_state suspended Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca while it is in vm_state suspended Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Returning 409 to user: Cannot 'migrate' instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca while it is in vm_state suspended {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:14.618047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-463cb422-5753-4b4a-a281-21e5ffe01aca tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca/action" status: 409 len: 148 microversion: 2.1 time: 0.193787 Sep 07 09:54:14.623909 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1094/2246] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:14 2022] POST /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca/action => generated 148 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:54:14.630065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01079189-59ab-4dfc-8af2-cd26ea353e81 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01079189-59ab-4dfc-8af2-cd26ea353e81 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Request method failure captured: Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9/action HTTP/1.1 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 39 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGoR_nT74Ij4Cev5ebwRz0qPSFiteBSKw9id6dhTNJyRiWoqS3bFF5GxgjmBgZu8CgUNN9lUj34WdGoMa81L_R43KD5pTV7vGQEHBY01fWk-PX8PoWJnLd40lWoWrfvMpkkmem-XSIiwah3kf9NIIMZ0bTP9OHXJORe3I4gwpq2koQU Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63755be6a6fc4652a6323fca82357053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63755be6a6fc4652a6323fca82357053", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 56620cef55c54e31932fda7f681770ac Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: {"os-resetState": {"state": "invalid"}} Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '27d205ab-f172-4948-a082-79120721efa9', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:54:14.635228 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 07 09:54:14.640600 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.646731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:14.656810 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51d60dc6-8d1f-4227-bfb0-921a44136608 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 200 len: 1305 microversion: 2.1 time: 0.224726 Sep 07 09:54:14.657656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01079189-59ab-4dfc-8af2-cd26ea353e81 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:14.659043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01079189-59ab-4dfc-8af2-cd26ea353e81 tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9/action" status: 400 len: 144 microversion: 2.1 time: 0.033939 Sep 07 09:54:14.664812 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1153/2247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:14 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 1305 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:14.665559 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1095/2248] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:14 2022] POST /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9/action => generated 144 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:54:14.685287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f76b545-4258-47b5-898f-60dde3195f2a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f76b545-4258-47b5-898f-60dde3195f2a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Request method failure captured: Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9/action HTTP/1.1 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 31 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoR_nT74Ij4Cev5ebwRz0qPSFiteBSKw9id6dhTNJyRiWoqS3bFF5GxgjmBgZu8CgUNN9lUj34WdGoMa81L_R43KD5pTV7vGQEHBY01fWk-PX8PoWJnLd40lWoWrfvMpkkmem-XSIiwah3kf9NIIMZ0bTP9OHXJORe3I4gwpq2koQU Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63755be6a6fc4652a6323fca82357053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63755be6a6fc4652a6323fca82357053", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 56620cef55c54e31932fda7f681770ac Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: {"os-resetState": {"state": 1}} Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '27d205ab-f172-4948-a082-79120721efa9', 'body': {'os-resetState': {'state': 1}}} Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 1 Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 07 09:54:14.713302 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 07 09:54:14.717046 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.719614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f76b545-4258-47b5-898f-60dde3195f2a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:14.720864 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f76b545-4258-47b5-898f-60dde3195f2a tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9/action" status: 400 len: 120 microversion: 2.1 time: 0.054726 Sep 07 09:54:14.722860 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1154/2249] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:14 2022] POST /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9/action => generated 120 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:54:14.731611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-679dabc9-fc89-4f66-990d-d57594d037ed tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:14.734364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-679dabc9-fc89-4f66-990d-d57594d037ed tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Failed to fetch instance by id 999 {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 09:54:14.735111 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-679dabc9-fc89-4f66-990d-d57594d037ed tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-679dabc9-fc89-4f66-990d-d57594d037ed tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Request method failure captured: Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 37 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGoR_nT74Ij4Cev5ebwRz0qPSFiteBSKw9id6dhTNJyRiWoqS3bFF5GxgjmBgZu8CgUNN9lUj34WdGoMa81L_R43KD5pTV7vGQEHBY01fWk-PX8PoWJnLd40lWoWrfvMpkkmem-XSIiwah3kf9NIIMZ0bTP9OHXJORe3I4gwpq2koQU Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63755be6a6fc4652a6323fca82357053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63755be6a6fc4652a6323fca82357053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63755be6a6fc4652a6323fca82357053", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 63755be6a6fc4652a6323fca82357053 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1577062344 Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 56620cef55c54e31932fda7f681770ac Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1577062344-project-admin Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: {"os-resetState": {"state": "error"}} Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 999 could not be found. Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:14.749883 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:54:14.755112 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:54:14.755112 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 07 09:54:14.755112 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:14.755112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-679dabc9-fc89-4f66-990d-d57594d037ed tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:14.755112 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-679dabc9-fc89-4f66-990d-d57594d037ed tempest-ServersAdminNegativeTestJSON-1577062344 tempest-ServersAdminNegativeTestJSON-1577062344-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026860 Sep 07 09:54:14.756194 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1096/2250] 10.222.0.60 () {60 vars in 1179 bytes} [Wed Sep 7 09:54:14 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 09:54:14.765860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:14.766652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:14.784208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.797831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.802323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.804211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:14.804915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:14.805545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:14.880442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:54:15.044640 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed0f202d-e62d-4ddd-ab6f-322f03cad730 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 204 len: 0 microversion: 2.1 time: 0.279534 Sep 07 09:54:15.046536 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1155/2251] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:54:14 2022] DELETE /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:54:15.055888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:15.056492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:15.064980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:15.066310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:15.067181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:15.068307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:15.068930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:15.069852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:15.326029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:15.327208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:15.335912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:15.336852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:15.337867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:15.338941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:15.339663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:15.340332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:15.344848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:15.352035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:15.361321 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-49940184-04e0-4088-9b78-b3ec2ec9a773 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1467 microversion: 2.1 time: 0.309226 Sep 07 09:54:15.362690 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1097/2252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:15 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1467 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:54:15.435201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2af44272-e590-4005-9693-078d4a855044 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b13c90d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:15.518889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2af44272-e590-4005-9693-078d4a855044 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.090642 Sep 07 09:54:15.519795 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1098/2253] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:15 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:15.601702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:15.613820 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bdbbad06-f583-4138-88aa-483465ca185a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 0.293144 Sep 07 09:54:15.617040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1156/2254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:15 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:15.690685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:15.691511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:15.693522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=84 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:15.699164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:15.699941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:15.700599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:15.701564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:15.702244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:15.702911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:15.719396 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 HTTP/1.1 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7e39a880-c107-479a-ac03-1bea990c81f8'} Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:15.721789 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:54:15.726043 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:15.727795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:15.730251 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67b90079-b9e3-4b0d-af13-6fc2aec35845 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 404 len: 111 microversion: 2.1 time: 0.042871 Sep 07 09:54:15.744743 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1099/2255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:15 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:54:15.904160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1612820348", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:15.978942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:54:16.385269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:16.386487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:16.410149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:16.416664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:16.419006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:16.424306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:16.431422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:16.432301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:17.052133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:17.066714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:54:17.067210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:54:17.067695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:54:17.068109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:54:17.068524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:54:17.081374 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7fe3580-4f3b-4789-b206-3a3d13149add tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1467 microversion: 2.1 time: 0.700058 Sep 07 09:54:17.081977 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1100/2256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:16 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1467 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:17.099378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:17.099876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:17.100364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:17.101514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:17.107226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d957054-a3e4-4757-bf55-32cfb706d7f4 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b235f310>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:17.110248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:17.110708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:17.211608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:54:17.227231 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d957054-a3e4-4757-bf55-32cfb706d7f4 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.143908 Sep 07 09:54:17.227829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1101/2257] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:17 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:17.245790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:54:17.251029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:17.252304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:17.273850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:17.284739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:17.286771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:54:17.287306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:17.292519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:54:17.292998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:17.293673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:17.295803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:17.474322 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-10e1f41c-f9b6-4513-b48c-ffdfeeed909d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578009 Sep 07 09:54:17.484584 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1157/2258] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:54:18.053527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-721384094", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:18.091798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:18.106194 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d9b5b84-148e-44c4-8d8a-8e356250bccc tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 0.876692 Sep 07 09:54:18.113656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1102/2259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:17 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:18.151501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61f41c83-48b1-453b-a352-e3d910c0566d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:18.162135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-61f41c83-48b1-453b-a352-e3d910c0566d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:18.239991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] validate_networks() for [('293d2dbc-1fd0-45f3-9d72-4dcea2a99e1b', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:54:19.009434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-61f41c83-48b1-453b-a352-e3d910c0566d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:19.037881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-61f41c83-48b1-453b-a352-e3d910c0566d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1215 microversion: 2.1 time: 0.916174 Sep 07 09:54:19.053208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1103/2260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:18 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1215 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:19.053208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:19.056909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:19.085724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:19.086314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:19.106087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:19.106749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:19.107023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:19.113611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:19.580974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:19.598957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4514347a-b20f-4fe7-bf15-0cb741f4961e tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 200 len: 1425 microversion: 2.1 time: 0.553977 Sep 07 09:54:19.599553 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1104/2261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:19 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 1425 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:19.626553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93bfbe56-2149-488c-b460-9991b85600d6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b22b9a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:19.798726 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93bfbe56-2149-488c-b460-9991b85600d6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.181254 Sep 07 09:54:19.808765 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1105/2262] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:19 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:19.821973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:19.826686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:19.840366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:19.860194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:19.861820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:19.862841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:19.863571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:19.864267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:20.644722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:20.660518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4a857b7-f732-4dc9-a382-5b7278ec7b44 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 0.842416 Sep 07 09:54:20.661220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1106/2263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:19 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:20.683949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b9cb2454-928e-462e-9cc5-4c82eece824d req-c8f28ccf-8fba-4e69-b8f2-188793efb71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca", "name": "network-vif-deleted", "tag": "050189cc-e370-4b38-9feb-a8c04b44cb6c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:20.722901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b9cb2454-928e-462e-9cc5-4c82eece824d req-c8f28ccf-8fba-4e69-b8f2-188793efb71b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:20.730102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b9cb2454-928e-462e-9cc5-4c82eece824d req-c8f28ccf-8fba-4e69-b8f2-188793efb71b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:20.731113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b9cb2454-928e-462e-9cc5-4c82eece824d req-c8f28ccf-8fba-4e69-b8f2-188793efb71b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:20.780416 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b9cb2454-928e-462e-9cc5-4c82eece824d req-c8f28ccf-8fba-4e69-b8f2-188793efb71b service nova] Creating event network-vif-deleted:050189cc-e370-4b38-9feb-a8c04b44cb6c for instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca on n-h2-836830-16 Sep 07 09:54:20.804241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b9cb2454-928e-462e-9cc5-4c82eece824d req-c8f28ccf-8fba-4e69-b8f2-188793efb71b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137098 Sep 07 09:54:20.806838 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1107/2264] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:20.827184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:20.831387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:20.851180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:20.852786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:20.854566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:20.857365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:20.858738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:20.859748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:21.428023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:54:21.433475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:54:21.434350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:54:21.434955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:54:21.435535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:54:21.468302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:21.480907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:21.485356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:21.488167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:21.488654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:21.489374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:21.538272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Getting quotas for project 828328e7cafb488087392d52b51e5c02. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:54:21.544743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Getting quotas for user fc0088e18ea446cf8674649ad040c87e and project 828328e7cafb488087392d52b51e5c02. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:54:21.565272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:54:21.568635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:54:21.640359 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0a23ba0-41ac-4462-a089-e945a74141fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.154422 Sep 07 09:54:21.641624 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1158/2265] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:54:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:54:21.647066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:21.648067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:21.659121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:21.660090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:21.661244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:21.662199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:21.662822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:21.663408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:21.688056 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] HTTP exception thrown: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca could not be found. Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Request method failure captured: Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca HTTP/1.1 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoQyrnRI3rk_iRrjcaeJDzlAkLXpH48gNiTqrAl14bD3qa8OtswaHBAbqUMJBmO9ojj0UEwa0fInqIwabY3m-izC30USXhK64Car1g1F-Fg312O1SpJrAcW5UayozHfK6Q-lJAfimkZAPiAjH3vH0wMTmKYrGCkctFA6IwiffRp-w4 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5e3d627af5d143a3b9a1d459d9c38cb1 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1045627710 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e3d627af5d143a3b9a1d459d9c38cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e3d627af5d143a3b9a1d459d9c38cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e3d627af5d143a3b9a1d459d9c38cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e3d627af5d143a3b9a1d459d9c38cb1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1045627710 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5e3d627af5d143a3b9a1d459d9c38cb1 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1045627710 Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAdminNegativeTestJSON-1045627710-project Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 4ab5920bb33b4fd6989e01e5c9c6d98d Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1045627710-project Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca could not be found. Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca'} Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca could not be found. Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca could not be found. Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:21.690298 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca could not be found. Sep 07 09:54:21.694700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:21.696172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Returning 404 to user: Instance dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:21.697209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97682ada-1fb9-4b2a-847b-1c9b5bd4811c tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca" status: 404 len: 111 microversion: 2.1 time: 0.054346 Sep 07 09:54:21.697928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1159/2266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:21 2022] GET /compute/v2.1/servers/dcaa84cb-5bdd-4d49-a9f0-eb11e0d846ca => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:54:21.703794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d215797-b49e-477a-9251-70a54ca537a2 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1e169d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:21.764342 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d215797-b49e-477a-9251-70a54ca537a2 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.065212 Sep 07 09:54:21.774029 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1160/2267] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:21 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:21.780334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-514fc04d-2a27-4127-9490-23416e7884ff tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:21.781252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-514fc04d-2a27-4127-9490-23416e7884ff tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:21.935082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:21.947140 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-800fa777-2759-4bd0-a3e1-4cad997fedd9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1285 microversion: 2.1 time: 1.137349 Sep 07 09:54:21.947750 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1108/2268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:20 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1285 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:21.982412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:21.983057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:22.002213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:22.003685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:22.004350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:22.005459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:22.008724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:22.009450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:22.055248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-514fc04d-2a27-4127-9490-23416e7884ff tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:22.063720 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-514fc04d-2a27-4127-9490-23416e7884ff tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1213 microversion: 2.1 time: 0.288280 Sep 07 09:54:22.064505 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1161/2269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:21 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:22.084328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:22.094491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:22.121000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:22.121495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:22.121944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:22.122669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:22.123130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:22.123565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:22.207850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:54:22.216111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:22.450357 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19f592a7-26a1-424b-9fe7-d15868955949 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "DELETE /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 204 len: 0 microversion: 2.1 time: 0.375826 Sep 07 09:54:22.451310 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1162/2270] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:54:22 2022] DELETE /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:54:22.866145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1851256669", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:23.019519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:54:23.780730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:23.800549 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8462c121-ec0d-4b1d-a47f-a41d4d669a96 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 1.842447 Sep 07 09:54:23.803470 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1109/2271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:21 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:23.819249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:23.821671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:23.842111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:23.843822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:23.844506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:23.849320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:23.850066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:23.850753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.481731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:54:24.482287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:54:24.482609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:54:24.483211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:54:24.483760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:54:24.521932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.522441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.522892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.523643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.524099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.524530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.574406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:54:24.585445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for user 0e051e5308924154b7d5ecc2ea7ffdf7 and project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:54:24.607919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:54:24.610658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:54:24.619056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:24.629150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3bc80c63-bf7f-4ddb-8702-052d432c0b0f tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1478 microversion: 2.1 time: 0.819617 Sep 07 09:54:24.629769 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1110/2272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:23 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1478 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:24.654618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67c57222-8952-4424-8042-f913faad967e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b22c6550>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:24.703452 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26621958-da01-4d17-af00-6975d621e2e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249821 Sep 07 09:54:24.710011 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1163/2273] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:54:24.728332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:24.729031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:24.738987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.739562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.740198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.741160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.741761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.742291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.762285 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67c57222-8952-4424-8042-f913faad967e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1455 microversion: 2.1 time: 0.116140 Sep 07 09:54:24.764271 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1111/2274] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:24 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:24.785237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:24.786078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:24.800283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.801291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.801952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.802886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.803575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.804221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:24.920909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:24.934700 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-973e1cab-4018-4a59-a532-6ad98b7fd3f4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1265 microversion: 2.1 time: 0.167471 Sep 07 09:54:24.935293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1112/2275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:24 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:24.949385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b72e719f-9d9f-4305-9f51-05ded738d45c req-7d5f58c5-bfd8-43fc-9988-3ac150b2d90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b08c201-3210-4230-b246-f21ca1c22c1b", "name": "network-vif-plugged", "status": "completed", "tag": "c9c7774f-158c-43a8-a86a-d5d016f73ded"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:24.977426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b72e719f-9d9f-4305-9f51-05ded738d45c req-7d5f58c5-bfd8-43fc-9988-3ac150b2d90d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:24.978306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b72e719f-9d9f-4305-9f51-05ded738d45c req-7d5f58c5-bfd8-43fc-9988-3ac150b2d90d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:24.978944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b72e719f-9d9f-4305-9f51-05ded738d45c req-7d5f58c5-bfd8-43fc-9988-3ac150b2d90d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:25.003793 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b72e719f-9d9f-4305-9f51-05ded738d45c req-7d5f58c5-bfd8-43fc-9988-3ac150b2d90d service nova] Creating event network-vif-plugged:c9c7774f-158c-43a8-a86a-d5d016f73ded for instance 3b08c201-3210-4230-b246-f21ca1c22c1b on n-h2-836830-16 Sep 07 09:54:25.021059 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b72e719f-9d9f-4305-9f51-05ded738d45c req-7d5f58c5-bfd8-43fc-9988-3ac150b2d90d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084420 Sep 07 09:54:25.022178 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1113/2276] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:25.148047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-253faa64-b665-425a-9a61-cc9ec7ee0229 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Action: 'create', calling method: .version_select at 0x7f14b1bed160>, body: {"keypair": {"name": "tempest-keypair-1677069777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzZdz4aVl2IFT93Ha2PfEw6NBpdnrHrJwiTa0oduyYV6i31d7jQDvILuCr1KoxxULcLpfZtuO9huwk0x/tL8+dvWJ7JIVU/jgRORuP7zbJDE/otlmQ0YutW3j8uzqBprQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:25.248594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-253faa64-b665-425a-9a61-cc9ec7ee0229 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Getting quotas for project 9527f4c832da4894b05771befd4868ba. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:54:25.264201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-253faa64-b665-425a-9a61-cc9ec7ee0229 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Getting quotas for user 2d2550430d8d403a992faeb064db2d85 and project 9527f4c832da4894b05771befd4868ba. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:54:25.363370 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-253faa64-b665-425a-9a61-cc9ec7ee0229 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.339905 Sep 07 09:54:25.368290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1114/2277] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:54:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:25.381372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6bd3b28-b004-4393-b752-96a9c1c268fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:25.382152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6bd3b28-b004-4393-b752-96a9c1c268fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:25.440045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:25.451611 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62d3c637-16a9-4105-a1b7-c8057c29a072 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1315 microversion: 2.1 time: 0.739715 Sep 07 09:54:25.455398 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1164/2278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:24 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:25.489437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:25.492566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:25.508865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:25.510856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:25.511571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:25.514461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:25.516649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:25.518027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:25.632639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a6bd3b28-b004-4393-b752-96a9c1c268fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:25.641824 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6bd3b28-b004-4393-b752-96a9c1c268fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1213 microversion: 2.1 time: 0.272213 Sep 07 09:54:25.647368 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1115/2279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:25 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:25.652810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:25.658600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:25.674155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:25.675014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:25.679583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:25.680780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:25.681530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:25.682201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:25.996437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:26.008642 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c810ac5c-7126-46dc-925f-b6e375bf3d84 tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1436 microversion: 2.1 time: 0.359367 Sep 07 09:54:26.037913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1116/2280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:25 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1436 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:26.062214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb9608cf-b1b6-4a80-893d-b651a3e24b02 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b235fb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:26.145096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb9608cf-b1b6-4a80-893d-b651a3e24b02 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1464 microversion: 2.1 time: 0.104443 Sep 07 09:54:26.145727 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1117/2281] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:26 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:26.154335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:26.159987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:26.179586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.180106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.183935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.184704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.190436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.191044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.232579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:26.247442 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89367702-ec99-4553-a09d-02ea4d5be487 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1332 microversion: 2.1 time: 0.790012 Sep 07 09:54:26.248054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1165/2282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:25 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1332 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:26.261433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0ad088a4-cfb9-41aa-a375-4743a742add6 req-39c25d2f-b5ac-4248-b57b-58860419c9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e196505e-2b63-4862-b532-6449982ac183", "tag": "6bbac783-aa25-468e-aa1d-cb59eb7d42cd"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:26.280966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0ad088a4-cfb9-41aa-a375-4743a742add6 req-39c25d2f-b5ac-4248-b57b-58860419c9fc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.283565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0ad088a4-cfb9-41aa-a375-4743a742add6 req-39c25d2f-b5ac-4248-b57b-58860419c9fc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.284072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0ad088a4-cfb9-41aa-a375-4743a742add6 req-39c25d2f-b5ac-4248-b57b-58860419c9fc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.300413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0ad088a4-cfb9-41aa-a375-4743a742add6 req-39c25d2f-b5ac-4248-b57b-58860419c9fc service nova] Creating event network-changed:6bbac783-aa25-468e-aa1d-cb59eb7d42cd for instance e196505e-2b63-4862-b532-6449982ac183 on n-h1-836830-16 Sep 07 09:54:26.308300 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0ad088a4-cfb9-41aa-a375-4743a742add6 req-39c25d2f-b5ac-4248-b57b-58860419c9fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058941 Sep 07 09:54:26.310345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1166/2283] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:26.330871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8d31468b-1e5a-4cc6-8094-57d80c4809cc req-79bf83f3-7062-4df3-9a23-a70edfbccd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d205ab-f172-4948-a082-79120721efa9", "name": "network-vif-deleted", "tag": "39a29db1-2fe8-41e0-a748-cde32f878586"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:26.337114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=9 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:26.359724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:26.384489 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a2f32ebd-e2d8-4163-9499-53d6eee1f12f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1271 microversion: 2.1 time: 0.223277 Sep 07 09:54:26.384693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d31468b-1e5a-4cc6-8094-57d80c4809cc req-79bf83f3-7062-4df3-9a23-a70edfbccd9a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.386833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d31468b-1e5a-4cc6-8094-57d80c4809cc req-79bf83f3-7062-4df3-9a23-a70edfbccd9a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.397227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d31468b-1e5a-4cc6-8094-57d80c4809cc req-79bf83f3-7062-4df3-9a23-a70edfbccd9a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.397447 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1118/2284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:26 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:26.397447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7de503e-e212-4e27-8e12-f354ba618db6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1bed820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:26.451847 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8d31468b-1e5a-4cc6-8094-57d80c4809cc req-79bf83f3-7062-4df3-9a23-a70edfbccd9a service nova] Creating event network-vif-deleted:39a29db1-2fe8-41e0-a748-cde32f878586 for instance 27d205ab-f172-4948-a082-79120721efa9 on n-h2-836830-16 Sep 07 09:54:26.466571 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a7de503e-e212-4e27-8e12-f354ba618db6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 200 len: 1464 microversion: 2.1 time: 0.077702 Sep 07 09:54:26.467461 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1119/2285] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:26 2022] GET /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:26.481667 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8d31468b-1e5a-4cc6-8094-57d80c4809cc req-79bf83f3-7062-4df3-9a23-a70edfbccd9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166071 Sep 07 09:54:26.482157 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1167/2286] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:26.506999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:26.509741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:26.519963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:26.520760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:26.528096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.530962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.532096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.534969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.535879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.537658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.544194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.545115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.545808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.546726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:26.547799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:26.549393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:26.972445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:26.980874 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f30179bb-b85d-4aa3-b26c-cc9d1d48ea8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1468 microversion: 2.1 time: 0.493495 Sep 07 09:54:26.997748 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1168/2287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:26 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1468 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:27.004336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:27.005308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:27.005666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:27.013086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.013883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.014544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.015502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.016174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.016825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.021279 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c15beaba-321c-44d1-82f1-573d13eee3d5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1315 microversion: 2.1 time: 0.546309 Sep 07 09:54:27.024270 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1120/2288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:26 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:27.055248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1165835923"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:27.057868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:27.091967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.092489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.092946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.097820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.098329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.098800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.201867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:27.214618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f06c46a-d0ac-4da4-b177-d1105e88d793 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1265 microversion: 2.1 time: 0.215373 Sep 07 09:54:27.215217 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1169/2289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:26 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:27.228477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:27.229653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:27.241421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.241944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.242386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.243109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.243573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.244005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.333779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.334565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.335178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.335812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lazy-loading 'fault' on Instance uuid 27d205ab-f172-4948-a082-79120721efa9 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:54:27.417909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab5920bb33b4fd6989e01e5c9c6d98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3d627af5d143a3b9a1d459d9c38cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:27.448440 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-657d618d-52b5-43d4-8ab0-5176b3fd33aa tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 200 len: 1312 microversion: 2.1 time: 0.232086 Sep 07 09:54:27.449715 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1170/2290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:27 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:27.469347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:27.475186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:27.503404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.504130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.505203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.506151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.506779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.507818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.595870 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b286c70-5dfe-47b8-8e86-b971781222ed tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "POST /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b/action" status: 202 len: 0 microversion: 2.1 time: 0.569182 Sep 07 09:54:27.597472 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1121/2291] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:27 2022] POST /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:54:27.603527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:27.604693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:27.614163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.614680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.615132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.615848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:27.616464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:27.617163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:27.991356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:28.000316 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2480e46-f32b-412b-88d8-5f5a77f4f2ed tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1536 microversion: 2.1 time: 0.549159 Sep 07 09:54:28.001255 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1171/2292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:27 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1536 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:28.006321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d183d441-6ef9-4656-b79b-d4cc76e4ec05 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1dee9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:28.047867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:28.058148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e41eed41-74bf-4f0d-bb26-889828d236c4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 0.458961 Sep 07 09:54:28.065562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d183d441-6ef9-4656-b79b-d4cc76e4ec05 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.063035 Sep 07 09:54:28.066357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1172/2293] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:28 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:28.068380 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1122/2294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:27 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:28.072017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9a7ce8c-ca4c-4d8e-ae6f-9cf64d95962a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'create', calling method: .version_select at 0x7f14b203bf70>, body: {"pool": "82bf5053-cc6d-4ef1-927d-8e55a4633a0a"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:28.080591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:28.081502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:28.088220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:28.089048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:28.089674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:28.090545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:28.091191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:28.091758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:28.558874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:28.568542 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-904d0f10-a0e9-423b-beb0-c31958047718 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1315 microversion: 2.1 time: 0.498700 Sep 07 09:54:28.585654 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1123/2295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:28 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:28.591367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:28.592261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:28.600358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:28.600963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:28.601437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:28.602158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:28.602835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:28.603285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:28.608034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:28.828332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:28.839867 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a73e6e7b-9199-4817-ac45-0b905ad56e64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1271 microversion: 2.1 time: 0.252697 Sep 07 09:54:28.841498 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1124/2296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:28 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:28.858946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:28.861239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] [instance: 27d205ab-f172-4948-a082-79120721efa9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:28.878600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:28.879523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:28.880163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:28.881075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:28.881773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:28.882410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:28.899078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] HTTP exception thrown: Instance 27d205ab-f172-4948-a082-79120721efa9 could not be found. Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Request method failure captured: Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 HTTP/1.1 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGoQyrnRI3rk_iRrjcaeJDzlAkLXpH48gNiTqrAl14bD3qa8OtswaHBAbqUMJBmO9ojj0UEwa0fInqIwabY3m-izC30USXhK64Car1g1F-Fg312O1SpJrAcW5UayozHfK6Q-lJAfimkZAPiAjH3vH0wMTmKYrGCkctFA6IwiffRp-w4 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5e3d627af5d143a3b9a1d459d9c38cb1 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1045627710 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e3d627af5d143a3b9a1d459d9c38cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e3d627af5d143a3b9a1d459d9c38cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e3d627af5d143a3b9a1d459d9c38cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e3d627af5d143a3b9a1d459d9c38cb1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1045627710 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5e3d627af5d143a3b9a1d459d9c38cb1 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1045627710 Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminNegativeTestJSON-1045627710-project Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4ab5920bb33b4fd6989e01e5c9c6d98d Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1045627710-project Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 27d205ab-f172-4948-a082-79120721efa9 could not be found. Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '27d205ab-f172-4948-a082-79120721efa9'} Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d205ab-f172-4948-a082-79120721efa9 could not be found. Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d205ab-f172-4948-a082-79120721efa9 could not be found. Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:28.901501 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d205ab-f172-4948-a082-79120721efa9 could not be found. Sep 07 09:54:28.904861 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:54:28.914904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] Returning 404 to user: Instance 27d205ab-f172-4948-a082-79120721efa9 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:28.916406 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a7a29be-c3f7-4600-8599-542b5c7d4abf tempest-ServersAdminNegativeTestJSON-1045627710 tempest-ServersAdminNegativeTestJSON-1045627710-project] 10.222.0.60 "GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9" status: 404 len: 111 microversion: 2.1 time: 0.073590 Sep 07 09:54:28.917676 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1125/2297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:28 2022] GET /compute/v2.1/servers/27d205ab-f172-4948-a082-79120721efa9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:54:29.098010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db147e4e-39de-4ef5-be1e-76657484f614 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b21a63a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:29.208315 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db147e4e-39de-4ef5-be1e-76657484f614 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.129305 Sep 07 09:54:29.212689 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1126/2298] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:29 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:29.223176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:29.223864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:29.235676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:29.237019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:29.237693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:29.238620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:29.239254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:29.239867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:29.780512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:29.795449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e3b2f54e-75e0-422a-bcc3-c0677b4af013 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 0.578735 Sep 07 09:54:29.796238 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1127/2299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:29 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:29.801194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:29.801817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:29.808420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:29.808920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:29.809421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:29.810417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:29.811094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:29.811751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:30.349357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:30.363067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f43212e-ce7d-4ac2-8b90-e985e8c2438c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1315 microversion: 2.1 time: 0.565503 Sep 07 09:54:30.363977 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1128/2300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:29 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:30.372811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:30.373466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:30.388444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:30.389734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:30.390770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:30.392516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:30.393477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:30.394167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:30.894340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:30.913436 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8628a0fd-d4ae-49c3-b8ce-65df620e9667 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1313 microversion: 2.1 time: 0.547944 Sep 07 09:54:30.931655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1129/2301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:30 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:30.952510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4f3a00e-6157-4399-9af4-ae216f11d23c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1932940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:31.016972 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f4f3a00e-6157-4399-9af4-ae216f11d23c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.084002 Sep 07 09:54:31.025167 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1130/2302] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:30 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:31.041338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6d1d42ee-d54d-46f2-ac58-7205c1fbf6f5 req-ebababe9-3c89-48a2-ae6c-94f1f9f22b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "name": "network-vif-unplugged", "status": "completed", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:31.061561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6d1d42ee-d54d-46f2-ac58-7205c1fbf6f5 req-ebababe9-3c89-48a2-ae6c-94f1f9f22b1e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:31.062216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6d1d42ee-d54d-46f2-ac58-7205c1fbf6f5 req-ebababe9-3c89-48a2-ae6c-94f1f9f22b1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:31.062861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6d1d42ee-d54d-46f2-ac58-7205c1fbf6f5 req-ebababe9-3c89-48a2-ae6c-94f1f9f22b1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:31.089743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6d1d42ee-d54d-46f2-ac58-7205c1fbf6f5 req-ebababe9-3c89-48a2-ae6c-94f1f9f22b1e service nova] Creating event network-vif-unplugged:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:54:31.107159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6d1d42ee-d54d-46f2-ac58-7205c1fbf6f5 req-ebababe9-3c89-48a2-ae6c-94f1f9f22b1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076958 Sep 07 09:54:31.107773 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1131/2303] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:31.122313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:31.124951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:31.134924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:31.134924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:31.134924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:31.135247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:31.135875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:31.136302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:31.650837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:31.660317 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6452a488-f959-47e9-9c0b-7076a7eb816c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 0.551178 Sep 07 09:54:31.674830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1132/2304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:31 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:31.680623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-116d7b95-e629-4bef-96d9-ffa7ab5c3918 req-e38077e7-2305-4644-bcbe-87e417d11773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbfe500-4014-4f0d-b630-2aeafd3f5324", "tag": "f68f8e09-24ba-4b81-9bfe-4485238abe37"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:31.692718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-116d7b95-e629-4bef-96d9-ffa7ab5c3918 req-e38077e7-2305-4644-bcbe-87e417d11773 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:31.693260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-116d7b95-e629-4bef-96d9-ffa7ab5c3918 req-e38077e7-2305-4644-bcbe-87e417d11773 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:31.693847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-116d7b95-e629-4bef-96d9-ffa7ab5c3918 req-e38077e7-2305-4644-bcbe-87e417d11773 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:31.706643 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-116d7b95-e629-4bef-96d9-ffa7ab5c3918 req-e38077e7-2305-4644-bcbe-87e417d11773 service nova] Creating event network-changed:f68f8e09-24ba-4b81-9bfe-4485238abe37 for instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 on n-h1-836830-16 Sep 07 09:54:31.711575 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-116d7b95-e629-4bef-96d9-ffa7ab5c3918 req-e38077e7-2305-4644-bcbe-87e417d11773 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035118 Sep 07 09:54:31.712184 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1133/2305] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:31.721753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "26f8c1d5-4e4d-4795-91d1-00688df854b9"}], "security_groups": [{"name": "tempest-securitygroup--1097013653"}], "key_name": "tempest-keypair-1677069777", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:31.983962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] validate_networks() for [('26f8c1d5-4e4d-4795-91d1-00688df854b9', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:54:32.421151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9a7ce8c-ca4c-4d8e-ae6f-9cf64d95962a tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.352856 Sep 07 09:54:32.432385 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1173/2306] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:54:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:32.433954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5334b40c-9932-4e72-a080-3e4b07e3df3f req-8a228a75-0980-4a62-a999-c493fe4feb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f029b53-a749-4ebb-b41c-851193050f4a", "tag": "b19ed238-70ae-4d78-87e0-c9a31f159809"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:32.447511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5334b40c-9932-4e72-a080-3e4b07e3df3f req-8a228a75-0980-4a62-a999-c493fe4feb5f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.448074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5334b40c-9932-4e72-a080-3e4b07e3df3f req-8a228a75-0980-4a62-a999-c493fe4feb5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.449085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5334b40c-9932-4e72-a080-3e4b07e3df3f req-8a228a75-0980-4a62-a999-c493fe4feb5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.461819 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5334b40c-9932-4e72-a080-3e4b07e3df3f req-8a228a75-0980-4a62-a999-c493fe4feb5f service nova] Creating event network-changed:b19ed238-70ae-4d78-87e0-c9a31f159809 for instance 5f029b53-a749-4ebb-b41c-851193050f4a on n-h2-836830-16 Sep 07 09:54:32.471857 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5334b40c-9932-4e72-a080-3e4b07e3df3f req-8a228a75-0980-4a62-a999-c493fe4feb5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040993 Sep 07 09:54:32.473495 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1174/2307] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:32.481114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:32.482042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:32.490851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.491632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.493026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.494200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.494885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.495420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.726339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:54:32.726887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:54:32.727283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:54:32.727876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:54:32.728289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:54:32.738196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.738946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.739537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.744544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.745267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.746400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.758917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:32.770517 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8084dac3-4934-43eb-8552-8cdec158f18c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1315 microversion: 2.1 time: 0.295533 Sep 07 09:54:32.773904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1175/2308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:32 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:32.774171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Getting quotas for project 9527f4c832da4894b05771befd4868ba. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:54:32.779747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:32.779881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Getting quotas for user 2d2550430d8d403a992faeb064db2d85 and project 9527f4c832da4894b05771befd4868ba. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:54:32.780604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:32.788600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.789438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.790371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.791424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.793361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:54:32.793568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.794097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.796598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:54:32.868070 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ecfc0ebb-30c7-488f-b47b-2f70752390dd tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.151110 Sep 07 09:54:32.877261 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1134/2309] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:54:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:54:32.882756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8d2e68a5-c35b-47ea-9987-cb3e7bace757 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b21821f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:32.947859 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8d2e68a5-c35b-47ea-9987-cb3e7bace757 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.069128 Sep 07 09:54:32.956407 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1135/2310] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:32 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:32.956407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.104"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:32.956807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:32.964515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.965203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.965655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:32.967113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:32.967587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:32.968019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:33.010467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:33.011075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:54:33.011482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquired lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:54:33.022622 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9de4c2a4-08bc-4441-964f-011050fb1c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1313 microversion: 2.1 time: 0.246970 Sep 07 09:54:33.038229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1176/2311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:32 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:33.038229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:33.038229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:33.044352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:33.044937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:33.045310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:33.046029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:33.046490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:33.047035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:33.553843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:33.568580 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ec9d011-e1e7-4e32-a364-a505703ccf0d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 0.543550 Sep 07 09:54:33.581202 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1177/2312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:33 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:33.581202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:33.581202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:33.581581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:33.581850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:33.582449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:33.583471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:33.584140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:33.584744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:34.084488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:34.097254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77adcd53-e0f2-462f-9efe-57ba65842841 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1230 microversion: 2.1 time: 0.525595 Sep 07 09:54:34.098400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1178/2313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:33 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1230 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:34.117932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e8cfa33b-ec63-41b3-b586-9378f5c57ed4 req-0546abbf-2f70-45d6-8d37-53101226817f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e196505e-2b63-4862-b532-6449982ac183", "name": "network-vif-plugged", "status": "completed", "tag": "6bbac783-aa25-468e-aa1d-cb59eb7d42cd"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:34.132611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8cfa33b-ec63-41b3-b586-9378f5c57ed4 req-0546abbf-2f70-45d6-8d37-53101226817f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:34.133221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8cfa33b-ec63-41b3-b586-9378f5c57ed4 req-0546abbf-2f70-45d6-8d37-53101226817f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:34.134545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8cfa33b-ec63-41b3-b586-9378f5c57ed4 req-0546abbf-2f70-45d6-8d37-53101226817f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:34.149341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e8cfa33b-ec63-41b3-b586-9378f5c57ed4 req-0546abbf-2f70-45d6-8d37-53101226817f service nova] Creating event network-vif-plugged:6bbac783-aa25-468e-aa1d-cb59eb7d42cd for instance e196505e-2b63-4862-b532-6449982ac183 on n-h1-836830-16 Sep 07 09:54:34.155816 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e8cfa33b-ec63-41b3-b586-9378f5c57ed4 req-0546abbf-2f70-45d6-8d37-53101226817f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056134 Sep 07 09:54:34.156813 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1179/2314] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:34.164960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:34.165891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:34.174616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:34.175372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:34.175958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:34.176829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:34.177457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:34.178172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:34.552739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:34.603533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=20 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:35.115038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:35.124962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b7115f1-5e24-46f7-a8bb-818ad86316a7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1315 microversion: 2.1 time: 0.965635 Sep 07 09:54:35.132314 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1180/2315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:34 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1315 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:35.137731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed47596f-93f0-4c9d-9425-84c75f138d59 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b24acf70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:35.228263 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed47596f-93f0-4c9d-9425-84c75f138d59 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.094516 Sep 07 09:54:35.234107 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1181/2316] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:35 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:35.249284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:35.254117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:35.275950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:35.276455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:35.276900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:35.277648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:35.279395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:35.280023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:35.827758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:35.844978 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fcf4b3b9-34c2-4d36-b2f6-532757a2e2f0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1313 microversion: 2.1 time: 0.609559 Sep 07 09:54:35.848340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1182/2317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:35 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:35.887499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46f1572c-0137-484a-b78d-69550c5b388a"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:35.896893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:35.906442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:35.908297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:35.908988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:35.912508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:35.913241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:35.913880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:36.057496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:36.487600 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-280d695c-9461-49e8-983c-3dd0711568e7 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626576 Sep 07 09:54:36.494483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1183/2318] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 09:54:35 2022] POST /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:36.519103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:36.520008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:36.539729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:36.540976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:36.541958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:36.543696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:36.547101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:36.547960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:36.729441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:54:37.197768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:37.210936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2df0836b-0c38-4900-ae2e-03e2b37a7e81 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 0.711417 Sep 07 09:54:37.228117 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1184/2319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:36 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:37.246200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:37.248623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:37.259672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:37.260415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:37.261022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:37.261925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:37.262530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:37.263123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:37.365943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:37.378891 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4c6d831c-828a-416f-94d2-59ef4097f94b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1284 microversion: 2.1 time: 0.149335 Sep 07 09:54:37.380229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1185/2320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:37 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:37.391332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:37.397003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:37.425056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:37.430017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:37.433778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:37.436564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:37.437247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:37.440177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:38.094980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:38.104310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d7523464-200a-45ee-b035-463ce27b4299 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1502 microversion: 2.1 time: 0.720633 Sep 07 09:54:38.110015 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1186/2321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:37 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:38.123183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-231864ab-7901-4615-b958-f5b152da474e req-2337d763-7a07-4a6a-98b3-81cbb8e2b628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bd1d3e-70c6-4d04-8f7e-43b82a37515b", "name": "network-vif-plugged", "status": "completed", "tag": "b12bc190-ba6f-4910-823e-fabfc4f68991"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:38.143722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-231864ab-7901-4615-b958-f5b152da474e req-2337d763-7a07-4a6a-98b3-81cbb8e2b628 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:38.148187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-231864ab-7901-4615-b958-f5b152da474e req-2337d763-7a07-4a6a-98b3-81cbb8e2b628 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:38.148769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-231864ab-7901-4615-b958-f5b152da474e req-2337d763-7a07-4a6a-98b3-81cbb8e2b628 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:38.175142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-231864ab-7901-4615-b958-f5b152da474e req-2337d763-7a07-4a6a-98b3-81cbb8e2b628 service nova] Creating event network-vif-plugged:b12bc190-ba6f-4910-823e-fabfc4f68991 for instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b on n-h1-836830-16 Sep 07 09:54:38.192116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-231864ab-7901-4615-b958-f5b152da474e req-2337d763-7a07-4a6a-98b3-81cbb8e2b628 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080047 Sep 07 09:54:38.192893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1187/2322] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:38.210076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-39dca2c4-a2d9-444e-a58e-639008bd0354 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1dee9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:38.323113 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-39dca2c4-a2d9-444e-a58e-639008bd0354 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.123576 Sep 07 09:54:38.324032 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1188/2323] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:38 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:38.669084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2b123370-bf7b-423f-93a2-9e0240ab0d41 req-dc48ee00-e6d6-45e1-9080-b83d5185541c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b08c201-3210-4230-b246-f21ca1c22c1b", "tag": "c9c7774f-158c-43a8-a86a-d5d016f73ded"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:38.703788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Updating instance_info_cache with network_info: [{"id": "c9c7774f-158c-43a8-a86a-d5d016f73ded", "address": "fa:16:3e:ed:64:7d", "network": {"id": "52c60bdb-1b30-4879-bd45-435a7208ebc2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1962977370-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "62b2af63da0a4b70b07255424c743450", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9c7774f-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:54:38.716533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2b123370-bf7b-423f-93a2-9e0240ab0d41 req-dc48ee00-e6d6-45e1-9080-b83d5185541c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:38.717171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2b123370-bf7b-423f-93a2-9e0240ab0d41 req-dc48ee00-e6d6-45e1-9080-b83d5185541c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:38.721322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2b123370-bf7b-423f-93a2-9e0240ab0d41 req-dc48ee00-e6d6-45e1-9080-b83d5185541c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:38.728254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Releasing lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:54:38.729422 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-514ee58a-b598-42fe-b498-f7b6e03c1b73 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action" status: 202 len: 0 microversion: 2.1 time: 5.779515 Sep 07 09:54:38.730078 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1136/2324] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:32 2022] POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action => generated 0 bytes in 5781 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:54:38.754187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:38.754821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:38.771923 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2b123370-bf7b-423f-93a2-9e0240ab0d41 req-dc48ee00-e6d6-45e1-9080-b83d5185541c service nova] Creating event network-changed:c9c7774f-158c-43a8-a86a-d5d016f73ded for instance 3b08c201-3210-4230-b246-f21ca1c22c1b on n-h2-836830-16 Sep 07 09:54:38.782228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:38.785204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2b123370-bf7b-423f-93a2-9e0240ab0d41 req-dc48ee00-e6d6-45e1-9080-b83d5185541c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459769 Sep 07 09:54:38.786426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:38.788279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:38.791933 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1189/2325] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:38.792242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:38.795829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:38.796876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:38.819422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:38.823663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:38.849711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:38.855216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:38.855541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:38.857649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:38.861576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:38.862147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:39.029778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'flavor' on Instance uuid e196505e-2b63-4862-b532-6449982ac183 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:54:39.729114 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c40212ca-7c60-4657-b9d3-67424529b592 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183/action" status: 202 len: 0 microversion: 2.1 time: 0.931902 Sep 07 09:54:39.734200 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1190/2326] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:38 2022] POST /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183/action => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:54:39.755375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:39.761277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:39.806311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:39.806752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:39.807199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:39.807934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:39.808396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:39.808826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:40.708473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:40.726078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34e5d8bb-06df-42e9-8ebc-13fd2cb7a878 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1313 microversion: 2.1 time: 1.993699 Sep 07 09:54:40.754018 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1137/2327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:38 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1313 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:40.786800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:40.787487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:40.847467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:40.847942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:40.848428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:40.849173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:40.849664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:40.850095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:41.187078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:41.208042 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06814444-4fc8-4204-be90-9353663fbeca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 1.468127 Sep 07 09:54:41.210323 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1191/2328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:39 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:41.235260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82843e65-bca7-4957-9e0e-a39e20539e25 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'create', calling method: .version_select at 0x7f14b18900d0>, body: {"pool": "82bf5053-cc6d-4ef1-927d-8e55a4633a0a"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:41.973891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:41.986882 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e78b14f2-8d68-4877-a12a-33c975f86ffe tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1352 microversion: 2.1 time: 1.231506 Sep 07 09:54:41.994548 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1138/2329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:40 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1352 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:42.001607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f3a9579-c18d-48b2-9faa-7f8d23833eba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b5d90430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:42.079357 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f3a9579-c18d-48b2-9faa-7f8d23833eba tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.083195 Sep 07 09:54:42.080106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1139/2330] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:41 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:42.099222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:42.100065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:42.128168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:42.128620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:42.129233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:42.129835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:42.130309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:42.130809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:42.760840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:42.788840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:43.068069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:43.079939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fce03551-bf5b-4706-9ac1-b27f13e736ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.998529 Sep 07 09:54:43.080899 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1140/2331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:42 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:43.101068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbfe500-4014-4f0d-b630-2aeafd3f5324", "name": "network-vif-plugged", "status": "completed", "tag": "f68f8e09-24ba-4b81-9bfe-4485238abe37"}, {"server_uuid": "5f029b53-a749-4ebb-b41c-851193050f4a", "name": "network-vif-plugged", "status": "completed", "tag": "b19ed238-70ae-4d78-87e0-c9a31f159809"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:43.134394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:43.145093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:43.149420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:43.216366 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] Creating event network-vif-plugged:f68f8e09-24ba-4b81-9bfe-4485238abe37 for instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 on n-h1-836830-16 Sep 07 09:54:43.219321 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] Creating event network-vif-plugged:b19ed238-70ae-4d78-87e0-c9a31f159809 for instance 5f029b53-a749-4ebb-b41c-851193050f4a on n-h2-836830-16 Sep 07 09:54:43.255143 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-cf97fb04-9351-478b-89cd-3e7d412b06aa req-e2b8afd5-9dbe-46c6-8f9f-31ff09e081df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.172882 Sep 07 09:54:43.255790 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1141/2332] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:43.306514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:43.307322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:43.337082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:43.342099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:43.349080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:43.355259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:43.361220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:43.362195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:44.107700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:44.135864 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9849f7c-08ab-409a-a9f9-0b62d73141a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1313 microversion: 2.1 time: 0.878743 Sep 07 09:54:44.161010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1142/2333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:43 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1313 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:44.168689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:44.171616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:44.183613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:44.188159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:44.190579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:44.192107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:44.195199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:44.195943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:44.196717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:44.608599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:44.619918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7887b405-cd10-4bc7-9b9c-54ecf974c0bb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1313 microversion: 2.1 time: 0.455083 Sep 07 09:54:44.633849 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1143/2334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:44 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:44.652544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:44.658448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:44.678677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:44.679445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:44.682038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:44.683330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:44.685587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:44.686356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:45.117261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:45.140442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1eb750a-8834-4813-980a-6175454a991c tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1352 microversion: 2.1 time: 0.504046 Sep 07 09:54:45.141459 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1144/2335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:44 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1352 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:45.159825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1181b699-ebca-431f-86df-8d1fa613d417 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1c1c8b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:45.248731 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1181b699-ebca-431f-86df-8d1fa613d417 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.105599 Sep 07 09:54:45.249332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1145/2336] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:45 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:45.388574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45c7ca48-6320-4fdd-9377-500f73361b00 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Action: 'create', calling method: .version_select at 0x7f14b1c1c310>, body: {"pool": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:46.515988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82843e65-bca7-4957-9e0e-a39e20539e25 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.304381 Sep 07 09:54:46.524410 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1192/2337] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:54:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:46.524410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:46.524410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:46.538967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:46.540478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:46.540478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:46.540786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:46.541267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:46.541705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:47.272520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:47.291765 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82dcca96-49c8-4860-a94d-6c979b7f00ab tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.772610 Sep 07 09:54:47.299926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1193/2338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:46 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:47.310728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3b0573cd-b2e3-4f34-9731-8a6db3a42d20 req-c32e873c-e37b-4220-b1dd-f571c634a367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de44dabc-4237-4dfc-9234-b456fe99214d", "tag": "008d5f5d-58d3-456f-9846-019141cb24d8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:47.332537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b0573cd-b2e3-4f34-9731-8a6db3a42d20 req-c32e873c-e37b-4220-b1dd-f571c634a367 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:47.333030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b0573cd-b2e3-4f34-9731-8a6db3a42d20 req-c32e873c-e37b-4220-b1dd-f571c634a367 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:47.333496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b0573cd-b2e3-4f34-9731-8a6db3a42d20 req-c32e873c-e37b-4220-b1dd-f571c634a367 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:47.377127 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3b0573cd-b2e3-4f34-9731-8a6db3a42d20 req-c32e873c-e37b-4220-b1dd-f571c634a367 service nova] Creating event network-changed:008d5f5d-58d3-456f-9846-019141cb24d8 for instance de44dabc-4237-4dfc-9234-b456fe99214d on n-h2-836830-16 Sep 07 09:54:47.387478 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3b0573cd-b2e3-4f34-9731-8a6db3a42d20 req-c32e873c-e37b-4220-b1dd-f571c634a367 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085850 Sep 07 09:54:47.388605 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1194/2339] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:47.396027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:47.397096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:47.405316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:47.406272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:47.407784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:47.411638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:47.412323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:47.412922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:47.796325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:47.810181 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5b775a0-aab5-42d3-9f08-9872c371c35e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1463 microversion: 2.1 time: 0.420099 Sep 07 09:54:47.829824 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1195/2340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:47 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:47.840680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:47.841733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:47.851202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:47.851989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:47.852591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:47.853637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:47.854374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:47.854857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:48.192301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:48.202420 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-773d4d13-9b4c-443f-80e0-995956e6e87a tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1498 microversion: 2.1 time: 0.371082 Sep 07 09:54:48.202924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1196/2341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:47 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1498 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:48.231754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:48.232478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:48.239024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:48.239504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:48.241587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:48.243170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:48.244157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:48.245092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:48.670383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:48.684935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b592d98-b1a2-418c-81e8-fef4963e1544 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1352 microversion: 2.1 time: 0.457135 Sep 07 09:54:48.686660 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1197/2342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:48 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1352 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:48.692460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-46ee137f-0e61-4976-bb4d-0c9a5578b55a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1c423a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:48.760643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-46ee137f-0e61-4976-bb4d-0c9a5578b55a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.072612 Sep 07 09:54:48.762128 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1198/2343] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:48 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:48.775729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.53"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:48.782621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:48.792562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:48.793060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:48.793695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:48.794551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:48.795239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:48.795675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:48.844895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:54:48.846054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquired lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:54:48.852023 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45c7ca48-6320-4fdd-9377-500f73361b00 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.601361 Sep 07 09:54:48.852652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1146/2344] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:54:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:49.031286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:49.032848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:49.041394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:49.050637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:49.052144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:49.053615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:49.054233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:49.054798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:49.474531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a.", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:54:49.475443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Releasing lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:54:49.476298 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.476298 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Request method failure captured: Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action HTTP/1.1 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 45 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGo1XZC9cjYGK8lpfMOfWNl-k3yJ11xYsUXVTeqXBH_TfR7RcoETlCBR7wWVRqUrgwUlBNbb7-CV8Ff-UsLQ8XcRpWfmUvqxPnSU78nqZnBM36wNKZAUtblPwHvcJwersvDBtEui6fMgVzr2z9MOEOfxpd-EHm5H6EZ7XGf8rN9hhI4 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62b2af63da0a4b70b07255424c743450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62b2af63da0a4b70b07255424c743450", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 633cd5fd9f084704837e49c5667576ab Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: {"addFloatingIp": {"address": "172.25.3.53"}} Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3b08c201-3210-4230-b246-f21ca1c22c1b', 'body': {'addFloatingIp': {'address': '172.25.3.53'}}} Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:54:49.479767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] Sep 07 09:54:49.483952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:54:49.488791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Returning 400 to user: Cannot associate floating IP 172.25.3.53 (8c563497-2792-4a04-bbaa-b3628517e3dd) with port c9c7774f-158c-43a8-a86a-d5d016f73ded using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 82bf5053-cc6d-4ef1-927d-8e55a4633a0a. Sep 07 09:54:49.488791 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-1f7bfd94-f20f-4fae-a18f-f0e8432fc569'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:54:49.490046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8997a285-9ec8-4f17-8d74-5248eeffeede tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action" status: 400 len: 380 microversion: 2.1 time: 0.726533 Sep 07 09:54:49.493585 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1199/2345] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:48 2022] POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action => generated 380 bytes in 730 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:54:49.503800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:49.506859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:49.515133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:49.515875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:49.516669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:49.518297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:49.519297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:49.522422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:49.561505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lazy-loading 'flavor' on Instance uuid 5f029b53-a749-4ebb-b41c-851193050f4a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:54:49.582521 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8086d3b7-7611-420b-b947-ec6cc25f381e tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1616 microversion: 2.1 time: 0.727097 Sep 07 09:54:49.584416 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1147/2346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:48 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1616 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:49.589783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:49.590850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:49.599732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:49.600516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:49.601337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:49.602321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:49.602946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:49.603988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:49.633442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:49.674075 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5bd8befd-756b-4829-b4ca-1f43db64acd0 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "POST /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a/action" status: 200 len: 32 microversion: 2.1 time: 0.177996 Sep 07 09:54:49.675784 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1200/2347] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:49 2022] POST /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:54:49.682785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc981c5a-28f0-4b50-b122-81a39b9a21b4 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Action: 'create', calling method: .version_select at 0x7f14b203b940>, body: {"pool": null} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:49.984967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:49.997898 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d792f5b-a174-4953-b125-1a056359b3e7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.411350 Sep 07 09:54:50.015852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1148/2348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:49 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:50.024489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e762da5-9356-4d6f-af3a-bf831a287a67 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '.version_select at 0x7f14b23170d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:51.991443 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e762da5-9356-4d6f-af3a-bf831a287a67 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/8c563497-2792-4a04-bbaa-b3628517e3dd" status: 202 len: 0 microversion: 2.1 time: 1.973529 Sep 07 09:54:51.993904 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1149/2349] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:54:50 2022] DELETE /compute/v2.1/os-floating-ips/8c563497-2792-4a04-bbaa-b3628517e3dd => generated 0 bytes in 1977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:54:52.002478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:52.003576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:52.017568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.018972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.019646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.020639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.021342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.021999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.031809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:52.068905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '56dde78e93f44d5ab460e8fa71b8d7ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72fb1502184da0b77d1eba7cc1159f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:52.070172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] flavor_id is None. Assuming migration. {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 09:54:52.070781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 09:54:52.479618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc981c5a-28f0-4b50-b122-81a39b9a21b4 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.801338 Sep 07 09:54:52.481024 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1201/2350] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:54:49 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:52.491952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:52.494550 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-943f8be9-cabd-4f39-9a7c-987a3d36d108 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324/action" status: 202 len: 0 microversion: 2.1 time: 0.497299 Sep 07 09:54:52.498660 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1150/2351] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:51 2022] POST /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:54:52.505490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:52.505644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:52.506314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:52.516536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.517894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.518523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.519491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.520087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.520515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.526426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.526605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.532178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.533222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.533887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.534119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.769213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:52.782269 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c9a61bed-7628-4230-af3c-d1e9a87d782f tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1352 microversion: 2.1 time: 0.282228 Sep 07 09:54:52.799232 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1151/2352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:52 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1352 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:52.804294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00b6f5be-5065-4000-ba69-ee2e1ceef842 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1d34dc0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:52.833012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:52.841397 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-377ee2b8-7b5b-48e0-b153-1e2e15d7e7cc tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.356972 Sep 07 09:54:52.851581 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1202/2353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:52 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:52.857015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:52.872934 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00b6f5be-5065-4000-ba69-ee2e1ceef842 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1455 microversion: 2.1 time: 0.072411 Sep 07 09:54:52.873830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1152/2354] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:52 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:52.879828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:52.888651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.889380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.890029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:52.890941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:52.892149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:52.892820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:53.024178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-208ab909-60c4-4912-8159-292804e6e08d req-cb75b738-0792-4cfa-b2a8-773dcebcf9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de44dabc-4237-4dfc-9234-b456fe99214d", "name": "network-vif-plugged", "status": "completed", "tag": "008d5f5d-58d3-456f-9846-019141cb24d8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:53.047406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-208ab909-60c4-4912-8159-292804e6e08d req-cb75b738-0792-4cfa-b2a8-773dcebcf9c8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:53.049167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-208ab909-60c4-4912-8159-292804e6e08d req-cb75b738-0792-4cfa-b2a8-773dcebcf9c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:53.051402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-208ab909-60c4-4912-8159-292804e6e08d req-cb75b738-0792-4cfa-b2a8-773dcebcf9c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:53.085461 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-208ab909-60c4-4912-8159-292804e6e08d req-cb75b738-0792-4cfa-b2a8-773dcebcf9c8 service nova] Creating event network-vif-plugged:008d5f5d-58d3-456f-9846-019141cb24d8 for instance de44dabc-4237-4dfc-9234-b456fe99214d on n-h2-836830-16 Sep 07 09:54:53.115117 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-208ab909-60c4-4912-8159-292804e6e08d req-cb75b738-0792-4cfa-b2a8-773dcebcf9c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239643 Sep 07 09:54:53.115696 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1153/2355] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:53.123175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:53.125546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.104"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:53.132409 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e21d2c6b-c458-44e2-b201-4d81d9ff2c46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.279155 Sep 07 09:54:53.132993 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1203/2356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:52 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:53.156285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d19015c3-8e93-429a-ab3f-e6f29d51c6fd tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Action: 'create', calling method: .version_select at 0x7f14b1dee310>, body: {"pool": null} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:53.518172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:53.525373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:53.525879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:53.526304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:53.527014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:53.527470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:53.527895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:54.092791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:54:54.093378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquired lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:54:55.145764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:54:55.913504 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d19015c3-8e93-429a-ab3f-e6f29d51c6fd tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.779373 Sep 07 09:54:55.914142 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1204/2357] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:54:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:55.927160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:55.927778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:55.938059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:55.939977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:55.940619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:55.945072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:55.945909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:55.946541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.218705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:56.231541 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42db50fa-5d0f-42f6-8294-dcd5176df007 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1472 microversion: 2.1 time: 0.308691 Sep 07 09:54:56.232330 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1205/2358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:55 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:56.239675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:56.242438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:56.251037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.252223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.252930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.254607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.255408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.256427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.288579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'flavor' on Instance uuid 35a9cd8e-0a42-4622-9b8d-885638580dbf {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:54:56.359118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Updating instance_info_cache with network_info: [{"id": "c9c7774f-158c-43a8-a86a-d5d016f73ded", "address": "fa:16:3e:ed:64:7d", "network": {"id": "52c60bdb-1b30-4879-bd45-435a7208ebc2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1962977370-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "62b2af63da0a4b70b07255424c743450", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9c7774f-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:54:56.373565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Releasing lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:54:56.382275 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06a4ea84-4cf1-4ef3-b398-3097ac99ac30 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action" status: 202 len: 0 microversion: 2.1 time: 3.264405 Sep 07 09:54:56.382995 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1154/2359] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:53 2022] POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action => generated 0 bytes in 3266 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:54:56.388395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:56.389701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:56.398101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.398658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.399440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.400635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.401313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.401948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.464855 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b80fac44-6013-4a09-9799-64912d2fbb90 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/action" status: 200 len: 32 microversion: 2.1 time: 0.230479 Sep 07 09:54:56.465756 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1206/2360] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:54:56 2022] POST /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:54:56.472566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:56.473432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:56.481369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.481638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.482781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.483557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.484025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.484449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.629902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:56.637763 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56a6de87-c543-412d-bf4b-2471dc16a9a9 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1541 microversion: 2.1 time: 0.253615 Sep 07 09:54:56.649217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1155/2361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:56 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1541 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:56.649217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b4bd57ed-b90a-4138-a647-c2a4253b6ff6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1fe6dc0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:56.692805 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b4bd57ed-b90a-4138-a647-c2a4253b6ff6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1464 microversion: 2.1 time: 0.053437 Sep 07 09:54:56.693415 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1156/2362] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:56 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1464 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:56.698578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:56.699302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:56.706352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.706839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.707279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.707982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.708443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.708873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.752112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:56.760393 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5729690-8d9d-4c21-b12c-fe86fdf7b3b7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.293052 Sep 07 09:54:56.764885 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1207/2363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:56 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:56.765776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c133bd09-5756-497f-b028-7aaeb79ad655 req-c7d2f258-af2b-4f75-8069-1fa518ea91ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b08c201-3210-4230-b246-f21ca1c22c1b", "tag": "c9c7774f-158c-43a8-a86a-d5d016f73ded"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:56.771196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=67 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:54:56.777108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c133bd09-5756-497f-b028-7aaeb79ad655 req-c7d2f258-af2b-4f75-8069-1fa518ea91ff service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:56.777652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c133bd09-5756-497f-b028-7aaeb79ad655 req-c7d2f258-af2b-4f75-8069-1fa518ea91ff service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:56.778086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c133bd09-5756-497f-b028-7aaeb79ad655 req-c7d2f258-af2b-4f75-8069-1fa518ea91ff service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:56.789443 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c133bd09-5756-497f-b028-7aaeb79ad655 req-c7d2f258-af2b-4f75-8069-1fa518ea91ff service nova] Creating event network-changed:c9c7774f-158c-43a8-a86a-d5d016f73ded for instance 3b08c201-3210-4230-b246-f21ca1c22c1b on n-h2-836830-16 Sep 07 09:54:56.794734 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c133bd09-5756-497f-b028-7aaeb79ad655 req-c7d2f258-af2b-4f75-8069-1fa518ea91ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032482 Sep 07 09:54:56.795343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1208/2364] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:56.801045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d23051ea-0370-4579-8bc7-bd2aae03fdb3 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Action: 'create', calling method: .version_select at 0x7f14b1dd9550>, body: {"pool": null} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:54:57.038858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:57.047157 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0ea7dfc-8000-4470-bf78-36312d750e28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.352772 Sep 07 09:54:57.048423 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1157/2365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:56 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:57.052923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-989153eb-55d8-4b8a-81d3-71e8774ef0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '.version_select at 0x7f14b1d25a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:58.811704 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-989153eb-55d8-4b8a-81d3-71e8774ef0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/3565df80-6b5c-4774-8c88-4cbf9323499d" status: 202 len: 0 microversion: 2.1 time: 1.762199 Sep 07 09:54:58.817474 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1158/2366] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:54:57 2022] DELETE /compute/v2.1/os-floating-ips/3565df80-6b5c-4774-8c88-4cbf9323499d => generated 0 bytes in 1763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:54:58.817888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:58.818514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:58.825841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:58.826336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:58.826780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:58.827485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:58.827946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:58.828375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.342069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:59.350728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-afcba960-7426-45a8-9eda-bc5de889034a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.537215 Sep 07 09:54:59.351654 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1159/2367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:58 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:59.356855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:59.357373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:59.364561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.365062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.366048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.366801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.367270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.367699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.513314 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-761155b0-53fe-4a3a-b2f2-f73cd332659b tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160367 Sep 07 09:54:59.514358 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1160/2368] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:54:59 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:59.520197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19abd00e-61f4-4101-bfbd-30912ad11dfe tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b22c61f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:59.578937 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19abd00e-61f4-4101-bfbd-30912ad11dfe tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 200 len: 1464 microversion: 2.1 time: 0.063327 Sep 07 09:54:59.579912 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1161/2369] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:54:59 2022] GET /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 1464 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:59.595892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:59.596571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:59.603594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.604116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.604583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.605318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.605872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.606299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.810307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d23051ea-0370-4579-8bc7-bd2aae03fdb3 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.011286 Sep 07 09:54:59.811519 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1209/2370] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:54:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:54:59.822949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:59.825168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:59.834929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.835426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.835870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.836591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.837228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.837673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.842265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:54:59.855396 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-47fe2109-167a-488f-80a7-eebad3f7c6b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.264329 Sep 07 09:54:59.856402 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1162/2371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:59 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:54:59.861652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:54:59.862508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:54:59.877019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.877649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.878172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:54:59.878970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:54:59.879508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:54:59.880010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.053245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:00.066156 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bed9561f-f4ff-4c3b-9fed-b79d31bf9e1d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.253029 Sep 07 09:55:00.066762 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1210/2372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:59 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:00.073378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cf33c5e2-1158-42ce-844a-3d36e82b2bf1 req-8c3c7c3e-4009-47a0-bd4c-bcc56cde9e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bd1d3e-70c6-4d04-8f7e-43b82a37515b", "name": "network-vif-unplugged", "status": "completed", "tag": "b12bc190-ba6f-4910-823e-fabfc4f68991"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:00.087173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf33c5e2-1158-42ce-844a-3d36e82b2bf1 req-8c3c7c3e-4009-47a0-bd4c-bcc56cde9e70 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.089569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf33c5e2-1158-42ce-844a-3d36e82b2bf1 req-8c3c7c3e-4009-47a0-bd4c-bcc56cde9e70 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.090657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf33c5e2-1158-42ce-844a-3d36e82b2bf1 req-8c3c7c3e-4009-47a0-bd4c-bcc56cde9e70 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.090814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:00.100354 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8fc313d3-6357-4025-aed1-e72b8d30bf8d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.242418 Sep 07 09:55:00.101253 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1163/2373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:54:59 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:00.113405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cf33c5e2-1158-42ce-844a-3d36e82b2bf1 req-8c3c7c3e-4009-47a0-bd4c-bcc56cde9e70 service nova] Creating event network-vif-unplugged:b12bc190-ba6f-4910-823e-fabfc4f68991 for instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b on n-h1-836830-16 Sep 07 09:55:00.117361 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cf33c5e2-1158-42ce-844a-3d36e82b2bf1 req-8c3c7c3e-4009-47a0-bd4c-bcc56cde9e70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048447 Sep 07 09:55:00.117981 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1211/2374] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:00.123635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b03e3ff1-929b-4468-b399-e6aea593e181 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:00.127004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:00.127784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b03e3ff1-929b-4468-b399-e6aea593e181 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Request method failure captured: Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action HTTP/1.1 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 34 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGo1XZC9cjYGK8lpfMOfWNl-k3yJ11xYsUXVTeqXBH_TfR7RcoETlCBR7wWVRqUrgwUlBNbb7-CV8Ff-UsLQ8XcRpWfmUvqxPnSU78nqZnBM36wNKZAUtblPwHvcJwersvDBtEui6fMgVzr2z9MOEOfxpd-EHm5H6EZ7XGf8rN9hhI4 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62b2af63da0a4b70b07255424c743450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62b2af63da0a4b70b07255424c743450", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 633cd5fd9f084704837e49c5667576ab Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: {"addFloatingIp": {"address": ""}} Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3b08c201-3210-4230-b246-f21ca1c22c1b', 'body': {'addFloatingIp': {'address': ''}}} Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi '' Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 09:55:00.129625 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b03e3ff1-929b-4468-b399-e6aea593e181 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b03e3ff1-929b-4468-b399-e6aea593e181 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action" status: 400 len: 142 microversion: 2.1 time: 0.016158 Sep 07 09:55:00.135290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1164/2375] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:00 2022] POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:55:00.138525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28b2ce94-a118-447c-a6e9-e34aa9b420ce tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b1c1c550>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:00.141438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.142570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.143017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.143927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.144395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.144977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.444996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:00.445142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28b2ce94-a118-447c-a6e9-e34aa9b420ce tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/234d1c1b-4411-47bb-841f-088740320c18" status: 200 len: 142 microversion: 2.1 time: 0.311367 Sep 07 09:55:00.445891 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1165/2376] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 09:55:00 2022] GET /compute/v2.1/os-floating-ips/234d1c1b-4411-47bb-841f-088740320c18 => generated 142 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:00.449293 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19507345-237d-4c1d-86fe-017d34cae326 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1468 microversion: 2.1 time: 0.329914 Sep 07 09:55:00.457620 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1212/2377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:00 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:00.457963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:00.457963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:00.461016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.461794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.462358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:00.462602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.463352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:00.463878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.464498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.465085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.470527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.471154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.471720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.472531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.473173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.473765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.495533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:55:00.497283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquired lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:55:00.641112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Releasing lock "refresh_cache-3b08c201-3210-4230-b246-f21ca1c22c1b" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:55:00.642125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] HTTP exception thrown: floating IP not found Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Request method failure captured: Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action HTTP/1.1 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 41 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGo1XZC9cjYGK8lpfMOfWNl-k3yJ11xYsUXVTeqXBH_TfR7RcoETlCBR7wWVRqUrgwUlBNbb7-CV8Ff-UsLQ8XcRpWfmUvqxPnSU78nqZnBM36wNKZAUtblPwHvcJwersvDBtEui6fMgVzr2z9MOEOfxpd-EHm5H6EZ7XGf8rN9hhI4 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62b2af63da0a4b70b07255424c743450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62b2af63da0a4b70b07255424c743450", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 633cd5fd9f084704837e49c5667576ab Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: exception: floating IP not found Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3b08c201-3210-4230-b246-f21ca1c22c1b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 07 09:55:00.644740 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 07 09:55:00.649300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:00.650952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Returning 404 to user: floating IP not found {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:00.653334 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d0d21b0-27b1-4df4-a314-0a83e7471019 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action" status: 404 len: 67 microversion: 2.1 time: 0.206771 Sep 07 09:55:00.659900 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1166/2378] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:00 2022] POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action => generated 67 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:55:00.664735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5dc25124-8662-4c71-84e6-ad13e87607bc tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b1c350d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:00.741060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:00.750221 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1a64135-1cd5-494a-a2a3-864c4ca4498b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.298915 Sep 07 09:55:00.751711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1213/2379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:00 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:00.759727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1340785749"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:00.762357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:00.770373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.770877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.771319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:00.772027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:00.772487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:00.772915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:01.064870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ed0dcc3-c00f-4577-8682-b488783acf1c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "POST /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be/action" status: 202 len: 0 microversion: 2.1 time: 0.311537 Sep 07 09:55:01.078440 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1214/2380] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:00 2022] POST /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:55:01.090839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3888a619-5817-43f5-a174-fb6dcd50d38d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:01.182688 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-3888a619-5817-43f5-a174-fb6dcd50d38d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3888a619-5817-43f5-a174-fb6dcd50d38d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Request method failure captured: Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action HTTP/1.1 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 44 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGo1XZC9cjYGK8lpfMOfWNl-k3yJ11xYsUXVTeqXBH_TfR7RcoETlCBR7wWVRqUrgwUlBNbb7-CV8Ff-UsLQ8XcRpWfmUvqxPnSU78nqZnBM36wNKZAUtblPwHvcJwersvDBtEui6fMgVzr2z9MOEOfxpd-EHm5H6EZ7XGf8rN9hhI4 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62b2af63da0a4b70b07255424c743450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62b2af63da0a4b70b07255424c743450", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 633cd5fd9f084704837e49c5667576ab Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: exception: Floating IP not found for address 0.0.0.0. Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3b08c201-3210-4230-b246-f21ca1c22c1b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 07 09:55:01.188504 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3888a619-5817-43f5-a174-fb6dcd50d38d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3888a619-5817-43f5-a174-fb6dcd50d38d tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action" status: 404 len: 88 microversion: 2.1 time: 0.108169 Sep 07 09:55:01.193001 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1215/2381] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:01 2022] POST /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b/action => generated 88 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:55:01.202562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b2f70787-5c12-4a53-b7da-4b7d360bcab2 req-6e0a9ed0-4bda-4000-8679-99bdd7810dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de44dabc-4237-4dfc-9234-b456fe99214d", "tag": "008d5f5d-58d3-456f-9846-019141cb24d8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:01.226109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b2f70787-5c12-4a53-b7da-4b7d360bcab2 req-6e0a9ed0-4bda-4000-8679-99bdd7810dae service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:01.226912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b2f70787-5c12-4a53-b7da-4b7d360bcab2 req-6e0a9ed0-4bda-4000-8679-99bdd7810dae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:01.230641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b2f70787-5c12-4a53-b7da-4b7d360bcab2 req-6e0a9ed0-4bda-4000-8679-99bdd7810dae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:01.247216 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b2f70787-5c12-4a53-b7da-4b7d360bcab2 req-6e0a9ed0-4bda-4000-8679-99bdd7810dae service nova] Creating event network-changed:008d5f5d-58d3-456f-9846-019141cb24d8 for instance de44dabc-4237-4dfc-9234-b456fe99214d on n-h2-836830-16 Sep 07 09:55:01.271094 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b2f70787-5c12-4a53-b7da-4b7d360bcab2 req-6e0a9ed0-4bda-4000-8679-99bdd7810dae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077827 Sep 07 09:55:01.271995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1216/2382] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:01.277634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:01.278355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:01.286713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:01.287308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:01.287817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:01.288605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:01.289136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:01.289773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:01.605852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:01.614962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0bf48924-aecc-4614-99cc-ca27d4d511c1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.341593 Sep 07 09:55:01.615794 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1217/2383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:01 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:01.639071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b1f81194-e662-4d9f-b612-070944a845f6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1848af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:01.693839 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b1f81194-e662-4d9f-b612-070944a845f6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.063078 Sep 07 09:55:01.694671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1218/2384] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:01 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:01.699339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:01.700055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:01.707777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:01.708262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:01.708779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:01.709575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:01.710171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:01.710653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.012866 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5dc25124-8662-4c71-84e6-ad13e87607bc tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/234d1c1b-4411-47bb-841f-088740320c18" status: 202 len: 0 microversion: 2.1 time: 1.357819 Sep 07 09:55:02.017922 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1167/2385] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:55:00 2022] DELETE /compute/v2.1/os-floating-ips/234d1c1b-4411-47bb-841f-088740320c18 => generated 0 bytes in 1363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:55:02.022461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.023080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:02.029643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.030138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.030754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.030885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:02.031762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.032423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.033122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.040244 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c0e0c2a-7963-4b31-a90f-8853bfd36aca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.344409 Sep 07 09:55:02.048052 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1219/2386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:01 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:02.054085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.057532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:02.062189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.062691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.063154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.065280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.065837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.066327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.104648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:55:02.106700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:02.194647 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18e8d571-d9c7-47b8-8a41-1026a4acd0f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 204 len: 0 microversion: 2.1 time: 0.151988 Sep 07 09:55:02.195416 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1220/2387] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:55:02 2022] DELETE /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:02.202839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.203598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:02.210575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.211156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.211589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.212291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.212736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.213166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.242913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:02.251323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5902533-50d7-4cec-abbd-b89f2bb10c52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.232182 Sep 07 09:55:02.252382 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1168/2388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:02.257357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c161b3f7-d824-4d27-b389-6aa9b8ee42ef tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b19939d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.506917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:02.516155 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4919115a-3cda-48d9-aadd-5eeed82e32dc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.319375 Sep 07 09:55:02.517558 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1221/2389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:02.518948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c161b3f7-d824-4d27-b389-6aa9b8ee42ef tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.265008 Sep 07 09:55:02.519592 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1169/2390] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:55:02.522762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.523381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:02.530463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.530952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b99f2439-7f27-41f1-ab8d-608da1cde897 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b19d9280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.531096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.531640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.533533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.534087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.534596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.770689 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b99f2439-7f27-41f1-ab8d-608da1cde897 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.243965 Sep 07 09:55:02.771351 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1170/2391] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:02.774627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:02.777571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.778202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:02.783211 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cdfb1926-bddc-4a6c-ba75-8ce73c69f1f1 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1542 microversion: 2.1 time: 0.264630 Sep 07 09:55:02.783873 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1222/2392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:02.785008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.785703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.786142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.786838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:02.787289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:02.787718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:02.788823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8458503e-f86d-4754-aa3c-3df269b9f2de tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b24acaf0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:02.842406 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8458503e-f86d-4754-aa3c-3df269b9f2de tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.057462 Sep 07 09:55:02.842982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1223/2393] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:02.849427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6958bf2-4330-40c2-a0b2-5132b27cd320 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b1dd4d30>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:03.023922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:03.032352 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-222f9a90-ced2-414b-84f2-88a9f852534d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.258647 Sep 07 09:55:03.045202 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1171/2394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:02 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:03.066787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:03.067410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:03.073745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:03.074230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:03.074666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:03.075355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:03.075809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:03.076230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:03.339251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:03.346999 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d76237b-156b-4cdc-b9fc-14de884a4921 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.284720 Sep 07 09:55:03.347562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1172/2395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:03 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:55:03.352279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:03.352889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:03.359346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:03.359816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:03.360968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:03.361783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:03.362231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:03.362652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.015827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:04.024400 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3bff63ea-cc04-444b-9748-d4f25b817ece tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.675841 Sep 07 09:55:04.040225 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1173/2396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:03 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:04.045171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:04.045821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:04.053695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.054183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.054621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.055321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.055785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.056218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.383456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:04.386537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:04.396238 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84f165e9-3e46-45b7-9678-918af7a82edf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.354730 Sep 07 09:55:04.417370 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1174/2397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:04 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:04.417370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:04.417370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:04.420286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.420852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.421402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.422186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.422759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.423267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.539393 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d6958bf2-4330-40c2-a0b2-5132b27cd320 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/615305b7-c42b-4bca-b96c-64f90112c024" status: 202 len: 0 microversion: 2.1 time: 1.695343 Sep 07 09:55:04.540527 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1224/2398] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:55:02 2022] DELETE /compute/v2.1/os-floating-ips/615305b7-c42b-4bca-b96c-64f90112c024 => generated 0 bytes in 1697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:55:04.548868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d94880db-7351-4c7e-9858-ed281e576977 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1deef70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:04.603208 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d94880db-7351-4c7e-9858-ed281e576977 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.060276 Sep 07 09:55:04.604221 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1225/2399] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:04 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:04.609316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:04.609932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:04.617585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.618298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.618744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.619705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.620310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.620899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.716479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633cd5fd9f084704837e49c5667576ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b2af63da0a4b70b07255424c743450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:04.724640 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-999d5a82-4180-44df-b6a8-fd23ee405827 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 200 len: 1542 microversion: 2.1 time: 0.319624 Sep 07 09:55:04.737287 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1175/2400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:04 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 1542 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:04.737287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:04.737287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:04.738267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.738802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.739290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.740707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:04.741263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:04.742107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:04.893677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:04.902477 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1196d3d-8a25-4686-a0f3-866768ffbd79 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.297070 Sep 07 09:55:04.915951 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1226/2401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:04 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:04.915951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3ae7566-18bf-4bee-a748-4c38cb634199 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b1ec40d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:04.998939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:05.008532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-089c4624-d1ff-4462-97f5-1384993e02eb tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.281390 Sep 07 09:55:05.009768 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1176/2402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:04 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:05.014465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-42571770-4db2-4fcd-983e-38dfaa3a41de req-46551b4b-5b4e-4378-90fe-34fb2118aaef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b08c201-3210-4230-b246-f21ca1c22c1b", "name": "network-vif-deleted", "tag": "c9c7774f-158c-43a8-a86a-d5d016f73ded"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:05.025749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-42571770-4db2-4fcd-983e-38dfaa3a41de req-46551b4b-5b4e-4378-90fe-34fb2118aaef service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.026428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-42571770-4db2-4fcd-983e-38dfaa3a41de req-46551b4b-5b4e-4378-90fe-34fb2118aaef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.026877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-42571770-4db2-4fcd-983e-38dfaa3a41de req-46551b4b-5b4e-4378-90fe-34fb2118aaef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.039978 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-42571770-4db2-4fcd-983e-38dfaa3a41de req-46551b4b-5b4e-4378-90fe-34fb2118aaef service nova] Creating event network-vif-deleted:c9c7774f-158c-43a8-a86a-d5d016f73ded for instance 3b08c201-3210-4230-b246-f21ca1c22c1b on n-h2-836830-16 Sep 07 09:55:05.045629 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-42571770-4db2-4fcd-983e-38dfaa3a41de req-46551b4b-5b4e-4378-90fe-34fb2118aaef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Sep 07 09:55:05.046229 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1177/2403] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:05.053458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:05.056354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:05.062528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.062953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.064132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.064851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.065349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.065782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.427987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:05.436557 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05b93df6-0ab3-44f9-8afc-4b9d3b9c4903 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.389128 Sep 07 09:55:05.437473 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1178/2404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:05 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:05.442255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:05.443172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:05.449761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.450242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.450820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.451686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.452137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.452741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.694557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:05.704432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eae64ff2-34d6-4c58-ac29-0328baf189d2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.265708 Sep 07 09:55:05.709238 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1179/2405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:05 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:05.709946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d62fb7fb-9b66-4d8f-9c17-8c7d4e6ba488 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1b63940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:05.803127 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d62fb7fb-9b66-4d8f-9c17-8c7d4e6ba488 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.096941 Sep 07 09:55:05.803998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1180/2406] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:05 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:05.810219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:05.817389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] [instance: 3b08c201-3210-4230-b246-f21ca1c22c1b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:05.831966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.832758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.833418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.834312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.834930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.835539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.852970 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] HTTP exception thrown: Instance 3b08c201-3210-4230-b246-f21ca1c22c1b could not be found. Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Request method failure captured: Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b HTTP/1.1 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGo1XZC9cjYGK8lpfMOfWNl-k3yJ11xYsUXVTeqXBH_TfR7RcoETlCBR7wWVRqUrgwUlBNbb7-CV8Ff-UsLQ8XcRpWfmUvqxPnSU78nqZnBM36wNKZAUtblPwHvcJwersvDBtEui6fMgVzr2z9MOEOfxpd-EHm5H6EZ7XGf8rN9hhI4 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62b2af63da0a4b70b07255424c743450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62b2af63da0a4b70b07255424c743450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62b2af63da0a4b70b07255424c743450", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 62b2af63da0a4b70b07255424c743450 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 633cd5fd9f084704837e49c5667576ab Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3b08c201-3210-4230-b246-f21ca1c22c1b could not be found. Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3b08c201-3210-4230-b246-f21ca1c22c1b'} Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b08c201-3210-4230-b246-f21ca1c22c1b could not be found. Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b08c201-3210-4230-b246-f21ca1c22c1b could not be found. Sep 07 09:55:05.855261 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b08c201-3210-4230-b246-f21ca1c22c1b could not be found. Sep 07 09:55:05.858920 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:05.862948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] Returning 404 to user: Instance 3b08c201-3210-4230-b246-f21ca1c22c1b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:05.864362 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a14534b3-ea8c-4ef9-bf5c-7dc0b93f6c03 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621 tempest-FloatingIPsAssociationNegativeTestJSON-1692695621-project] 10.222.0.60 "GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b" status: 404 len: 111 microversion: 2.1 time: 0.059043 Sep 07 09:55:05.865532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1181/2407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:05 2022] GET /compute/v2.1/servers/3b08c201-3210-4230-b246-f21ca1c22c1b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:55:05.927045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:05.928084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:05.936315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.936785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.937502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.939269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:05.940003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:05.940666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:05.987788 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3ae7566-18bf-4bee-a748-4c38cb634199 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/fd50a0c5-6885-4a30-aa72-7c945de2b3b8" status: 202 len: 0 microversion: 2.1 time: 1.083343 Sep 07 09:55:05.988377 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1227/2408] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:55:04 2022] DELETE /compute/v2.1/os-floating-ips/fd50a0c5-6885-4a30-aa72-7c945de2b3b8 => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:55:05.996669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c45df6d-a4d8-4ed7-b2d7-af5d8a8bbc16 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] Calling method '.version_select at 0x7f14b1d34b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:06.226428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:06.238108 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-649c4983-5117-4cc7-9f3f-ee118f4e7bd5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.315060 Sep 07 09:55:06.242019 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1182/2409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:05 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:55:06.249925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:06.253854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:06.267020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.267843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.273470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:06.274516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.275193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.275709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:06.612531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:06.621308 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd7cb630-1847-41bb-ac58-06382012ce52 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.377869 Sep 07 09:55:06.629152 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1183/2410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:06 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:06.645496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a5058001-4c9e-4077-834b-995a206cc1aa req-26e072ae-4491-4c3f-a34d-815a7fd54cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "name": "network-vif-plugged", "status": "completed", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:06.657649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a5058001-4c9e-4077-834b-995a206cc1aa req-26e072ae-4491-4c3f-a34d-815a7fd54cd5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.667360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a5058001-4c9e-4077-834b-995a206cc1aa req-26e072ae-4491-4c3f-a34d-815a7fd54cd5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.668218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a5058001-4c9e-4077-834b-995a206cc1aa req-26e072ae-4491-4c3f-a34d-815a7fd54cd5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:06.683421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a5058001-4c9e-4077-834b-995a206cc1aa req-26e072ae-4491-4c3f-a34d-815a7fd54cd5 service nova] Creating event network-vif-plugged:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:55:06.690377 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a5058001-4c9e-4077-834b-995a206cc1aa req-26e072ae-4491-4c3f-a34d-815a7fd54cd5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059268 Sep 07 09:55:06.691532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1184/2411] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:06.698736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:06.699650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:06.706788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.707570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.708222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:06.709122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.709831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.710449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:06.918023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:06.925223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-535ccbc9-f383-4541-bcd8-395dfac6ae92 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.232158 Sep 07 09:55:06.942216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1185/2412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:06 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:06.950894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:06.951563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:06.961105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.961760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.962473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:06.963252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:06.963776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:06.964270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:07.262981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:07.280444 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-61086111-acad-410c-a598-4b13e38d8e87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.333450 Sep 07 09:55:07.281031 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1186/2413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:06 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:07.298910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2208cc32-02c5-4ed9-803e-bd6d6c1370de tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1b63940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:07.381167 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2208cc32-02c5-4ed9-803e-bd6d6c1370de tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.091782 Sep 07 09:55:07.381745 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1187/2414] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:07 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:07.414037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:07.414894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:07.432633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:07.433428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:07.434029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:07.435929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:07.439294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:07.440266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:07.508770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c45df6d-a4d8-4ed7-b2d7-af5d8a8bbc16 tempest-FloatingIPDetailsTestJSON-412252042 tempest-FloatingIPDetailsTestJSON-412252042-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/7613e6e9-0133-4873-8cb6-860e8dbc5c0d" status: 202 len: 0 microversion: 2.1 time: 1.515892 Sep 07 09:55:07.511809 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1228/2415] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:55:05 2022] DELETE /compute/v2.1/os-floating-ips/7613e6e9-0133-4873-8cb6-860e8dbc5c0d => generated 0 bytes in 1520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:55:07.658536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:07.659169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:07.668726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:07.673555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:07.674423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:07.675346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:07.677783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:07.678436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:07.780683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:07.789857 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81eb8a7c-70e2-4463-bc6a-f4cba14e6b34 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.406984 Sep 07 09:55:07.805759 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1188/2416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:07 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:07.955739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:07.956378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:07.976131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:07.976644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:07.977084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:07.977829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:07.982909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:07.983370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:08.017139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:08.030481 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2227abe0-4140-4f1f-b7f8-06be5fa14511 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.376697 Sep 07 09:55:08.031539 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1229/2417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:07 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:08.267322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:08.277914 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58414302-ae26-42e6-bef5-9c2d38484820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.327771 Sep 07 09:55:08.281163 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1189/2418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:07 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:08.310271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:08.311792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:08.326674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:08.328653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:08.329996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:08.330952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:08.331563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:08.332767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:08.398316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5962d38-83d5-470d-bd65-acf5b91016fa tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b22c61f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:08.489874 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5962d38-83d5-470d-bd65-acf5b91016fa tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.095807 Sep 07 09:55:08.490977 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1190/2419] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:08 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:08.817974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:08.818635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:08.829970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:08.838757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:08.839234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:08.840014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:08.840497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:08.840932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:09.067987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:09.084436 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c67f688a-1180-439a-9c77-509681d56b41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.776494 Sep 07 09:55:09.085465 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1230/2420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:08 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:09.092019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:09.092645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:09.111467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:09.112233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:09.112841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:09.115915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:09.116564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:09.117213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:09.184995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:09.194718 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d424021-168a-4ebc-bd9b-8cefc83ee0a3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.382657 Sep 07 09:55:09.209574 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1191/2421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:08 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:09.309496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:09.310889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:09.325789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:09.326772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:09.327615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:09.328532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:09.329827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:09.334769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:09.399306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:09.409398 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa72122d-c893-49ba-9376-70ed53a5300c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.322725 Sep 07 09:55:09.422508 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1231/2422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:09 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:09.510358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-357c61db-8976-4e3c-ac10-bd2ab0a1d5b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1b7f430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:09.574330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:09.576618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-357c61db-8976-4e3c-ac10-bd2ab0a1d5b0 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.074629 Sep 07 09:55:09.577699 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1232/2423] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:09 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:09.583721 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dcf2df8c-09d0-4df1-8843-23d129e370b9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1508 microversion: 2.1 time: 0.279515 Sep 07 09:55:09.592767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1192/2424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:09 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:10.115261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:10.116044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:10.136906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.139202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.139903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.140784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.141716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.142875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.226897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:10.228078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:10.246964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.252011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.253971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.257249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.259324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.261728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.687649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:10.698814 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5d23f87-06a2-4fd7-aa3e-229af12011fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.475812 Sep 07 09:55:10.718815 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1193/2425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:10 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:10.728033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:10.734683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:10.736998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:10.756763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.759934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.765809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.767604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.768323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.768981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.772075 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58cf94f8-46c0-45a4-a538-ba323ea55dcd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.663083 Sep 07 09:55:10.772524 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1233/2426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:10 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:10.788180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-225ad7a2-44f3-464f-a809-b09ac54787cd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b2798dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:10.919803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-225ad7a2-44f3-464f-a809-b09ac54787cd tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.145915 Sep 07 09:55:10.921432 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1234/2427] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:10 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:10.947434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:10.948246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:10.955057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.955834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.956472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:10.957246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:10.957697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:10.958389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:11.456219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:11.459854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:11.467411 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d45ff2ff-9a83-4c8d-aee4-3cfea09b69f7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.747040 Sep 07 09:55:11.467940 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b778f512-4907-4f88-9cda-86481f7020ba tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1529 microversion: 2.1 time: 0.545289 Sep 07 09:55:11.486277 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1194/2428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:10 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:11.486658 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1235/2429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:10 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1529 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:11.724361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:11.725401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:11.736563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:11.741510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:11.742305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:11.743646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:11.745429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:11.748084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:11.800323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:11.801577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:11.813977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:11.817845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:11.818796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:11.822021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:11.823103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:11.823720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:12.310036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:12.339136 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40f19343-2901-4be0-a346-642ef788e120 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.543558 Sep 07 09:55:12.343884 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1195/2430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:11 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:55:12.350370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b96613e-3f5b-4333-b379-4661d52699fc tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b19bd040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:12.416317 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b96613e-3f5b-4333-b379-4661d52699fc tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1455 microversion: 2.1 time: 0.070278 Sep 07 09:55:12.417137 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1196/2431] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:12 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:12.444142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:12.461876 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d918a0d-cfac-4871-8004-806bed49f7fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.735960 Sep 07 09:55:12.465121 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1236/2432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:11 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:12.518133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:12.519091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:12.530010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:12.534601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:12.561355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:12.561868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:12.563318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:12.563870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:12.566143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:12.566468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:12.567892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:12.570622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:12.571130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:12.571580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:12.571905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:12.572591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:12.626386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:13.063914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:13.079516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99da2e18-cc03-4d22-9eab-f10e20126fe7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.580548 Sep 07 09:55:13.080518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1237/2433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:12 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:13.145788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:13.167962 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39539020-3695-42ee-9011-3e056cdf0096 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.671079 Sep 07 09:55:13.168851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1197/2434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:12 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:13.370521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:13.371151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:13.386999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:13.394596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:13.406152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:13.420550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:13.422385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:13.423634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:13.434598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca6723ee-ebf2-4d42-8a77-1b281e4f71c4 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1d41040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:13.768246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:13.780254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ee02e9e-9375-4540-92af-5f0b0a0278a8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.415540 Sep 07 09:55:13.780852 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1238/2435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:13 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:13.798424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:13.799189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:13.815750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:13.816257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:13.816703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:13.817700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:13.818325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:13.818939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:14.739612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:14.753594 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0faeaa3-4d8e-44ff-8cd3-3cc0ee2342b5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.971427 Sep 07 09:55:14.754711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1239/2436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:13 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:14.771717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:14.776825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:14.785507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:14.786249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:14.786976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:14.787853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:14.788468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:14.789115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.093385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:15.109587 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4e93358e-e5fb-4a95-872a-f751bcc7a19d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.352465 Sep 07 09:55:15.110053 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1240/2437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:14 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:15.115563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:15.117618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:15.145815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.159250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.161325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.163584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.164086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.164503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.440494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:15.449287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bbb037cb-568d-4e98-8fe7-145f99a4920b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.337537 Sep 07 09:55:15.449870 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1241/2438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:15 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:15.455678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f5f2f8c8-d3d4-4a61-ac2e-38c34134d9a5 req-dae0bd45-5e0b-460a-9229-1e8afabd3e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e196505e-2b63-4862-b532-6449982ac183", "name": "network-vif-plugged", "status": "completed", "tag": "6bbac783-aa25-468e-aa1d-cb59eb7d42cd"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:15.467088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f5f2f8c8-d3d4-4a61-ac2e-38c34134d9a5 req-dae0bd45-5e0b-460a-9229-1e8afabd3e6c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.471146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f5f2f8c8-d3d4-4a61-ac2e-38c34134d9a5 req-dae0bd45-5e0b-460a-9229-1e8afabd3e6c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.471832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f5f2f8c8-d3d4-4a61-ac2e-38c34134d9a5 req-dae0bd45-5e0b-460a-9229-1e8afabd3e6c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.500913 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f5f2f8c8-d3d4-4a61-ac2e-38c34134d9a5 req-dae0bd45-5e0b-460a-9229-1e8afabd3e6c service nova] Creating event network-vif-plugged:6bbac783-aa25-468e-aa1d-cb59eb7d42cd for instance e196505e-2b63-4862-b532-6449982ac183 on n-h1-836830-16 Sep 07 09:55:15.515592 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f5f2f8c8-d3d4-4a61-ac2e-38c34134d9a5 req-dae0bd45-5e0b-460a-9229-1e8afabd3e6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064126 Sep 07 09:55:15.520940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1242/2439] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:15.530891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:15.537882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:15.557888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.558644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.560315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.561274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.567685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.568953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.615197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:15.924023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:15.938204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0a0f09ea-7e03-41f3-9563-cf457edaca87 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.415065 Sep 07 09:55:15.939180 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1243/2440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:15 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:15.959892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:15.960557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:15.977138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.977683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.978130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:15.979003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:15.979476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:15.979931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:16.321513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:16.335222 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbb9fdd7-68c2-43c2-8b2f-453c93fff85d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.395020 Sep 07 09:55:16.336112 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1244/2441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:15 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:16.346799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:16.350066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:16.361703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:16.362502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:16.363108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:16.364080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:16.364694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:16.365670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:16.815275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:16.824092 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ba42b0a-8dbd-4dc2-8207-6b518d0fe0e5 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.486817 Sep 07 09:55:16.853401 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1245/2442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:16 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:16.877003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:16.877828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:16.909629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:16.910509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:16.917943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:16.919087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:16.919778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:16.920659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:17.345756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:17.368403 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f9187b2-2fde-4f4a-b2e0-b21e988af6ca tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.510237 Sep 07 09:55:17.369283 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1246/2443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:16 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:17.379087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:17.379930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:17.414080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:17.414855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:17.415307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:17.424226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:17.424657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:17.425107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:18.182764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:18.205415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62dfc290-b937-48af-8371-5fd6be03b49a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.834800 Sep 07 09:55:18.226760 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1247/2444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:17 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:18.256835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:18.260341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:18.287464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:18.294926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:18.297844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:18.300689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:18.301517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:18.303667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:19.129259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:19.146937 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1154650-ecb6-4c81-b630-bf0339532b7e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1477 microversion: 2.1 time: 0.918734 Sep 07 09:55:19.147775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1248/2445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:18 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1477 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:19.152388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:19.162205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:19.170796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:19.171458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:19.172053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:19.173721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:19.176772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:19.177416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:19.838991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:19.855693 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-557159dc-271b-4df9-99c6-07d0cac02363 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1504 microversion: 2.1 time: 0.706712 Sep 07 09:55:19.856281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1249/2446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:19 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1504 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:19.912628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:19.924417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:19.960861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:19.964865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:19.968009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:19.969098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:19.988471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:19.990146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:21.223224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:21.240204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-055fe277-8362-4f2a-ba55-08abf3217b46 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 1.377637 Sep 07 09:55:21.259252 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1250/2447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:19 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:21.279891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:21.280899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:21.288619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:21.289528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:21.290233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:21.291202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:21.291926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:21.292583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:21.545003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:21.565513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b10ffbf-7b28-4f9e-a027-fd5dee1a02a6 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.304629 Sep 07 09:55:21.567701 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1251/2448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:21 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:21.897933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-181081809", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:22.558617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=79 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:22.930294 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca6723ee-ebf2-4d42-8a77-1b281e4f71c4 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1464 microversion: 2.1 time: 9.501458 Sep 07 09:55:22.932360 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1198/2449] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:13 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1464 bytes in 9505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:22.941057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:22.942024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:22.952955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:55:22.979624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:22.981039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:22.981698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:22.983517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:22.984169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:22.984896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.126334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:24.126334 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30d5c2e7-6dfa-42ed-8cb8-e1b16e8fbe1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1476 microversion: 2.1 time: 1.185814 Sep 07 09:55:24.126334 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1199/2450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:22 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1476 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:24.126334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:24.127086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:24.147329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.147329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.147329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.147329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.147329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.147329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.281757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:55:24.282307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:55:24.282799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:55:24.283217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:55:24.283647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:55:24.295510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.296000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.296446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.297761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.298434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.298874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.318444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Getting quotas for project d26be1ae8f8d45e28ae37c07670deb86. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:55:24.324505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Getting quotas for user 52661062c37f426984b4a0ad2ba02d3f and project d26be1ae8f8d45e28ae37c07670deb86. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:55:24.338045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:55:24.340317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:55:24.400525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7f72754-1eae-473f-b111-26346fc54d71 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.829556 Sep 07 09:55:24.401587 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1252/2451] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:55:24.407948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbfe500-4014-4f0d-b630-2aeafd3f5324", "name": "network-vif-unplugged", "status": "completed", "tag": "f68f8e09-24ba-4b81-9bfe-4485238abe37"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:24.420920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.421801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.423198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.437002 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] Creating event network-vif-unplugged:f68f8e09-24ba-4b81-9bfe-4485238abe37 for instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 on n-h2-836830-16 Sep 07 09:55:24.447163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:55:24.461171 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-124ba49b-0696-4b94-bfb0-2053414e32ce req-d028e047-2544-4fd7-aa96-96b9a7bc7f40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057664 Sep 07 09:55:24.462389 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1253/2452] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:24.468043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:24.470540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:24.480415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.481306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.481917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.482877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.483570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.484204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.528708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:24.539307 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0faad2a-dd04-46ce-b904-1ba6917b7435 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1484 microversion: 2.1 time: 0.417454 Sep 07 09:55:24.540550 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1200/2453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:24 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1484 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:24.545420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:24.546273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:24.553052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.553895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.554511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.555401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:24.556070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:24.556654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:24.982159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:24.995270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:24.998468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99f3ada5-4cc2-45c0-9738-96f2a7b03649 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.456646 Sep 07 09:55:25.013622 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1201/2454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:24 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:25.017294 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e77d7857-c253-4fcf-9719-87ef8c7d1cec tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.552326 Sep 07 09:55:25.027382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79dfc21c-4831-49d2-9625-5ad5485c1cbc tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b19bd700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:25.035842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1254/2455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:24 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:25.044267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e4e47e1-f4a0-48a8-a213-96ad6b931e1f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:25.045311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e4e47e1-f4a0-48a8-a213-96ad6b931e1f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:25.133160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79dfc21c-4831-49d2-9625-5ad5485c1cbc tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 200 len: 1464 microversion: 2.1 time: 0.118138 Sep 07 09:55:25.134656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1202/2456] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:25 2022] GET /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 1464 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:25.147126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e4e47e1-f4a0-48a8-a213-96ad6b931e1f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:25.155751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e4e47e1-f4a0-48a8-a213-96ad6b931e1f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1216 microversion: 2.1 time: 0.117040 Sep 07 09:55:25.156062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1982718357", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:25.170481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1255/2457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:25 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:25.185263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:25.186357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:25.197956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:25.198847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:25.200365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:25.201478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:25.202189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:25.202910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:25.324891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] validate_networks() for [('293d2dbc-1fd0-45f3-9d72-4dcea2a99e1b', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:55:25.638350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:25.651693 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7f48a85-8aab-41ae-93a4-5890b6a6d054 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1476 microversion: 2.1 time: 0.479650 Sep 07 09:55:25.673919 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1256/2458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:25 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1476 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:25.684020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:25.685061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:25.688257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:25.693956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:25.694679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:25.695682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:25.696557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:25.697208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:25.697831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.214395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:26.231446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b4cf0767-f3e1-4eda-b7aa-3fcb9f65f2c6 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1468 microversion: 2.1 time: 0.554959 Sep 07 09:55:26.235231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1257/2459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:25 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1468 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:26.254507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:26.256144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:26.287576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:26.291153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:26.293959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.296137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:26.298854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:26.300134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.720253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:26.735254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91fe3d16-9c33-45c8-8fae-d8bd08049679 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.498076 Sep 07 09:55:26.738720 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1258/2460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:26 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:26.749976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:26.753051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:26.770164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:55:26.770653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:55:26.771382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:55:26.771606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:26.771986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:55:26.772410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:55:26.772701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:26.774290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.783275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:26.784716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:26.785434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.800147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:26.800896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:26.803714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.804756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:26.805446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:26.808659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:26.867373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Getting quotas for project 828328e7cafb488087392d52b51e5c02. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:55:26.895227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Getting quotas for user fc0088e18ea446cf8674649ad040c87e and project 828328e7cafb488087392d52b51e5c02. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:55:26.952031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:55:26.956309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:55:27.103389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c3b3b39b-921d-42da-a97e-4cb221fcf21e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.965508 Sep 07 09:55:27.111199 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1203/2461] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:55:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:55:27.142888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:27.150238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:27.171779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:27.173310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:27.179844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:27.180851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:27.181661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:27.183970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:27.186379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:27.207457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-56c2c14e-9e1e-4137-a9e4-0f917c878d9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.462621 Sep 07 09:55:27.223150 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1259/2462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:26 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:27.246340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f96a060-36b4-4dc5-b5f1-9c15fbaf2975 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b24acf70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:27.388062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:27.402898 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eba739d0-5f12-4d3c-834d-3311229f14f6 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1274 microversion: 2.1 time: 0.280482 Sep 07 09:55:27.413593 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1204/2463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:27 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1274 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:27.428861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbfe500-4014-4f0d-b630-2aeafd3f5324", "tag": "f68f8e09-24ba-4b81-9bfe-4485238abe37"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:27.457261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:27.460310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:27.462260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:27.500139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] Creating event network-changed:f68f8e09-24ba-4b81-9bfe-4485238abe37 for instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 on n-h2-836830-16 Sep 07 09:55:27.526290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:55:27.550090 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f96a060-36b4-4dc5-b5f1-9c15fbaf2975 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?changes-since=2022-09-07T09%3A53%3A16Z" status: 200 len: 1904 microversion: 2.1 time: 0.324472 Sep 07 09:55:27.565218 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1260/2464] 10.222.0.60 () {58 vars in 1199 bytes} [Wed Sep 7 09:55:27 2022] GET /compute/v2.1/images?changes-since=2022-09-07T09%3A53%3A16Z => generated 1904 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:27.572389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:27.573364 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-955ac047-5a12-4876-ba20-ca74a3a07eb9 req-26ec72b8-e19f-4bc3-a282-6415d0490dd6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157225 Sep 07 09:55:27.573499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:27.573986 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1205/2465] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:27.602725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-32ce53e9-178a-450a-8f0d-a16859cd3320 req-5c3b6d99-ee66-4816-b7a8-5dfb3b82b7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "name": "network-vif-unplugged", "status": "completed", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:27.611646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:27.616657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:27.617524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:27.618607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:27.619914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:27.620723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:27.647879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-32ce53e9-178a-450a-8f0d-a16859cd3320 req-5c3b6d99-ee66-4816-b7a8-5dfb3b82b7f8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:27.648371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-32ce53e9-178a-450a-8f0d-a16859cd3320 req-5c3b6d99-ee66-4816-b7a8-5dfb3b82b7f8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:27.648815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-32ce53e9-178a-450a-8f0d-a16859cd3320 req-5c3b6d99-ee66-4816-b7a8-5dfb3b82b7f8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:27.677124 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-32ce53e9-178a-450a-8f0d-a16859cd3320 req-5c3b6d99-ee66-4816-b7a8-5dfb3b82b7f8 service nova] Creating event network-vif-unplugged:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:55:27.688528 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-32ce53e9-178a-450a-8f0d-a16859cd3320 req-5c3b6d99-ee66-4816-b7a8-5dfb3b82b7f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113151 Sep 07 09:55:27.691348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1206/2466] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:27.704263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dfaea6f5-0d29-4649-9496-5e73b19a9edf tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:27.714989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dfaea6f5-0d29-4649-9496-5e73b19a9edf tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:27.862219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dfaea6f5-0d29-4649-9496-5e73b19a9edf tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:27.876814 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dfaea6f5-0d29-4649-9496-5e73b19a9edf tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1214 microversion: 2.1 time: 0.177088 Sep 07 09:55:27.877725 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1207/2467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:27 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:27.888690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9adbcb27-43a7-4483-bf20-a4729ffcf579 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b19933a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:28.045360 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9adbcb27-43a7-4483-bf20-a4729ffcf579 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-914663722" status: 200 len: 484 microversion: 2.1 time: 0.157609 Sep 07 09:55:28.056216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1208/2468] 10.222.0.60 () {58 vars in 1229 bytes} [Wed Sep 7 09:55:27 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-914663722 => generated 484 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:28.066730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:28.067361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:28.075318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.076078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.076697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.077591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.078773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.086193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.130754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:28.159028 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f57dafd-6bb0-44c4-bb2f-b961847a7db9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1471 microversion: 2.1 time: 0.592012 Sep 07 09:55:28.160082 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1261/2469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:27 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1471 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:28.177537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc35c5f4-d406-4b45-b461-408bc8bdfedb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b2381af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:28.434588 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc35c5f4-d406-4b45-b461-408bc8bdfedb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?server=07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 958 microversion: 2.1 time: 0.272189 Sep 07 09:55:28.436447 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1262/2470] 10.222.0.60 () {58 vars in 1209 bytes} [Wed Sep 7 09:55:28 2022] GET /compute/v2.1/images?server=07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 958 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:28.448599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:28.452653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:28.474850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.475463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.476016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.476857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.477450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.478116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.586859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:28.651242 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f9c69f1-e53c-47d4-9dd6-37e5a55faede tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324/action" status: 204 len: 0 microversion: 2.1 time: 0.212353 Sep 07 09:55:28.652649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1263/2471] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:28 2022] POST /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324/action => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:28.663940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:28.669069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:28.676909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.681433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.682110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.683040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.686795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.688070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.732942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:28.755735 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7238b7e7-b6d9-4aa5-9901-3443609f5d41 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.698304 Sep 07 09:55:28.772870 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1209/2472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:28 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:28.774758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:28.775621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:28.806262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.807081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.807684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:28.810489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:28.812722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:28.816199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:29.260976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:29.270880 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f161e80-aa8e-4575-b074-387012287b25 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1274 microversion: 2.1 time: 0.509660 Sep 07 09:55:29.276324 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1210/2473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:28 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1274 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:29.296804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23ce724e-c213-41ae-84d6-d40423909007 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b12a6670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:29.350104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:29.381481 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2651ab4a-cc7d-428a-9da5-c048f86ed1d0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.726993 Sep 07 09:55:29.382975 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1264/2474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:28 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:29.392077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23ce724e-c213-41ae-84d6-d40423909007 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 485 microversion: 2.1 time: 0.114404 Sep 07 09:55:29.397134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:29.402050 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1211/2475] 10.222.0.60 () {58 vars in 1317 bytes} [Wed Sep 7 09:55:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 485 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:29.404360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:29.425024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:29.428846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:29.435837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:29.438682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:29.444091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:29.445441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:29.448416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:29.449136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:29.469044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:29.469586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:29.470125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:29.470861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:29.471331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:29.471768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:29.859873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:29.875604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8b14fdd8-5397-46e8-be32-50694ed73a5d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1210 microversion: 2.1 time: 0.471473 Sep 07 09:55:29.876205 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1212/2476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:29 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1210 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:29.908222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2566d18c-5dd4-40fa-b543-a0eeaac90988 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1bd64c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.035335 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2566d18c-5dd4-40fa-b543-a0eeaac90988 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 485 microversion: 2.1 time: 0.138800 Sep 07 09:55:30.037998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1213/2477] 10.222.0.60 () {58 vars in 1303 bytes} [Wed Sep 7 09:55:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 485 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:30.053410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.054274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:30.064528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.072809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.074003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.075493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.075493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.075908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.151214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:30.161820 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-872c9c14-cc7e-4b3f-ba65-9e76ebdf1af3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1471 microversion: 2.1 time: 0.768373 Sep 07 09:55:30.169743 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1265/2478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:29 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1471 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:30.183138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82b6b764-1d45-469b-a2e3-2ce1bcccecde tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b18cdaf0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.394255 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82b6b764-1d45-469b-a2e3-2ce1bcccecde tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.220190 Sep 07 09:55:30.395694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1266/2479] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:30.400553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.401468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:30.409099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.409956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.410626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.411569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.412241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.412899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.414209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:30.429907 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc43a560-0259-4cfe-89ec-98d54a23c9cd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1734 microversion: 2.1 time: 0.390383 Sep 07 09:55:30.434187 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1214/2480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1734 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:30.444056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.444718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:30.463399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.463912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.466435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.467664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.468295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.469665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.531439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:30.542378 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f605be4-be97-46a4-b67b-55416d4eab85 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1274 microversion: 2.1 time: 0.145246 Sep 07 09:55:30.562242 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1267/2481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:30.576126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a8c5526a-40c8-4939-8d91-6dc11167e026 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1d15040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.726445 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a8c5526a-40c8-4939-8d91-6dc11167e026 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.161662 Sep 07 09:55:30.730977 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1268/2482] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:30.744903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1de5f6fb-5ab4-4a0a-ae8c-d7542a5a3d24 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1e3d820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.904475 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1de5f6fb-5ab4-4a0a-ae8c-d7542a5a3d24 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.163306 Sep 07 09:55:30.907645 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1269/2483] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:30.937543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:30.956589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:30.985353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.986376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.986376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:30.987206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:30.987728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:30.988247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:31.503587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:31.510149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:31.511664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-821c6d0e-045e-4c09-84a2-ec1d5499106d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 1.076385 Sep 07 09:55:31.520635 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20b5a1bb-1e3b-4d93-89c0-2dd974de8997 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1274 microversion: 2.1 time: 0.608367 Sep 07 09:55:31.526309 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1270/2484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1274 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:31.537622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7af5736-422a-4b1b-a6e2-e350946f2e9c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1d153a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:31.547266 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1215/2485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:30 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:31.553214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:31.555661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:31.577160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:31.586707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:31.589138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:31.595082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:31.595829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:31.596700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:31.749146 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7af5736-422a-4b1b-a6e2-e350946f2e9c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?changes-since=2022-09-07T09%3A53%3A06Z" status: 200 len: 6333 microversion: 2.1 time: 0.221408 Sep 07 09:55:31.751691 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1271/2486] 10.222.0.60 () {58 vars in 1220 bytes} [Wed Sep 7 09:55:31 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-07T09%3A53%3A06Z => generated 6333 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:31.891950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4e754ee9-b46a-4ee8-9429-838047d0780c tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Calling method '.version_select at 0x7f14b1aefc10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:32.040168 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4e754ee9-b46a-4ee8-9429-838047d0780c tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.270750 Sep 07 09:55:32.061757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1272/2487] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 09:55:31 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:55:32.071555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:32.072223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:32.100184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.100683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.101125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.101857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.103237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.103237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.256039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:32.275642 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9931f159-b91c-4a94-aa33-0c3437e8eacb tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1471 microversion: 2.1 time: 0.726095 Sep 07 09:55:32.276466 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1216/2488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:31 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1471 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:32.286458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:32.287492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:32.296524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.298117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.299314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.300372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.301064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.301784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.416774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:32.427903 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07a65485-6a97-45dc-899a-8eea60ed7809 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1714 microversion: 2.1 time: 0.363356 Sep 07 09:55:32.441233 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1273/2489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:32 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1714 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:32.453936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d885617-c505-4b98-8fb3-e327f9f68e44 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b18748b0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:32.539188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d885617-c505-4b98-8fb3-e327f9f68e44 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-914663722" status: 200 len: 664 microversion: 2.1 time: 0.105631 Sep 07 09:55:32.552856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1274/2490] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Sep 7 09:55:32 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-914663722 => generated 664 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:32.560228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbfe500-4014-4f0d-b630-2aeafd3f5324", "name": "network-vif-plugged", "status": "completed", "tag": "f68f8e09-24ba-4b81-9bfe-4485238abe37"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:32.587037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.587515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.587949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.612208 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] Creating event network-vif-plugged:f68f8e09-24ba-4b81-9bfe-4485238abe37 for instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 on n-h2-836830-16 Sep 07 09:55:32.622189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:55:32.659079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-35269f48-797e-4fcb-8088-2154aced5a91 req-5550a2d2-623d-4ff1-ade7-bda59ea76979 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104746 Sep 07 09:55:32.659712 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1275/2491] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:32.664910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7968e18b-0c99-4444-af2a-89a5917e03fa tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Action: 'create', calling method: .version_select at 0x7f14b1aef820>, body: {"pool": "non_exist_pool"} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:32.676456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:32.684667 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a92a535e-0adf-4902-b113-211b52f5c180 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1316 microversion: 2.1 time: 0.406845 Sep 07 09:55:32.685936 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1217/2492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:32 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:32.694674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:32.701788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:32.703790 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7968e18b-0c99-4444-af2a-89a5917e03fa tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] HTTP exception thrown: Floating IP pool not found. Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7968e18b-0c99-4444-af2a-89a5917e03fa tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Request method failure captured: Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 26 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGqTBaEDZRjJOnVhwvu1QMbvv8F6JWh9sa6Q2imtwf9fbkkgujmvqCiSUEZ06qy7TfvosyQi7YD3CLgTOqFUuJ6shwieR_HNGDJVuVGvzuSKeTTSUr5e3QvZ19o620H9ehh0uxFSwsiWBrAa1PSjKsHrPfg4WUbUiviRBVUkn5ULsrc Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0e1452be77634ce9b19b7a3f446d94d9 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-692496154 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e1452be77634ce9b19b7a3f446d94d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e1452be77634ce9b19b7a3f446d94d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e1452be77634ce9b19b7a3f446d94d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e1452be77634ce9b19b7a3f446d94d9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-692496154 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0e1452be77634ce9b19b7a3f446d94d9 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-692496154 Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-FloatingIPsNegativeTestJSON-692496154-project Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 77c949a2549b45c5bf5fd16c51219c6f Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-692496154-project Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: {"pool": "non_exist_pool"} Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: exception: Floating IP pool not found. Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:32.705926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:32.710709 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 07 09:55:32.710709 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:32.711804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7968e18b-0c99-4444-af2a-89a5917e03fa tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Returning 404 to user: Floating IP pool not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:32.712820 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7968e18b-0c99-4444-af2a-89a5917e03fa tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.052038 Sep 07 09:55:32.720869 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1276/2493] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:55:32 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:55:32.726148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:32.726903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:32.732081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.733403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.736256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.740376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.741889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.743133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.744664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.745171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.745643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.746354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:32.746815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:32.747243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:32.888286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:32.898854 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6920281c-bc35-45d0-b917-e14215348074 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1272 microversion: 2.1 time: 0.176493 Sep 07 09:55:32.909332 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1277/2494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:32 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:32.914394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-073b162c-2750-4b6b-ad58-eb4ebe59e6be tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1abeaf0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.025083 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-073b162c-2750-4b6b-ad58-eb4ebe59e6be tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1467 microversion: 2.1 time: 0.113182 Sep 07 09:55:33.035834 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1278/2495] 10.222.0.60 () {58 vars in 1338 bytes} [Wed Sep 7 09:55:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1467 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:33.040803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.041333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:33.048169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.049035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.049725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.050456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.050926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.051893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.094439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:33.117940 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1a3eb7c-5777-4426-8bed-f06cafb08e42 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1524 microversion: 2.1 time: 0.429634 Sep 07 09:55:33.142690 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1218/2496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:32 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1524 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:33.153618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-972799e7-ac94-4a64-8292-57e0fffdbdc4 tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Calling method '.version_select at 0x7f14b12a6c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.191808 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Cannot 'detach_volume' instance 35a9cd8e-0a42-4622-9b8d-885638580dbf while it is in vm_state rescued Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments/46f1572c-0137-484a-b78d-69550c5b388a HTTP/1.1 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot 'detach_volume' instance 35a9cd8e-0a42-4622-9b8d-885638580dbf while it is in vm_state rescued Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'server_id': '35a9cd8e-0a42-4622-9b8d-885638580dbf', 'id': '46f1572c-0137-484a-b78d-69550c5b388a'} Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 35a9cd8e-0a42-4622-9b8d-885638580dbf while it is in vm_state rescued Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.193865 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.197746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:33.197746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:33.197746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:33.197746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:33.197746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 35a9cd8e-0a42-4622-9b8d-885638580dbf while it is in vm_state rescued Sep 07 09:55:33.197746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.199741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 409 to user: Cannot 'detach_volume' instance 35a9cd8e-0a42-4622-9b8d-885638580dbf while it is in vm_state rescued {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:33.200829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c4f0ebe6-4821-424d-a936-1190aac0c2b5 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments/46f1572c-0137-484a-b78d-69550c5b388a" status: 409 len: 152 microversion: 2.1 time: 0.164031 Sep 07 09:55:33.202506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1279/2497] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 09:55:33 2022] DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments/46f1572c-0137-484a-b78d-69550c5b388a => generated 152 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:55:33.209707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8a7d2720-4912-4d72-9616-5ad676d3b273 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1acbf70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.319326 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8a7d2720-4912-4d72-9616-5ad676d3b273 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1467 microversion: 2.1 time: 0.115237 Sep 07 09:55:33.338166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1280/2498] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Sep 7 09:55:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1467 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:33.350042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:33.350596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:33.362453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.362954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.363400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.364116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.364570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.365444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.442743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-972799e7-ac94-4a64-8292-57e0fffdbdc4 tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ed893b47-bd10-47cb-ad39-a79963796e1b could not be found", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:55:33.442743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-972799e7-ac94-4a64-8292-57e0fffdbdc4 tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] HTTP exception thrown: Floating IP not found for ID ed893b47-bd10-47cb-ad39-a79963796e1b Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-972799e7-ac94-4a64-8292-57e0fffdbdc4 tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Request method failure captured: Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-floating-ips/ed893b47-bd10-47cb-ad39-a79963796e1b HTTP/1.1 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGqTBaEDZRjJOnVhwvu1QMbvv8F6JWh9sa6Q2imtwf9fbkkgujmvqCiSUEZ06qy7TfvosyQi7YD3CLgTOqFUuJ6shwieR_HNGDJVuVGvzuSKeTTSUr5e3QvZ19o620H9ehh0uxFSwsiWBrAa1PSjKsHrPfg4WUbUiviRBVUkn5ULsrc Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 0e1452be77634ce9b19b7a3f446d94d9 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-692496154 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e1452be77634ce9b19b7a3f446d94d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e1452be77634ce9b19b7a3f446d94d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e1452be77634ce9b19b7a3f446d94d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e1452be77634ce9b19b7a3f446d94d9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-692496154 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 0e1452be77634ce9b19b7a3f446d94d9 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-692496154 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-FloatingIPsNegativeTestJSON-692496154-project Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 77c949a2549b45c5bf5fd16c51219c6f Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-692496154-project Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: exception: Floating IP not found for ID ed893b47-bd10-47cb-ad39-a79963796e1b Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ed893b47-bd10-47cb-ad39-a79963796e1b'} Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ed893b47-bd10-47cb-ad39-a79963796e1b could not be found Sep 07 09:55:33.444635 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-670ceae2-7d2d-4f73-81b7-ca93d11f9d9f'] Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ed893b47-bd10-47cb-ad39-a79963796e1b. Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ed893b47-bd10-47cb-ad39-a79963796e1b Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ed893b47-bd10-47cb-ad39-a79963796e1b Sep 07 09:55:33.450709 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:33.457516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-972799e7-ac94-4a64-8292-57e0fffdbdc4 tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] Returning 404 to user: Floating IP not found for ID ed893b47-bd10-47cb-ad39-a79963796e1b {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:33.457740 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-972799e7-ac94-4a64-8292-57e0fffdbdc4 tempest-FloatingIPsNegativeTestJSON-692496154 tempest-FloatingIPsNegativeTestJSON-692496154-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/ed893b47-bd10-47cb-ad39-a79963796e1b" status: 404 len: 111 microversion: 2.1 time: 0.312421 Sep 07 09:55:33.459070 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1219/2499] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:55:33 2022] DELETE /compute/v2.1/os-floating-ips/ed893b47-bd10-47cb-ad39-a79963796e1b => generated 111 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:55:33.472021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.475174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:33.496024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.496767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.497450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.499273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.502566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.504551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.518619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f2e8f46-b455-4f6e-8194-9f8c7a8f59d9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.178331 Sep 07 09:55:33.519274 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1281/2500] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:33 2022] POST /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:55:33.530216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2755779-0390-41c0-a8d6-7435435de887 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1aef820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.714477 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2755779-0390-41c0-a8d6-7435435de887 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.193964 Sep 07 09:55:33.715677 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1282/2501] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 7 09:55:33 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:33.814097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-70742fb8-0b67-40ca-a61c-71dcc1c6f235 req-a61c59e6-213d-4a9a-8b92-e99a690fff45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:33.833837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-70742fb8-0b67-40ca-a61c-71dcc1c6f235 req-a61c59e6-213d-4a9a-8b92-e99a690fff45 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.834480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-70742fb8-0b67-40ca-a61c-71dcc1c6f235 req-a61c59e6-213d-4a9a-8b92-e99a690fff45 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.834926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-70742fb8-0b67-40ca-a61c-71dcc1c6f235 req-a61c59e6-213d-4a9a-8b92-e99a690fff45 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.846640 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-70742fb8-0b67-40ca-a61c-71dcc1c6f235 req-a61c59e6-213d-4a9a-8b92-e99a690fff45 service nova] Creating event network-changed:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:55:33.851584 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-70742fb8-0b67-40ca-a61c-71dcc1c6f235 req-a61c59e6-213d-4a9a-8b92-e99a690fff45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134968 Sep 07 09:55:33.852410 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1283/2502] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:33.863637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:33.865359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:33.873168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.874004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.874743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:33.876638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:33.878169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:33.878903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:34.178202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:34.189761 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-417df134-8cd3-4a98-b6b3-772b9a0dfc35 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1471 microversion: 2.1 time: 0.729437 Sep 07 09:55:34.190349 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1220/2503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:33 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:34.197804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:34.198435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:34.209303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:34.210099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:34.210552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:34.211279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:34.211745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:34.212212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:34.308895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:34.727770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:34.743190 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54535fce-28c7-48f7-8364-f4c2a0a0a8aa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1722 microversion: 2.1 time: 0.888664 Sep 07 09:55:34.744095 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1284/2504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:33 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1722 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:34.753126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61ab3f8d-7ad2-4c5e-aa05-b838e18f2d61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1b16c10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:34.860484 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61ab3f8d-7ad2-4c5e-aa05-b838e18f2d61 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.115043 Sep 07 09:55:34.874448 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1285/2505] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 7 09:55:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:34.881122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:34.881902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:34.891058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:34.892200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:34.892914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:34.895516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:34.897388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:34.898264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.076605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:35.092232 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7edb1347-c71a-46ad-b15d-8bcc7c9afefb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1316 microversion: 2.1 time: 0.900458 Sep 07 09:55:35.095566 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1221/2506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:34 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1316 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:35.104083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:35.106147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:35.116012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.123180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.123737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.124500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.126004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.126816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.155136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:35.428856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:35.436639 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cbcd170-3f4f-4ccf-a92b-ceaaf60d34b9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.560163 Sep 07 09:55:35.437224 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1286/2507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:34 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:35.441887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:35.442391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:35.448600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.449085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.449923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.450960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.451424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.452033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.478427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:55:35.570275 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cf8407a-6cbd-42d0-a25a-6d163f6e2d39 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "DELETE /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 204 len: 0 microversion: 2.1 time: 0.131150 Sep 07 09:55:35.571067 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1287/2508] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:55:35 2022] DELETE /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:35.576541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25b60468-a160-4baf-b286-08df5af11545 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1d344c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:35.583666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:35.587544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:35.597323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9873a247-98f8-4b07-9cb5-cf32bbaf4dc8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1506 microversion: 2.1 time: 0.500385 Sep 07 09:55:35.597921 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1222/2509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:35 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:35.603112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:35.604153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:35.635196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.635702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.636146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.638810 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25b60468-a160-4baf-b286-08df5af11545 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/8aa3194e-7f8e-4ddc-8419-88dfe300e0f7" status: 200 len: 784 microversion: 2.1 time: 0.066750 Sep 07 09:55:35.643131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1288/2510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:35 2022] GET /compute/v2.1/images/8aa3194e-7f8e-4ddc-8419-88dfe300e0f7 => generated 784 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:35.644038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.644542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.644986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.651027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:35.652010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:35.661812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.662538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.663285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:35.664163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:35.664779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:35.665394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.076603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:36.094543 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-881343ef-d7a3-4701-ac75-449c50be9c6d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1463 microversion: 2.1 time: 0.495388 Sep 07 09:55:36.095714 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1223/2511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:35 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1463 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:36.100764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2492c873-8145-4d1f-9548-e2416830dc5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b19d9f70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:36.111446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:36.120801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:36.138928 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6963d2e-8013-4025-980e-746a7bc179f3 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1665 microversion: 2.1 time: 0.489012 Sep 07 09:55:36.139875 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1289/2512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:35 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1665 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:36.150233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:36.151583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:36.169515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.170179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.170799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.171500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.172625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.173102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.177082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2492c873-8145-4d1f-9548-e2416830dc5c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.080168 Sep 07 09:55:36.177712 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1224/2513] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:55:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:36.188507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:36.189347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:36.202115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.202702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.203272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.204152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.204696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.205217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.567204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:36.575969 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-23500657-6831-405d-b500-8ef6d1a83163 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1722 microversion: 2.1 time: 0.434759 Sep 07 09:55:36.576543 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1290/2514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:36 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:36.581543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:36.582140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:36.587896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.588378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.588810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.589519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.589977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.590399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.622179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:36.631151 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0be9e5b1-6f01-4a20-a0a7-c91d250866a3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1316 microversion: 2.1 time: 0.450927 Sep 07 09:55:36.631928 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1225/2515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:36 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:36.637131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f972573-7970-40d3-b6a5-c94bd92b518a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1bd6670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:36.835738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:36.862570 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05abc5e0-ee24-4638-9954-4376191a94e8 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1616 microversion: 2.1 time: 0.284959 Sep 07 09:55:36.873410 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1291/2516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:36 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1616 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:36.873410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:36.873410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:36.885166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.887953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.888755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:36.892784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:36.894104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:36.894727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.285542 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f972573-7970-40d3-b6a5-c94bd92b518a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf" status: 204 len: 0 microversion: 2.1 time: 0.652415 Sep 07 09:55:37.286146 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1226/2517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:36 2022] DELETE /compute/v2.1/images/778f5058-e45b-482b-9063-dcaa462983cf => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:37.292995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:37.293650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:37.300557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.301052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.301520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.302230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.302713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.303122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.502757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:37.510833 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-773d99c5-338c-4db9-9980-23bef5166559 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.645912 Sep 07 09:55:37.511424 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1292/2518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:36 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:37.516375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75a5ae3e-7449-425f-b80f-be9e68b19eff tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '.version_select at 0x7f14b1b818b0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:37.519913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a5ae3e-7449-425f-b80f-be9e68b19eff tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.520397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a5ae3e-7449-425f-b80f-be9e68b19eff tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.520841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a5ae3e-7449-425f-b80f-be9e68b19eff tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.528287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75a5ae3e-7449-425f-b80f-be9e68b19eff tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.015840 Sep 07 09:55:37.528810 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1293/2519] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:55:37 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:37.535485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:37.536114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:37.545753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.546358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.546692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.548388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.549212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.550086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.696077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:37.704752 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93474f97-22e6-490b-add5-bff2709a6cd7 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1506 microversion: 2.1 time: 0.417402 Sep 07 09:55:37.717455 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1227/2520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:37 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:37.725557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88339f6d-4cb2-4a72-9c49-c7ace6795d23 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1c35c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:37.834958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:37.843295 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8e52e35-ee2c-4453-8b8e-5f9cb2f7f37a tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1665 microversion: 2.1 time: 0.313250 Sep 07 09:55:37.844584 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1294/2521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:37 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1665 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:37.849513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-463783e7-76fe-444f-b540-5429a783ae4e req-72c9f7ca-246d-48bc-8bda-05792ea83190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7653962-9d9a-4669-b441-27fc2f00dfa3", "tag": "2f229892-2e11-43ac-9e89-fe3a1162a339"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:37.859195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-463783e7-76fe-444f-b540-5429a783ae4e req-72c9f7ca-246d-48bc-8bda-05792ea83190 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.859944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-463783e7-76fe-444f-b540-5429a783ae4e req-72c9f7ca-246d-48bc-8bda-05792ea83190 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.860666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-463783e7-76fe-444f-b540-5429a783ae4e req-72c9f7ca-246d-48bc-8bda-05792ea83190 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.867110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:37.872519 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-463783e7-76fe-444f-b540-5429a783ae4e req-72c9f7ca-246d-48bc-8bda-05792ea83190 service nova] Creating event network-changed:2f229892-2e11-43ac-9e89-fe3a1162a339 for instance c7653962-9d9a-4669-b441-27fc2f00dfa3 on n-h2-836830-16 Sep 07 09:55:37.877675 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-463783e7-76fe-444f-b540-5429a783ae4e req-72c9f7ca-246d-48bc-8bda-05792ea83190 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Sep 07 09:55:37.878336 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1295/2522] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:37.883572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:37.884282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:37.891673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.892306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.894033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:37.894763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:37.895232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:37.895701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:38.139995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:38.151046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6616027b-fdfc-45ed-b83a-85b192f7e247 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1722 microversion: 2.1 time: 0.271353 Sep 07 09:55:38.151634 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1296/2523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:37 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:38.159369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:38.160242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:38.176609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:38.177603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:38.178296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:38.179878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:38.180573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:38.181656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:38.269746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88339f6d-4cb2-4a72-9c49-c7ace6795d23 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6" status: 204 len: 0 microversion: 2.1 time: 0.550542 Sep 07 09:55:38.270412 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1228/2524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:37 2022] DELETE /compute/v2.1/images/061e4694-0bbd-41e2-a128-106229fe2da6 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:38.277271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-404796882", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:38.357696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:55:38.824721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:38.838201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-169dea4c-0c39-4850-9165-9df1cbe5fd4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1316 microversion: 2.1 time: 0.684198 Sep 07 09:55:38.839319 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1297/2525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:38 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1316 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:38.850419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25d29c3f-1f5d-430d-913f-b74fe8abf609 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1afb9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:39.569971 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25d29c3f-1f5d-430d-913f-b74fe8abf609 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba" status: 204 len: 0 microversion: 2.1 time: 0.728994 Sep 07 09:55:39.571097 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1298/2526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:38 2022] DELETE /compute/v2.1/images/d80905b6-cdc6-4e28-8740-ec3363ef79ba => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:39.584565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:39.585423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:39.595764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:39.596559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:39.597364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:39.598617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:39.599814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:39.607093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:39.799085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:55:39.799602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:55:39.799988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:55:39.800582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:55:39.801160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:55:39.816268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:39.817002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:39.817801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:39.818805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:39.819577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:39.820441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:39.854105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:55:39.878439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for user 0e051e5308924154b7d5ecc2ea7ffdf7 and project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:55:39.903863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:55:39.907903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:55:39.979285 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23641794-2fe3-44ce-adfb-e9d9f1d0e696 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704175 Sep 07 09:55:39.980987 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1229/2527] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:55:39.988350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ceef830e-01d7-4a36-981d-9766002d4587 req-0b32aae9-4d69-45fe-b974-94282f4892a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e196505e-2b63-4862-b532-6449982ac183", "name": "network-vif-unplugged", "status": "completed", "tag": "6bbac783-aa25-468e-aa1d-cb59eb7d42cd"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:40.014524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ceef830e-01d7-4a36-981d-9766002d4587 req-0b32aae9-4d69-45fe-b974-94282f4892a3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.014524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ceef830e-01d7-4a36-981d-9766002d4587 req-0b32aae9-4d69-45fe-b974-94282f4892a3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.014959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ceef830e-01d7-4a36-981d-9766002d4587 req-0b32aae9-4d69-45fe-b974-94282f4892a3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:40.035560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.compute.server_external_events [req-ceef830e-01d7-4a36-981d-9766002d4587 req-0b32aae9-4d69-45fe-b974-94282f4892a3 service nova] Unable to find a host for instance e196505e-2b63-4862-b532-6449982ac183. Dropping event network-vif-unplugged {{(pid=128832) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 09:55:40.036555 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ceef830e-01d7-4a36-981d-9766002d4587 req-0b32aae9-4d69-45fe-b974-94282f4892a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054335 Sep 07 09:55:40.041704 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1230/2528] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 09:55:40.048827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:40.050335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:40.070378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.070897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.071351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:40.072074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.072541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.072970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:40.272008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:40.279966 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-817c7a9d-0a29-4379-a578-0586fa44c5e8 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.707272 Sep 07 09:55:40.280491 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1299/2529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:39 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:40.298463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:40.299109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:40.322092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.322878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.323531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:40.324676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.330508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.331422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:40.675749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:40.686427 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-739971c9-d173-405e-9323-a58f9f25b2e8 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 200 len: 1449 microversion: 2.1 time: 0.643274 Sep 07 09:55:40.688038 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1231/2530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:40 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 1449 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:40.693897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:40.702579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:40.716849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.717536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.718131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:40.722400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:40.723183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:40.723859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.240752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:41.249542 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41730ec5-8f97-4330-83eb-666b832c8473 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1665 microversion: 2.1 time: 0.967983 Sep 07 09:55:41.251327 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1300/2531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:40 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1665 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:41.256416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:41.257254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:41.263897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.264735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.266048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.267286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.267986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.268668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.300700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:55:41.364357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:41.374680 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c01d883-d5c0-4307-bae5-42ebb82357d4 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1728 microversion: 2.1 time: 0.685268 Sep 07 09:55:41.376018 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1232/2532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:40 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1728 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:41.381407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:41.382210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:41.402059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.410072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.411942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.413698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.416036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.416927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.425335 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-34444e36-9a57-4044-8ecd-a55919db3b31 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 204 len: 0 microversion: 2.1 time: 0.172288 Sep 07 09:55:41.427189 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1301/2533] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:55:41 2022] DELETE /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:41.435902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:41.437055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:41.447431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.448251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.448981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.450108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.450764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.451509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.566574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:41.578903 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a0890b4a-4a63-46f0-b3f6-3d23c8a730e4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1264 microversion: 2.1 time: 0.149931 Sep 07 09:55:41.579844 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1302/2534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:41 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:41.589905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:41.591150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:41.598397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.599166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.599863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.600807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.601321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.601760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.637500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:55:41.646476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.api [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Working on deleting snapshot 8d3a57c6-897e-4eac-a4c5-909d058ebef7 from shelved instance... Sep 07 09:55:41.703575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:41.712682 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e23589f-c191-426a-b241-464e17b811e8 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1316 microversion: 2.1 time: 0.334929 Sep 07 09:55:41.714316 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1233/2535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:41 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:41.725173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:41.725897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:41.742575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.743179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.743693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:41.744498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:41.745835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:41.746488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.086853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:42.103765 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9dc10bb9-28f5-46bf-b384-0be4ed62e757 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.387929 Sep 07 09:55:42.106192 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1234/2536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:41 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:42.119558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:42.120082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:42.132930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.134045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.134731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.135834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.136787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.138411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.253229 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e79659b0-fab3-4ebc-a3df-db0b8e48b2cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145869 Sep 07 09:55:42.253916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1235/2537] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 09:55:42 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:42.262871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:42.264102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:42.284819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.286999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.287488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.288225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.289304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.289711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.495320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:42.521239 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71a5be87-599b-4897-8502-7a9fd0a5b9bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1474 microversion: 2.1 time: 0.265817 Sep 07 09:55:42.523498 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1236/2538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:42 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1474 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:42.528977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de44dabc-4237-4dfc-9234-b456fe99214d", "name": "network-vif-unplugged", "status": "completed", "tag": "008d5f5d-58d3-456f-9846-019141cb24d8"}, {"server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "name": "network-vif-plugged", "status": "completed", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:42.556355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.557318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.561284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.618101 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] Creating event network-vif-unplugged:008d5f5d-58d3-456f-9846-019141cb24d8 for instance de44dabc-4237-4dfc-9234-b456fe99214d on n-h2-836830-16 Sep 07 09:55:42.620179 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] Creating event network-vif-plugged:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:55:42.652546 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5aaf8bfc-6658-48cb-839b-457d28dbf831 req-9cd07007-18ed-4bbc-b52f-5db0b24eff0c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.127600 Sep 07 09:55:42.658638 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1237/2539] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:42.671374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-86537430-258d-477b-86a1-1090fb7e4eea req-59d86fa3-dc96-4e3e-a3af-21d5d310a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de44dabc-4237-4dfc-9234-b456fe99214d", "name": "network-vif-deleted", "tag": "008d5f5d-58d3-456f-9846-019141cb24d8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:42.692941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-86537430-258d-477b-86a1-1090fb7e4eea req-59d86fa3-dc96-4e3e-a3af-21d5d310a2e8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.693674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-86537430-258d-477b-86a1-1090fb7e4eea req-59d86fa3-dc96-4e3e-a3af-21d5d310a2e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.694294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-86537430-258d-477b-86a1-1090fb7e4eea req-59d86fa3-dc96-4e3e-a3af-21d5d310a2e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.708820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-86537430-258d-477b-86a1-1090fb7e4eea req-59d86fa3-dc96-4e3e-a3af-21d5d310a2e8 service nova] Creating event network-vif-deleted:008d5f5d-58d3-456f-9846-019141cb24d8 for instance de44dabc-4237-4dfc-9234-b456fe99214d on n-h2-836830-16 Sep 07 09:55:42.739561 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-86537430-258d-477b-86a1-1090fb7e4eea req-59d86fa3-dc96-4e3e-a3af-21d5d310a2e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078812 Sep 07 09:55:42.749541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1238/2540] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:42.757884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:42.759228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:42.767157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.768241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.768992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.770572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.771199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.772102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.788687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Doing local delete in cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=128833) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 07 09:55:42.791263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.791848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.793129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.794286 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.api [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 07 09:55:42.803032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] deallocate_for_instance() {{(pid=128833) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 07 09:55:42.824593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:42.824875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:42.829718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:42.830519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lazy-loading 'fault' on Instance uuid de44dabc-4237-4dfc-9234-b456fe99214d {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:55:42.934909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2550430d8d403a992faeb064db2d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9527f4c832da4894b05771befd4868ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:42.945795 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a3ac0ec-473d-45f6-995c-2c06dba8f896 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 200 len: 1316 microversion: 2.1 time: 0.192625 Sep 07 09:55:42.974670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1239/2541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:42 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:42.991587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:42.992509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:42.999687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:43.002761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:43.004030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:43.004804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:43.006309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:43.007510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:43.008107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:43.127071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:43.135618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e0931aa-0fec-4fe2-a37c-d132d7fe1407 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1264 microversion: 2.1 time: 0.157519 Sep 07 09:55:43.136772 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1240/2542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:42 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:43.143248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:43.144044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:43.157398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:43.158234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:43.158861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:43.159754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:43.160560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:43.161302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:43.799088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:43.807412 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6524e37d-d9fb-4142-b8fb-e5e84a60f990 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1316 microversion: 2.1 time: 0.669148 Sep 07 09:55:43.808356 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1241/2543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:43 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:43.814048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:43.814792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:43.821298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:43.821892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:43.822602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:43.824277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:43.824953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:43.825663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.341343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:44.348752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Updating instance_info_cache with network_info: [] {{(pid=128833) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:55:44.351208 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-626e59bb-41e2-457b-95df-de43cabae141 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.541567 Sep 07 09:55:44.351814 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1242/2544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:43 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:44.370206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:44.371048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:44.380805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.381389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.388783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.389681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.390179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.391367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.600970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:44.618316 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65c75a50-f88d-4175-b138-a73783d82458 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 200 len: 1432 microversion: 2.1 time: 0.265424 Sep 07 09:55:44.618932 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1243/2545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:44 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 1432 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:44.626864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:44.631764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] [instance: de44dabc-4237-4dfc-9234-b456fe99214d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:44.638245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.638919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.639544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.640445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.641080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.641689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.659146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] HTTP exception thrown: Instance de44dabc-4237-4dfc-9234-b456fe99214d could not be found. Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Request method failure captured: Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d HTTP/1.1 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGpO8qedHc0KQEgEgPpUUQ4WC17tDecq6GvN-kr8LppObirtJmc0qlIRVo5CjrRT2feQOVDnFvFhkxudkvOPrlxg6_9E0T6pGMpmQW6bNouqtH8Ddi8TwvL4daSwu1YiQPTskHSdIGGXnAcJGfYP1L-tqVhRIiyztfB15REl55-F-Wk Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 9527f4c832da4894b05771befd4868ba Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestFqdnHostnames-1657660502 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9527f4c832da4894b05771befd4868ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9527f4c832da4894b05771befd4868ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9527f4c832da4894b05771befd4868ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9527f4c832da4894b05771befd4868ba", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestFqdnHostnames-1657660502 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 9527f4c832da4894b05771befd4868ba Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1657660502 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestFqdnHostnames-1657660502-project Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2d2550430d8d403a992faeb064db2d85 Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestFqdnHostnames-1657660502-project Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance de44dabc-4237-4dfc-9234-b456fe99214d could not be found. Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'de44dabc-4237-4dfc-9234-b456fe99214d'} Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de44dabc-4237-4dfc-9234-b456fe99214d could not be found. Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de44dabc-4237-4dfc-9234-b456fe99214d could not be found. Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:44.662665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de44dabc-4237-4dfc-9234-b456fe99214d could not be found. Sep 07 09:55:44.667337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:44.668621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Returning 404 to user: Instance de44dabc-4237-4dfc-9234-b456fe99214d could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:44.669693 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e0a68f9-a483-4802-8ac7-c496b2b91363 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d" status: 404 len: 111 microversion: 2.1 time: 0.047320 Sep 07 09:55:44.670762 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1244/2546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:44 2022] GET /compute/v2.1/servers/de44dabc-4237-4dfc-9234-b456fe99214d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:55:44.676897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6617aace-f33e-4bb5-b978-70f4b2490875 req-311e684b-7415-4130-9866-3485be7e12ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a9cd8e-0a42-4622-9b8d-885638580dbf", "tag": "e95a1e84-34bf-408e-a698-11c49deef067"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:44.688283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6617aace-f33e-4bb5-b978-70f4b2490875 req-311e684b-7415-4130-9866-3485be7e12ab service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.689308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6617aace-f33e-4bb5-b978-70f4b2490875 req-311e684b-7415-4130-9866-3485be7e12ab service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.689979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6617aace-f33e-4bb5-b978-70f4b2490875 req-311e684b-7415-4130-9866-3485be7e12ab service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.717291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:44.725312 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6617aace-f33e-4bb5-b978-70f4b2490875 req-311e684b-7415-4130-9866-3485be7e12ab service nova] Creating event network-changed:e95a1e84-34bf-408e-a698-11c49deef067 for instance 35a9cd8e-0a42-4622-9b8d-885638580dbf on n-h2-836830-16 Sep 07 09:55:44.739294 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6617aace-f33e-4bb5-b978-70f4b2490875 req-311e684b-7415-4130-9866-3485be7e12ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066797 Sep 07 09:55:44.740073 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1245/2547] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:44.758585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:44.759314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:44.774614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.775118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.775560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.776272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:44.783464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:44.783957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:44.855539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:44.975741 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7949c499-0829-4598-ba58-a48ebd5151b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 204 len: 0 microversion: 2.1 time: 3.394053 Sep 07 09:55:44.978141 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1303/2548] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:55:41 2022] DELETE /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 0 bytes in 3397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:44.987783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2b551fa7-da56-4b82-941a-7d102662b4e4 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] Calling method '.version_select at 0x7f14b1acbb80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:45.017697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2b551fa7-da56-4b82-941a-7d102662b4e4 tempest-ServersTestFqdnHostnames-1657660502 tempest-ServersTestFqdnHostnames-1657660502-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677069777" status: 202 len: 0 microversion: 2.1 time: 0.036595 Sep 07 09:55:45.019827 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1304/2549] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 09:55:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677069777 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:55:45.026054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-74a511c3-e997-4c81-acf2-1611c0fcd799 req-45e12c54-549f-4c56-aabb-2bb55cf11548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e196505e-2b63-4862-b532-6449982ac183", "name": "network-vif-deleted", "tag": "6bbac783-aa25-468e-aa1d-cb59eb7d42cd"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:45.038452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74a511c3-e997-4c81-acf2-1611c0fcd799 req-45e12c54-549f-4c56-aabb-2bb55cf11548 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.038936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74a511c3-e997-4c81-acf2-1611c0fcd799 req-45e12c54-549f-4c56-aabb-2bb55cf11548 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.039422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74a511c3-e997-4c81-acf2-1611c0fcd799 req-45e12c54-549f-4c56-aabb-2bb55cf11548 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:45.062018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_external_events [req-74a511c3-e997-4c81-acf2-1611c0fcd799 req-45e12c54-549f-4c56-aabb-2bb55cf11548 service nova] Unable to find a host for instance e196505e-2b63-4862-b532-6449982ac183. Dropping event network-vif-deleted {{(pid=128833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 09:55:45.063692 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-74a511c3-e997-4c81-acf2-1611c0fcd799 req-45e12c54-549f-4c56-aabb-2bb55cf11548 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.042517 Sep 07 09:55:45.064834 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1305/2550] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 09:55:45.071840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:45.073294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:45.082429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.083145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.083903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:45.084828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.085699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.086426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:45.118384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:45.134020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0752299d-89d8-43cf-9402-215c87302588 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1270 microversion: 2.1 time: 0.392634 Sep 07 09:55:45.134621 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1246/2551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:44 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1270 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:45.153256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:45.154402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:45.163633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.164228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.168424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:45.169625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.171383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.171967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:45.206104 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 HTTP/1.1 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e196505e-2b63-4862-b532-6449982ac183'} Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:45.212080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:55:45.216240 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:55:45.218351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:45.221786 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2da78ff-a4bf-4736-bbad-164dadae0820 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 404 len: 111 microversion: 2.1 time: 0.084574 Sep 07 09:55:45.223055 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1247/2552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:45 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:55:45.347580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1734287282", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:45.498680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:55:45.588870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:45.598236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d95c6dde-bf79-4cb3-8a44-41e0e773a42d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1466 microversion: 2.1 time: 0.531997 Sep 07 09:55:45.598848 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1306/2553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:45 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1466 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:45.627780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:45.628665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:45.635558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.636277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.636880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:45.637780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:45.638804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:45.639399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:46.169284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:46.179577 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-17ae8f5f-09c8-4ba7-8d75-728678b4a347 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.563736 Sep 07 09:55:46.182079 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1307/2554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:45 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:46.190486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2135758176", "metadata": {"image_type": "test"}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:46.196506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:46.228663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:46.229633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:46.231308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:46.232428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:46.233211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:46.233893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:46.336122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Getting quotas for project d26be1ae8f8d45e28ae37c07670deb86. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:55:46.346098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Getting quotas for user 52661062c37f426984b4a0ad2ba02d3f and project d26be1ae8f8d45e28ae37c07670deb86. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:55:46.372498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:46.699775 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36db8c4b-e0be-4d5c-9577-d85c69922de4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "POST /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f/action" status: 202 len: 0 microversion: 2.1 time: 0.515308 Sep 07 09:55:46.707567 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1308/2555] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:46 2022] POST /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:55:46.723495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:46.724690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 17bd1d3e-70c6-4d04-8f7e-43b82a37515b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:46.735273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:46.736577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:46.737278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:46.738787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:46.739991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:46.742081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:46.770179 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] HTTP exception thrown: Instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b could not be found. Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Request method failure captured: Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b HTTP/1.1 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoBYoZ6nzCUOzEwPlifuI4jRHSfm3nRcfP8yka0_QDsZPko1Ogo8luoUB1gbKXxsCyMxBc3MRuqCZVoY20FxGnSBiJ172Ji2jDRYb4ameTqhQ_sy_bP3Qs5aIL_gBE26iAVXfpT1_l2Fk_7W4v-y_8b7wmQ4zwnaUVLdJ-kOqO2DfE Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 22c907cee7e14aaaa5d0e145c1c682b1 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListImageFiltersTestJSON-1083778097 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22c907cee7e14aaaa5d0e145c1c682b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22c907cee7e14aaaa5d0e145c1c682b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22c907cee7e14aaaa5d0e145c1c682b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22c907cee7e14aaaa5d0e145c1c682b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListImageFiltersTestJSON-1083778097 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 22c907cee7e14aaaa5d0e145c1c682b1 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1083778097 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListImageFiltersTestJSON-1083778097-project Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 05f721b5776f4323911a52b3708c6bd3 Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListImageFiltersTestJSON-1083778097-project Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b could not be found. Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '17bd1d3e-70c6-4d04-8f7e-43b82a37515b'} Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b could not be found. Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b could not be found. Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:46.773208 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b could not be found. Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Returning 404 to user: Instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:46.776941 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7266b0eb-906a-4955-a913-693c00ce9d78 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b" status: 404 len: 111 microversion: 2.1 time: 0.072184 Sep 07 09:55:46.779992 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1309/2556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:46 2022] GET /compute/v2.1/servers/17bd1d3e-70c6-4d04-8f7e-43b82a37515b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:55:46.785917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:46.786774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:46.795831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:46.796499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:46.797525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:46.798473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:46.800030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:46.800551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.316142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:55:47.316682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:55:47.318123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:55:47.319075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:55:47.319642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:55:47.352357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.355062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.355978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.356929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.361839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.362303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.372496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:47.385843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf70a1bd-09cb-441e-b185-e64567727a02 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 0.605128 Sep 07 09:55:47.386428 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1310/2557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:46 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:47.386576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:55:47.405827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:55:47.415071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21d408cd-43a4-4e1e-826b-9fecc590f0b3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1b164c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:47.431910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:55:47.441418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:55:47.487215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21d408cd-43a4-4e1e-826b-9fecc590f0b3 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.099336 Sep 07 09:55:47.495652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1311/2558] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:47 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:47.498833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:47.499551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:47.513354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.518316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.518952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.519799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.520345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.520833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.563248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:55:47.576821 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d63baac-6cde-4803-a38a-160daf62c449 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233978 Sep 07 09:55:47.580807 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1248/2559] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:55:47.595515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a9cd8e-0a42-4622-9b8d-885638580dbf", "tag": "e95a1e84-34bf-408e-a698-11c49deef067"}, {"server_uuid": "17bd1d3e-70c6-4d04-8f7e-43b82a37515b", "name": "network-vif-deleted", "tag": "b12bc190-ba6f-4910-823e-fabfc4f68991"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:47.631182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.632594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.633500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.669599 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] Creating event network-changed:e95a1e84-34bf-408e-a698-11c49deef067 for instance 35a9cd8e-0a42-4622-9b8d-885638580dbf on n-h2-836830-16 Sep 07 09:55:47.670129 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] Creating event network-vif-deleted:b12bc190-ba6f-4910-823e-fabfc4f68991 for instance 17bd1d3e-70c6-4d04-8f7e-43b82a37515b on n-h1-836830-16 Sep 07 09:55:47.696847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f7d15d22-9eb2-483b-9235-ebdd577f0e60 req-940f71b3-a26d-4517-97b8-75507f7d542f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.112945 Sep 07 09:55:47.699548 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1249/2560] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:47.713530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:47.715345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:47.731150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.733476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.735623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:47.736615 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3b2eec5-5d87-435a-838d-05bfcc3ca0bb tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 204 len: 0 microversion: 2.1 time: 0.246322 Sep 07 09:55:47.737355 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1312/2561] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:55:47 2022] DELETE /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:47.742886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:47.743831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c608548-90ba-47b7-a25c-5ed44d3e634a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:47.744536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8c608548-90ba-47b7-a25c-5ed44d3e634a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:47.745120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:47.746787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:48.258698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8c608548-90ba-47b7-a25c-5ed44d3e634a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:48.268666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c608548-90ba-47b7-a25c-5ed44d3e634a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1215 microversion: 2.1 time: 0.529491 Sep 07 09:55:48.269970 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1313/2562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:47 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1215 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:48.306967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:48.307511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:48.314560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:48.315356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:48.316046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:48.317108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:48.317781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:48.318439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:48.545703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:48.561565 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4785e3ac-6927-4396-8446-a8ee9112f88e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.860003 Sep 07 09:55:48.566435 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1250/2563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:47 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:48.584538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-67dab7c1-fa4f-412e-ba57-7138f63e683d req-5bdccfc0-847d-4278-9a79-e61d831f5d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7653962-9d9a-4669-b441-27fc2f00dfa3", "name": "network-vif-plugged", "status": "completed", "tag": "2f229892-2e11-43ac-9e89-fe3a1162a339"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:48.600244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67dab7c1-fa4f-412e-ba57-7138f63e683d req-5bdccfc0-847d-4278-9a79-e61d831f5d03 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:48.601142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67dab7c1-fa4f-412e-ba57-7138f63e683d req-5bdccfc0-847d-4278-9a79-e61d831f5d03 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:48.602350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-67dab7c1-fa4f-412e-ba57-7138f63e683d req-5bdccfc0-847d-4278-9a79-e61d831f5d03 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:48.621754 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-67dab7c1-fa4f-412e-ba57-7138f63e683d req-5bdccfc0-847d-4278-9a79-e61d831f5d03 service nova] Creating event network-vif-plugged:2f229892-2e11-43ac-9e89-fe3a1162a339 for instance c7653962-9d9a-4669-b441-27fc2f00dfa3 on n-h2-836830-16 Sep 07 09:55:48.632109 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-67dab7c1-fa4f-412e-ba57-7138f63e683d req-5bdccfc0-847d-4278-9a79-e61d831f5d03 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062573 Sep 07 09:55:48.632849 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1251/2564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:48.639814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:48.640939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:48.656996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:48.662090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:48.662829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:48.663813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:48.664445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:48.665077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:49.377611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:49.385598 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3bd3b72b-d82c-489e-afa7-8e385425fc6c tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1474 microversion: 2.1 time: 1.082998 Sep 07 09:55:49.389781 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1314/2565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:48 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1474 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:49.415656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76142632-1ae3-4c78-a5f4-f27fb33020f7 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b180b700>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:49.509532 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76142632-1ae3-4c78-a5f4-f27fb33020f7 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.106891 Sep 07 09:55:49.511435 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1315/2566] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:49 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:49.519005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:49.522020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:49.530186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:49.531078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:49.531763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:49.532773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:49.534455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:49.535129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:49.717637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:49.728715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88dda862-0cb1-4dcf-b081-e7d54bc22526 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 1.094243 Sep 07 09:55:49.729792 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1252/2567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:48 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:49.736154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:49.737055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:49.745002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:49.745779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:49.746624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:49.747474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:49.748412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:49.749001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:49.815835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:49.824866 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac62c438-7b16-4f51-abd3-5b108f3bf53a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1275 microversion: 2.1 time: 0.311887 Sep 07 09:55:49.829705 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1316/2568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:49 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1275 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:50.426598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:50.429623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:50.441711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:50.442811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:50.444155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:50.445593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:50.446289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:50.447306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:50.563486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:50.573008 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d919c1c1-c16b-45da-a544-ec62abc1c2fd tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1314 microversion: 2.1 time: 0.841763 Sep 07 09:55:50.578011 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1253/2569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:49 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:50.583230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-608b53c8-1808-459c-bbbb-187230ccb5c5 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b116c160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:50.670666 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-608b53c8-1808-459c-bbbb-187230ccb5c5 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.091044 Sep 07 09:55:50.671941 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1254/2570] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:50 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:50.754727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:50.755358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:50.770045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:50.770549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:50.770993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:50.771708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:50.772168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:50.772601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:51.303084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:51.321850 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e7824f7-136f-4184-ae4e-e85d0df25b2e tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1474 microversion: 2.1 time: 0.904811 Sep 07 09:55:51.338775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1317/2571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:50 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1474 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:51.346832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:51.347814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:51.363755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:51.364598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:51.367345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:51.368565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:51.369215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:51.373791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:51.619971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:51.634225 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d1bbc8a-62fb-4109-a533-f751d7166ab2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 0.884747 Sep 07 09:55:51.635860 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1255/2572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:50 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:55:51.640958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:51.641957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:51.650820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:51.651321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:51.651769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:51.652480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:51.652938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:51.653458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.216890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:52.229558 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-088a6fc0-bc3a-493e-8757-08ce53db5a7d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 0.889153 Sep 07 09:55:52.233373 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1318/2573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:51 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:52.238950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eccfea28-fd6e-4719-809f-c64d6d560b23 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b180b940>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:52.340696 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eccfea28-fd6e-4719-809f-c64d6d560b23 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.105560 Sep 07 09:55:52.341842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1319/2574] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:52 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:52.348262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a1c4a67a-f472-4b59-9c0c-297b5d097546 req-da1c6144-7021-4f3a-9052-94e04b53be93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef9a4b-68a2-4f66-a5f3-dc857e08f7be", "name": "network-vif-deleted", "tag": "c1d1d886-ac05-4741-bb2f-1eef65ad915c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:52.457075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a1c4a67a-f472-4b59-9c0c-297b5d097546 req-da1c6144-7021-4f3a-9052-94e04b53be93 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.458002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a1c4a67a-f472-4b59-9c0c-297b5d097546 req-da1c6144-7021-4f3a-9052-94e04b53be93 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.460160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a1c4a67a-f472-4b59-9c0c-297b5d097546 req-da1c6144-7021-4f3a-9052-94e04b53be93 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.477328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:52.503875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a1c4a67a-f472-4b59-9c0c-297b5d097546 req-da1c6144-7021-4f3a-9052-94e04b53be93 service nova] Creating event network-vif-deleted:c1d1d886-ac05-4741-bb2f-1eef65ad915c for instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be on n-h1-836830-16 Sep 07 09:55:52.519166 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a1c4a67a-f472-4b59-9c0c-297b5d097546 req-da1c6144-7021-4f3a-9052-94e04b53be93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175633 Sep 07 09:55:52.525138 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1320/2575] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:52.539987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-72db2f8f-8ff1-4fc1-9efd-251e2d054f1b req-dcdfdbe4-b3b2-49ff-a524-32d6286d5152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1caf64-97d3-4d37-b66b-4fdc9bff03ab", "tag": "ad4cd55f-c2ec-4458-9b22-5d93adec48a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:52.554672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-72db2f8f-8ff1-4fc1-9efd-251e2d054f1b req-dcdfdbe4-b3b2-49ff-a524-32d6286d5152 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.556457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-72db2f8f-8ff1-4fc1-9efd-251e2d054f1b req-dcdfdbe4-b3b2-49ff-a524-32d6286d5152 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.557172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-72db2f8f-8ff1-4fc1-9efd-251e2d054f1b req-dcdfdbe4-b3b2-49ff-a524-32d6286d5152 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.581090 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-72db2f8f-8ff1-4fc1-9efd-251e2d054f1b req-dcdfdbe4-b3b2-49ff-a524-32d6286d5152 service nova] Creating event network-changed:ad4cd55f-c2ec-4458-9b22-5d93adec48a5 for instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab on n-h1-836830-16 Sep 07 09:55:52.591670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-72db2f8f-8ff1-4fc1-9efd-251e2d054f1b req-dcdfdbe4-b3b2-49ff-a524-32d6286d5152 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057502 Sep 07 09:55:52.592841 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1321/2576] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:52.600150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:52.601096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:52.601470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:52.610297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.611209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.612022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.612139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e2aaa67-fd5f-4ec9-a999-aaf46788bf47 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1499 microversion: 2.1 time: 0.975025 Sep 07 09:55:52.613283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.614078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.614868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.615780 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1256/2577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:51 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1499 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:52.654272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:52.657333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:52.662478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.664007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.666259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.666975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lazy-loading 'fault' on Instance uuid 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:55:52.682994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.683502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.683938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.698277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:52.698786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:52.699247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:52.814900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lazy-loading 'flavor' on Instance uuid c7653962-9d9a-4669-b441-27fc2f00dfa3 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:55:53.040157 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84bf66bd-a911-4b93-8f01-48a7aee2075f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "POST /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3/action" status: 200 len: 32 microversion: 2.1 time: 0.398781 Sep 07 09:55:53.042219 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1257/2578] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:55:52 2022] POST /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:55:53.072023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f721b5776f4323911a52b3708c6bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c907cee7e14aaaa5d0e145c1c682b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:53.079204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:53.080727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:53.101557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:53.101768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c038af7e-f84e-4c45-bf9d-52be1cba95d3 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 200 len: 1308 microversion: 2.1 time: 0.501306 Sep 07 09:55:53.102459 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1322/2579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:52 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 1308 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:53.102717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:53.103416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:53.104509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:53.105203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:53.105825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:53.139345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:53.145020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:53.181641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:53.192603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:53.198149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:53.199333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:53.200315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:53.201964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:53.884808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:53.918336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:53.947777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f86fe9d-941c-4150-886c-861234be322d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.819895 Sep 07 09:55:53.948509 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1323/2580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:53 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:53.961242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36a5543c-85c1-44af-a97c-44e5420c8bf4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 0.913759 Sep 07 09:55:53.965069 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1258/2581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:53 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:53.987109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b5ed0ec8-461e-4ea8-a3f2-a2ac700a0953 req-ef6bd35b-66ae-459e-a09c-1c6546f93882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "name": "network-vif-plugged", "status": "completed", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:54.003415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:54.007890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:54.029792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b5ed0ec8-461e-4ea8-a3f2-a2ac700a0953 req-ef6bd35b-66ae-459e-a09c-1c6546f93882 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:54.030548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b5ed0ec8-461e-4ea8-a3f2-a2ac700a0953 req-ef6bd35b-66ae-459e-a09c-1c6546f93882 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:54.031745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b5ed0ec8-461e-4ea8-a3f2-a2ac700a0953 req-ef6bd35b-66ae-459e-a09c-1c6546f93882 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:54.034662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:54.035483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:54.037484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:54.039946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:54.040572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:54.043119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:54.076910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b5ed0ec8-461e-4ea8-a3f2-a2ac700a0953 req-ef6bd35b-66ae-459e-a09c-1c6546f93882 service nova] Creating event network-vif-plugged:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:55:54.099487 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b5ed0ec8-461e-4ea8-a3f2-a2ac700a0953 req-ef6bd35b-66ae-459e-a09c-1c6546f93882 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136175 Sep 07 09:55:54.101584 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1324/2582] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:54.113040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0937c35-0ed4-45b3-9123-323dfc2ac342 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1b810d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:54.250770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0937c35-0ed4-45b3-9123-323dfc2ac342 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.146171 Sep 07 09:55:54.252601 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1325/2583] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:54 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:54.257496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:54.274252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] [instance: 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:54.285352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:54.285856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:54.286317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:54.287018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:54.287482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:54.287915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:54.350200 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] HTTP exception thrown: Instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be could not be found. Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Request method failure captured: Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be HTTP/1.1 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGoBYoZ6nzCUOzEwPlifuI4jRHSfm3nRcfP8yka0_QDsZPko1Ogo8luoUB1gbKXxsCyMxBc3MRuqCZVoY20FxGnSBiJ172Ji2jDRYb4ameTqhQ_sy_bP3Qs5aIL_gBE26iAVXfpT1_l2Fk_7W4v-y_8b7wmQ4zwnaUVLdJ-kOqO2DfE Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 22c907cee7e14aaaa5d0e145c1c682b1 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListImageFiltersTestJSON-1083778097 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22c907cee7e14aaaa5d0e145c1c682b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22c907cee7e14aaaa5d0e145c1c682b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22c907cee7e14aaaa5d0e145c1c682b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22c907cee7e14aaaa5d0e145c1c682b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListImageFiltersTestJSON-1083778097 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 22c907cee7e14aaaa5d0e145c1c682b1 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1083778097 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListImageFiltersTestJSON-1083778097-project Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 05f721b5776f4323911a52b3708c6bd3 Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListImageFiltersTestJSON-1083778097-project Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be could not be found. Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '07ef9a4b-68a2-4f66-a5f3-dc857e08f7be'} Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be could not be found. Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be could not be found. Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:55:54.351904 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be could not be found. Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Returning 404 to user: Instance 07ef9a4b-68a2-4f66-a5f3-dc857e08f7be could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7142c36-5bc5-45f5-aef2-209a02b80b8a tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be" status: 404 len: 111 microversion: 2.1 time: 0.099560 Sep 07 09:55:54.357144 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1326/2584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:54 2022] GET /compute/v2.1/servers/07ef9a4b-68a2-4f66-a5f3-dc857e08f7be => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:55:54.369599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a6490e1c-a956-4594-b6e9-ba29b4bac71f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b5f6b1f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:55.478700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a6490e1c-a956-4594-b6e9-ba29b4bac71f tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/images/0128c2aa-4899-400b-a5cd-0719007d952e" status: 204 len: 0 microversion: 2.1 time: 1.112988 Sep 07 09:55:55.480085 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1327/2585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:54 2022] DELETE /compute/v2.1/images/0128c2aa-4899-400b-a5cd-0719007d952e => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:55.505022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:55.506018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:55.529151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:55.536218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:55.536961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:55.539929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:55.540633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:55.541332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:55.979913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:55.995687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8de5d457-6f9a-498e-8ecb-72780ae0c104 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 2.015174 Sep 07 09:55:55.997367 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1259/2586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:53 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:56.011894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:56.012844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:56.054086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:56.054929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:56.066338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:56.069324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:56.069856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:56.070579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:56.431788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:56.448568 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a399ab5e-bff6-4dac-81fc-81de3f810899 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 0.448214 Sep 07 09:55:56.449551 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1260/2587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:55 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:56.455176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8904ecf3-164e-459a-bac7-a4878542bafc req-40a02dad-c88e-4180-8559-64eda8774368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fe8ffa-af59-455c-9957-e6d062c247a5", "tag": "4806ee61-974e-4ebf-b038-bd901d1298e5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:55:56.490399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8904ecf3-164e-459a-bac7-a4878542bafc req-40a02dad-c88e-4180-8559-64eda8774368 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:56.491041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8904ecf3-164e-459a-bac7-a4878542bafc req-40a02dad-c88e-4180-8559-64eda8774368 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:56.491494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8904ecf3-164e-459a-bac7-a4878542bafc req-40a02dad-c88e-4180-8559-64eda8774368 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:56.513131 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8904ecf3-164e-459a-bac7-a4878542bafc req-40a02dad-c88e-4180-8559-64eda8774368 service nova] Creating event network-changed:4806ee61-974e-4ebf-b038-bd901d1298e5 for instance b9fe8ffa-af59-455c-9957-e6d062c247a5 on n-h2-836830-16 Sep 07 09:55:56.531708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8904ecf3-164e-459a-bac7-a4878542bafc req-40a02dad-c88e-4180-8559-64eda8774368 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075933 Sep 07 09:55:56.532494 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1261/2588] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:55:56.537933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9e7be4a2-8ecd-4af1-9a61-f484f53665f4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1171af0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:56.565687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:56.586107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5449efc3-138c-40a8-a549-3ceaf17ac83b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 1.104700 Sep 07 09:55:56.588823 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1328/2589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:55 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:56.596606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29e1393d-5168-4692-943c-8de32dcb15e5 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b180fca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:57.374536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:57.419681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:57.528196 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29e1393d-5168-4692-943c-8de32dcb15e5 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/images/717add26-ae8f-45ec-bcab-f86a4bd654aa" status: 204 len: 0 microversion: 2.1 time: 0.937274 Sep 07 09:55:57.529072 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1329/2590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:56 2022] DELETE /compute/v2.1/images/717add26-ae8f-45ec-bcab-f86a4bd654aa => generated 0 bytes in 939 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:57.540102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:57.543131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:57.552410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:57.552908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:57.553590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:57.554871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:57.555670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:57.555821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:57.557552 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9e7be4a2-8ecd-4af1-9a61-f484f53665f4 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 1.023603 Sep 07 09:55:57.558529 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1262/2591] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:56 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:57.569669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:57.580069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:57.600994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:57.601596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:57.601990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:57.603001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:57.603173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:57.614409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:58.068550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:58.084674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5eca1dd3-4379-4c0a-89a0-41c9f2d59133 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 0.520668 Sep 07 09:55:58.086583 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1263/2592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:57 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:58.101761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39f5485f-289e-4d5e-add4-b45267835b09 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] Calling method '.version_select at 0x7f14b1171700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:58.268744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:55:58.681739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39f5485f-289e-4d5e-add4-b45267835b09 tempest-ListImageFiltersTestJSON-1083778097 tempest-ListImageFiltersTestJSON-1083778097-project] 10.222.0.60 "DELETE /compute/v2.1/images/8341f27e-344b-4edc-b22e-e55fda1f0eca" status: 204 len: 0 microversion: 2.1 time: 0.567614 Sep 07 09:55:58.720997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:58.730187 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1264/2593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:58 2022] DELETE /compute/v2.1/images/8341f27e-344b-4edc-b22e-e55fda1f0eca => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:55:58.736017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03610f7a-66ca-404b-8ca0-cec9e2e4c6fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 1.205733 Sep 07 09:55:58.736627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1330/2594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:57 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:58.768125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:58.768974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:58.780291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:58.781367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:58.782028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:58.783911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:58.784678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:58.785361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:58.795181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c0ab655-54d5-4787-b09c-a056547fdd63 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1842280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:58.963962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c0ab655-54d5-4787-b09c-a056547fdd63 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.216783 Sep 07 09:55:58.964679 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1331/2595] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:55:58 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:59.116951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:59.117721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:59.135158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:59.141195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:59.142884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:59.144325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:59.145141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:59.146355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:59.784120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:55:59.808043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2c6b9d9-c117-4e8f-b2fe-51d6dbe3b5ae tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 1.076642 Sep 07 09:55:59.808653 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1265/2596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:58 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:55:59.822327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:55:59.829549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:55:59.844947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:59.845484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:59.845929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:55:59.846703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:55:59.847567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:55:59.848309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:00.305589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:00.320936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d4fe625-01ac-4f7a-ade3-ab013779294d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 1.209922 Sep 07 09:56:00.321603 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1332/2597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:59 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:00.329698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51855d3e-5568-4a3c-912d-0b9b7fedb831 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1842dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:00.440396 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51855d3e-5568-4a3c-912d-0b9b7fedb831 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.117540 Sep 07 09:56:00.442054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1333/2598] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:00 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:00.834314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:00.835415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:00.852903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:00.853715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:00.856481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:00.857939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:00.860734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:00.861247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:01.335984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:01.347636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f93a7f18-a3a5-4bb0-b164-f597cc85e91b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 1.533121 Sep 07 09:56:01.348502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1266/2599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:55:59 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:01.363483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:01.364385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:01.381539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:01.385634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:01.386317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:01.387227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:01.387856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:01.388503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:01.413765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:01.427716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:01.441904 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03a78ff8-6e0c-4c79-a436-ccb4419b3424 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.607561 Sep 07 09:56:01.457206 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1334/2600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:00 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:01.462387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03597265-e898-481b-923e-107750c00718 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1acbd30>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:01.529649 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03597265-e898-481b-923e-107750c00718 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.075212 Sep 07 09:56:01.532297 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1335/2601] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:01 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:02.373441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:02.374145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:02.396518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:02.397366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:02.398324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:02.399414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:02.400506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:02.401467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:02.723555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:02.740912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ec3a62dc-5051-480c-aac5-c3f7e151555e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 1.389373 Sep 07 09:56:02.744850 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1267/2602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:01 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:02.761364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:02.761867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:02.767382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:02.774582 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf96d16a-304c-4f38-8639-f1b20e1e5647 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 0.404283 Sep 07 09:56:02.792548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:02.793528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:02.796283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:02.798381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:02.799236 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1336/2603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:02 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:02.803031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:02.803730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:02.809610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-984ee514-c0c8-4fa9-b5d2-6f2b60fd4b58 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1842940>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:02.894907 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-984ee514-c0c8-4fa9-b5d2-6f2b60fd4b58 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.094217 Sep 07 09:56:02.895502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1337/2604] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:02 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:03.272619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:03.289672 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-855bfc21-9c8f-453b-a463-e2bb32d30274 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.542113 Sep 07 09:56:03.291050 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1268/2605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:02 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:03.769770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:03.770543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:03.783018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:03.783428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:03.783867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:03.784589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:03.785050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:03.785510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:03.806689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:03.807303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:03.815891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:03.816387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:03.816859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:03.817586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:03.820782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:03.823410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:04.869737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:04.875921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:04.901121 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-295d8c3a-b22e-4ea4-9606-cce7c65d45f1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 1.098158 Sep 07 09:56:04.904011 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e36ffdae-37d4-409a-8a1b-c180ce0404f5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 1.131824 Sep 07 09:56:04.917440 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1338/2606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:03 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:04.917633 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1269/2607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:03 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:04.919861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6111587c-dabe-44df-8e3b-c8384866f79f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1842dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:04.928100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:04.928729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:04.975953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:04.982346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:04.986321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:04.990367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:04.991263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:04.995112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:05.043739 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6111587c-dabe-44df-8e3b-c8384866f79f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.135181 Sep 07 09:56:05.044538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1339/2608] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:04 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:05.065711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f7471478-60ce-4435-9cde-597b3959cb11 req-26360b8c-c97c-43e2-bfe3-323190e86cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1caf64-97d3-4d37-b66b-4fdc9bff03ab", "name": "network-vif-plugged", "status": "completed", "tag": "ad4cd55f-c2ec-4458-9b22-5d93adec48a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:05.096938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7471478-60ce-4435-9cde-597b3959cb11 req-26360b8c-c97c-43e2-bfe3-323190e86cbb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:05.097978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7471478-60ce-4435-9cde-597b3959cb11 req-26360b8c-c97c-43e2-bfe3-323190e86cbb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:05.098593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7471478-60ce-4435-9cde-597b3959cb11 req-26360b8c-c97c-43e2-bfe3-323190e86cbb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:05.112189 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f7471478-60ce-4435-9cde-597b3959cb11 req-26360b8c-c97c-43e2-bfe3-323190e86cbb service nova] Creating event network-vif-plugged:ad4cd55f-c2ec-4458-9b22-5d93adec48a5 for instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab on n-h1-836830-16 Sep 07 09:56:05.118946 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f7471478-60ce-4435-9cde-597b3959cb11 req-26360b8c-c97c-43e2-bfe3-323190e86cbb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072878 Sep 07 09:56:05.119983 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1340/2609] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:05.933871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:05.934748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:05.957018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:05.957554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:05.958031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:05.965490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:05.967250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:05.969111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:06.345326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:06.361911 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-abfabd5d-daad-48b4-a29c-60f52c6c097b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 1.445775 Sep 07 09:56:06.365450 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1270/2610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:04 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:06.391701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:06.396105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:06.430127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:06.430640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:06.431086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:06.435612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:06.437463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:06.438191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:06.543095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:06.578421 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1484d9b7-a9b7-4939-a5a2-d4528b07871d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1312 microversion: 2.1 time: 0.640904 Sep 07 09:56:06.579245 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1341/2611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:05 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1312 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:06.594425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48fef7ed-6819-47b1-90c1-4b55801afebb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b5def670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:06.692924 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48fef7ed-6819-47b1-90c1-4b55801afebb tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.102850 Sep 07 09:56:06.693558 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1342/2612] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:06 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:07.011155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:07.020776 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb0793a5-e43d-447b-8eb7-41bdbb7f731f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 0.654171 Sep 07 09:56:07.027655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1271/2613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:06 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:07.388085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:07.402564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:07.441305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:07.450345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:07.451306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:07.453379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:07.454373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:07.455298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:07.504518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-75da3f70-eccf-443f-8c30-4bc0ffa92477 req-2b27ae49-7197-43c3-9baa-519f11063b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe8ffa-af59-455c-9957-e6d062c247a5", "name": "network-vif-plugged", "status": "completed", "tag": "4806ee61-974e-4ebf-b038-bd901d1298e5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:07.532739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-75da3f70-eccf-443f-8c30-4bc0ffa92477 req-2b27ae49-7197-43c3-9baa-519f11063b25 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:07.548090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-75da3f70-eccf-443f-8c30-4bc0ffa92477 req-2b27ae49-7197-43c3-9baa-519f11063b25 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:07.548915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-75da3f70-eccf-443f-8c30-4bc0ffa92477 req-2b27ae49-7197-43c3-9baa-519f11063b25 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:07.595766 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-75da3f70-eccf-443f-8c30-4bc0ffa92477 req-2b27ae49-7197-43c3-9baa-519f11063b25 service nova] Creating event network-vif-plugged:4806ee61-974e-4ebf-b038-bd901d1298e5 for instance b9fe8ffa-af59-455c-9957-e6d062c247a5 on n-h2-836830-16 Sep 07 09:56:07.621634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-75da3f70-eccf-443f-8c30-4bc0ffa92477 req-2b27ae49-7197-43c3-9baa-519f11063b25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119239 Sep 07 09:56:07.626030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1272/2614] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:56:07.631865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:07.648076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:07.680387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:07.681392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:07.684547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:07.688701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:07.689510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:07.693000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:08.082095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:08.086079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:08.109483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1dac2e7e-5f45-440f-b1aa-f7501df4fd68 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1462 microversion: 2.1 time: 0.480550 Sep 07 09:56:08.112260 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1273/2615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:07 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1462 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:08.123655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84df73a9-5c2c-499f-ae0c-83fc05c99d47 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b116c5e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:08.127719 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d051495-0c5b-460b-acdf-3df57d905d50 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.725628 Sep 07 09:56:08.128822 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1343/2616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:07 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:08.148757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:08.150540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:08.204125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:08.207506 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84df73a9-5c2c-499f-ae0c-83fc05c99d47 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.092811 Sep 07 09:56:08.208146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:08.208774 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1274/2617] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:08 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:08.211398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:08.212453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:08.215650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:08.224271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:08.231815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:08.233288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:08.243218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:08.243715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:08.244144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:08.245026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:08.245672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:08.246276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:08.859693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:08.890741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Old instance type m1.heat2, new instance type m1.heat {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 09:56:08.923030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:56:08.942083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:56:08.942707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:56:08.943124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:56:08.943540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:56:09.151639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:09.164309 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-640635bc-18d8-4de0-80e4-0eb5595efef4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1315 microversion: 2.1 time: 1.027907 Sep 07 09:56:09.167400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1344/2618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:08 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:09.176092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:09.182798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:09.204456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:09.205266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:09.213481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:09.214809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:09.219632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:09.220332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:09.233412 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-44b344b7-2576-475e-bb33-3391c068e727 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab/action" status: 202 len: 0 microversion: 2.1 time: 1.022278 Sep 07 09:56:09.234809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1275/2619] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:08 2022] POST /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab/action => generated 0 bytes in 1025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:56:09.240403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-309243c6-63d8-4b8f-b633-3727936a8fcd tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1171670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:09.385147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-309243c6-63d8-4b8f-b633-3727936a8fcd tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.148894 Sep 07 09:56:09.387037 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1276/2620] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:09 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:09.406973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:09.411015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:09.424359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:09.426862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:09.427424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:09.428787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:09.430308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:09.430976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:09.716290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:09.754430 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a5813cb2-280f-46d1-a8ae-463eecac6bba tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.585660 Sep 07 09:56:09.757738 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1345/2621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:09 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:09.927585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:09.942248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5bcd1e06-ee1c-4843-a641-f0fbb1277ff1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1471 microversion: 2.1 time: 0.553908 Sep 07 09:56:09.943387 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1277/2622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:09 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:10.190427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:10.192938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:10.208451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:10.210398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:10.217385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:10.221244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:10.222715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:10.223811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:10.404552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38ebb091-78d4-4615-b95e-ca9514591425 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b22c6e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:10.482603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38ebb091-78d4-4615-b95e-ca9514591425 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.083125 Sep 07 09:56:10.490819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1278/2623] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:10 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:10.581745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:10.590523 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c5cff37a-6d71-4126-b74f-8e9875315b58 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1502 microversion: 2.1 time: 0.404104 Sep 07 09:56:10.591985 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1346/2624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:10 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:10.619089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98a8b032-7422-4dfc-992b-e507ede153e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:10.643261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98a8b032-7422-4dfc-992b-e507ede153e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:10.644184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98a8b032-7422-4dfc-992b-e507ede153e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:10.675619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98a8b032-7422-4dfc-992b-e507ede153e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:10.787327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:10.788015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:10.798507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:10.799213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:10.802032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:10.803146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:10.805094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:10.806381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:10.846658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98a8b032-7422-4dfc-992b-e507ede153e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Going to try to stop instance {{(pid=128832) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 09:56:11.024187 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98a8b032-7422-4dfc-992b-e507ede153e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5/action" status: 202 len: 0 microversion: 2.1 time: 0.407661 Sep 07 09:56:11.039649 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1279/2625] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:10 2022] POST /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:56:11.075769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:11.076969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:11.106024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:11.106555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:11.107005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:11.111484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:11.116113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:11.116570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:11.408221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:11.419871 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aa2fb944-46b5-4549-bdfc-9553a4174c2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.636645 Sep 07 09:56:11.423071 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1347/2626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:10 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:11.432530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:11.435265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:11.454165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:11.454609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:11.455059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:11.455772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:11.459445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:11.460217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:11.472642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:11.486020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5441202-af44-4b71-bf07-7c238e2eae8c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1471 microversion: 2.1 time: 0.445023 Sep 07 09:56:11.505231 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1280/2627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:11 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1471 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:11.505231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1e7dc57-76ba-4ab6-8354-f572ca66c5e7 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b116c280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:11.606978 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1e7dc57-76ba-4ab6-8354-f572ca66c5e7 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1424 microversion: 2.1 time: 0.107806 Sep 07 09:56:11.609998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1281/2628] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:11 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:11.805121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:11.813264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:11.819074 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c57b1a4-25c8-4322-9995-3bfee09d2807 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.394736 Sep 07 09:56:11.822947 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1348/2629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:11 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:12.449731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:12.450361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:12.479231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:12.479730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:12.480172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:12.480883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:12.481377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:12.494398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:12.519255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:12.520533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:12.540481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:12.543342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:12.543812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:12.549290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:12.555097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:12.555595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:12.916721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:12.919585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:12.928667 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c1397c7-788c-41e5-842a-12e57aca96a6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1471 microversion: 2.1 time: 0.416781 Sep 07 09:56:12.929895 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1349/2630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:12 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:12.930518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5fc1fa74-bb8b-4e5d-bc8c-56f5224dbc2e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.485157 Sep 07 09:56:12.935049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb1a8754-360e-45a2-b74b-78aefd6a03ec tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b5dc5c10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:12.942541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1282/2631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:12 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:12.949981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:12.950830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:12.958322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:12.959269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:12.959911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:12.960955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:12.961703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:12.962313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:13.311676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:13.326047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f945101-f815-46ee-b799-310fd1e8a03a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.381972 Sep 07 09:56:13.327017 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1283/2632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:12 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:13.956608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:13.958409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:13.978639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:13.987912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:13.997102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:13.997830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:14.002448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:14.004530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:14.008950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:14.826006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:14.840545 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84fdb270-eff6-4367-98c3-a673ad0adaa3 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.888372 Sep 07 09:56:14.845297 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1284/2633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:13 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:14.859485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:14.860110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:14.901276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:14.901276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:14.901276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:14.901276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:14.901276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:14.901276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:15.840324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:15.849564 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de1c5ac6-9eb8-4d52-bac5-ee48ad634a64 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1471 microversion: 2.1 time: 1.003079 Sep 07 09:56:15.855310 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1285/2634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:14 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1471 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:15.869389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:15.873283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:15.894540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:15.895461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:15.896103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:15.897030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:15.897721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:15.898497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:15.927742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:17.705843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:17.724857 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d1711d7-8ef7-4806-a892-8a9403befe3d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 1.867803 Sep 07 09:56:17.726083 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1286/2635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:15 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:17.733072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:17.735026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:17.743947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:17.744848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:17.745542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:17.746544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:17.747215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:17.748702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:18.234228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:18.267478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6bf08bee-8a38-40ff-9e42-0eef35120a2b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.538254 Sep 07 09:56:18.269724 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1287/2636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:17 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:18.288325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:18.312406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:18.321561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:18.322309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:18.335687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:18.336824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:18.337496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:18.338158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:18.910628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:18.925162 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3bec05e1-515a-4d92-8e7e-416c53565a72 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.652639 Sep 07 09:56:18.925791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1288/2637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:18 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:18.949366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:18.950144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:18.966480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:18.967028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:18.967570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:18.979231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:18.979991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:18.980450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:19.205817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'services' on Instance uuid 35a9cd8e-0a42-4622-9b8d-885638580dbf {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:56:19.401436 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de097020-271d-425c-a99e-8dfc4c0db1cc tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments/46f1572c-0137-484a-b78d-69550c5b388a" status: 202 len: 0 microversion: 2.1 time: 0.474354 Sep 07 09:56:19.402699 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1289/2638] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 09:56:18 2022] DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments/46f1572c-0137-484a-b78d-69550c5b388a => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:56:19.430138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:19.431744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:19.455249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:19.456810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:19.458334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:19.459697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:19.460334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:19.460919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:20.083135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:20.112160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e88daba0-c4bc-4610-a293-f111741aebe6 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.707970 Sep 07 09:56:20.115062 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1290/2639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:19 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:20.298395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1476d209-39a5-4cf4-a35c-9122781b1536 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Action: 'create', calling method: .version_select at 0x7f14b1bedc10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:20.384070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1476d209-39a5-4cf4-a35c-9122781b1536 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Getting quotas for project 4b66fd9d86e941c6a764dade5bb3a57b. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:56:20.391376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1476d209-39a5-4cf4-a35c-9122781b1536 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Getting quotas for user dda5d34e31fa4dadb583f3212187af04 and project 4b66fd9d86e941c6a764dade5bb3a57b. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:56:20.474610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1476d209-39a5-4cf4-a35c-9122781b1536 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Getting quotas for project 4b66fd9d86e941c6a764dade5bb3a57b. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:56:20.530678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1476d209-39a5-4cf4-a35c-9122781b1536 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Getting quotas for user dda5d34e31fa4dadb583f3212187af04 and project 4b66fd9d86e941c6a764dade5bb3a57b. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:56:20.567426 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1476d209-39a5-4cf4-a35c-9122781b1536 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.445086 Sep 07 09:56:20.571303 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1291/2640] 10.222.0.60 () {62 vars in 1214 bytes} [Wed Sep 7 09:56:20 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:56:20.580239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:20.583643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:20.603392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:20.603898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:20.604347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:20.611831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:20.612334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:20.612781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:21.123330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:21.142377 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e8a2dad-cbbe-4d56-b543-349677be7699 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.569503 Sep 07 09:56:21.143432 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1292/2641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:20 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:21.154577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:21.158942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:21.167236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:21.168698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:21.169868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:21.171224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:21.172061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:21.172719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:21.240496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-577fa934-8d42-405a-9393-340b7f462ad9 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095568 Sep 07 09:56:21.242218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1293/2642] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:21 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:21.254653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:21.256856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:21.268943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:21.269729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:21.270405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:21.271344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:21.272152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:21.273131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:21.506587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:21.521779 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38f18500-ed52-4d73-89c8-58f13a93db70 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.276004 Sep 07 09:56:21.524158 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1294/2643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:21 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:21.538575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f0df91e-7614-4bce-b51a-f1f85abe927a tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:21.626215 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f0df91e-7614-4bce-b51a-f1f85abe927a tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.087494 Sep 07 09:56:21.626215 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1295/2644] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 7 09:56:21 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:56:21.646408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:21.647046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:21.673075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:21.676245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:21.678599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:21.683530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:21.684131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:21.686632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:22.303906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:22.318926 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe508350-4cf3-4bb8-8ae4-f52b2e9b2370 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.697608 Sep 07 09:56:22.320999 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1296/2645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:21 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:22.332904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab9be768-41db-434d-b5ba-24afcab682eb tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:22.374290 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab9be768-41db-434d-b5ba-24afcab682eb tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7" status: 200 len: 235 microversion: 2.64 time: 0.045074 Sep 07 09:56:22.374778 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1297/2646] 10.222.0.60 () {60 vars in 1304 bytes} [Wed Sep 7 09:56:22 2022] GET /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7 => generated 235 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:56:22.388446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:22.392183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:22.418094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:22.419547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:22.423936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:22.428485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:22.429368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:22.430052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:22.538673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:22.927462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:23.696447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:23.699316 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb1a8754-360e-45a2-b74b-78aefd6a03ec tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1433 microversion: 2.1 time: 10.766833 Sep 07 09:56:23.709054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1350/2647] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:12 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1433 bytes in 10776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:23.715785 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-90b20882-5a63-49ec-96a7-fe35af26d82c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 1.337744 Sep 07 09:56:23.716373 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1298/2648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:22 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:23.727167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ad9823b-850c-4df2-8a20-e9205b8a05e2 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:23.729110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:23.731567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:23.745462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:23.746810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:23.747441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:23.748340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:23.749037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:23.749925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:23.794881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ad9823b-850c-4df2-8a20-e9205b8a05e2 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7" status: 204 len: 0 microversion: 2.64 time: 0.077421 Sep 07 09:56:23.796814 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1299/2649] 10.222.0.60 () {60 vars in 1307 bytes} [Wed Sep 7 09:56:23 2022] DELETE /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:56:23.804671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:23.805333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:23.826460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:23.827512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:23.827964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:23.828685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:23.829146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:23.835542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:23.876233 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d09a46f-ed05-4504-aaac-e5cc718ae8ac tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164928 Sep 07 09:56:23.876855 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1351/2650] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:23 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:23.911449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:23.912271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:23.958898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:23.961019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:23.961719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:23.965353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:23.966042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:23.968836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:24.930039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:24.947347 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1a03fe1-0a34-48bd-ad7b-e7d9f52f74f7 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 1.148279 Sep 07 09:56:24.949933 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1300/2651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:23 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:24.973946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:24.982482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09cc8581-3bba-423a-9063-5299c681e21d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1c35e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:24.984147 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89a6f912-e9da-4b02-bbe5-56fb46e7e8e4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 1.097557 Sep 07 09:56:24.985009 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1352/2652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:23 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:25.002697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-537f0c38-fcc0-4776-890a-bd895f4d4182 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.012657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-537f0c38-fcc0-4776-890a-bd895f4d4182 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] HTTP exception thrown: Instance group 0d5a8a26-1896-456e-91ff-df4cdaf837c7 could not be found. Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-537f0c38-fcc0-4776-890a-bd895f4d4182 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Request method failure captured: Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7 HTTP/1.1 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGrCDeIY-FZ1apKMBsY28cKSV6RjPGOYfISCbvuy1sd67g1WA8Ut1BTbxjDSevSXKc5H_VamDbgk6grA-0dOD2ywqqgv5gA08L8gWvMJE5WOoZFQrg72YEryEHoLcOCHNSLb4UMdaZd8PzSVHrsv4CImUwYWn6yxhcdhtNpxFkZsg5s Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.64 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 4b66fd9d86e941c6a764dade5bb3a57b Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerGroup264TestJSON-1099030459 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4b66fd9d86e941c6a764dade5bb3a57b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4b66fd9d86e941c6a764dade5bb3a57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4b66fd9d86e941c6a764dade5bb3a57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4b66fd9d86e941c6a764dade5bb3a57b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerGroup264TestJSON-1099030459 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 4b66fd9d86e941c6a764dade5bb3a57b Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1099030459 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerGroup264TestJSON-1099030459-project Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: dda5d34e31fa4dadb583f3212187af04 Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerGroup264TestJSON-1099030459-project Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance group 0d5a8a26-1896-456e-91ff-df4cdaf837c7 could not be found. Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '0d5a8a26-1896-456e-91ff-df4cdaf837c7'} Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0d5a8a26-1896-456e-91ff-df4cdaf837c7 could not be found. Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0d5a8a26-1896-456e-91ff-df4cdaf837c7 could not be found. Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:25.028775 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0d5a8a26-1896-456e-91ff-df4cdaf837c7 could not be found. Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-537f0c38-fcc0-4776-890a-bd895f4d4182 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] Returning 404 to user: Instance group 0d5a8a26-1896-456e-91ff-df4cdaf837c7 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:25.034758 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-537f0c38-fcc0-4776-890a-bd895f4d4182 tempest-ServerGroup264TestJSON-1099030459 tempest-ServerGroup264TestJSON-1099030459-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7" status: 404 len: 117 microversion: 2.64 time: 0.044318 Sep 07 09:56:25.035973 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1353/2653] 10.222.0.60 () {60 vars in 1307 bytes} [Wed Sep 7 09:56:24 2022] DELETE /compute/v2.1/os-server-groups/0d5a8a26-1896-456e-91ff-df4cdaf837c7 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:56:25.040932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.042434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:25.052835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.053236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.053672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.054736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.055496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.055966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.090362 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09cc8581-3bba-423a-9063-5299c681e21d tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 200 len: 1433 microversion: 2.1 time: 0.125871 Sep 07 09:56:25.100430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1301/2654] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:24 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 1433 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:25.100430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.100430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:25.108676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.109490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.110418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.111225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.111802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.112339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.228277 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1c05cb1-f26c-4554-b343-0c3e7cf0fb53 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134069 Sep 07 09:56:25.232035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1302/2655] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:25 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:25.271550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.275704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:25.307234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.316183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.317324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.321669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.327733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.329931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.615193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:25.632120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f8ee038b-ca5c-4bea-a79b-50979aaabb31 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.595580 Sep 07 09:56:25.633075 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1354/2656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:25 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:25.726450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:25.744063 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-17bae767-efaa-4fa8-95f0-ac9b122ce1ae tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1466 microversion: 2.1 time: 0.506682 Sep 07 09:56:25.747825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1303/2657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:25 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1466 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:25.771386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-787bc3cc-52e6-47b8-a9a6-838762baba7e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b5ff80d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.889037 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-787bc3cc-52e6-47b8-a9a6-838762baba7e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/8aa3194e-7f8e-4ddc-8419-88dfe300e0f7" status: 200 len: 784 microversion: 2.1 time: 0.121633 Sep 07 09:56:25.891012 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1355/2658] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:25 2022] GET /compute/v2.1/images/8aa3194e-7f8e-4ddc-8419-88dfe300e0f7 => generated 784 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:25.904968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41e75104-a4f9-47dd-9932-19f7c43aef8a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.919037 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41e75104-a4f9-47dd-9932-19f7c43aef8a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017839 Sep 07 09:56:25.920230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1304/2659] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:56:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:25.933079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-314bfc7e-cf10-48c0-8941-6af4c7f8899e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b180b4c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.975776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:25.976681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:25.985193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.994508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:25.994991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:25.996108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:25.998569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:26.003690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:26.288530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:26.308860 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6ae6f44-f06d-4c47-9610-89be63eea084 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.336699 Sep 07 09:56:26.309548 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1305/2660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:25 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:26.808027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:26.808869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:26.817169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:26.824346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:26.824873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:26.825564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:26.826016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:26.826445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.163075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:27.176925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a5b0e14-9ff1-4bda-959d-6f025122637b tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.862015 Sep 07 09:56:27.177515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1306/2661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:26 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:27.187974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:27.203008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:27.237363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.237860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.238304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.240909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.241445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.241934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.302948 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-314bfc7e-cf10-48c0-8941-6af4c7f8899e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "DELETE /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 204 len: 0 microversion: 2.1 time: 1.373560 Sep 07 09:56:27.309094 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1356/2662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:25 2022] DELETE /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 0 bytes in 1376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:56:27.316520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:27.317389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:27.336150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.338435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.340247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.343147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.344181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.345713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.349385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f0b9e53-486e-4ac6-8cb1-73141952e9b1 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167863 Sep 07 09:56:27.350976 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1307/2663] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:27 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:27.363987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-921b4abd-d634-4d4e-b09f-f95675310d45 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b11721f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:27.397142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-921b4abd-d634-4d4e-b09f-f95675310d45 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] HTTP exception thrown: Image not found. Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-921b4abd-d634-4d4e-b09f-f95675310d45 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Request method failure captured: Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e HTTP/1.1 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGqHiITbQs_ZPFHa5jbsCiNGw81Hp3UF0zVNC65x-zq64lllXqkqxxYESMNAymG9p454aIoAbYspcxMtRftGIa2GDqMfhjPIEaoU-tATHM9-_Kfwl6WpSF4VQ2BJ8hWH2DonCMGasoiQrXrERqeiJ2JaECdgjDFdb3aQGFP33T_t7l0 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d26be1ae8f8d45e28ae37c07670deb86 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d26be1ae8f8d45e28ae37c07670deb86", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d26be1ae8f8d45e28ae37c07670deb86 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerTestJSON-1089448778-project Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 52661062c37f426984b4a0ad2ba02d3f Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerTestJSON-1089448778-project Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e'} Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 09:56:27.399669 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e could not be found. Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:56:27.404317 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:27.410416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-921b4abd-d634-4d4e-b09f-f95675310d45 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:27.412634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-921b4abd-d634-4d4e-b09f-f95675310d45 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 404 len: 62 microversion: 2.1 time: 0.059678 Sep 07 09:56:27.413662 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1308/2664] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:27 2022] GET /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:56:27.435477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:27.437051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:27.453709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.454957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.456490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.458594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.460245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.461812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.495210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:27.770091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:27.786095 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2476a31-ece3-40da-a37b-1faa41925fd6 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1485 microversion: 2.1 time: 0.474806 Sep 07 09:56:27.796242 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1357/2665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:27 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1485 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:27.829899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1190198872"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:27.838264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:27.838937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:27.847039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.848249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.849334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.850258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.851086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.851668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.856938 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8a7baf7-af8e-4724-ae03-195a5ad6ac1c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.441754 Sep 07 09:56:27.859042 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1309/2666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:27 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:27.865032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-84127600-4950-4189-bbbb-e670cb9eac94 req-56ae0f13-697a-4348-9a99-dad3bd5e7076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "name": "network-vif-unplugged", "status": "completed", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:27.885907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-84127600-4950-4189-bbbb-e670cb9eac94 req-56ae0f13-697a-4348-9a99-dad3bd5e7076 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.890796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-84127600-4950-4189-bbbb-e670cb9eac94 req-56ae0f13-697a-4348-9a99-dad3bd5e7076 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.891355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-84127600-4950-4189-bbbb-e670cb9eac94 req-56ae0f13-697a-4348-9a99-dad3bd5e7076 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.919808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-84127600-4950-4189-bbbb-e670cb9eac94 req-56ae0f13-697a-4348-9a99-dad3bd5e7076 service nova] Creating event network-vif-unplugged:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:56:27.932748 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-84127600-4950-4189-bbbb-e670cb9eac94 req-56ae0f13-697a-4348-9a99-dad3bd5e7076 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072406 Sep 07 09:56:27.934734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1310/2667] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:27.943545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:27.952437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:27.965275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.969738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.970374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:27.971288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:27.972158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:27.978375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.154113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b631f0e-fa1a-4bec-bd57-35dafa43dd0e tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "POST /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3/action" status: 202 len: 0 microversion: 2.1 time: 0.214445 Sep 07 09:56:28.160265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1311/2668] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:27 2022] POST /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:56:28.187514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:28.190431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:28.198584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.199409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.200195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.201307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.202549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.203622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.351177 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a25c0222-efd7-4ec5-b165-63b27eb1b21e tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "POST /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f/action" status: 202 len: 0 microversion: 2.1 time: 0.552446 Sep 07 09:56:28.353241 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1358/2669] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:27 2022] POST /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 09:56:28.386984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:28.392033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:28.419587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.422622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.423190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.424193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.433970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.435438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.475523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:28.488375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28978423-3cbe-4248-a91e-a8145c675f7d tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1493 microversion: 2.1 time: 0.315750 Sep 07 09:56:28.490703 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1312/2670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:28 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1493 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:28.505805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:28.510069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:28.522393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.522898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.523331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.524046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.524506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.527159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.578590 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21625876-53e5-4406-91ef-c6a0609910fa tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086020 Sep 07 09:56:28.580207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1313/2671] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:28 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:28.588873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3d88fda-c59c-462a-80f8-7d4629033703 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1172040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:28.660664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3d88fda-c59c-462a-80f8-7d4629033703 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.078483 Sep 07 09:56:28.662220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1314/2672] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:28 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:28.815934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:28.829049 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c654fb9b-12cd-4334-8914-e389c801dcf0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.471688 Sep 07 09:56:28.830695 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1359/2673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:28 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:28.885751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:28.886841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:28.895421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.896140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.896760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:28.897920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:28.898794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:28.899721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.215897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:29.228073 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f4ec753-a206-4f17-841e-a638c8ad8008 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.346266 Sep 07 09:56:29.233683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1315/2674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:28 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:29.519981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:29.522299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:29.537672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:29.538378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:29.539001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.540036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:29.540646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:29.541362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.591898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:29.595040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:29.622293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:29.625857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:29.626854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.627604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:29.635478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:29.636390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.682782 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e66f5970-84fd-4e33-b716-b41a6cb02c78 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094868 Sep 07 09:56:29.688359 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1316/2675] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:29 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:29.704856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46aa44d8-c89f-4ae5-b2cd-31d05f957018 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1081310>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:29.768887 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46aa44d8-c89f-4ae5-b2cd-31d05f957018 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.078535 Sep 07 09:56:29.770862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1317/2676] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:29 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:29.855031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:29.857315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:29.859169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:29.869867 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0d6e4c99-5a0c-4680-8168-2f3c994315f9 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1493 microversion: 2.1 time: 0.357292 Sep 07 09:56:29.870820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:29.871314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:29.872717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.873464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:29.874298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:29.874720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:29.888111 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1360/2677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:29 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1493 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:30.138955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:30.151273 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e986d29-f055-4180-a3da-13296dfa930d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.297869 Sep 07 09:56:30.156689 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1318/2678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:29 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:30.262841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:30.263477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:30.278336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.278840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.279286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.280365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.281270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.281865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.496360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:30.508366 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4ce2ff8-9011-471f-8f90-b712a796d2ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.250825 Sep 07 09:56:30.508961 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1361/2679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:30 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:30.695001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:30.697555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:30.706850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:30.708436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.709074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.709586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.710172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.710632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.711246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.771472 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-066ac1de-6e66-4a13-9b7c-27f76720e7f8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080403 Sep 07 09:56:30.772263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1319/2680] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 09:56:30 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:56:30.785805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac731386-9e7c-451d-a6df-40d0f1599a4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b180b9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:30.877335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:30.881495 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac731386-9e7c-451d-a6df-40d0f1599a4f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.101448 Sep 07 09:56:30.884348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:30.886540 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1362/2681] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:30 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:30.892212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.892717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.893160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.898385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:30.898992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:30.902039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.904786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.907206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.914875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.915612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.916689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:30.922495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:30.922988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:30.924054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.010566 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Cannot 'reboot' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action HTTP/1.1 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 28 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: {"reboot": {"type": "HARD"}} Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'reboot' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2a95ceab-b418-4e73-b1d1-7a8cc9b2d435', 'body': {'reboot': {'type': 'HARD'}}} Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:56:31.018603 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.022471 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.026622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 409 to user: Cannot 'reboot' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:31.030835 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-294be39c-262f-4ffb-a794-8aa057139805 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action" status: 409 len: 145 microversion: 2.1 time: 0.158498 Sep 07 09:56:31.036978 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1320/2682] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:30 2022] POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action => generated 145 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:56:31.063947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:31.071760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:31.089710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.090257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.090717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.091720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.092193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.093284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.162113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Cannot 'rebuild' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action HTTP/1.1 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 65 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'rebuild' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2a95ceab-b418-4e73-b1d1-7a8cc9b2d435', 'body': {'rebuild': {'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7'}}} Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:56:31.163919 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:31.167756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 409 to user: Cannot 'rebuild' instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 while it is in vm_state rescued {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:31.170739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd9946ac-7fcd-423f-8cbb-9d3764cf4e7a tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action" status: 409 len: 146 microversion: 2.1 time: 0.127131 Sep 07 09:56:31.171933 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1321/2683] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:31 2022] POST /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435/action => generated 146 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:56:31.194831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:31.197949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:31.212558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:31.216990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.218444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.219501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.222570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.233964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.234696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.335079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:31.347099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc9e7c6c-931f-4ff2-8c2c-89905bc0d008 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1493 microversion: 2.1 time: 0.452415 Sep 07 09:56:31.350964 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1363/2684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:30 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1493 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:31.367494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:31.368433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:31.380658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.381166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.381640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.382357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.382828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.383260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.458690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:56:31.601918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:31.621899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-69222a37-01b6-4b6a-add4-9b77630e09a9 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.445785 Sep 07 09:56:31.623014 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1322/2685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:31 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:31.631837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:31.633478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:31.660723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.661890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.664674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.667333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.667953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.668365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3a20f5d5-c049-4833-8342-eb6bbe900a92 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 204 len: 0 microversion: 2.1 time: 0.308975 Sep 07 09:56:31.669121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.669445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1364/2686] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:56:31 2022] DELETE /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:56:31.686452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:31.687518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:31.696850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.696850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.699869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:31.701040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:31.702167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:31.702167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:32.187287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:32.204018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:32.214039 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-553e9231-748e-4bcb-af36-e482a9a7ff67 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.574058 Sep 07 09:56:32.220223 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-592181a3-bdac-4c8b-a323-bfa6351a5bec tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1688 microversion: 2.1 time: 0.545719 Sep 07 09:56:32.221278 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1323/2687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:31 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:32.224759 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1365/2688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:31 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1688 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:32.229207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-221cbea2-25fc-40d3-921d-ce8d03fc75ff tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b104be50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:32.291983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-221cbea2-25fc-40d3-921d-ce8d03fc75ff tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.068203 Sep 07 09:56:32.293999 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1324/2689] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:32 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:32.376556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:32.377450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:32.385936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:32.389666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:32.390322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:32.392942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:32.394051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:32.394862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:32.645012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:32.645801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:32.656247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:32.656755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:32.659455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:32.660614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:32.661292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:32.668133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:33.139688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:33.186045 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-841b795e-3cda-4660-ac3f-b77981101515 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1493 microversion: 2.1 time: 0.812143 Sep 07 09:56:33.206159 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1366/2690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:32 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1493 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:33.267654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:33.268472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:33.272994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:33.284158 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-445f6aa5-3288-4de8-956d-6da87d19d0c5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.642904 Sep 07 09:56:33.300376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:33.300376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:33.300376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:33.300376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:33.300692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:33.300962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:33.308114 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1325/2691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:32 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:33.315000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:33.315889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:33.339910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:33.340783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:33.341515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:33.343046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:33.353959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:33.354805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:33.739597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:33.747515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03e8ad16-3326-450a-89e2-a38b39482ec8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1688 microversion: 2.1 time: 0.438025 Sep 07 09:56:33.753879 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1326/2692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:33 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1688 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:33.759097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-51ef23c7-e657-405d-b1f9-00b3a7d92c81 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b0fe5e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:33.837762 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-51ef23c7-e657-405d-b1f9-00b3a7d92c81 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.082323 Sep 07 09:56:33.838716 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1327/2693] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:33 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:33.895095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:33.915155 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7489e8fb-b342-4924-a270-faa545a69c6e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.674638 Sep 07 09:56:33.917838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1367/2694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:33 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:33.969633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9abc550e-7f6a-4805-a03f-9c7d9511de3d req-50918e9e-373f-4cfe-8ef0-5ad7c34bf765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "name": "network-vif-plugged", "status": "completed", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:33.994623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9abc550e-7f6a-4805-a03f-9c7d9511de3d req-50918e9e-373f-4cfe-8ef0-5ad7c34bf765 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:34.002164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9abc550e-7f6a-4805-a03f-9c7d9511de3d req-50918e9e-373f-4cfe-8ef0-5ad7c34bf765 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:34.002959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9abc550e-7f6a-4805-a03f-9c7d9511de3d req-50918e9e-373f-4cfe-8ef0-5ad7c34bf765 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:34.036674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9abc550e-7f6a-4805-a03f-9c7d9511de3d req-50918e9e-373f-4cfe-8ef0-5ad7c34bf765 service nova] Creating event network-vif-plugged:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:56:34.048833 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9abc550e-7f6a-4805-a03f-9c7d9511de3d req-50918e9e-373f-4cfe-8ef0-5ad7c34bf765 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084369 Sep 07 09:56:34.051056 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1328/2695] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:34.221342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:34.222600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:34.246618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:34.247223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:34.253135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:34.263493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:34.264029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:34.265065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:34.337130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:34.338608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:34.348905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:34.350195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:34.350871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:34.351803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:34.352759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:34.353482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:34.379032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:35.043957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:35.056295 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ddcd4eca-3558-4287-aa7f-3c78de72d87c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.723850 Sep 07 09:56:35.074155 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1329/2696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:34 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:35.074155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:35.074155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:35.110761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:35.113056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:35.114153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:35.115035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:35.115823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:35.116492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:35.121057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:35.131681 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08731094-909f-4d43-bd1f-dc287de54c98 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1493 microversion: 2.1 time: 0.916258 Sep 07 09:56:35.162475 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1368/2697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:34 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1493 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:35.170089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9a9bd5d-4500-4763-8346-54f869b1e8b0 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b5dc55e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:35.255057 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9a9bd5d-4500-4763-8346-54f869b1e8b0 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.091089 Sep 07 09:56:35.256516 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1369/2698] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:35 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:35.271736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:35.278089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:35.295484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:35.298637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:35.300977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:35.303530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:35.304237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:35.305474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:35.730207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:35.747682 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-66192649-1629-40e7-89d1-e4e4fd716550 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1688 microversion: 2.1 time: 0.681252 Sep 07 09:56:35.748700 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1330/2699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:35 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1688 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:35.886304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:35.902048 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a25bc0f6-6525-4943-a351-2d5101a983b9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.641150 Sep 07 09:56:35.903418 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1370/2700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:35 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:36.083695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:36.087325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:36.109613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.120740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.125289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.130484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.131027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.137426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.162188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:36.163185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:36.174582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.175006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:36.175841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.181915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.182679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.183153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.183679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.798564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:36.808365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a5ce585e-3a04-447e-b251-537ef20ef3a7 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1499 microversion: 2.1 time: 0.651923 Sep 07 09:56:36.814231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1371/2701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:36 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1499 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:36.819880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:36.834236 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a1281ae-32e2-4956-aa96-d4a0660ca259 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.754415 Sep 07 09:56:36.845817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4e5f586-be10-4e8d-a645-792e3dfee801 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1afbca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:36.852062 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1331/2702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:36 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:36.864480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:36.871435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:36.888141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.888651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.889097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.910379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.910887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.911332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.943006 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4e5f586-be10-4e8d-a645-792e3dfee801 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 0.127335 Sep 07 09:56:36.943932 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1372/2703] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:36 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:36.955253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:36.962096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:36.979002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.981930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.983839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:36.987005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:36.989259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:36.996703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:37.106606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:56:37.228599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:37.246533 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85ed9669-d04f-4372-8071-1d73e5fbdf01 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1688 microversion: 2.1 time: 0.391840 Sep 07 09:56:37.247248 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1332/2704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:36 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1688 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:37.258547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:37.261696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:37.279246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:37.281901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:37.283145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:37.284881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:37.292766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:37.295120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:37.382072 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5f26083-7f43-42f6-8f58-a57c2054b48c tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 204 len: 0 microversion: 2.1 time: 0.435088 Sep 07 09:56:37.388895 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1373/2705] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:56:36 2022] DELETE /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:56:37.403913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:37.406122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:37.441417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:37.452662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:37.455906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:37.456926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:37.458609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:37.460649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:38.412478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:38.422654 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5112fea7-7559-42e5-af97-a1189d3a14ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 1.173391 Sep 07 09:56:38.427612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:38.430819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1333/2706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:37 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:38.448141 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9caf2ab-2a9f-4828-8f15-363309effa6b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 1.053013 Sep 07 09:56:38.449725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1374/2707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:37 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:38.452610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:38.458886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:38.487720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:38.488672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f1bf675-a7e1-4639-890f-c984ca925272 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b5debee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:38.490142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:38.490832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:38.491774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:38.495897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:38.496679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:38.844886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:38.864845 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9bd7b4ea-81bf-449c-97ee-03fd36d2e426 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1512 microversion: 2.1 time: 0.432759 Sep 07 09:56:38.885488 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1334/2708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:38 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:38.902291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:38.908120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:38.931792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:38.932663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:38.934390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:38.940196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:38.942743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:38.945145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:39.364576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:39.374329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bbc3c1db-a7b2-4831-aad7-f49f362c7833 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1688 microversion: 2.1 time: 0.485873 Sep 07 09:56:39.374899 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1335/2709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:38 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1688 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:39.463352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:39.464049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:39.477685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:39.479022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:39.479629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:39.480686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:39.481382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:39.481971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:39.816518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:39.827792 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba38ab42-17a0-4765-a168-6f3525a7555d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.373223 Sep 07 09:56:39.829523 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1336/2710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:39 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:39.840600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:39.841259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:39.862343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:39.863548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:39.864904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:39.867446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:39.869843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:39.870609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:40.362829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:40.371030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f7cdbf48-248e-4614-8cfc-7956ec02bf9f tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1505 microversion: 2.1 time: 0.540443 Sep 07 09:56:40.377533 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1337/2711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:39 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:40.392790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-00a38199-11c3-4ea8-8e6c-ab693f7bd857 req-f7991331-a1ed-426b-afc5-9cf6c58f947f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a9cd8e-0a42-4622-9b8d-885638580dbf", "name": "network-vif-deleted", "tag": "e95a1e84-34bf-408e-a698-11c49deef067"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:40.410383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00a38199-11c3-4ea8-8e6c-ab693f7bd857 req-f7991331-a1ed-426b-afc5-9cf6c58f947f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:40.411155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00a38199-11c3-4ea8-8e6c-ab693f7bd857 req-f7991331-a1ed-426b-afc5-9cf6c58f947f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:40.411792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00a38199-11c3-4ea8-8e6c-ab693f7bd857 req-f7991331-a1ed-426b-afc5-9cf6c58f947f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:40.445787 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-00a38199-11c3-4ea8-8e6c-ab693f7bd857 req-f7991331-a1ed-426b-afc5-9cf6c58f947f service nova] Creating event network-vif-deleted:e95a1e84-34bf-408e-a698-11c49deef067 for instance 35a9cd8e-0a42-4622-9b8d-885638580dbf on n-h2-836830-16 Sep 07 09:56:40.456058 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-00a38199-11c3-4ea8-8e6c-ab693f7bd857 req-f7991331-a1ed-426b-afc5-9cf6c58f947f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076731 Sep 07 09:56:40.457525 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1338/2712] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:40.472952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:40.478216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:40.487059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:40.488316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:40.488795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:40.489757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:40.490464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:40.491812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:40.864286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:40.883331 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78665bb4-1431-4c11-b912-ea50b5917d1a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1489 microversion: 2.1 time: 0.415147 Sep 07 09:56:40.887963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1339/2713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:40 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1489 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:40.922438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:40.923629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:40.933163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:40.934310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:40.935269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:40.936482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:40.938650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:40.939535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.052094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.054388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.057716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.062594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'fault' on Instance uuid 35a9cd8e-0a42-4622-9b8d-885638580dbf {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:56:41.237211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:41.262097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2d03fe8-6061-4f2f-ae84-efa6621631a2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 200 len: 1335 microversion: 2.1 time: 0.371314 Sep 07 09:56:41.280760 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1340/2714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:40 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 1335 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:41.288557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:41.291344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:41.328576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.330697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.332776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.334831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.335480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.337704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.626037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:41.641683 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cef16bc0-31d3-4f2a-82e8-ba6ac0ac075c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.370281 Sep 07 09:56:41.653205 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1341/2715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:41 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:41.653205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:41.653205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:41.661579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.661579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.661579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.661579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.661579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.661579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.706301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:56:41.934460 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-91bfa4f5-b2bb-4f0d-8cbf-a7e9a6194e3e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 204 len: 0 microversion: 2.1 time: 0.289799 Sep 07 09:56:41.935412 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1342/2716] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:56:41 2022] DELETE /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:56:41.956523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:41.960559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:41.974181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.977380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.978133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:41.982040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:41.982605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:41.983178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.069004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:42.082328 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08da851c-cca0-42ac-a38d-74f93cdc78ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1463 microversion: 2.1 time: 0.144833 Sep 07 09:56:42.083675 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1343/2717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:41 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:42.089108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:42.090927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:42.111467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.113024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.115297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.128463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.130961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.131332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.401868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:42.412427 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d38d4c06-a174-4252-a628-5f78083da5b3 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1495 microversion: 2.1 time: 0.327449 Sep 07 09:56:42.414249 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1344/2718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:42 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1495 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:42.425776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:42.426635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 35a9cd8e-0a42-4622-9b8d-885638580dbf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:42.459259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.462800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.463320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.465813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.466332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.466849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.508488 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf could not be found. Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf HTTP/1.1 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf could not be found. Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '35a9cd8e-0a42-4622-9b8d-885638580dbf'} Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf could not be found. Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf could not be found. Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:42.510534 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf could not be found. Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 404 to user: Instance 35a9cd8e-0a42-4622-9b8d-885638580dbf could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:42.515474 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8bd5c0d5-0c4f-46ec-a0e5-dd7d015aa6e2 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf" status: 404 len: 111 microversion: 2.1 time: 0.097269 Sep 07 09:56:42.517470 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1345/2719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:42 2022] GET /compute/v2.1/servers/35a9cd8e-0a42-4622-9b8d-885638580dbf => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:56:42.525704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1043dad3-930f-4028-9727-e9f945d9f2d3 req-3da767ba-eb8b-4bfa-b398-6d64a5946a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7653962-9d9a-4669-b441-27fc2f00dfa3", "name": "network-vif-deleted", "tag": "2f229892-2e11-43ac-9e89-fe3a1162a339"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:42.541476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1043dad3-930f-4028-9727-e9f945d9f2d3 req-3da767ba-eb8b-4bfa-b398-6d64a5946a4d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.541971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1043dad3-930f-4028-9727-e9f945d9f2d3 req-3da767ba-eb8b-4bfa-b398-6d64a5946a4d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.542412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1043dad3-930f-4028-9727-e9f945d9f2d3 req-3da767ba-eb8b-4bfa-b398-6d64a5946a4d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.580319 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1043dad3-930f-4028-9727-e9f945d9f2d3 req-3da767ba-eb8b-4bfa-b398-6d64a5946a4d service nova] Creating event network-vif-deleted:2f229892-2e11-43ac-9e89-fe3a1162a339 for instance c7653962-9d9a-4669-b441-27fc2f00dfa3 on n-h2-836830-16 Sep 07 09:56:42.592400 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1043dad3-930f-4028-9727-e9f945d9f2d3 req-3da767ba-eb8b-4bfa-b398-6d64a5946a4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072640 Sep 07 09:56:42.594542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1346/2720] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:42.609050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d6e8c7a-b0a5-43e2-ad32-827aa092be59 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '.version_select at 0x7f14b100a040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:42.710146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d6e8c7a-b0a5-43e2-ad32-827aa092be59 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933097232" status: 202 len: 0 microversion: 2.1 time: 0.111762 Sep 07 09:56:42.712607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1347/2721] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 09:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933097232 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:56:42.722557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:42.726218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:42.737094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.738346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.739422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:42.743776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:42.743776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:42.744527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:43.143898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:43.147001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:43.162274 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c47b4a8-4920-470d-8781-fef1d6aef5ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1476 microversion: 2.1 time: 0.446707 Sep 07 09:56:43.183562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1348/2722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:42 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1476 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:43.192598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:43.198237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:43.214156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:43.219232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:43.219941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:43.220918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:43.221658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:43.222282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:43.493492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:43.509462 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c9f5ff8-ac45-41ea-a0a8-e07886131b7b tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 200 len: 1299 microversion: 2.1 time: 0.321431 Sep 07 09:56:43.510910 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1349/2723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:43 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 1299 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:43.524675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:43.527811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:43.557682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:43.566684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:43.568884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:43.569935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:43.570455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:43.571281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:43.952980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:43.964603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b49971c4-b2f6-4772-b2da-16cc30695c0e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1495 microversion: 2.1 time: 0.451078 Sep 07 09:56:43.968669 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1350/2724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:43 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1495 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:44.192000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:44.193136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:44.206601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:44.207347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:44.207939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:44.208803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:44.213114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:44.213795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:44.562724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:44.574105 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9cb47aeb-3bf4-4468-9150-4aee82304da2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1475 microversion: 2.1 time: 0.386191 Sep 07 09:56:44.583736 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1351/2725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:44 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1475 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:44.597633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:44.600111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: c7653962-9d9a-4669-b441-27fc2f00dfa3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:44.626386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:44.626883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:44.627321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:44.628022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:44.630928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:44.631461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:44.686522 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] HTTP exception thrown: Instance c7653962-9d9a-4669-b441-27fc2f00dfa3 could not be found. Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Request method failure captured: Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 HTTP/1.1 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGpIqO4JZd3ioGRhqT7R9601qDSTz8D88Tj4JjNHP-kj8SsugxSQXq_mufYMMPcXzRoQGDWAmV54EjWJAoAalaaILg85XZW2lEEDQAgbndrdcrPxe22pfS-EO9mOm_gLsFv5yetuhh4O8eNW8UTm91TT-KOrYfmgAresWrWCou2DepA Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 828328e7cafb488087392d52b51e5c02 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueTestJSON-1927256311 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/828328e7cafb488087392d52b51e5c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/828328e7cafb488087392d52b51e5c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/828328e7cafb488087392d52b51e5c02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_828328e7cafb488087392d52b51e5c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueTestJSON-1927256311 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 828328e7cafb488087392d52b51e5c02 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueTestJSON-1927256311 Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueTestJSON-1927256311-project Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fc0088e18ea446cf8674649ad040c87e Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueTestJSON-1927256311-project Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance c7653962-9d9a-4669-b441-27fc2f00dfa3 could not be found. Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'c7653962-9d9a-4669-b441-27fc2f00dfa3'} Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7653962-9d9a-4669-b441-27fc2f00dfa3 could not be found. Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7653962-9d9a-4669-b441-27fc2f00dfa3 could not be found. Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:44.688242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7653962-9d9a-4669-b441-27fc2f00dfa3 could not be found. Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Returning 404 to user: Instance c7653962-9d9a-4669-b441-27fc2f00dfa3 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:44.691995 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-53153c9d-d0cb-4b8a-a267-cf3e848ee775 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3" status: 404 len: 111 microversion: 2.1 time: 0.104627 Sep 07 09:56:44.720278 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1352/2726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:44 2022] GET /compute/v2.1/servers/c7653962-9d9a-4669-b441-27fc2f00dfa3 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:56:44.738276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:44.741725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:44.774778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:44.775683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:44.776365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:44.777447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:44.778831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:44.779850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:44.845288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:56:45.052552 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-97fbf4df-7246-4644-b1c5-59cd4a543571 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 204 len: 0 microversion: 2.1 time: 0.330695 Sep 07 09:56:45.054668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1353/2727] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:56:44 2022] DELETE /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:56:45.062079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-00836aa5-9b95-44a8-a77c-3d75d749734f req-6c4b619f-aaf6-454a-a33b-be9c99bf0c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe8ffa-af59-455c-9957-e6d062c247a5", "name": "network-vif-deleted", "tag": "4806ee61-974e-4ebf-b038-bd901d1298e5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:45.090741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00836aa5-9b95-44a8-a77c-3d75d749734f req-6c4b619f-aaf6-454a-a33b-be9c99bf0c19 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.092074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00836aa5-9b95-44a8-a77c-3d75d749734f req-6c4b619f-aaf6-454a-a33b-be9c99bf0c19 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.093369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00836aa5-9b95-44a8-a77c-3d75d749734f req-6c4b619f-aaf6-454a-a33b-be9c99bf0c19 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.117004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-00836aa5-9b95-44a8-a77c-3d75d749734f req-6c4b619f-aaf6-454a-a33b-be9c99bf0c19 service nova] Creating event network-vif-deleted:4806ee61-974e-4ebf-b038-bd901d1298e5 for instance b9fe8ffa-af59-455c-9957-e6d062c247a5 on n-h2-836830-16 Sep 07 09:56:45.123179 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-00836aa5-9b95-44a8-a77c-3d75d749734f req-6c4b619f-aaf6-454a-a33b-be9c99bf0c19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066919 Sep 07 09:56:45.124809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1354/2728] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:45.130499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:45.131671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:45.144892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.146005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.148020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.149597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.150803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.151618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.201220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.202328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.203095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.203828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'fault' on Instance uuid b9fe8ffa-af59-455c-9957-e6d062c247a5 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:56:45.267020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:45.278182 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39c3cb19-f0e8-450e-b1ab-c84109a61089 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1305 microversion: 2.1 time: 0.151438 Sep 07 09:56:45.280983 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1355/2729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:45 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:45.291718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:45.293997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:45.312155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.312905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.313446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.314544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.315333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.316142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.849519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:45.859229 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70aef50e-d2c7-4b87-b0af-d28208013885 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1490 microversion: 2.1 time: 0.573135 Sep 07 09:56:45.869401 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1356/2730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:45 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1490 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:45.900397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:45.901120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:45.914422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.922072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.923630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:45.924494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:45.925766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:45.929734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:46.330778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:46.339652 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ece84c9-d3d2-4c13-9a45-adb9f9ead496 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1473 microversion: 2.1 time: 0.467009 Sep 07 09:56:46.340350 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1357/2731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:45 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1473 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:46.345305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:46.351573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:46.368732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:46.369453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:46.370179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:46.371126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:46.371991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:46.379900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:46.469280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:46.469950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:46.470502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:46.473505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'fault' on Instance uuid b9fe8ffa-af59-455c-9957-e6d062c247a5 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:56:46.556053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:46.569300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aaed4695-2f3b-4482-be36-ce682a210956 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1305 microversion: 2.1 time: 0.227617 Sep 07 09:56:46.570862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1358/2732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:46 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1305 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:46.892669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:46.893444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:46.906283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:46.909048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:46.909651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:46.912631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:46.914095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:46.916395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:47.207165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:47.220098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-43d603b4-d9f9-4d89-bc56-5f04c2da23a1 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1490 microversion: 2.1 time: 0.329462 Sep 07 09:56:47.236646 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1359/2733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:46 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1490 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:47.363714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:47.364406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:47.371874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:47.381326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:47.381899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:47.382845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:47.383489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:47.384104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:47.435413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:47.745818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:47.756293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c135ce6e-164d-435f-9cea-35e3cbfe14fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1473 microversion: 2.1 time: 0.396379 Sep 07 09:56:47.778206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1360/2734] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:47 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:47.786654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:47.788189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:47.796313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:47.797244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:47.797862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:47.799190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:47.799998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:47.800720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:47.850791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:47.851555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:47.852145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:47.852841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'fault' on Instance uuid b9fe8ffa-af59-455c-9957-e6d062c247a5 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:56:47.941241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:47.958147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c8cac516-bca0-4d5a-9c38-50dd63fb96cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 200 len: 1305 microversion: 2.1 time: 0.178177 Sep 07 09:56:47.959088 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1361/2735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:47 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:47.977635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1caf64-97d3-4d37-b66b-4fdc9bff03ab", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4cd55f-c2ec-4458-9b22-5d93adec48a5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:47.999393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:48.000619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:48.001727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:48.025440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] Creating event network-vif-unplugged:ad4cd55f-c2ec-4458-9b22-5d93adec48a5 for instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab on n-h1-836830-16 Sep 07 09:56:48.036730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:56:48.045458 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-26edbf20-8a1c-41ed-a8fd-6df5dcb14644 req-95fd5b01-cb6e-4faa-9e4c-23372a04d05c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084452 Sep 07 09:56:48.046772 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1362/2736] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:48.253664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:48.257133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:48.290363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:48.294282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:48.296354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:48.298448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:48.304855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:48.304855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:48.305169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:48.443563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:48.619856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0088e18ea446cf8674649ad040c87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828328e7cafb488087392d52b51e5c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:48.633451 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08ed2f83-0d3b-49be-b13b-37272f62e7ca tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 200 len: 1490 microversion: 2.1 time: 0.383342 Sep 07 09:56:48.635293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1363/2737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:48 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 1490 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:48.783062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:48.783742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:48.790943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:48.791995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:48.792808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:48.793851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:48.794477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:48.794932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:48.812736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:56:48.989868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:49.002086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13ed869b-bfaa-4310-9583-f4751c890305 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1470 microversion: 2.1 time: 0.224328 Sep 07 09:56:49.017275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1364/2738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:48 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:56:49.017275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:49.017275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:49.017275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:49.017275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:49.017878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:49.018598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:49.019271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:49.019783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:49.038713 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 HTTP/1.1 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b9fe8ffa-af59-455c-9957-e6d062c247a5'} Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:49.040509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:56:49.045987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:49.046892 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ff350c0-c220-4a83-a3f6-cd1e7bae0afc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 404 len: 111 microversion: 2.1 time: 0.040843 Sep 07 09:56:49.047509 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1365/2739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:49 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:56:49.079346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:49.080043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:49.097670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:49.099552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:49.104137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:49.105008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:49.105602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:49.109564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:49.279780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7cb1eee6-01ee-4d60-a184-3a29127b4d69 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab/action" status: 204 len: 0 microversion: 2.1 time: 0.230824 Sep 07 09:56:49.287099 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1366/2740] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:56:49 2022] POST /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab/action => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:56:49.310288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:49.314296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:49.335823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:49.336708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:49.338143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:49.341103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:49.341884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:49.344311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:50.108731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:50.120912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4cd76b0c-d20c-4961-b135-80ac1fdc76ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1470 microversion: 2.1 time: 0.831681 Sep 07 09:56:50.127377 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1367/2741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:49 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1470 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:50.138491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-793626466", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "43b222c4-ce7e-44cd-8f53-a9d4905f7dee"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:59.364798 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f1bf675-a7e1-4639-890f-c984ca925272 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1429 microversion: 2.1 time: 20.903172 Sep 07 09:56:59.365620 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1375/2742] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:56:38 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1429 bytes in 20905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:56:59.370760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:59.375473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] [instance: 5f029b53-a749-4ebb-b41c-851193050f4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:59.385729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:59.386449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:59.387104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:59.388013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:59.388694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:59.390109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:59.420310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] HTTP exception thrown: Instance 5f029b53-a749-4ebb-b41c-851193050f4a could not be found. Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Request method failure captured: Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a HTTP/1.1 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGpIqO4JZd3ioGRhqT7R9601qDSTz8D88Tj4JjNHP-kj8SsugxSQXq_mufYMMPcXzRoQGDWAmV54EjWJAoAalaaILg85XZW2lEEDQAgbndrdcrPxe22pfS-EO9mOm_gLsFv5yetuhh4O8eNW8UTm91TT-KOrYfmgAresWrWCou2DepA Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 828328e7cafb488087392d52b51e5c02 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerRescueTestJSON-1927256311 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/828328e7cafb488087392d52b51e5c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/828328e7cafb488087392d52b51e5c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/828328e7cafb488087392d52b51e5c02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_828328e7cafb488087392d52b51e5c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerRescueTestJSON-1927256311 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 828328e7cafb488087392d52b51e5c02 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerRescueTestJSON-1927256311 Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerRescueTestJSON-1927256311-project Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fc0088e18ea446cf8674649ad040c87e Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerRescueTestJSON-1927256311-project Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5f029b53-a749-4ebb-b41c-851193050f4a could not be found. Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5f029b53-a749-4ebb-b41c-851193050f4a'} Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f029b53-a749-4ebb-b41c-851193050f4a could not be found. Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f029b53-a749-4ebb-b41c-851193050f4a could not be found. Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:56:59.423259 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f029b53-a749-4ebb-b41c-851193050f4a could not be found. Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] Returning 404 to user: Instance 5f029b53-a749-4ebb-b41c-851193050f4a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c802d454-7a58-4574-bf29-f78cb0853ce4 tempest-ServerRescueTestJSON-1927256311 tempest-ServerRescueTestJSON-1927256311-project] 10.222.0.60 "GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a" status: 404 len: 111 microversion: 2.1 time: 0.058675 Sep 07 09:56:59.427269 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1376/2743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:59 2022] GET /compute/v2.1/servers/5f029b53-a749-4ebb-b41c-851193050f4a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:56:59.433857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-85111742-35f0-48a3-b9fd-dad3a9c83a4d req-26dbd95b-25ad-4b26-9c2a-3c2a08c4059b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f029b53-a749-4ebb-b41c-851193050f4a", "name": "network-vif-deleted", "tag": "b19ed238-70ae-4d78-87e0-c9a31f159809"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:56:59.461985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-85111742-35f0-48a3-b9fd-dad3a9c83a4d req-26dbd95b-25ad-4b26-9c2a-3c2a08c4059b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:59.463200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-85111742-35f0-48a3-b9fd-dad3a9c83a4d req-26dbd95b-25ad-4b26-9c2a-3c2a08c4059b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:59.463756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-85111742-35f0-48a3-b9fd-dad3a9c83a4d req-26dbd95b-25ad-4b26-9c2a-3c2a08c4059b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:59.468703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] validate_networks() for [('43b222c4-ce7e-44cd-8f53-a9d4905f7dee', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:56:59.492314 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-85111742-35f0-48a3-b9fd-dad3a9c83a4d req-26dbd95b-25ad-4b26-9c2a-3c2a08c4059b service nova] Creating event network-vif-deleted:b19ed238-70ae-4d78-87e0-c9a31f159809 for instance 5f029b53-a749-4ebb-b41c-851193050f4a on n-h2-836830-16 Sep 07 09:56:59.502564 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-85111742-35f0-48a3-b9fd-dad3a9c83a4d req-26dbd95b-25ad-4b26-9c2a-3c2a08c4059b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072982 Sep 07 09:56:59.504566 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1377/2744] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:56:59.512189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:56:59.514489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:56:59.523589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:59.525162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:59.526074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:59.532989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:56:59.533815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:56:59.536125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:56:59.967554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:56:59.984875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4cba979e-ee4d-4088-99ae-b53b3d104d42 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1462 microversion: 2.1 time: 0.477175 Sep 07 09:56:59.988999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1378/2745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:56:59 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1462 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:00.012130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-28e88cc1-e07a-4258-9ece-7dc93299c8e5 req-fe525cd3-f620-4d15-b610-2f663e030aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1caf64-97d3-4d37-b66b-4fdc9bff03ab", "name": "network-vif-plugged", "status": "completed", "tag": "ad4cd55f-c2ec-4458-9b22-5d93adec48a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:00.031786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-28e88cc1-e07a-4258-9ece-7dc93299c8e5 req-fe525cd3-f620-4d15-b610-2f663e030aa5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:00.032278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-28e88cc1-e07a-4258-9ece-7dc93299c8e5 req-fe525cd3-f620-4d15-b610-2f663e030aa5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:00.032704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-28e88cc1-e07a-4258-9ece-7dc93299c8e5 req-fe525cd3-f620-4d15-b610-2f663e030aa5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:00.047012 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-28e88cc1-e07a-4258-9ece-7dc93299c8e5 req-fe525cd3-f620-4d15-b610-2f663e030aa5 service nova] Creating event network-vif-plugged:ad4cd55f-c2ec-4458-9b22-5d93adec48a5 for instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab on n-h1-836830-16 Sep 07 09:57:00.052913 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-28e88cc1-e07a-4258-9ece-7dc93299c8e5 req-fe525cd3-f620-4d15-b610-2f663e030aa5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062380 Sep 07 09:57:00.054266 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1379/2746] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:00.116408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:00.175878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:00.254212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1105597267", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:00.375994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] validate_networks() for [('49fdca33-4357-4012-8837-6ad24e57961b', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:57:00.814830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:00.816136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:00.816971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:00.818858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:00.819541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:00.846288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:00.847286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:00.848993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:00.853587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:00.854621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:00.855499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:00.908155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:00.918549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Getting quotas for user 4c2392bb6ddb418faf01ad30c07297c0 and project c32ff711449d46a8988320faa8d16932. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:00.989304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:00.997235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:01.115592 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9101bc0c-7144-4bb9-a5d2-985e96b880b5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.983629 Sep 07 09:57:01.123196 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1368/2747] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 10994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:57:01.129256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:01.129767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:01.143981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.144489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.145072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.156110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.156767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.157426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.206857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:57:01.340065 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-587c7781-fee0-499d-aace-07e581443eaf tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 204 len: 0 microversion: 2.1 time: 0.214917 Sep 07 09:57:01.343562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1369/2748] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:01 2022] DELETE /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:57:01.352161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:01.355220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:01.366156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.366814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.367925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.368660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.369814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.370233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.442048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:01.443121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:01.443806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:01.444821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:01.446257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:01.470898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.472724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.475441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.477402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.478253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.478970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.516146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Getting quotas for project 2b6e5ea5bc5b442497b1e787827630fa. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:01.524521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Getting quotas for user 528af86591194a5dae2ba78847d7bc06 and project 2b6e5ea5bc5b442497b1e787827630fa. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:01.547866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:01.552060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:01.609409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:01.623604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4acc7ec-cb73-46bb-b7e2-79f152ce09e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1462 microversion: 2.1 time: 0.277181 Sep 07 09:57:01.624087 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1370/2749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:01 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1462 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:01.629835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67631728-dded-42e3-af02-5e5942349965 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b0f6d160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:01.674055 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31af6cf4-8b5f-4a21-a728-d62f5a81ccfe tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.618386 Sep 07 09:57:01.681296 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1380/2750] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:57:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:57:01.693859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80948686-4037-4582-a9a5-91f48f3ccbdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:01.694931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80948686-4037-4582-a9a5-91f48f3ccbdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:01.738646 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67631728-dded-42e3-af02-5e5942349965 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1438 microversion: 2.1 time: 0.113155 Sep 07 09:57:01.740065 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1371/2751] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:57:01 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:01.746034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:01.746650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:01.773491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.774619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.775052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.777916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:01.778397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:01.778837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:01.867462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-80948686-4037-4582-a9a5-91f48f3ccbdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:01.875377 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80948686-4037-4582-a9a5-91f48f3ccbdb tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1214 microversion: 2.1 time: 0.188523 Sep 07 09:57:01.876798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1381/2752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:01 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:01.886916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-552bc813-2c1b-4304-b563-447153fc5c47 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'create', calling method: .version_select at 0x7f14b5deb790>, body: {"keypair": {"name": "tempest-keypair-1903180541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkZqkfWltKSX+xl3eje9VhFnVnrvrogyDkYZWtyy/RcFgPQNhC/xP1a605rpReUgCEY97cyF28VoHfrgJr9N+aN3pzAekTfUV3yyPWxBgN+3ct3gIRNbW6h2pAGGLhSWg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:01.928925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-552bc813-2c1b-4304-b563-447153fc5c47 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:01.944814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-552bc813-2c1b-4304-b563-447153fc5c47 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for user 0e051e5308924154b7d5ecc2ea7ffdf7 and project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:02.009026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-552bc813-2c1b-4304-b563-447153fc5c47 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125933 Sep 07 09:57:02.011121 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1382/2753] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 09:57:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:02.039966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6860fd15-fc92-4913-9c1f-dc0f1e1184e0 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:02.041978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6860fd15-fc92-4913-9c1f-dc0f1e1184e0 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:02.142775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6860fd15-fc92-4913-9c1f-dc0f1e1184e0 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:02.152585 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6860fd15-fc92-4913-9c1f-dc0f1e1184e0 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1223 microversion: 2.1 time: 0.140226 Sep 07 09:57:02.153212 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1383/2754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:02 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:02.176382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c420d8ba-f79c-4b2d-be77-7bd66e00e01c tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b5f6be50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:02.263325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c420d8ba-f79c-4b2d-be77-7bd66e00e01c tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 200 len: 1438 microversion: 2.1 time: 0.108952 Sep 07 09:57:02.267629 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1384/2755] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 09:57:02 2022] GET /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:02.283057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:02.284083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:02.299645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:02.300100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:02.301326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:02.302398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:02.303726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:02.305837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:02.308183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:02.308912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-246be686-fee5-462e-8ccb-7d8d1ff3024e tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1507 microversion: 2.1 time: 0.567817 Sep 07 09:57:02.314050 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1372/2756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:01 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:02.907136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:02.908360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:02.921343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:02.922705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:02.924263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:02.927476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:02.928737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:02.929413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:03.199487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:03.208667 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-732b82ed-96b7-44f5-90ee-7d5e17af6a94 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1266 microversion: 2.1 time: 0.308980 Sep 07 09:57:03.215844 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1373/2757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:02 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:03.226979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:03.228230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:03.239624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:03.240370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:03.241635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:03.243235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:03.245800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:03.246623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:03.532519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:03.546216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93797c92-dddd-4f63-bd96-f42ad7697e17 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1275 microversion: 2.1 time: 0.328397 Sep 07 09:57:03.547092 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1374/2758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:03 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:03.556981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:03.561525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:03.578427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:03.579403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:03.579861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:03.580606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:03.581074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:03.581540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:03.753702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:03.762245 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eba98d43-fcc8-408d-98a0-eb4c62d17b53 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1466 microversion: 2.1 time: 1.484854 Sep 07 09:57:03.762843 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1385/2759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:02 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1466 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:03.791496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-54f258cc-92c8-4fc4-aa41-c260542a9967 req-0195197a-5220-4f93-8ae2-4e411566d0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "name": "network-vif-unplugged", "status": "completed", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:03.805101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-54f258cc-92c8-4fc4-aa41-c260542a9967 req-0195197a-5220-4f93-8ae2-4e411566d0b9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:03.805925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-54f258cc-92c8-4fc4-aa41-c260542a9967 req-0195197a-5220-4f93-8ae2-4e411566d0b9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:03.806611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-54f258cc-92c8-4fc4-aa41-c260542a9967 req-0195197a-5220-4f93-8ae2-4e411566d0b9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:03.822207 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-54f258cc-92c8-4fc4-aa41-c260542a9967 req-0195197a-5220-4f93-8ae2-4e411566d0b9 service nova] Creating event network-vif-unplugged:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:57:03.828655 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-54f258cc-92c8-4fc4-aa41-c260542a9967 req-0195197a-5220-4f93-8ae2-4e411566d0b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047837 Sep 07 09:57:03.829340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1386/2760] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:03.835008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5923be6-7da8-47e1-8d08-d35ef008a3e9 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b1261670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:04.626851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:04.655476 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ffe3e8b3-c4b8-451b-b467-ad17642ba677 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1507 microversion: 2.1 time: 1.106157 Sep 07 09:57:04.657971 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1375/2761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:03 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1507 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:04.672884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:04.673609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:04.687825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:04.688723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:04.693894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:04.699039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:04.700711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:04.704406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:04.949415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:04.974025 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5923be6-7da8-47e1-8d08-d35ef008a3e9 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "DELETE /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf" status: 204 len: 0 microversion: 2.1 time: 1.142001 Sep 07 09:57:04.975993 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1387/2762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:03 2022] DELETE /compute/v2.1/images/a6d5782f-2b01-48d3-a481-fdc8636a5cbf => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:57:04.985550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:04.986491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:04.999131 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7be33298-fc74-48f0-9724-b17c6482a0cf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1272 microversion: 2.1 time: 0.336795 Sep 07 09:57:05.010805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.012051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.012660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.014702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.015677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.016275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.021122 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1376/2763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:04 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:05.026958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74514737-26b7-402c-b149-b9fbc139248f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '.version_select at 0x7f14b0f961f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:05.085652 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-74514737-26b7-402c-b149-b9fbc139248f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] HTTP exception thrown: Image not found. Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74514737-26b7-402c-b149-b9fbc139248f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Request method failure captured: Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e HTTP/1.1 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGqHiITbQs_ZPFHa5jbsCiNGw81Hp3UF0zVNC65x-zq64lllXqkqxxYESMNAymG9p454aIoAbYspcxMtRftGIa2GDqMfhjPIEaoU-tATHM9-_Kfwl6WpSF4VQ2BJ8hWH2DonCMGasoiQrXrERqeiJ2JaECdgjDFdb3aQGFP33T_t7l0 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d26be1ae8f8d45e28ae37c07670deb86 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d26be1ae8f8d45e28ae37c07670deb86", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d26be1ae8f8d45e28ae37c07670deb86 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerTestJSON-1089448778-project Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 52661062c37f426984b4a0ad2ba02d3f Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerTestJSON-1089448778-project Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e'} Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e to delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e could not be found. Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.087500 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74514737-26b7-402c-b149-b9fbc139248f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74514737-26b7-402c-b149-b9fbc139248f tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "DELETE /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e" status: 404 len: 62 microversion: 2.1 time: 0.065841 Sep 07 09:57:05.093010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1377/2764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:05 2022] DELETE /compute/v2.1/images/7c4e5e10-bd9c-4a90-86c1-a3f67aa6499e => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 09:57:05.098488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:05.102225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:05.116744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.117292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.117746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.118467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.118934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.119373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.205036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:57:05.344502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:05.367586 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bbf34dc5-7dbd-4ab8-9333-40ca8f93281a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1281 microversion: 2.1 time: 0.388096 Sep 07 09:57:05.368596 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1388/2765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:04 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1281 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:05.507450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-727e83b0-ee29-4fc0-a182-d2dfb1559947 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 204 len: 0 microversion: 2.1 time: 0.413450 Sep 07 09:57:05.511259 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1378/2766] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:05 2022] DELETE /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:57:05.518223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:05.518846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:05.529166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.531750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.532353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.533250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.535584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.537982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.627731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a5cfcdcb-6b23-422c-a51d-264b9f302bfa req-d981ee83-fbf4-4532-bbf5-6cfa42e70f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a95ceab-b418-4e73-b1d1-7a8cc9b2d435", "name": "network-vif-deleted", "tag": "2f818bbe-9767-4766-8b4f-518ac10b3abf"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:05.651690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a5cfcdcb-6b23-422c-a51d-264b9f302bfa req-d981ee83-fbf4-4532-bbf5-6cfa42e70f2d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.652349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a5cfcdcb-6b23-422c-a51d-264b9f302bfa req-d981ee83-fbf4-4532-bbf5-6cfa42e70f2d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.653290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a5cfcdcb-6b23-422c-a51d-264b9f302bfa req-d981ee83-fbf4-4532-bbf5-6cfa42e70f2d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.689205 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a5cfcdcb-6b23-422c-a51d-264b9f302bfa req-d981ee83-fbf4-4532-bbf5-6cfa42e70f2d service nova] Creating event network-vif-deleted:2f818bbe-9767-4766-8b4f-518ac10b3abf for instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 on n-h1-836830-16 Sep 07 09:57:05.703380 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a5cfcdcb-6b23-422c-a51d-264b9f302bfa req-d981ee83-fbf4-4532-bbf5-6cfa42e70f2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080018 Sep 07 09:57:05.708604 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1379/2767] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:05.716546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:05.719268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:05.737725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.738739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.739339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.743226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:05.743937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:05.744664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:05.865932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:05.878009 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14331eec-b663-4edb-81fd-6ca92420223c tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1465 microversion: 2.1 time: 0.167814 Sep 07 09:57:05.890151 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1380/2768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:05 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:06.029923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:06.030473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:06.055251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.055692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.056140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:06.056865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.057352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.057998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:06.066714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:06.085473 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b06c36c6-18a8-436a-a06e-f89089e03318 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1472 microversion: 2.1 time: 0.571846 Sep 07 09:57:06.086336 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1389/2769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:05 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1472 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:06.177447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-841bdff1-2024-4a75-83bc-90e0d433080c tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '.version_select at 0x7f14b125d5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:06.182843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841bdff1-2024-4a75-83bc-90e0d433080c tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.184547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841bdff1-2024-4a75-83bc-90e0d433080c tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.186563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-841bdff1-2024-4a75-83bc-90e0d433080c tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:06.198281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-841bdff1-2024-4a75-83bc-90e0d433080c tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.024768 Sep 07 09:57:06.217910 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1390/2770] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 09:57:06 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:06.222506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fc69968-cc4f-4b33-a6ad-f863f0c1e285 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:06.233666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4fc69968-cc4f-4b33-a6ad-f863f0c1e285 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017011 Sep 07 09:57:06.234451 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1391/2771] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 09:57:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:06.247462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6e4e357e-2602-43fb-bff5-033eb1bc0579 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-5403019", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:06.284993 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6e4e357e-2602-43fb-bff5-033eb1bc0579 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 496 microversion: 2.1 time: 0.040903 Sep 07 09:57:06.286238 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1392/2772] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Sep 7 09:57:06 2022] POST /compute/v2.1/flavors => generated 496 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:06.298870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8ae3106-b7a7-4680-b026-5efb3717fafe tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:06.309341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8ae3106-b7a7-4680-b026-5efb3717fafe tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014462 Sep 07 09:57:06.321481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1393/2773] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 7 09:57:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 09:57:06.395608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:06.396235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:06.425733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.426163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.433301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:06.434325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.436368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.443422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:06.502204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:06.512760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0840f17b-2252-4dfe-a84d-f8da0479f1ae tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.488447 Sep 07 09:57:06.515751 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1381/2774] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:06 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:06.566554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:06.578765 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80bf9f9e-265d-4e72-84a1-caab66485417 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1281 microversion: 2.1 time: 0.187225 Sep 07 09:57:06.582287 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1394/2775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:06 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:06.618120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-668075433", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "ca6f7c72-5c48-4e50-af7c-77106cce9593"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:06.711893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] validate_networks() for None {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:57:06.907233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:06.907857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:06.916813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.917347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.917789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:06.918503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:06.918964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:06.919408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:07.079255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:07.095355 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fcc8f121-b1f2-40fb-b212-8a8b4ef35999 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1465 microversion: 2.1 time: 0.193231 Sep 07 09:57:07.095977 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1395/2776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:06 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:07.118728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:07.121104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:07.128504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:07.128993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:07.129799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:07.130532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:07.131311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:07.131906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:07.285994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:07.286611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:07.287255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:07.287828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:07.288425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:07.303458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:07.304271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:07.305486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:07.307337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:07.308079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:07.308702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:07.338452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:07.353133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for user 0e051e5308924154b7d5ecc2ea7ffdf7 and project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:07.395055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:07.406280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:07.488297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87294a8e-d2dc-47f5-814b-1cc6a26aa6ed tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874218 Sep 07 09:57:07.499776 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1382/2777] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:57:07.505425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:07.521970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86de6852-10df-4d6c-8b34-cc3d33dde135 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:07.522916 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b903949f-914a-41c6-9b5f-13ec2c5bd90b tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1472 microversion: 2.1 time: 0.399578 Sep 07 09:57:07.525975 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1396/2778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:07 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:07.526887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86de6852-10df-4d6c-8b34-cc3d33dde135 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:07.539150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:07.539766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:07.564295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:07.564806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:07.565272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:07.565987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:07.566442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:07.566863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:08.022759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86de6852-10df-4d6c-8b34-cc3d33dde135 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:08.035840 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86de6852-10df-4d6c-8b34-cc3d33dde135 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1278 microversion: 2.1 time: 0.534755 Sep 07 09:57:08.036646 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1383/2779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:07 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1278 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:08.041471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:08.065490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:08.072399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:08.082327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:08.082995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:08.083961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:08.084579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:08.085199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:08.460587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:08.471595 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5bb12f69-5ec0-4d00-bc70-e6f71f93cdb4 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.934781 Sep 07 09:57:08.472705 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1397/2780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:07 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:08.485740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:08.486597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:08.498923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:08.499786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:08.501520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:08.505224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:08.505900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:08.506413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:08.605619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:08.606266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:08.606775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:08.608989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'fault' on Instance uuid 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:57:09.357098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:09.382376 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-846eb125-84c2-4908-b61e-18371eef32c6 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 1.342775 Sep 07 09:57:09.385568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1384/2781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:08 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:09.392160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:09.393131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:09.422906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.423770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.424640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:09.425623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.426279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.426903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:09.456077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:09.478209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-844a6ce4-b1ac-4dc8-b230-0a97a59e3b58 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 200 len: 1312 microversion: 2.1 time: 1.003999 Sep 07 09:57:09.479934 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1398/2782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:08 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 1312 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:09.487308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9f75786e-890f-40d3-93f4-cd306cd6cc77 req-54392ae3-b278-470b-8701-dd80e6c5e115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39cffed-b173-455b-96fe-36ff55a430e5", "tag": "7f019167-4036-4afd-83ef-2ab56ea7fcd7"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:09.509358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9f75786e-890f-40d3-93f4-cd306cd6cc77 req-54392ae3-b278-470b-8701-dd80e6c5e115 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.512177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9f75786e-890f-40d3-93f4-cd306cd6cc77 req-54392ae3-b278-470b-8701-dd80e6c5e115 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.514465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9f75786e-890f-40d3-93f4-cd306cd6cc77 req-54392ae3-b278-470b-8701-dd80e6c5e115 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:09.538407 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9f75786e-890f-40d3-93f4-cd306cd6cc77 req-54392ae3-b278-470b-8701-dd80e6c5e115 service nova] Creating event network-changed:7f019167-4036-4afd-83ef-2ab56ea7fcd7 for instance e39cffed-b173-455b-96fe-36ff55a430e5 on n-h2-836830-16 Sep 07 09:57:09.552498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9f75786e-890f-40d3-93f4-cd306cd6cc77 req-54392ae3-b278-470b-8701-dd80e6c5e115 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070742 Sep 07 09:57:09.553761 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1399/2783] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:09.567064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:09.568252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:09.583667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.585416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.588651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:09.589641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.590268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.590849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:09.770253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:09.780213 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c26b9ba5-0112-4e6c-ae19-43c63354d346 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1330 microversion: 2.1 time: 0.222482 Sep 07 09:57:09.796179 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1400/2784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:09 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1330 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:09.810596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:09.811711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:09.827102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.827640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.829488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:09.830516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:09.836101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:09.836798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.035927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:10.055408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78f6ee42-9caa-4e0b-b878-52e0d7ad8961 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1472 microversion: 2.1 time: 0.668024 Sep 07 09:57:10.059677 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1385/2785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:09 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:10.369014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:10.381907 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab649dd9-e17d-45cb-bf3c-4b4ac12e9c39 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.582171 Sep 07 09:57:10.382738 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1401/2786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:09 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:10.410850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:10.412255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:10.427588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.429169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.430332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.431296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.432024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.433063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.444686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:10.509302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:10.511180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:10.526655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.530981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.531982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.533362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.534076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.534850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.554485 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 could not be found. Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 HTTP/1.1 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 could not be found. Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2a95ceab-b418-4e73-b1d1-7a8cc9b2d435'} Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 could not be found. Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 could not be found. Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:10.557056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 could not be found. Sep 07 09:57:10.562429 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:10.572477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 404 to user: Instance 2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:10.574092 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0e20983-fca5-4d96-8234-b44f3028d404 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435" status: 404 len: 111 microversion: 2.1 time: 0.069642 Sep 07 09:57:10.592192 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1402/2787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:10 2022] GET /compute/v2.1/servers/2a95ceab-b418-4e73-b1d1-7a8cc9b2d435 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:57:10.607480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:10.609891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:10.634892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.635767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.637088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.650505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.656966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.658140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:10.744974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:57:10.865547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:10.918183 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96a89b3b-c682-44ba-9ef0-b6062f319cba tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 204 len: 0 microversion: 2.1 time: 0.320856 Sep 07 09:57:10.919684 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1403/2788] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:10 2022] DELETE /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:57:10.937772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3c2e0916-d6a6-4b81-af9a-933408e67056 req-f0e35438-f42b-4ab8-9247-1254f705756d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:10.980728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3c2e0916-d6a6-4b81-af9a-933408e67056 req-f0e35438-f42b-4ab8-9247-1254f705756d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:10.982025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3c2e0916-d6a6-4b81-af9a-933408e67056 req-f0e35438-f42b-4ab8-9247-1254f705756d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:10.984245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3c2e0916-d6a6-4b81-af9a-933408e67056 req-f0e35438-f42b-4ab8-9247-1254f705756d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.018938 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3c2e0916-d6a6-4b81-af9a-933408e67056 req-f0e35438-f42b-4ab8-9247-1254f705756d service nova] Creating event network-changed:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:57:11.030138 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3c2e0916-d6a6-4b81-af9a-933408e67056 req-f0e35438-f42b-4ab8-9247-1254f705756d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108119 Sep 07 09:57:11.031357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1404/2789] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:11.038556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:11.040183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:11.056756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.058313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.062135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.063273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.063976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.066366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.264764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:11.272274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:11.276929 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-300ad900-fdac-4c8a-a8af-217d717305fa tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1336 microversion: 2.1 time: 0.243597 Sep 07 09:57:11.278169 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1405/2790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:11 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:11.288969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:11.293158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:11.298882 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-018f27e1-70d4-4851-963b-23c5368e6c1e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.892863 Sep 07 09:57:11.300073 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1386/2791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:10 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:11.305008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:11.305842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:11.314265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.314855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.315391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.316654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.317279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.319038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.322946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.323363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.323801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.324511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.328726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.329305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.434618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:11.449699 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0077205e-bff7-44cc-a09c-d4acb8775a01 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1430 microversion: 2.1 time: 0.148296 Sep 07 09:57:11.459463 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1387/2792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:11 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1430 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:11.473123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:11.474048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:11.496035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:11.497577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.502128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.502826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.506116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:11.506925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:11.508429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:11.688676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:11.701530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5ec2104a-b1e4-4769-8132-da80930f12b8 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.421143 Sep 07 09:57:11.706061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1406/2793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:11 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:11.973680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:11.987931 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06d36c90-8612-44a9-bba5-5ab5652a61e1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.525397 Sep 07 09:57:11.993876 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1388/2794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:11 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:12.300679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:12.301623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:12.304291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:12.316205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.318988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.328925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:12.329738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:12.332491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.333578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.333993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.334555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.345338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.345472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.346091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.347829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.348466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.349116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.774171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:12.791410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:12.792868 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a5fb29b-7b9f-4db7-996b-108a738d3378 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.462242 Sep 07 09:57:12.793729 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1389/2795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:12 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:12.801201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1462e21-4434-432f-959b-fa3746fe628c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.504221 Sep 07 09:57:12.802445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1407/2796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:12 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:12.807301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:12.808183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:12.812754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:12.813419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:12.819855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.820575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.821503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.822362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.822974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.823098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.823539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.823843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.823981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.824662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:12.830161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:12.830298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:12.950303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:12.965609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4de37896-ac01-4bd6-ba93-00f74e081caa tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1430 microversion: 2.1 time: 0.170544 Sep 07 09:57:12.966182 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1390/2797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:12 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1430 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:13.024967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:13.025862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:13.033305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.034006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.034454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:13.035166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.035632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.036059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:13.040329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:13.053298 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c72d710d-fe82-4462-9414-746190db338b tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.248763 Sep 07 09:57:13.069167 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1408/2798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:12 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:13.125078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1d0ce551-4f1c-48ed-8362-3d2502ecce45 req-3087afc9-324b-46a1-823d-2dc6e61a3703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85fc285-eb10-46e3-93ab-882fcaaeb63f", "name": "network-vif-deleted", "tag": "3f0b6c24-8dd5-499a-b37f-8ee636b078c8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:13.141633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:13.141633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1d0ce551-4f1c-48ed-8362-3d2502ecce45 req-3087afc9-324b-46a1-823d-2dc6e61a3703 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.141633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1d0ce551-4f1c-48ed-8362-3d2502ecce45 req-3087afc9-324b-46a1-823d-2dc6e61a3703 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.141633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1d0ce551-4f1c-48ed-8362-3d2502ecce45 req-3087afc9-324b-46a1-823d-2dc6e61a3703 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:13.152206 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1d0ce551-4f1c-48ed-8362-3d2502ecce45 req-3087afc9-324b-46a1-823d-2dc6e61a3703 service nova] Creating event network-vif-deleted:3f0b6c24-8dd5-499a-b37f-8ee636b078c8 for instance d85fc285-eb10-46e3-93ab-882fcaaeb63f on n-h1-836830-16 Sep 07 09:57:13.158150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1d0ce551-4f1c-48ed-8362-3d2502ecce45 req-3087afc9-324b-46a1-823d-2dc6e61a3703 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038313 Sep 07 09:57:13.158755 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1409/2799] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:13.224218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:13.234903 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0313bee4-dfb7-454d-ac23-b91b8f54f919 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.221651 Sep 07 09:57:13.236249 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1391/2800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:13 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:13.819019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:13.819723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:13.828856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:13.829502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:13.830227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.830955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.831716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:13.832638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.833354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.833991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:13.844159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.844644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.845078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:13.850388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:13.850873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:13.851308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:14.451307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:14.470219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ccb7f00d-a9db-4c20-a051-bf41f0c8a6ff tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.654883 Sep 07 09:57:14.471147 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1410/2801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:13 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:14.490642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:14.501605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:14.511066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:14.511552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:14.514076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:14.515635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:14.516605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:14.517604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:14.607814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:14.609612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:14.612306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:14.613053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lazy-loading 'fault' on Instance uuid d85fc285-eb10-46e3-93ab-882fcaaeb63f {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:57:14.734165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:14.745864 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0b7304c-9b42-4cc1-9392-01345629c065 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.921570 Sep 07 09:57:14.746702 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1392/2802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:13 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:14.758990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:14.762403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:14.773089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:14.773089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:14.773384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:14.774319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:14.774775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:14.775213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:14.939229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52661062c37f426984b4a0ad2ba02d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26be1ae8f8d45e28ae37c07670deb86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:14.960843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9451ea7-5c21-4b81-9052-8721d12f0525 tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 200 len: 1306 microversion: 2.1 time: 0.487361 Sep 07 09:57:14.964112 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1411/2803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:14 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 1306 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:14.976427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:14.977582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:15.005048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.013146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.014655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:15.016673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.018306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.020045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:15.696766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:15.714079 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd659a8e-fb45-4e67-bbf4-55c8a50c363d tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1519 microversion: 2.1 time: 0.962753 Sep 07 09:57:15.715241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1393/2804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:14 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1519 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:15.740215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-efa39b1c-5bf1-488d-a9e7-e5167bd145b4 req-38e116f0-0b27-472e-b4dd-417574e1c7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:15.775517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-efa39b1c-5bf1-488d-a9e7-e5167bd145b4 req-38e116f0-0b27-472e-b4dd-417574e1c7ea service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.776289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-efa39b1c-5bf1-488d-a9e7-e5167bd145b4 req-38e116f0-0b27-472e-b4dd-417574e1c7ea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.776887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-efa39b1c-5bf1-488d-a9e7-e5167bd145b4 req-38e116f0-0b27-472e-b4dd-417574e1c7ea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:15.806373 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-efa39b1c-5bf1-488d-a9e7-e5167bd145b4 req-38e116f0-0b27-472e-b4dd-417574e1c7ea service nova] Creating event network-changed:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 09:57:15.818537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-efa39b1c-5bf1-488d-a9e7-e5167bd145b4 req-38e116f0-0b27-472e-b4dd-417574e1c7ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090592 Sep 07 09:57:15.825260 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1394/2805] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:15.835230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:15.836120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:15.840509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:15.844202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.844898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.845649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:15.846511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.847267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.847846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:15.851797 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9436169-0bcb-48cd-9fb4-8d3e5b7beda5 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.885129 Sep 07 09:57:15.852393 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1412/2806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:14 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:15.865833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:15.865833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:15.891974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.892809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.894736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:15.898045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:15.898763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:15.899359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.334736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:16.347681 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1bf5324c-6cea-49c0-876b-c449484dd8c7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.520301 Sep 07 09:57:16.348619 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1395/2807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:15 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:16.353558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:16.353558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] [instance: d85fc285-eb10-46e3-93ab-882fcaaeb63f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:16.371698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.372450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.373968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.374927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.375545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.376132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.404606 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] HTTP exception thrown: Instance d85fc285-eb10-46e3-93ab-882fcaaeb63f could not be found. Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Request method failure captured: Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f HTTP/1.1 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGqHiITbQs_ZPFHa5jbsCiNGw81Hp3UF0zVNC65x-zq64lllXqkqxxYESMNAymG9p454aIoAbYspcxMtRftGIa2GDqMfhjPIEaoU-tATHM9-_Kfwl6WpSF4VQ2BJ8hWH2DonCMGasoiQrXrERqeiJ2JaECdgjDFdb3aQGFP33T_t7l0 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d26be1ae8f8d45e28ae37c07670deb86 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d26be1ae8f8d45e28ae37c07670deb86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d26be1ae8f8d45e28ae37c07670deb86", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d26be1ae8f8d45e28ae37c07670deb86 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1089448778 Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesOneServerTestJSON-1089448778-project Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 52661062c37f426984b4a0ad2ba02d3f Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesOneServerTestJSON-1089448778-project Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d85fc285-eb10-46e3-93ab-882fcaaeb63f could not be found. Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd85fc285-eb10-46e3-93ab-882fcaaeb63f'} Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85fc285-eb10-46e3-93ab-882fcaaeb63f could not be found. Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85fc285-eb10-46e3-93ab-882fcaaeb63f could not be found. Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:16.411889 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85fc285-eb10-46e3-93ab-882fcaaeb63f could not be found. Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] Returning 404 to user: Instance d85fc285-eb10-46e3-93ab-882fcaaeb63f could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09bbd925-7600-4b28-8975-a86ce4f8a72a tempest-ImagesOneServerTestJSON-1089448778 tempest-ImagesOneServerTestJSON-1089448778-project] 10.222.0.60 "GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f" status: 404 len: 111 microversion: 2.1 time: 0.064145 Sep 07 09:57:16.416394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1396/2808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:16 2022] GET /compute/v2.1/servers/d85fc285-eb10-46e3-93ab-882fcaaeb63f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:16.423763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:16.433642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4510cd73-8f03-4fda-9cdd-6faa74455daf tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.580161 Sep 07 09:57:16.434456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-87cbbb76-4dd4-4d48-bb40-8602b04fc9bf req-521e604b-70a2-4c97-b488-2487f8fd5b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839a4577-a9a7-40c2-a837-4ec147ebb4fe", "name": "network-vif-deleted", "tag": "e709bf9d-7ef9-45a3-845c-fdc790d7079c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:16.434770 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1413/2809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:15 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:16.452472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87cbbb76-4dd4-4d48-bb40-8602b04fc9bf req-521e604b-70a2-4c97-b488-2487f8fd5b75 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.452971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87cbbb76-4dd4-4d48-bb40-8602b04fc9bf req-521e604b-70a2-4c97-b488-2487f8fd5b75 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.453449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-87cbbb76-4dd4-4d48-bb40-8602b04fc9bf req-521e604b-70a2-4c97-b488-2487f8fd5b75 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.476818 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-87cbbb76-4dd4-4d48-bb40-8602b04fc9bf req-521e604b-70a2-4c97-b488-2487f8fd5b75 service nova] Creating event network-vif-deleted:e709bf9d-7ef9-45a3-845c-fdc790d7079c for instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe on n-h1-836830-16 Sep 07 09:57:16.488286 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-87cbbb76-4dd4-4d48-bb40-8602b04fc9bf req-521e604b-70a2-4c97-b488-2487f8fd5b75 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057843 Sep 07 09:57:16.489641 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1397/2810] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:57:16.617451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bd4bd212-2305-4122-af6e-7a5d3fd594cb req-9ef22956-eabe-4f1e-96ab-553f27b082f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39cffed-b173-455b-96fe-36ff55a430e5", "name": "network-vif-plugged", "status": "completed", "tag": "7f019167-4036-4afd-83ef-2ab56ea7fcd7"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:16.706251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bd4bd212-2305-4122-af6e-7a5d3fd594cb req-9ef22956-eabe-4f1e-96ab-553f27b082f3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.714425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bd4bd212-2305-4122-af6e-7a5d3fd594cb req-9ef22956-eabe-4f1e-96ab-553f27b082f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.716097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bd4bd212-2305-4122-af6e-7a5d3fd594cb req-9ef22956-eabe-4f1e-96ab-553f27b082f3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.748951 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bd4bd212-2305-4122-af6e-7a5d3fd594cb req-9ef22956-eabe-4f1e-96ab-553f27b082f3 service nova] Creating event network-vif-plugged:7f019167-4036-4afd-83ef-2ab56ea7fcd7 for instance e39cffed-b173-455b-96fe-36ff55a430e5 on n-h2-836830-16 Sep 07 09:57:16.749167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:16.750034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:16.758382 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bd4bd212-2305-4122-af6e-7a5d3fd594cb req-9ef22956-eabe-4f1e-96ab-553f27b082f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146264 Sep 07 09:57:16.759759 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1414/2811] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:16.762333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.762798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.763925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.764858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.765372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.765805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.875600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:16.881242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.881914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.882616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.883234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'fault' on Instance uuid 839a4577-a9a7-40c2-a837-4ec147ebb4fe {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:57:16.892249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:16.893838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:16.906867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.907843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.908382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:16.909273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:16.910033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:16.910556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:17.162202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:17.178497 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bdc70f8e-5c7c-4c1d-98eb-3b2ed047c8f0 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1311 microversion: 2.1 time: 0.435337 Sep 07 09:57:17.180954 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1398/2812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:16 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1311 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:17.380044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:17.382613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:17.392898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:17.399296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:17.402594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:17.405496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:17.417717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:17.417717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:17.417717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:17.480915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:17.501140 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f8fe2d3-3da3-484d-a8cb-b3d9061db10d tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.622859 Sep 07 09:57:17.514458 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1415/2813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:16 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:17.523592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:17.530582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:17.548253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:17.548857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:17.549429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:17.550392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:17.550977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:17.551512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:18.029576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:18.032309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:18.040545 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81de4b39-9110-46d0-a4d4-a2819f896092 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.668942 Sep 07 09:57:18.064606 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1399/2814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:17 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:18.083594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:18.091832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-23830f1b-b86e-4ebb-b9c8-abd8d1f664f6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.575666 Sep 07 09:57:18.115060 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1416/2815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:17 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:18.216714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:18.218479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:18.235319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:18.245717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:18.246499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:18.247479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:18.251277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:18.251988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:18.369678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:18.373502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:18.378762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:18.380274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lazy-loading 'fault' on Instance uuid 839a4577-a9a7-40c2-a837-4ec147ebb4fe {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:57:18.528872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:18.531128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:18.550295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:18.554740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:18.555794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:18.557108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:18.569908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:18.571708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:18.702047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ddb24f5e0f46d4a1a6f228af0fbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a0a655407f4a0581de17ee2c7f8710', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:18.720386 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23b02b17-eeca-4d23-ad19-7c5a2453f5dd tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 200 len: 1311 microversion: 2.1 time: 0.512073 Sep 07 09:57:18.724118 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1400/2816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:18 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 1311 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:19.072612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:19.073979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:19.094250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:19.094754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:19.095810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:19.096551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:19.097500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:19.097500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:19.161100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:19.174411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4712ffe6-d96d-4f60-bca7-35b6b1dbafe1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1314 microversion: 2.1 time: 0.649881 Sep 07 09:57:19.194646 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1417/2817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:18 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:19.208530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:19.210341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:19.220910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:19.221734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:19.222393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:19.223264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:19.223881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:19.224464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:19.635734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:19.648569 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f4a0f00-0bfc-48e3-9c03-2dae1f98e24b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.452139 Sep 07 09:57:19.649671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1418/2818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:19 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:19.754359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:19.756046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] [instance: 839a4577-a9a7-40c2-a837-4ec147ebb4fe] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:19.766393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:19.769695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:19.770563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:19.771968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:19.772856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:19.773635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:19.801634 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] HTTP exception thrown: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe could not be found. Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Request method failure captured: Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe HTTP/1.1 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGmNizxB4fShSFrFh9Wyfm6wnqdKZy1tFr51h-_9N11GnUwTsH7OWIOnevZ4K-td0Xq2GUR8625QUK7CkYZJN43lHOE8h81hPqJUDtmblaHu7HrA4ajSDN0Xf-no8Zn5WryZ0YQEvNNHD_OnX5UhNU8j7saOe7-dUD-R73z64PLOXBA Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32a0a655407f4a0581de17ee2c7f8710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32a0a655407f4a0581de17ee2c7f8710", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 32a0a655407f4a0581de17ee2c7f8710 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-279762552 Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 46ddb24f5e0f46d4a1a6f228af0fbe8e Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-279762552-project Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe could not be found. Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '839a4577-a9a7-40c2-a837-4ec147ebb4fe'} Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe could not be found. Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe could not be found. Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:19.804516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe could not be found. Sep 07 09:57:19.808478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:57:19.808959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:19.812467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] Returning 404 to user: Instance 839a4577-a9a7-40c2-a837-4ec147ebb4fe could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:19.813962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36b139aa-339f-4557-9a02-ae3d091fa266 tempest-ServerRescueNegativeTestJSON-279762552 tempest-ServerRescueNegativeTestJSON-279762552-project] 10.222.0.60 "GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe" status: 404 len: 111 microversion: 2.1 time: 0.066139 Sep 07 09:57:19.821939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1292810e-6f68-4b9a-a5e1-36bff8bc2102 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.753611 Sep 07 09:57:19.822599 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1401/2820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:19 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:19.822778 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1419/2820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:19 2022] GET /compute/v2.1/servers/839a4577-a9a7-40c2-a837-4ec147ebb4fe => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:20.209623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:20.210223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:20.221539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:20.229823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:20.230294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:20.231142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:20.231606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:20.232719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:20.674096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:20.675407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:20.684272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:20.685750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:20.686459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:20.687482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:20.688403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:20.688941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:21.355797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:21.368780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-514aa0e8-8a38-479a-a536-dcc55317ee00 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1501 microversion: 2.1 time: 1.159624 Sep 07 09:57:21.375671 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1402/2821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:20 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1501 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:21.394695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:21.396911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:21.412590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:21.413082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:21.413548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:21.417373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:21.418001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:21.418595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:21.772449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:21.787204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37be5ce5-07fa-4599-8ea4-d29a04d3f650 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 1.117813 Sep 07 09:57:21.801169 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1420/2822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:20 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:21.804637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:21.805519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:21.814961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:21.815469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:21.815908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:21.816614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:21.817359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:21.817760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:21.854044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lazy-loading 'flavor' on Instance uuid e39cffed-b173-455b-96fe-36ff55a430e5 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:57:21.984805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:22.046074 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b31b6c9c-cf95-41cc-9261-958050ea31a0 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "POST /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5/action" status: 202 len: 0 microversion: 2.1 time: 0.250086 Sep 07 09:57:22.047727 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1421/2823] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:57:21 2022] POST /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:57:22.082498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-08fe8f06-0850-4d06-b7fe-706aff97d783 req-58268f45-6689-4109-ac68-ac8399e563cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "name": "network-vif-plugged", "status": "completed", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:22.117507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-08fe8f06-0850-4d06-b7fe-706aff97d783 req-58268f45-6689-4109-ac68-ac8399e563cf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:22.118385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-08fe8f06-0850-4d06-b7fe-706aff97d783 req-58268f45-6689-4109-ac68-ac8399e563cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:22.119263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-08fe8f06-0850-4d06-b7fe-706aff97d783 req-58268f45-6689-4109-ac68-ac8399e563cf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:22.139594 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-08fe8f06-0850-4d06-b7fe-706aff97d783 req-58268f45-6689-4109-ac68-ac8399e563cf service nova] Creating event network-vif-plugged:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:57:22.148390 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-08fe8f06-0850-4d06-b7fe-706aff97d783 req-58268f45-6689-4109-ac68-ac8399e563cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082931 Sep 07 09:57:22.149915 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1422/2824] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:22.157467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:22.158642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:22.167787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:22.168729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:22.170361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:22.171451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:22.172144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:22.172785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:22.364042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:22.379537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e056b8a4-2ac6-48ab-a775-d07a1bcff130 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 1.001086 Sep 07 09:57:22.379537 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1403/2825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:21 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:22.823925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:22.823925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:22.837639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:22.838561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:22.839312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:22.840421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:22.841108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:22.842784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:22.848477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:23.320105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:23.333837 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91c2d407-66db-4c9f-abd6-f03fb972b70c tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1509 microversion: 2.1 time: 1.179129 Sep 07 09:57:23.334401 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1423/2826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:22 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1509 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:23.403323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:23.404546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:23.420512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:23.421428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:23.427042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:23.429156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:23.435196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:23.435828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:23.565291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:23.587496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a6b68e4-6306-43d0-8603-e39f89905bcd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.777789 Sep 07 09:57:23.590274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1404/2827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:22 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:23.949073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:23.967632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-40d236e4-52f1-4476-a828-273bc5ed990d tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1323 microversion: 2.1 time: 0.568040 Sep 07 09:57:23.972192 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1424/2828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:23 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1323 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:24.357938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:24.359040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:24.384029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:24.387604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:24.389687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:24.391764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:24.393514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:24.394208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:24.613209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:24.614989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:24.625482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:24.626210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:24.629625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:24.630585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:24.631251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:24.631745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:24.979229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:24.980624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:24.994631 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67de18e5-4258-4fda-9c5c-0791f5a90e8b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.380986 Sep 07 09:57:24.995574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1425/2829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:24 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:25.004610 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7447f2b5-8cb4-4609-9d90-f8524fe3ffdf tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1492 microversion: 2.1 time: 0.647475 Sep 07 09:57:25.004610 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1405/2830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:24 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1492 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:25.030444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:25.031071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:25.032207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:25.032909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:25.040416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:25.040957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:25.041462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:25.042220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:25.042818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:25.043190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:25.043307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:25.053983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:25.054856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:25.055809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:25.056447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:25.057113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:25.099013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:57:25.307508 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a78ed66-b94a-4960-a47b-decb6caa5f0f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 204 len: 0 microversion: 2.1 time: 0.279781 Sep 07 09:57:25.308895 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1426/2831] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:25 2022] DELETE /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:57:25.317945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:25.319038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:25.333336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:25.334183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:25.334902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:25.336143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:25.336879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:25.337546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.055965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:26.064038 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25daef77-7444-43b2-bac1-9d0b70b98771 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1498 microversion: 2.1 time: 0.750221 Sep 07 09:57:26.068212 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1427/2832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:25 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1498 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:26.080367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5d9f7ffb-db67-4336-bd0a-4f963de89e2d req-019821fb-756d-49f2-bbeb-8f095c26142d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "name": "network-vif-plugged", "status": "completed", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:26.099315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5d9f7ffb-db67-4336-bd0a-4f963de89e2d req-019821fb-756d-49f2-bbeb-8f095c26142d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.100161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5d9f7ffb-db67-4336-bd0a-4f963de89e2d req-019821fb-756d-49f2-bbeb-8f095c26142d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.100812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5d9f7ffb-db67-4336-bd0a-4f963de89e2d req-019821fb-756d-49f2-bbeb-8f095c26142d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.114221 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5d9f7ffb-db67-4336-bd0a-4f963de89e2d req-019821fb-756d-49f2-bbeb-8f095c26142d service nova] Creating event network-vif-plugged:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 09:57:26.119927 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5d9f7ffb-db67-4336-bd0a-4f963de89e2d req-019821fb-756d-49f2-bbeb-8f095c26142d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050138 Sep 07 09:57:26.120961 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1428/2833] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:26.127114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:26.128134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:26.135503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.136416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.137391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.139077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.139796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.140693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.227808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:26.241420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0cd2272-821f-45f4-9c18-e37432811e2e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1519 microversion: 2.1 time: 1.220876 Sep 07 09:57:26.242122 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1406/2834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:25 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1519 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:26.270486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:26.272917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:26.290787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.291791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.292246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.292968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.293559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.295025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.364470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lazy-loading 'flavor' on Instance uuid 195c12a5-e815-48c9-a628-b717b87f676c {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:57:26.554762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:26.564001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d1c6d787-f63c-4041-9670-f28668f72c6f tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 0.441476 Sep 07 09:57:26.592804 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1429/2835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:26 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:26.698663 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a64a22db-a079-44a3-bd30-0e81bd8c7ef8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action" status: 200 len: 32 microversion: 2.1 time: 0.431980 Sep 07 09:57:26.709118 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1407/2836] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:57:26 2022] POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 09:57:26.710684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:26.711383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:26.723199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.736519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.737678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:26.740317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:26.742509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:26.745710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:27.102959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:27.106450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:27.120367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:27.131235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:27.137335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:27.139225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:27.146190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:27.148569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:28.137285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:28.150780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-550b2cde-564e-4557-9be4-02bf0981fd86 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1498 microversion: 2.1 time: 1.056345 Sep 07 09:57:28.153484 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1408/2837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:27 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1498 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:28.162939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:28.163925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:28.176377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:28.200397 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-486dc689-dd1e-4827-9f6b-9cd731a8ca7b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 1.486050 Sep 07 09:57:28.204846 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1430/2838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:26 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:28.208937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:28.210058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:28.219596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:28.222951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:28.223697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:28.226220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:28.230985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8151202c-5b05-4950-b22a-2ecb8271b0df tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Action: 'create', calling method: .version_select at 0x7f14b1264a60>, body: {"keypair": {"name": "tempest-keypair-341427353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWCCyTJtg9NDhzCaFKS1cVppmXF47qKVKiySVwyfWRsBXxYO4y1mor+5lBjAwlv9B6rZBPNu7fZ2DQmGCuM14HN5Fxo5oYGymZVIKAUNJbCXs9I68jUezvUFCwcRthW8g=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:28.275236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-8151202c-5b05-4950-b22a-2ecb8271b0df tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Getting quotas for project e3c7a2ab850049869743783576449827. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:28.292649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-8151202c-5b05-4950-b22a-2ecb8271b0df tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Getting quotas for user a94d8ef11b6a438a8812e7c0e8c1adde and project e3c7a2ab850049869743783576449827. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:28.348421 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8151202c-5b05-4950-b22a-2ecb8271b0df tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.142186 Sep 07 09:57:28.350103 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1431/2839] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:57:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:57:29.182139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:29.182757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:29.196846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:29.197426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:29.198060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:29.201850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:29.202538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:29.204943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:29.372168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:29.384263 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd80c1e5-09ef-4592-b403-ca8bd609c56b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1378 microversion: 2.1 time: 1.228451 Sep 07 09:57:29.389529 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1409/2840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:28 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1378 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:29.398668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:29.399758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:29.422743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:29.423246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:29.423693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:29.424402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:29.429533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:29.430084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:30.127235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:30.139296 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-59b3c54b-9789-4725-8be1-22fab1ec6840 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.748595 Sep 07 09:57:30.140504 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1410/2841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:29 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:30.395005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2392bb6ddb418faf01ad30c07297c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32ff711449d46a8988320faa8d16932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:30.417748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:30.421734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:30.429225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cfe0755-b194-46dd-8271-138be01d1d52 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 200 len: 1498 microversion: 2.1 time: 1.251587 Sep 07 09:57:30.454227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:30.454830 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1432/2842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:29 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 1498 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:30.457014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:30.457548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:30.459324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:30.459813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:30.460256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:30.838334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b07c230e-8e8a-4459-81c5-6aa2a9bd2c34 req-c27a6b2c-409e-47ff-8109-9ae9caaa63b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39cffed-b173-455b-96fe-36ff55a430e5", "name": "network-vif-deleted", "tag": "7f019167-4036-4afd-83ef-2ab56ea7fcd7"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:30.868862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b07c230e-8e8a-4459-81c5-6aa2a9bd2c34 req-c27a6b2c-409e-47ff-8109-9ae9caaa63b0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:30.869392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b07c230e-8e8a-4459-81c5-6aa2a9bd2c34 req-c27a6b2c-409e-47ff-8109-9ae9caaa63b0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:30.869830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b07c230e-8e8a-4459-81c5-6aa2a9bd2c34 req-c27a6b2c-409e-47ff-8109-9ae9caaa63b0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:30.910984 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b07c230e-8e8a-4459-81c5-6aa2a9bd2c34 req-c27a6b2c-409e-47ff-8109-9ae9caaa63b0 service nova] Creating event network-vif-deleted:7f019167-4036-4afd-83ef-2ab56ea7fcd7 for instance e39cffed-b173-455b-96fe-36ff55a430e5 on n-h2-836830-16 Sep 07 09:57:30.925310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b07c230e-8e8a-4459-81c5-6aa2a9bd2c34 req-c27a6b2c-409e-47ff-8109-9ae9caaa63b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092334 Sep 07 09:57:30.926238 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1433/2843] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:31.168700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:31.170074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:31.176029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:31.196493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3de71d69-6a9a-4595-a0bc-da5e4a500c99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1528 microversion: 2.1 time: 0.780162 Sep 07 09:57:31.202957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1411/2844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:30 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1528 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:31.207317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:31.207828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:31.211010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:31.214131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:31.214656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:31.215107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:31.230019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:31.231320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:31.264777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:31.265328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:31.265781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:31.266507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:31.266971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:31.267404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.064297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:32.080293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93c0db3d-a9ee-4a23-ace7-0b26403c1440 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1528 microversion: 2.1 time: 0.854124 Sep 07 09:57:32.081609 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1412/2845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:31 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1528 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:32.086631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.087251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.102080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.102581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.103154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.103882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.113112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.113974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.152249 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 HTTP/1.1 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e39cffed-b173-455b-96fe-36ff55a430e5'} Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.159433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.164934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.166856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.167952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dab20332-044a-48bb-b7a4-92544818ad54 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 404 len: 111 microversion: 2.1 time: 0.085075 Sep 07 09:57:32.179335 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1413/2846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.185716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fba25ca7-e362-49ca-9228-81d6aca4dad5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Action: 'create', calling method: .version_select at 0x7f14b0fc4700>, body: {"keypair": {"name": "tempest-keypair-998894080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiaNwmlK1NKkQF1FtDkscJaWSobOi4o1mCMGfXXFLqfnCe4M3eRj7VGaEEAwMLyXYA7gJPKAgexYkYpZkqGbUIxHpPNJ98+gLd0d8rMvlpx73HnShJi/6LDM2Z+7phQqg=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:32.204680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:32.206926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fba25ca7-e362-49ca-9228-81d6aca4dad5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Getting quotas for project 997725e52ede40b592e0d19f35e5bc5d. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:32.219107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d8cab9f-5969-454d-a9ea-821e690c9ad7 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 1.055335 Sep 07 09:57:32.220853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fba25ca7-e362-49ca-9228-81d6aca4dad5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Getting quotas for user 2384d558123f4c0c9a3948556ceb4145 and project 997725e52ede40b592e0d19f35e5bc5d. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:32.223954 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1434/2847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:31 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:32.238374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79a8a71e-2167-425e-8fdd-7798d27527cb tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.288413 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fba25ca7-e362-49ca-9228-81d6aca4dad5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.107432 Sep 07 09:57:32.289454 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1414/2848] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:57:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:57:32.297777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79a8a71e-2167-425e-8fdd-7798d27527cb tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/ca6f7c72-5c48-4e50-af7c-77106cce9593" status: 202 len: 0 microversion: 2.1 time: 0.072443 Sep 07 09:57:32.299377 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1435/2849] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:32 2022] DELETE /compute/v2.1/flavors/ca6f7c72-5c48-4e50-af7c-77106cce9593 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:57:32.299496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.299899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.306433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ba89121-3223-4c9a-9aa1-6a70742db563 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.323064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.323641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.327641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.328655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.329385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.330016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.350675 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ba89121-3223-4c9a-9aa1-6a70742db563 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047761 Sep 07 09:57:32.356916 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.358145 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1436/2850] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 HTTP/1.1 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e39cffed-b173-455b-96fe-36ff55a430e5'} Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.360069 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.363970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.366016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.367291 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e390d680-21db-4343-8a44-850161c574b1 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 404 len: 111 microversion: 2.1 time: 0.076525 Sep 07 09:57:32.376726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:32.379032 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1415/2851] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:32 2022] DELETE /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.382333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.387893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.392893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e39cffed-b173-455b-96fe-36ff55a430e5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.405656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.406333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.414523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.416588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.419032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.419587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.424828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.425477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.425996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.427029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.429703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.430233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.464660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 HTTP/1.1 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e39cffed-b173-455b-96fe-36ff55a430e5'} Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.470089 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.474968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance e39cffed-b173-455b-96fe-36ff55a430e5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.475935 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65dbe3ba-964e-4762-8dcf-a10f9d951cea tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5" status: 404 len: 111 microversion: 2.1 time: 0.094719 Sep 07 09:57:32.480941 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1416/2852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/servers/e39cffed-b173-455b-96fe-36ff55a430e5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.486240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.493116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.534064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.536142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.538161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.539598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.543356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.543843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.584100 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 HTTP/1.1 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b9fe8ffa-af59-455c-9957-e6d062c247a5'} Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.586127 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.590836 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.592419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.593345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-02574231-f5d9-475f-9afd-8d34d7513d28 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 404 len: 111 microversion: 2.1 time: 0.110964 Sep 07 09:57:32.594055 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1417/2853] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:32 2022] DELETE /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.602399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.603303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: b9fe8ffa-af59-455c-9957-e6d062c247a5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.611368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.612021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.612768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.613794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.614432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.614980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.634013 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 HTTP/1.1 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b9fe8ffa-af59-455c-9957-e6d062c247a5'} Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.636015 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance b9fe8ffa-af59-455c-9957-e6d062c247a5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6851021a-2982-4450-be32-1f216bb576ce tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5" status: 404 len: 111 microversion: 2.1 time: 0.040764 Sep 07 09:57:32.640084 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1418/2854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/servers/b9fe8ffa-af59-455c-9957-e6d062c247a5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.648475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.649158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.656699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.657974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.658841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.659946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.660681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.661385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.681141 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 HTTP/1.1 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e196505e-2b63-4862-b532-6449982ac183'} Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.683218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.687728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.690833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.691990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-273ac2c5-4cb6-44ee-a39a-341c34558614 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 404 len: 111 microversion: 2.1 time: 0.048387 Sep 07 09:57:32.693728 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1419/2855] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:32 2022] DELETE /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.703537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.704526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: e196505e-2b63-4862-b532-6449982ac183] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.713057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.714028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.714705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.715797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.716586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.717340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.737799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 HTTP/1.1 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e196505e-2b63-4862-b532-6449982ac183'} Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.739828 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. Sep 07 09:57:32.743780 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.749908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance e196505e-2b63-4862-b532-6449982ac183 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.751740 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f4bf1532-6f3a-4c81-a3f5-e448a46109cc tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183" status: 404 len: 111 microversion: 2.1 time: 0.054671 Sep 07 09:57:32.752930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1420/2856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/servers/e196505e-2b63-4862-b532-6449982ac183 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.765303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.767274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.775766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.777440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.779159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.780204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.780903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.781608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.806862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 HTTP/1.1 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7e39a880-c107-479a-ac03-1bea990c81f8'} Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.809835 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.816337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.824136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.824136 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b51a13ed-ef34-46d7-97c5-de8566d32d99 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 404 len: 111 microversion: 2.1 time: 0.063911 Sep 07 09:57:32.824136 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1421/2857] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:32 2022] DELETE /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.832727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.833381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 7e39a880-c107-479a-ac03-1bea990c81f8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.845506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.846386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.847743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.848750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.849321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.849825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.867080 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 HTTP/1.1 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7e39a880-c107-479a-ac03-1bea990c81f8'} Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.871535 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.876989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 7e39a880-c107-479a-ac03-1bea990c81f8 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.880527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-73afdecc-78ab-4944-9e61-5be11c3bf393 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8" status: 404 len: 111 microversion: 2.1 time: 0.052634 Sep 07 09:57:32.884753 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1422/2858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/servers/7e39a880-c107-479a-ac03-1bea990c81f8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:57:32.891017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.892175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:32.901289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.902462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.904824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.907143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:32.909070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:32.909889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:32.933313 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 HTTP/1.1 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4eda8ab4-7762-4e34-9ea3-e64fba33d3a7'} Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:32.938399 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:32.949239 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:32.954316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:32.959192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dbb1787c-1d07-43c3-8fa7-c2627b758541 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 404 len: 111 microversion: 2.1 time: 0.072935 Sep 07 09:57:32.968133 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1423/2859] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:32 2022] DELETE /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:32.982775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:32.985144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:33.009659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:33.012530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:33.013223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:33.017415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:33.018160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:33.019241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:33.068361 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 HTTP/1.1 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4eda8ab4-7762-4e34-9ea3-e64fba33d3a7'} Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:33.073387 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:33.078290 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d17636c6-4c09-4696-8b82-fcd9e2c97a9a tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7" status: 404 len: 111 microversion: 2.1 time: 0.105328 Sep 07 09:57:33.079253 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1424/2860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:32 2022] GET /compute/v2.1/servers/4eda8ab4-7762-4e34-9ea3-e64fba33d3a7 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:33.163451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:33.197034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Old instance type tempest-test_resize_flavor_-5403019, new instance type m1.heat {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 09:57:33.221427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:33.222063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:33.222319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:33.222732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:33.223254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:33.251604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:33.252301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:33.269624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:33.270140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:33.270593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:33.271324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:33.271790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:33.277913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:33.602140 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ead3883f-9bb0-466f-8971-8b6fb9a41f19 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36/action" status: 202 len: 0 microversion: 2.1 time: 1.229843 Sep 07 09:57:33.613412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1437/2861] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:57:32 2022] POST /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36/action => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:57:33.621501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:33.623594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:33.639554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:33.644033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:33.644693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:33.646174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:33.646817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:33.648629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:34.058403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:34.069694 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc97e1c8-a9c2-4ca8-aa4d-2727a7fa66da tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.822649 Sep 07 09:57:34.071503 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1425/2862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:33 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:57:34.605999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:34.627328 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd382b14-cb02-4c27-8c78-c6277a50363a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1537 microversion: 2.1 time: 1.004807 Sep 07 09:57:34.631130 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1438/2863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:33 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1537 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:35.096536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:35.097364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:35.112270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:35.113481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:35.114909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:35.116855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:35.118699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:35.119624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:35.819467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:35.830494 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b02a1ac5-b778-432b-bbef-482fe24e5646 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.739247 Sep 07 09:57:35.837937 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1426/2864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:35 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:35.850956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:35.856635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:35.873429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:35.874853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:35.875533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:35.877076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:35.877815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:35.882140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:35.894007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:35.908285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac868b10-b07e-4679-8592-7a918888026f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b1234160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-459738437", "description": "tempest-description-1041468374"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:36.179589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:36.198350 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-457dfe30-89da-46ef-bf22-7016411d4330 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1537 microversion: 2.1 time: 0.351433 Sep 07 09:57:36.213840 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1427/2865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:35 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1537 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:36.226528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2039094292", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b94c0c25-42a5-4523-88e6-573c7a4373ae"}, {"port": "a8ae0eeb-5f67-4acd-8aba-e2102c88e845", "tag": "port-1"}, {"port": "f1db77bf-0c02-4148-82fb-f59530d17e45", "tag": "port-2"}, {"uuid": "44aa6cb9-0435-4852-a249-fef10e4bf7c8", "tag": "net-1"}, {"uuid": "44aa6cb9-0435-4852-a249-fef10e4bf7c8"}, {"uuid": "310e56f2-9af4-4f34-a5d9-28dd9b34eec9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "310e56f2-9af4-4f34-a5d9-28dd9b34eec9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "22543084-357d-4223-b1e9-5fa27c5c5df5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "45e1df02-ce35-472c-8ee7-855cd5f2f5e8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "011a10f8-0197-42fa-b007-45e08873ec75", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2055885979"}], "key_name": "tempest-keypair-341427353", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:36.419106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] validate_networks() for [('b94c0c25-42a5-4523-88e6-573c7a4373ae', None, None, None, None, None), (None, None, 'a8ae0eeb-5f67-4acd-8aba-e2102c88e845', None, None, None), (None, None, 'f1db77bf-0c02-4148-82fb-f59530d17e45', None, None, None), ('44aa6cb9-0435-4852-a249-fef10e4bf7c8', None, None, None, None, None), ('44aa6cb9-0435-4852-a249-fef10e4bf7c8', None, None, None, None, None), ('310e56f2-9af4-4f34-a5d9-28dd9b34eec9', '10.2.2.100', None, None, None, None), ('310e56f2-9af4-4f34-a5d9-28dd9b34eec9', '10.2.2.200', None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:57:36.775406 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac868b10-b07e-4679-8592-7a918888026f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.205998 Sep 07 09:57:36.776929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1439/2866] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:57:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:36.789868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1260c395-f3cc-4020-8780-cd03e6cdb5da tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b125d820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-34154996", "description": "tempest-description-879939785"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:37.895525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1260c395-f3cc-4020-8780-cd03e6cdb5da tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.109732 Sep 07 09:57:37.896446 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1440/2867] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:57:36 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:37.901090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:37.901729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:37.914637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:37.921720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:37.922850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:37.923931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:37.924557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:37.925413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:38.307811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:38.547648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:38.553529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:38.556285 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-644a4ae6-c1a1-4e4c-a635-d6d71797f6ca tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.658746 Sep 07 09:57:38.556873 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1441/2868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:37 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:38.573357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:38.574280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:38.594571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:38.595634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:38.596090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:38.596813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:38.597303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:38.597734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:38.933731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:38.950408 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2d9fed2-8da7-45d6-956f-ca505170d3ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1537 microversion: 2.1 time: 0.391871 Sep 07 09:57:38.951533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1442/2869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:38 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1537 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:38.960455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1569211796", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "f73e1c51-3b7c-466f-9296-75cc24b60851"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:39.089499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] validate_networks() for [('f73e1c51-3b7c-466f-9296-75cc24b60851', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:57:39.998348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:39.998978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:40.001052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:40.001524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:40.002233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:40.031870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:40.034185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:40.038816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:40.039808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:40.040711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:40.041346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:40.097444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Getting quotas for project f1519d78849c4223b6024a32d5607308. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:40.116433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Getting quotas for user d5f63b87c6474177a7705deed6a4365a and project f1519d78849c4223b6024a32d5607308. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:40.137725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:40.150369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:40.154760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:40.236764 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab010a71-9082-4507-a561-170a496d5904 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283341 Sep 07 09:57:40.238533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1443/2870] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:57:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:57:40.257360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1515688913", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2d8a977f-991f-48b1-977e-b494ece28b7b"}, {"port": "57936009-91d6-4234-b99f-5d420c0e3ffd", "tag": "port-1"}, {"port": "33dd40eb-4159-4612-af0e-40b1cdaa02ad", "tag": "port-2"}, {"uuid": "1fb92702-c13b-4e90-bf77-d8482153babc", "tag": "net-1"}, {"uuid": "1fb92702-c13b-4e90-bf77-d8482153babc"}, {"uuid": "1820129b-0f24-4a0f-9b88-edb3688205f6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1820129b-0f24-4a0f-9b88-edb3688205f6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "192a9ea0-421a-418d-95f1-1e88b391d05c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9f26292d-5db3-4407-b439-f5abe97241f8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cb0ab0a2-1174-4e3f-bf42-c2c1d495aa10", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2103277315"}], "key_name": "tempest-keypair-998894080", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:41.324859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] validate_networks() for [('2d8a977f-991f-48b1-977e-b494ece28b7b', None, None, None, None, None), (None, None, '57936009-91d6-4234-b99f-5d420c0e3ffd', None, None, None), (None, None, '33dd40eb-4159-4612-af0e-40b1cdaa02ad', None, None, None), ('1fb92702-c13b-4e90-bf77-d8482153babc', None, None, None, None, None), ('1fb92702-c13b-4e90-bf77-d8482153babc', None, None, None, None, None), ('1820129b-0f24-4a0f-9b88-edb3688205f6', '10.2.2.100', None, None, None, None), ('1820129b-0f24-4a0f-9b88-edb3688205f6', '10.2.2.200', None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:57:42.240496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:43.338914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:43.339600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:43.340156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:43.340677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:43.342147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:43.368013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:43.370715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:43.372311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:43.373911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:43.374395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:43.374840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:43.448654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Getting quotas for project e3c7a2ab850049869743783576449827. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:43.462957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Getting quotas for user a94d8ef11b6a438a8812e7c0e8c1adde and project e3c7a2ab850049869743783576449827. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:43.698304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:43.703138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='22543084-357d-4223-b1e9-5fa27c5c5df5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='45e1df02-ce35-472c-8ee7-855cd5f2f5e8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='011a10f8-0197-42fa-b007-45e08873ec75',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:44.460314 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99c44b86-5e27-4c5d-a5da-259888c67855 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.244679 Sep 07 09:57:44.468670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1428/2871] 10.222.0.60 () {62 vars in 1189 bytes} [Wed Sep 7 09:57:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 8247 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:57:44.468670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:44.468932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:44.476707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:44.477466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:44.478020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:44.479000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:44.480180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:44.480862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:44.512271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec HTTP/1.1 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '798bd295-ae8f-4655-9822-59beb0f4feec'} Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:44.514564 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-662ad84a-406e-45b7-a177-59bb37ea157f tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 404 len: 111 microversion: 2.1 time: 0.054021 Sep 07 09:57:44.519044 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1429/2872] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:44 2022] DELETE /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:44.524428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:44.525038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:44.532874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:44.533563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:44.533997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:44.534939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:44.535695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:44.536159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:45.259297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:45.271166 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a8da59e-f34d-4919-9359-970b76637c7e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.753092 Sep 07 09:57:45.273809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1430/2873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:44 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:45.281974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:45.283058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:45.302906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:45.303552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:45.303863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:45.304589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:45.305050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:45.307936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:45.761766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:45.776837 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3897ed59-abe7-469e-96b8-22ecdd4ccc22 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1542 microversion: 2.1 time: 0.501042 Sep 07 09:57:45.788461 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1431/2874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:45 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1542 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:45.788461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:45.788461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:45.791170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:45.791723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:45.792171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:45.793312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:45.794533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:45.795377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.116201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:46.125370 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-919e7590-1838-456a-a7d8-e770ea030979 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1316 microversion: 2.1 time: 0.345340 Sep 07 09:57:46.126515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1432/2875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:45 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:46.146379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-290686dc-5d11-40c4-b84c-5ea20d72a3bd req-6047222c-cec2-40be-ba52-29877f9d40e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ad764e-8eec-446f-8244-b67c4aa7572e", "tag": "8edec6c7-02b8-49db-a1ed-0679991755e3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:46.164772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-290686dc-5d11-40c4-b84c-5ea20d72a3bd req-6047222c-cec2-40be-ba52-29877f9d40e1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.165573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-290686dc-5d11-40c4-b84c-5ea20d72a3bd req-6047222c-cec2-40be-ba52-29877f9d40e1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.166241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-290686dc-5d11-40c4-b84c-5ea20d72a3bd req-6047222c-cec2-40be-ba52-29877f9d40e1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.185539 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-290686dc-5d11-40c4-b84c-5ea20d72a3bd req-6047222c-cec2-40be-ba52-29877f9d40e1 service nova] Creating event network-changed:8edec6c7-02b8-49db-a1ed-0679991755e3 for instance 43ad764e-8eec-446f-8244-b67c4aa7572e on n-h1-836830-16 Sep 07 09:57:46.189798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-290686dc-5d11-40c4-b84c-5ea20d72a3bd req-6047222c-cec2-40be-ba52-29877f9d40e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047040 Sep 07 09:57:46.190770 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1433/2876] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:57:46.198408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:46.199375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:46.203446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:46.208174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.208674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.209133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.209867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.210331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.210763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.375443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:46.403009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:46.409600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:46.418803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2556daa7-a631-447c-9609-67efbb435eb3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1575 microversion: 2.32 time: 0.225130 Sep 07 09:57:46.422265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1434/2877] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:46 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:46.431112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:46.431742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 798bd295-ae8f-4655-9822-59beb0f4feec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:46.451095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.451621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.452070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.452778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.456794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.457572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.491525 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec HTTP/1.1 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '798bd295-ae8f-4655-9822-59beb0f4feec'} Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:46.495155 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. Sep 07 09:57:46.500002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:46.502825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 798bd295-ae8f-4655-9822-59beb0f4feec could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:46.505642 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9ecb97ff-2897-4a7e-9dd2-0bdd172aa3fd tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec" status: 404 len: 111 microversion: 2.1 time: 0.081941 Sep 07 09:57:46.506388 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1435/2878] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:46 2022] GET /compute/v2.1/servers/798bd295-ae8f-4655-9822-59beb0f4feec => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:46.516155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:46.516807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:46.533367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.534314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.534778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.537756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.540153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.541654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.938498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:46.951034 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e88d8fad-b1d4-45fc-ac0a-6c3e477bdfd9 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.441830 Sep 07 09:57:46.952539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1436/2879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:46 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:46.981105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:46.982611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:46.992326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.993685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.994350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:46.995316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:46.996961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:46.998196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:47.017408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a HTTP/1.1 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '20b26249-7d25-4480-bf8f-a7db6232438a'} Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:47.019554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.023217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:47.024056 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3f81623d-a57a-4bbb-b930-3512d967cd4e tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 404 len: 111 microversion: 2.1 time: 0.054353 Sep 07 09:57:47.028278 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1437/2880] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:57:46 2022] DELETE /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:47.031233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:47.032118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:47.043300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:47.044493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:47.045333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:47.046302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:47.046720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:47.047494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:47.674008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:47.684379 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-375c486a-f0a8-42d0-aaa9-cc6169b4889b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1542 microversion: 2.1 time: 0.658755 Sep 07 09:57:47.688284 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1438/2881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:47 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1542 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:47.701835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:47.702681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] [instance: 20b26249-7d25-4480-bf8f-a7db6232438a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:47.720506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:47.721208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:47.721814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:47.724723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:47.725478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:47.726406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:47.761300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] HTTP exception thrown: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Request method failure captured: Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a HTTP/1.1 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGmbROSYWeDlRnHboYjMSWhDuwTBXi2BDg62O_uAD7J0bFC3Q7IQRzruqPUs-Rg0rV0lnNnDqCRbA8BzMB0y_UCxRPRZJnIQWQZuqasxNcizujMIfnNOxpZGFdJx9p9unbl0Ro-AYs1a05by3QM35MypzMWpNHk_TGwMhHJs-3ur7aU Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c32ff711449d46a8988320faa8d16932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c32ff711449d46a8988320faa8d16932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c32ff711449d46a8988320faa8d16932", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c32ff711449d46a8988320faa8d16932 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1258348803 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4c2392bb6ddb418faf01ad30c07297c0 Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1258348803-project Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '20b26249-7d25-4480-bf8f-a7db6232438a'} Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:57:47.765912 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. Sep 07 09:57:47.770580 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:57:47.774001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] Returning 404 to user: Instance 20b26249-7d25-4480-bf8f-a7db6232438a could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:57:47.798404 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc84000f-1f5b-4c17-a95f-c63f166bf474 tempest-DeleteServersTestJSON-1258348803 tempest-DeleteServersTestJSON-1258348803-project] 10.222.0.60 "GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a" status: 404 len: 111 microversion: 2.1 time: 0.094138 Sep 07 09:57:47.811699 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1439/2882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:47 2022] GET /compute/v2.1/servers/20b26249-7d25-4480-bf8f-a7db6232438a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:57:47.827796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:47.829723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:47.838736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:47.839540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:47.841524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:47.842579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:47.843269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:47.843918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:48.058050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:48.058523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:48.058951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:48.059915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:48.060502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:48.093284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:48.094094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:48.099716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:48.100845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:48.102357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:48.103244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:48.174294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Getting quotas for project 997725e52ede40b592e0d19f35e5bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:48.181929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Getting quotas for user 2384d558123f4c0c9a3948556ceb4145 and project 997725e52ede40b592e0d19f35e5bc5d. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:48.560311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:48.563729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='192a9ea0-421a-418d-95f1-1e88b391d05c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9f26292d-5db3-4407-b439-f5abe97241f8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb0ab0a2-1174-4e3f-bf42-c2c1d495aa10',volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:48.888582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:48.897210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0151e6de-534e-487a-aefe-b82214a17d43 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1316 microversion: 2.1 time: 1.084028 Sep 07 09:57:48.901879 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1440/2883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:47 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:48.918092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:48.919012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:48.930480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:48.931283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:48.932608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:48.935246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:48.939653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:48.940346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:49.193826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:49.204819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:49.219397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:49.222855 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f47c8c4d-abb4-4e9a-b9c9-05e6bf937078 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1593 microversion: 2.32 time: 0.319670 Sep 07 09:57:49.227232 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1441/2884] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:48 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1593 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:49.239921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:49.245934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:49.256391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:49.264153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:49.264842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:49.265803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:49.270423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:49.271112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:49.290213 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49e9bd01-f61c-45d8-85e1-42b0e8977099 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.049388 Sep 07 09:57:49.292202 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1444/2885] 10.222.0.60 () {62 vars in 1189 bytes} [Wed Sep 7 09:57:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 9053 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:57:49.299260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:49.300183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:49.308064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:49.308825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:49.310146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:49.311103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:49.311785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:49.312431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:49.953124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:49.963586 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b5db955-0071-4554-b3b1-94cc660e70bb tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.735134 Sep 07 09:57:49.981763 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1442/2886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:49 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:49.981763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8a4c8d5-3c7c-4545-880d-1e3b87d223bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:49.981763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8a4c8d5-3c7c-4545-880d-1e3b87d223bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:50.028906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.048739 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1073dbec-e118-43b5-8176-88cbe75a0d9a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1542 microversion: 2.1 time: 0.755175 Sep 07 09:57:50.049398 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1445/2887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:49 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1542 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:50.057410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:50.058330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:50.088850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:50.089602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:50.090063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:50.092804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:50.093321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:50.093755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:50.309149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8a4c8d5-3c7c-4545-880d-1e3b87d223bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.323812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8a4c8d5-3c7c-4545-880d-1e3b87d223bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.332538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8a4c8d5-3c7c-4545-880d-1e3b87d223bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.334210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8a4c8d5-3c7c-4545-880d-1e3b87d223bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1285 microversion: 2.42 time: 0.365508 Sep 07 09:57:50.335279 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1443/2888] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:49 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:50.352676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:50.354752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:50.377505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:50.378562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:50.380968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:50.382801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:50.386327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:50.405581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:50.808073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.820621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.833394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:50.844820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c743aac6-0ac2-4e57-999b-4b0b9c8e2867 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1593 microversion: 2.32 time: 0.507992 Sep 07 09:57:50.859779 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1444/2889] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:50 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1593 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:50.891990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-13de06c9-9571-4066-9265-2cd9ec4b32f2 req-81e8ed37-1b6a-4aae-9351-d13b80366528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ad764e-8eec-446f-8244-b67c4aa7572e", "name": "network-vif-plugged", "status": "completed", "tag": "8edec6c7-02b8-49db-a1ed-0679991755e3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:50.914150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-13de06c9-9571-4066-9265-2cd9ec4b32f2 req-81e8ed37-1b6a-4aae-9351-d13b80366528 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:50.914790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-13de06c9-9571-4066-9265-2cd9ec4b32f2 req-81e8ed37-1b6a-4aae-9351-d13b80366528 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:50.915306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-13de06c9-9571-4066-9265-2cd9ec4b32f2 req-81e8ed37-1b6a-4aae-9351-d13b80366528 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:50.932603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-13de06c9-9571-4066-9265-2cd9ec4b32f2 req-81e8ed37-1b6a-4aae-9351-d13b80366528 service nova] Creating event network-vif-plugged:8edec6c7-02b8-49db-a1ed-0679991755e3 for instance 43ad764e-8eec-446f-8244-b67c4aa7572e on n-h1-836830-16 Sep 07 09:57:50.940055 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-13de06c9-9571-4066-9265-2cd9ec4b32f2 req-81e8ed37-1b6a-4aae-9351-d13b80366528 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055126 Sep 07 09:57:50.941101 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1445/2890] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:57:51.000120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:51.002181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:51.034662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:51.036251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:51.037374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:51.038639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:51.039544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:51.040264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:51.662150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:51.676801 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0888ec73-d850-43cb-a98b-9fcae2e78594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1316 microversion: 2.1 time: 1.623253 Sep 07 09:57:51.678346 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1446/2891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:50 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1316 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:51.685222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:51.686446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:51.695430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:51.709330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:51.709979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:51.710997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:51.711694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:51.712323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:52.042835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:52.068376 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b1bd749-89f4-4161-8675-b8753cbf7d9a tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 1.074199 Sep 07 09:57:52.074386 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1446/2892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:50 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:52.123566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:52.136974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be7098b9-9766-4091-9ad9-a76335b7e52e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1542 microversion: 2.1 time: 0.455437 Sep 07 09:57:52.138190 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1447/2893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:51 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:52.145064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:52.145956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:52.155943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:52.156635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:52.157935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:52.158955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:52.160418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:52.161032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:52.463527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:52.484606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:52.490884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:52.493551 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8d961358-cb05-4e6b-be54-db8577dddff1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1575 microversion: 2.42 time: 0.353000 Sep 07 09:57:52.494122 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1448/2894] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:52 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1575 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:52.510966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:52.514999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:52.535244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:52.535751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:52.541398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:52.545212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:52.546946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:52.549712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:52.690996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-488980393", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "319765c4-f691-402e-90ae-94e281b4eeb1"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:52.835408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] validate_networks() for [('319765c4-f691-402e-90ae-94e281b4eeb1', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:57:53.426955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:53.762258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:53.784210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:53.791266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:53.795635 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f739fd4-a724-402c-b01c-791b4cc16666 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1661 microversion: 2.32 time: 1.300549 Sep 07 09:57:53.798857 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1449/2895] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:52 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1661 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:53.815007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:53.817023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:53.844407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:53.845493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:53.846185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:53.847671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:53.848377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:53.852219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:55.527654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:55.540729 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-686256b6-fce0-492f-a21c-abdacd290ea6 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1504 microversion: 2.1 time: 1.736109 Sep 07 09:57:55.544926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1450/2896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:53 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1504 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:55.561826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:55.563257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:55.588932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:55.595033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:55.595945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:55.597100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:55.597862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:55.603626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:56.225555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:57:56.226862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:57:56.227501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:57:56.228278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:57:56.241463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:57:56.308726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:56.339077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:56.339811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:56.340761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:56.345067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:56.357290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:56.373528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:56.385580 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f140ba1-dcd8-45ae-b049-59276fed954e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.836284 Sep 07 09:57:56.386475 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1451/2897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:55 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:56.417515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:56.422375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:56.443585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:56.448361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:56.450210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:56.456677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:56.457207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:56.461148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:56.465301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Getting quotas for project 4df7057507da417682ba9bd2728443c9. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:57:56.502370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Getting quotas for user e32b61b3bf6947de8a78a6f448462a81 and project 4df7057507da417682ba9bd2728443c9. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:57:56.566577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:57:56.578880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:57:56.710061 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1fdb0aff-a320-4516-b98d-e822b4753284 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.634203 Sep 07 09:57:56.717600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1447/2898] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:57:56.755397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:56.756165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:56.777755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:56.779130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:56.779606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:56.782028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:56.782519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:56.782964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:57.354186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:57.375958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:57.382465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:57.417711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:57.446551 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df87881f-1135-4cd2-8537-aaba65c04a58 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1542 microversion: 2.1 time: 1.056942 Sep 07 09:57:57.457949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79ef4a63-ef70-4bbe-b4a4-e0df23e61dca tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1708 microversion: 2.42 time: 0.701015 Sep 07 09:57:57.475188 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1448/2899] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:56 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1708 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:57.481585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:57.485817 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1452/2900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:56 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1542 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:57.501842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-459738437"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:57:57.504796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:57.505722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:57.525046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:57.526259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:57.526923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:57.527573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:57.528966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:57.531455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:57.532206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:57.532677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:57.533116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:57.536582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:57.537071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:57.539749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:58.143419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:58.206345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:58.362645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.network.security_group_api [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Adding security group b478e135-9baf-42aa-8e95-76357eab71b2 to port 8edec6c7-02b8-49db-a1ed-0679991755e3 Sep 07 09:57:58.562947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:58.578355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:58.583251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:58.586677 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4ca3778f-c212-48fe-a2b4-89c8654608da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1708 microversion: 2.32 time: 1.110457 Sep 07 09:57:58.590420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1449/2901] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:57 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1708 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:58.599091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:58.601613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:58.612856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:58.613829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:58.614499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:58.615531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:58.616468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:58.623213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:58.679801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:57:58.923637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:58.935930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:58.952948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:58.955565 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3326edca-6110-45af-bc84-35ac7090b6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1313 microversion: 2.26 time: 0.363540 Sep 07 09:57:58.958853 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1450/2902] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:57:58 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:57:58.979526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:58.981720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:59.011250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:59.016538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:59.017324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:59.018293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:59.019917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:59.020569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:59.746282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:57:59.756780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68cef6a7-3286-45c7-98d4-e9db153f6f8c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.796212 Sep 07 09:57:59.761261 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1451/2903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:58 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:57:59.777888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:57:59.780380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:57:59.798867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:59.799645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:59.800834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:57:59.802548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:57:59.803966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:57:59.805930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:00.047540 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8aff2a88-c642-4ea9-b0b6-3591e7d9f727 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e/action" status: 202 len: 0 microversion: 2.1 time: 2.560506 Sep 07 09:58:00.049345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1453/2904] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:57:57 2022] POST /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e/action => generated 0 bytes in 2563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:00.055049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:00.055880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:00.075618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:00.082119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:00.091727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:00.093811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:00.095187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:00.096009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:00.329407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:00.347107 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7842a2ca-05c3-4c7d-b9ac-34506f147325 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1542 microversion: 2.1 time: 0.584539 Sep 07 09:58:00.353954 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1452/2905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:57:59 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1542 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:00.366076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:00.370569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:00.390937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:00.391835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:00.392492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:00.393531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:00.422600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:00.427531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:00.672610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:00.695230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:00.699909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:00.702851 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-acd99882-3cff-4744-84ae-2c4f720dea4e tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1755 microversion: 2.42 time: 0.652177 Sep 07 09:58:00.710825 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1454/2906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:00 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1755 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:00.721122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:00.727668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:00.743520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:00.744398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:00.745049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:00.746033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:00.747796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:00.748472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:01.475733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:01.501829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:01.508086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:01.511381 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97369828-027e-4c86-a8f5-af34c009050a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1319 microversion: 2.26 time: 0.798781 Sep 07 09:58:01.512089 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1455/2907] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:00 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:01.531265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-34154996"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:01.532141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:01.539560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:01.540439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:01.541116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:01.542042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:01.542658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:01.543324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:01.563025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:01.598718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:01.600820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:01.603199 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5850973-99b5-41cd-91d6-a7acc1023a3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1755 microversion: 2.32 time: 1.247319 Sep 07 09:58:01.609452 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1453/2908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:00 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1755 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:01.614617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a805c405-cc08-4e9e-bdfd-4a76155fb8e7 req-01d70a3a-f159-4286-8ad0-59113dd3b188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ad764e-8eec-446f-8244-b67c4aa7572e", "tag": "8edec6c7-02b8-49db-a1ed-0679991755e3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:01.639107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a805c405-cc08-4e9e-bdfd-4a76155fb8e7 req-01d70a3a-f159-4286-8ad0-59113dd3b188 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:01.639882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a805c405-cc08-4e9e-bdfd-4a76155fb8e7 req-01d70a3a-f159-4286-8ad0-59113dd3b188 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:01.640583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a805c405-cc08-4e9e-bdfd-4a76155fb8e7 req-01d70a3a-f159-4286-8ad0-59113dd3b188 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:01.671290 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a805c405-cc08-4e9e-bdfd-4a76155fb8e7 req-01d70a3a-f159-4286-8ad0-59113dd3b188 service nova] Creating event network-changed:8edec6c7-02b8-49db-a1ed-0679991755e3 for instance 43ad764e-8eec-446f-8244-b67c4aa7572e on n-h1-836830-16 Sep 07 09:58:01.682983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a805c405-cc08-4e9e-bdfd-4a76155fb8e7 req-01d70a3a-f159-4286-8ad0-59113dd3b188 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072101 Sep 07 09:58:01.685125 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1454/2909] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:01.733029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:01.737433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:01.761319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:01.763880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:01.764839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:01.766700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:01.768392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:01.770592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:02.359240 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.network.security_group_api [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Adding security group 86320ec8-10b5-4800-8ed7-39d1203666a0 to port 8edec6c7-02b8-49db-a1ed-0679991755e3 Sep 07 09:58:02.639632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:02.655651 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-098a1385-8885-404b-859f-7da2096515cc tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1525 microversion: 2.1 time: 0.947044 Sep 07 09:58:02.669571 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1455/2910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:01 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1525 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:02.682278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:02.683564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:02.699095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:02.700528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:02.704074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:02.705086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:02.706134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:02.708199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:03.561445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:03.574075 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-045a590c-231a-42c0-956a-02de9cbf5662 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1541 microversion: 2.1 time: 0.901673 Sep 07 09:58:03.575536 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1456/2911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:02 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1541 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:03.597315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:03.598271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:03.610411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:03.616531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:03.617842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:03.618643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:03.619659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:03.620102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:04.404183 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8d98b0af-15c7-44d3-aec5-4aab1028cd77 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e/action" status: 202 len: 0 microversion: 2.1 time: 2.887886 Sep 07 09:58:04.406696 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1456/2912] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:01 2022] POST /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e/action => generated 0 bytes in 2890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:04.418654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:04.419576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:04.436348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:04.436841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:04.442434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:04.443269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:04.444211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:04.444651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:04.810226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:04.852621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:04.856441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:04.874347 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34d15f8f-fc6f-439b-b81b-77392d5a08f7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1802 microversion: 2.42 time: 1.294026 Sep 07 09:58:04.905260 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1457/2913] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:03 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1802 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:04.917234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:04.930285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:04.941527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:04.951749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:04.952255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:04.952702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:04.953662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:04.953889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:04.954320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:04.963871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:04.967212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:04.974921 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-239d73b7-8c8b-48ef-b057-8f6945b771d4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1361 microversion: 2.26 time: 0.566669 Sep 07 09:58:04.976338 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1457/2914] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:04 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1361 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:04.990281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:04.995191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:05.010955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.014903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.015389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:05.016131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.018469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.018913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:05.578658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:05.595249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:05.599459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:05.602975 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0d77e2f-7689-4c04-90d9-5c667f9931e6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1802 microversion: 2.32 time: 0.691523 Sep 07 09:58:05.603595 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1458/2915] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:04 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1802 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:05.614459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:05.617104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:05.623659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:05.633905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.633905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.633905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:05.636644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.638123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.638748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:05.661948 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c18d20cd-80c6-4c22-9470-44954247968c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1505 microversion: 2.1 time: 0.684433 Sep 07 09:58:05.665745 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1458/2916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:04 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:05.680152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "name": "network-vif-unplugged", "status": "completed", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:05.712738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.713889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.715490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:05.743091 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] Creating event network-vif-unplugged:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 09:58:05.761544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] Instance da840644-19ee-4750-9302-a4b5e3e7af36 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:58:05.777170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f1855e15-b55c-4374-abd5-d5bf212b4973 req-4ed65043-3bf6-46ff-8c5c-162f30cd858d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108931 Sep 07 09:58:05.777918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1459/2917] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:05.790566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:05.805164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:05.815930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.816874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.817631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:05.819414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:05.819414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:05.820212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:06.414073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:06.499362 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60976803-571d-461e-8089-fe9d44830ad4 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.894509 Sep 07 09:58:06.510620 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1459/2918] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 7 09:58:05 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e/os-security-groups => generated 1155 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:06.518853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c55d1209-f7db-4f84-ada5-a58c97faec84 req-8c2a3299-8af7-4d18-948b-dae16a258a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ad764e-8eec-446f-8244-b67c4aa7572e", "tag": "8edec6c7-02b8-49db-a1ed-0679991755e3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:06.538788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:06.565782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:06.573544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:06.579266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c55d1209-f7db-4f84-ada5-a58c97faec84 req-8c2a3299-8af7-4d18-948b-dae16a258a12 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:06.582662 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a75dd7cf-e50e-48d5-80af-a616d4a43666 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1470 microversion: 2.1 time: 0.794217 Sep 07 09:58:06.583534 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1460/2919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:05 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1470 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:06.597302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c55d1209-f7db-4f84-ada5-a58c97faec84 req-8c2a3299-8af7-4d18-948b-dae16a258a12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:06.597302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c55d1209-f7db-4f84-ada5-a58c97faec84 req-8c2a3299-8af7-4d18-948b-dae16a258a12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:06.608810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de4e12d3-61d1-4561-a13e-9983923dc40b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'create', calling method: .version_select at 0x7f14b5d8a790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1985634152", "description": "tempest-description-2038883846"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:06.671890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c55d1209-f7db-4f84-ada5-a58c97faec84 req-8c2a3299-8af7-4d18-948b-dae16a258a12 service nova] Creating event network-changed:8edec6c7-02b8-49db-a1ed-0679991755e3 for instance 43ad764e-8eec-446f-8244-b67c4aa7572e on n-h1-836830-16 Sep 07 09:58:06.703283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c55d1209-f7db-4f84-ada5-a58c97faec84 req-8c2a3299-8af7-4d18-948b-dae16a258a12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188498 Sep 07 09:58:06.709800 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1460/2920] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:06.736350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f7a8422d-74ec-47bb-a595-097e2d9744ad req-07141b1c-3e24-4090-8b41-be1fcef1bf0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab92bde-2c38-40d4-a36a-a17a55fa01f2", "tag": "d547ddec-f190-4e7c-a0ee-f180a69e25b0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:06.779412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f7a8422d-74ec-47bb-a595-097e2d9744ad req-07141b1c-3e24-4090-8b41-be1fcef1bf0a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:06.780404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f7a8422d-74ec-47bb-a595-097e2d9744ad req-07141b1c-3e24-4090-8b41-be1fcef1bf0a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:06.781095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f7a8422d-74ec-47bb-a595-097e2d9744ad req-07141b1c-3e24-4090-8b41-be1fcef1bf0a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:06.804143 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f7a8422d-74ec-47bb-a595-097e2d9744ad req-07141b1c-3e24-4090-8b41-be1fcef1bf0a service nova] Creating event network-changed:d547ddec-f190-4e7c-a0ee-f180a69e25b0 for instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 on n-h2-836830-16 Sep 07 09:58:06.820315 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f7a8422d-74ec-47bb-a595-097e2d9744ad req-07141b1c-3e24-4090-8b41-be1fcef1bf0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103207 Sep 07 09:58:06.821848 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1461/2921] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:06.835452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:06.836510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:06.853302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:06.854932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:06.857012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:06.858754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:06.861767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:06.862561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:07.939969 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de4e12d3-61d1-4561-a13e-9983923dc40b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.340149 Sep 07 09:58:07.943991 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1461/2922] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:06 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:07.966364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:07.967902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:07.989064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:07.993707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:07.994364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:07.995353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:07.996540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:08.000369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:08.132132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:08.144664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:08.146445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:08.148936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4ef8880a-ca98-4ac7-9b18-327c7b1d962b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1849 microversion: 2.42 time: 1.325615 Sep 07 09:58:08.149776 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1462/2923] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:06 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1849 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:08.155782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f765ee0-f08f-4fcd-90bf-8d84f84db645 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b1c49c10>, body: {"security_group": {"name": " tempest-securitygroup -821439868 ", "description": "tempest-description-1095003473"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:08.766571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:08.776639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:08.780606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:08.782230 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e9f13cd-cdf9-428e-a171-78a7ce6a9eba tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1361 microversion: 2.26 time: 0.836801 Sep 07 09:58:08.783445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1462/2924] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:07 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1361 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:08.788574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:08.789399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:08.796969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:08.797767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:08.798365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:08.799280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:08.799907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:08.800497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:08.847471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:08.848719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:08.849935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:08.850863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:08.851495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:08.852088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:08.881337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:58:08.888078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for user 0e051e5308924154b7d5ecc2ea7ffdf7 and project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:58:09.035614 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-572b15bc-3568-42b6-84fb-2f253ecfd49a tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36/action" status: 202 len: 0 microversion: 2.1 time: 0.249946 Sep 07 09:58:09.037533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1463/2925] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:08 2022] POST /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:09.045034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:09.046253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:09.048063 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f765ee0-f08f-4fcd-90bf-8d84f84db645 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.896851 Sep 07 09:58:09.052456 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1463/2926] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:08 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:09.057069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:09.057790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:09.060298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:09.061328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:09.061954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:09.062545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:09.065244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1985634152"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:09.070215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:09.094758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:09.095698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:09.100272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:09.102169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:09.103009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:09.103640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:09.770000 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Adding security group aab323b7-8d88-4f89-b80e-80fc59ecbf21 to port a79f0f04-0fd8-400e-b0bd-e1e8628e920b Sep 07 09:58:10.173529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:10.202065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:10.205149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:10.220045 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8bb83399-bd61-4a1d-a9cd-af60c1a36070 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1849 microversion: 2.32 time: 1.167886 Sep 07 09:58:10.222058 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1464/2927] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:09 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1849 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:10.242431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "name": "network-vif-plugged", "status": "completed", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:10.285159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:10.294276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:10.295103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:10.331960 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] Creating event network-vif-plugged:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 09:58:10.354290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] Instance da840644-19ee-4750-9302-a4b5e3e7af36 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:58:10.374381 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9d887e35-0ab4-4746-837b-7a84dfb3dd09 req-5e24cf86-8def-47aa-9137-c2c66f90160c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150773 Sep 07 09:58:10.375264 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1465/2928] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:10.380991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-71458491-5d62-4890-ba8a-aa811c8010a7 req-5a3edfe8-6edc-43a8-8f48-284376296862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "34db865d-7ea1-4f47-b238-dd9dea03cc4f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:10.428211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:10.430658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-71458491-5d62-4890-ba8a-aa811c8010a7 req-5a3edfe8-6edc-43a8-8f48-284376296862 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:10.431408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-71458491-5d62-4890-ba8a-aa811c8010a7 req-5a3edfe8-6edc-43a8-8f48-284376296862 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:10.432004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-71458491-5d62-4890-ba8a-aa811c8010a7 req-5a3edfe8-6edc-43a8-8f48-284376296862 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:10.448959 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-71458491-5d62-4890-ba8a-aa811c8010a7 req-5a3edfe8-6edc-43a8-8f48-284376296862 service nova] Creating event network-changed:34db865d-7ea1-4f47-b238-dd9dea03cc4f for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:10.457011 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-71458491-5d62-4890-ba8a-aa811c8010a7 req-5a3edfe8-6edc-43a8-8f48-284376296862 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080206 Sep 07 09:58:10.458054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1466/2929] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:10.463790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:10.465820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:10.472409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:10.473256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:10.473938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:10.474864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:10.475557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:10.476954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:11.008273 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c16f0156-2b78-4ac9-a7b2-5c8d9a02189c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action" status: 202 len: 0 microversion: 2.1 time: 1.953369 Sep 07 09:58:11.012251 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1464/2930] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:09 2022] POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action => generated 0 bytes in 1955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:11.019326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aff2dfac-295b-49c2-ad8b-d704ec353e79 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1084ca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:11.522496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aff2dfac-295b-49c2-ad8b-d704ec353e79 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345" status: 200 len: 223 microversion: 2.1 time: 0.511702 Sep 07 09:58:11.523365 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1465/2931] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:58:11 2022] GET /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345 => generated 223 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:11.530830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:11.532355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:11.556838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:11.557745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:11.560673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:11.561943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:11.564348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:11.565763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:11.594906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:11.607235 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd82556d-2a8e-4800-8473-f249c00cb362 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1469 microversion: 2.1 time: 1.144360 Sep 07 09:58:11.608830 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1467/2932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:10 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1469 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:11.643843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:11.645011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:11.677588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:11.678583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:11.682006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:11.685044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:11.685919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:11.688187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:13.072617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:13.086580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:13.088379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:13.092087 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fb0f02b2-6894-4a0f-8332-46490f4e9d74 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1361 microversion: 2.26 time: 1.476380 Sep 07 09:58:13.098364 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1468/2933] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:11 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1361 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:13.114437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-854c4184-cd3f-4996-b905-0fe1da913197 req-8df515f6-3121-4050-90fa-3594c6dda155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "7942dc19-0d73-4b64-8443-ed7290abd41e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:13.135217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-854c4184-cd3f-4996-b905-0fe1da913197 req-8df515f6-3121-4050-90fa-3594c6dda155 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:13.141803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:13.150860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-854c4184-cd3f-4996-b905-0fe1da913197 req-8df515f6-3121-4050-90fa-3594c6dda155 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:13.156285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-854c4184-cd3f-4996-b905-0fe1da913197 req-8df515f6-3121-4050-90fa-3594c6dda155 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:13.164956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:13.168076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:13.179175 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dda57b90-6917-41ef-bd7a-8879b7839ba7 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1891 microversion: 2.42 time: 1.653108 Sep 07 09:58:13.182259 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1466/2934] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:11 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1891 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:13.191204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1985634152"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:13.198524 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-854c4184-cd3f-4996-b905-0fe1da913197 req-8df515f6-3121-4050-90fa-3594c6dda155 service nova] Creating event network-changed:7942dc19-0d73-4b64-8443-ed7290abd41e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:13.199998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:13.221685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-854c4184-cd3f-4996-b905-0fe1da913197 req-8df515f6-3121-4050-90fa-3594c6dda155 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121861 Sep 07 09:58:13.230136 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1469/2935] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:13.233420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:13.234610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:13.235489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:13.242124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:13.245274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:13.245997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:13.253578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:13.257285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:13.285813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:13.289915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:13.290384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:13.291139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:13.291608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:13.292061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:14.626134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Removing security group aab323b7-8d88-4f89-b80e-80fc59ecbf21 from port a79f0f04-0fd8-400e-b0bd-e1e8628e920b Sep 07 09:58:15.054972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:15.092348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:15.094483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:15.122879 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ef2189c2-5dfe-4fcf-9aad-eefd4d582c15 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1870 microversion: 2.32 time: 1.888584 Sep 07 09:58:15.123786 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1470/2936] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:13 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1870 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:15.174326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-431a9f9a-6b2d-42db-b9e8-37d95de1a558 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b125d4c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:16.305886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28ac4cf1-5927-4902-a580-4d81d0cb6d3c tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action" status: 202 len: 0 microversion: 2.1 time: 3.122237 Sep 07 09:58:16.306528 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1467/2937] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:13 2022] POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action => generated 0 bytes in 3123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:16.316325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0d6a06f7-43b2-49ac-ae8d-54a97110950f req-9583a4ce-09d2-40e6-b803-c666e91886f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:16.332764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:16.341137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d6a06f7-43b2-49ac-ae8d-54a97110950f req-9583a4ce-09d2-40e6-b803-c666e91886f0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:16.345970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d6a06f7-43b2-49ac-ae8d-54a97110950f req-9583a4ce-09d2-40e6-b803-c666e91886f0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:16.353452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d6a06f7-43b2-49ac-ae8d-54a97110950f req-9583a4ce-09d2-40e6-b803-c666e91886f0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:16.375708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0d6a06f7-43b2-49ac-ae8d-54a97110950f req-9583a4ce-09d2-40e6-b803-c666e91886f0 service nova] Creating event network-changed:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:58:16.393358 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0d6a06f7-43b2-49ac-ae8d-54a97110950f req-9583a4ce-09d2-40e6-b803-c666e91886f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072860 Sep 07 09:58:16.394814 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1468/2938] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:16.413705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b6d87033-94f3-4e0c-a64b-f8dca6e512fe req-b2b78edf-3c0e-4bc6-9140-6b21666f87af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab92bde-2c38-40d4-a36a-a17a55fa01f2", "name": "network-vif-plugged", "status": "completed", "tag": "d547ddec-f190-4e7c-a0ee-f180a69e25b0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:16.442773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b6d87033-94f3-4e0c-a64b-f8dca6e512fe req-b2b78edf-3c0e-4bc6-9140-6b21666f87af service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:16.448894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b6d87033-94f3-4e0c-a64b-f8dca6e512fe req-b2b78edf-3c0e-4bc6-9140-6b21666f87af service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:16.451411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b6d87033-94f3-4e0c-a64b-f8dca6e512fe req-b2b78edf-3c0e-4bc6-9140-6b21666f87af service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:16.475301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b6d87033-94f3-4e0c-a64b-f8dca6e512fe req-b2b78edf-3c0e-4bc6-9140-6b21666f87af service nova] Creating event network-vif-plugged:d547ddec-f190-4e7c-a0ee-f180a69e25b0 for instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 on n-h2-836830-16 Sep 07 09:58:16.494215 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b6d87033-94f3-4e0c-a64b-f8dca6e512fe req-b2b78edf-3c0e-4bc6-9140-6b21666f87af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091600 Sep 07 09:58:16.500083 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1469/2939] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:16.508627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:16.511445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:16.526989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:16.527828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:16.529711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:16.530736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:16.533761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:16.534310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:17.463337 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-431a9f9a-6b2d-42db-b9e8-37d95de1a558 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345" status: 202 len: 0 microversion: 2.1 time: 2.321415 Sep 07 09:58:17.463976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1471/2940] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:58:15 2022] DELETE /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345 => generated 0 bytes in 2340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:17.469576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:17.470201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:17.478278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:17.479040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:17.482356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:17.484285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:17.484969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:17.485637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:18.149342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:18.162265 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc6f19a5-ed66-4c18-b3a8-80b7fc9a5204 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1535 microversion: 2.1 time: 1.660756 Sep 07 09:58:18.173337 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1470/2941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:16 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1535 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:18.177730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:18.178553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:18.188712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:18.189481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:18.190232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:18.191124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:18.191752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:18.192340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:18.323840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:18.342917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:18.345648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:18.347659 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd0eda87-4de5-456e-a323-472090a2ee43 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1361 microversion: 2.26 time: 0.882346 Sep 07 09:58:18.348859 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1472/2942] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:17 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1361 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:18.358120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "57936009-91d6-4234-b99f-5d420c0e3ffd"}, {"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "33dd40eb-4159-4612-af0e-40b1cdaa02ad"}, {"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "388c8aab-43f8-4b1f-81d6-1de595152f6e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:18.380770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:18.381615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:18.383348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:18.400672 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Creating event network-changed:57936009-91d6-4234-b99f-5d420c0e3ffd for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:18.402105 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Creating event network-changed:33dd40eb-4159-4612-af0e-40b1cdaa02ad for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:18.404157 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] Creating event network-changed:388c8aab-43f8-4b1f-81d6-1de595152f6e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:18.420972 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9e480aca-d0f7-4adf-83e0-d15eec2e1e81 req-5da72d58-645f-4466-8a1c-57b64dc089b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.069265 Sep 07 09:58:18.421903 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1473/2943] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:18.439344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:18.439954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:18.468881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:18.470293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:18.476473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:18.478016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:18.478776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:18.480281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:18.881669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:19.004880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:19.021440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:19.023472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:19.024956 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-661516d9-523d-47d2-b060-7c65ca08c570 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1891 microversion: 2.42 time: 0.861099 Sep 07 09:58:19.026528 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1471/2944] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:18 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1891 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:19.045356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b6c2648-f444-4cf6-91b7-60bfb1ac72c5 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'create', calling method: .version_select at 0x7f14b19d9430>, body: {"pool": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:19.280219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:19.312268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:19.314574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:19.316209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a893f89c-62c1-4d91-81a3-5772ee2bdccf tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1891 microversion: 2.32 time: 0.891488 Sep 07 09:58:19.316917 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1474/2945] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:18 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1891 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:19.333532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b12610d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:19.429764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:58:19.430373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:58:19.431064 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.431064 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345 HTTP/1.1 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '42ad52cb-b3f4-4fe8-9e91-0846660c4345'} Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:58:19.435177 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-da4e9b2d-0f85-4be9-80a2-a89c64749cb1'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:19.439916 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2809b863-6dd1-4a3f-be48-1b9277017336 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345" status: 404 len: 194 microversion: 2.1 time: 0.118839 Sep 07 09:58:19.443671 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1475/2946] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:58:19 2022] GET /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345 => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:19.453535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "a8ae0eeb-5f67-4acd-8aba-e2102c88e845"}, {"name": "network-changed", "server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:19.478920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:19.479584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:19.479909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:19.511169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] Creating event network-changed:a8ae0eeb-5f67-4acd-8aba-e2102c88e845 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:19.512584 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] Creating event network-changed:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:58:19.530861 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a58dc5ad-7a78-41b8-9e98-c9d5546b87f3 req-4001133a-8bdd-4956-82ec-0cb4205a630b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089072 Sep 07 09:58:19.531477 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1476/2947] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:19.537131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:19.545651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:19.564264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:19.564660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:19.570064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:19.570908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:19.571654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:19.573788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:21.040352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:21.058300 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-501554df-169b-4ea6-9de4-fc32dcdde775 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1535 microversion: 2.1 time: 1.524865 Sep 07 09:58:21.073808 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1477/2948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:19 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1535 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:21.081563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:21.082195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:21.090615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:21.091505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:21.092321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:21.093742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:21.094541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:21.095131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:21.842694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:21.852802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:21.860392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:21.862199 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9b7633f6-194f-43eb-81eb-422f27b8cc73 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1543 microversion: 2.26 time: 0.787256 Sep 07 09:58:21.863078 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1478/2949] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:21 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1543 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:21.900032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c07b2ca9-1bde-49d3-b1fd-1d5251798563 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b11d23a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-951013792", "description": "tempest-description-1854835804"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:22.678735 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c07b2ca9-1bde-49d3-b1fd-1d5251798563 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.783216 Sep 07 09:58:22.692739 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1479/2950] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:22.699079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:22.700470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:22.724898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:22.725557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:22.726006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:22.734205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:22.734733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:22.735534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:24.084715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:24.105546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:24.107747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:24.113272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d7979e7c-1182-4103-afce-d70a52210ccb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1891 microversion: 2.42 time: 1.417329 Sep 07 09:58:24.114276 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1480/2951] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:22 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1891 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:24.129567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:24.130900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:24.155175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:24.155985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:24.160283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:24.161627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:24.162272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:24.162896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:24.233896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:24.996875 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b6c2648-f444-4cf6-91b7-60bfb1ac72c5 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.968447 Sep 07 09:58:24.997930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1472/2952] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 7 09:58:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:25.002705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "da887d2b-904a-42ea-907a-bd6e5039d46e"}, {"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "86b5436c-53b2-4b67-9ddb-a9339f76af52"}, {"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "c4ddaf2a-dc3f-43a5-93a8-6635d7547448"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:25.022920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.023403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.023838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.069152 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Creating event network-changed:da887d2b-904a-42ea-907a-bd6e5039d46e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:25.069611 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Creating event network-changed:86b5436c-53b2-4b67-9ddb-a9339f76af52 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:25.070113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] Creating event network-changed:c4ddaf2a-dc3f-43a5-93a8-6635d7547448 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:58:25.094772 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4d1d8ecf-4a2b-4ff2-a670-32f1fd48a1ef req-48586340-04a3-440b-a8b2-8cfe4b33ca05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.095556 Sep 07 09:58:25.095406 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1473/2953] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:25.105752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e786db2a-6044-4ad1-b366-9a80d8ac7106 req-0b0e51b1-99ac-4a0f-a3f5-a360a09aba48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "name": "network-vif-unplugged", "status": "completed", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:25.131432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e786db2a-6044-4ad1-b366-9a80d8ac7106 req-0b0e51b1-99ac-4a0f-a3f5-a360a09aba48 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.133650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e786db2a-6044-4ad1-b366-9a80d8ac7106 req-0b0e51b1-99ac-4a0f-a3f5-a360a09aba48 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.134140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e786db2a-6044-4ad1-b366-9a80d8ac7106 req-0b0e51b1-99ac-4a0f-a3f5-a360a09aba48 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.187003 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e786db2a-6044-4ad1-b366-9a80d8ac7106 req-0b0e51b1-99ac-4a0f-a3f5-a360a09aba48 service nova] Creating event network-vif-unplugged:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 09:58:25.203592 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e786db2a-6044-4ad1-b366-9a80d8ac7106 req-0b0e51b1-99ac-4a0f-a3f5-a360a09aba48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106762 Sep 07 09:58:25.204554 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1474/2954] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:25.221828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-55a7daa2-765a-48c2-865d-b9b6bd8d4c61 req-6b3a7377-37f6-4311-bf9e-c29fbb81ebb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "f1db77bf-0c02-4148-82fb-f59530d17e45"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:25.275645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-55a7daa2-765a-48c2-865d-b9b6bd8d4c61 req-6b3a7377-37f6-4311-bf9e-c29fbb81ebb0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.276142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-55a7daa2-765a-48c2-865d-b9b6bd8d4c61 req-6b3a7377-37f6-4311-bf9e-c29fbb81ebb0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.282712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-55a7daa2-765a-48c2-865d-b9b6bd8d4c61 req-6b3a7377-37f6-4311-bf9e-c29fbb81ebb0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.337805 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-55a7daa2-765a-48c2-865d-b9b6bd8d4c61 req-6b3a7377-37f6-4311-bf9e-c29fbb81ebb0 service nova] Creating event network-changed:f1db77bf-0c02-4148-82fb-f59530d17e45 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:25.361070 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-55a7daa2-765a-48c2-865d-b9b6bd8d4c61 req-6b3a7377-37f6-4311-bf9e-c29fbb81ebb0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155051 Sep 07 09:58:25.366998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1475/2955] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:25.402303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b115c160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:25.434060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.434803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.441536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.452906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:25.462809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.467009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.467972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.470854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.473403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.477379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.544191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:25.560937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.561790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.562465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.591119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.593859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.601940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.667689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:25.696726 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a17a57b2-b153-46b1-a00d-bbb4906d2f6c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1029397059" status: 201 len: 0 microversion: 2.26 time: 0.327949 Sep 07 09:58:25.703036 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1476/2956] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 7 09:58:25 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1029397059 => generated 0 bytes in 335 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 09:58:25.708990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:25.710620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:25.718966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.719833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.720492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:25.721502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:25.722180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:25.722789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:26.133993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:26.175776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:26.191278 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3bf285a5-b1d1-45e7-a8e1-a459b43570b6 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1528 microversion: 2.1 time: 0.485609 Sep 07 09:58:26.193721 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1477/2957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:25 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:26.196027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:26.200939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:26.202466 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3afacd1b-463c-439c-96ff-f623231fe8af tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1891 microversion: 2.32 time: 2.081339 Sep 07 09:58:26.229243 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1481/2958] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:24 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1891 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:26.232105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1dc9695-7259-4598-8296-8b6d031e2640 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b137aaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-665344633", "description": "tempest-description-883282678"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:26.244340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.137"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:26.251599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:26.264228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:26.265268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:26.266897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:26.268082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:26.268860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:26.269592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:26.326271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "refresh_cache-195c12a5-e815-48c9-a628-b717b87f676c" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:58:26.327898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquired lock "refresh_cache-195c12a5-e815-48c9-a628-b717b87f676c" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:58:27.154743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1dc9695-7259-4598-8296-8b6d031e2640 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.958761 Sep 07 09:58:27.156152 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1478/2959] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:27.161484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:27.162334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:27.171322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:27.172171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:27.172837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:27.174073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:27.174760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:27.175396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:27.855382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:27.872583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:27.877027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:27.883004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-49cdad36-0643-4a50-9034-edd8f5fb262a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1891 microversion: 2.42 time: 0.725331 Sep 07 09:58:27.883631 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1479/2960] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:27 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1891 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:27.916954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6fb8670-e774-42fa-b873-9b92d5137256 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b104b700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:27.934083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6fb8670-e774-42fa-b873-9b92d5137256 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:27.938692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6fb8670-e774-42fa-b873-9b92d5137256 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:27.940538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6fb8670-e774-42fa-b873-9b92d5137256 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:27.968844 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6fb8670-e774-42fa-b873-9b92d5137256 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1029397059" status: 204 len: 0 microversion: 2.26 time: 0.068787 Sep 07 09:58:27.969516 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1480/2961] 10.222.0.60 () {60 vars in 1361 bytes} [Wed Sep 7 09:58:27 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1029397059 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:27.976441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:27.990209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:27.996850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:27.997622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:27.998244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:27.999144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:27.999770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:28.000355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:28.910266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:28.922420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-849fa9fe-2724-440a-8b51-6edccb8b6b99 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1528 microversion: 2.1 time: 0.950490 Sep 07 09:58:28.923029 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1481/2962] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:27 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1528 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:28.941769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-601b1308-4e19-4741-9243-cb9bec659594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b1ff2b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-359509987", "description": "tempest-description-1389574989"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:30.064703 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-601b1308-4e19-4741-9243-cb9bec659594 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.139416 Sep 07 09:58:30.074071 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1482/2963] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:30.080245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:30.081136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:30.088081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:30.088859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:30.089498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:30.091212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:30.091852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:30.092449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:30.519700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:30.532399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:30.541631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:30.543559 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a19956b-26cd-43f9-9ba9-fb43d1c0d292 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.466746 Sep 07 09:58:30.544649 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1483/2964] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:30 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:30.562954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-bfa7d959-26d1-48cd-96f0-b3feae4d5bb8 req-db24e00e-2934-4f83-9ac2-837b48e0b204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "name": "network-vif-plugged", "status": "completed", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:30.591358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfa7d959-26d1-48cd-96f0-b3feae4d5bb8 req-db24e00e-2934-4f83-9ac2-837b48e0b204 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:30.591859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfa7d959-26d1-48cd-96f0-b3feae4d5bb8 req-db24e00e-2934-4f83-9ac2-837b48e0b204 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:30.592311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfa7d959-26d1-48cd-96f0-b3feae4d5bb8 req-db24e00e-2934-4f83-9ac2-837b48e0b204 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:30.608363 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-bfa7d959-26d1-48cd-96f0-b3feae4d5bb8 req-db24e00e-2934-4f83-9ac2-837b48e0b204 service nova] Creating event network-vif-plugged:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 09:58:30.617445 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-bfa7d959-26d1-48cd-96f0-b3feae4d5bb8 req-db24e00e-2934-4f83-9ac2-837b48e0b204 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063180 Sep 07 09:58:30.618078 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1484/2965] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:30.646579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Building network info cache for instance {{(pid=128833) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:58:31.030133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1275443841", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "9f0c0150-bbcc-4c15-af75-b8ec968b69ed"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:31.126796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] validate_networks() for [('9f0c0150-bbcc-4c15-af75-b8ec968b69ed', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:58:32.763299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:58:32.765419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:58:32.767186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:58:32.768006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:58:32.768669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:58:32.786109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.786784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.787931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.789107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.789892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.797195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.829271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Getting quotas for project 233b50b19372481f9e1a43a4da277194. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:58:32.836817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Updating instance_info_cache with network_info: [{"id": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b", "address": "fa:16:3e:76:dd:27", "network": {"id": "49fdca33-4357-4012-8837-6ad24e57961b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1480643788-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2b6e5ea5bc5b442497b1e787827630fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa79f0f04-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128833) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:58:32.850599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Getting quotas for user b1507622fe2c4f3496a8bee52eea5bd7 and project 233b50b19372481f9e1a43a4da277194. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:58:32.862714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Releasing lock "refresh_cache-195c12a5-e815-48c9-a628-b717b87f676c" {{(pid=128833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:58:32.863910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-820febe0-8f36-4926-ac30-9dbc904a9af1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action" status: 202 len: 0 microversion: 2.1 time: 6.630915 Sep 07 09:58:32.864777 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1482/2966] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:26 2022] POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action => generated 0 bytes in 6634 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:58:32.873437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1bf1a60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:32.879181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:58:32.882343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:58:32.891688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.892770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.893854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.894560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:32.901943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.903508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.904206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.905780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.906469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.907185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.937966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.938948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.939582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.950443 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-861b158e-6410-405f-94ee-b516130f8622 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.330629 Sep 07 09:58:32.951125 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1485/2967] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:58:32.955740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "7b601b14-198e-469c-b95a-239bd800b1e0"}, {"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "ebd2b93f-9339-4996-b73d-d6aba65c7eb9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:32.969041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:32.969563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:32.970004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:32.970959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:32.996937 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e77c661-534e-4d42-8a96-66e81679beb4 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 204 len: 0 microversion: 2.26 time: 0.130247 Sep 07 09:58:32.998345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1483/2968] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 7 09:58:32 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:33.013362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:33.015460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:33.017627 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] Creating event network-changed:7b601b14-198e-469c-b95a-239bd800b1e0 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:33.018501 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] Creating event network-changed:ebd2b93f-9339-4996-b73d-d6aba65c7eb9 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:33.025603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5251046e-7f25-4470-a041-66b2f125b8ff req-5169719c-d5e7-40ea-9e32-93b402428ade service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072595 Sep 07 09:58:33.026830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1486/2969] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:33.027862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:33.028742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:33.030592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:33.032230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:33.033694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:33.036542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:33.037015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd9589a0-4c60-45b6-a147-289b9e314451 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:33.048555 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-cd9589a0-4c60-45b6-a147-289b9e314451 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] HTTP exception thrown: Flavor ca6f7c72-5c48-4e50-af7c-77106cce9593 could not be found. Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd9589a0-4c60-45b6-a147-289b9e314451 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Request method failure captured: Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/flavors/ca6f7c72-5c48-4e50-af7c-77106cce9593 HTTP/1.1 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGpNEbx34qy00jbk7eK0TbwtUG-7zz54rmGmsm4DiMfcBmM2MTPWkjBt-PgkFbQ-jEXH4bOLtAdUuRC_cYluViqaprCuU5kdEBIqGtZoJj4z2GmfyWlQ771kUPAxYlwtEDuc2quF4HwMMSBUyVaj4UpXjyfJsNrFiSkhaMNdHWFUdok Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cd72fb1502184da0b77d1eba7cc1159f Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-MigrationsAdminTest-910775036 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cd72fb1502184da0b77d1eba7cc1159f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cd72fb1502184da0b77d1eba7cc1159f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cd72fb1502184da0b77d1eba7cc1159f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cd72fb1502184da0b77d1eba7cc1159f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-MigrationsAdminTest-910775036 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cd72fb1502184da0b77d1eba7cc1159f Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-MigrationsAdminTest-910775036 Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-MigrationsAdminTest-910775036-project-admin Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 56dde78e93f44d5ab460e8fa71b8d7ad Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-MigrationsAdminTest-910775036-project-admin Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: exception: Flavor ca6f7c72-5c48-4e50-af7c-77106cce9593 could not be found. Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ca6f7c72-5c48-4e50-af7c-77106cce9593'} Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ca6f7c72-5c48-4e50-af7c-77106cce9593 could not be found. Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ca6f7c72-5c48-4e50-af7c-77106cce9593 could not be found. Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:33.060196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ca6f7c72-5c48-4e50-af7c-77106cce9593 could not be found. Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:33.064311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd9589a0-4c60-45b6-a147-289b9e314451 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Returning 404 to user: Flavor ca6f7c72-5c48-4e50-af7c-77106cce9593 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:33.065728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd9589a0-4c60-45b6-a147-289b9e314451 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/ca6f7c72-5c48-4e50-af7c-77106cce9593" status: 404 len: 109 microversion: 2.1 time: 0.036495 Sep 07 09:58:33.067292 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1487/2970] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:58:33 2022] DELETE /compute/v2.1/flavors/ca6f7c72-5c48-4e50-af7c-77106cce9593 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:33.089166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c76dc2fc-8f5f-4d26-b711-8c41a029c71f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b19bd550>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:33.499518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:33.518291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:33.523687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:33.525134 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-731a0983-1593-4d25-9aa7-5a641e48fb9b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.525417 Sep 07 09:58:33.544642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1484/2971] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:32 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:33.544642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:33.544642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:33.558057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:33.558768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:33.561232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:33.564154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:33.564648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:33.565091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:33.811942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c76dc2fc-8f5f-4d26-b711-8c41a029c71f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.743208 Sep 07 09:58:33.817312 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1488/2972] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:58:33 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:33.822229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.137"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:33.898823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:33.917329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:33.919598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:33.922562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3dc9d455-5dea-41ac-9c94-756b19254706 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.394026 Sep 07 09:58:33.930723 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1485/2973] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:33 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:33.937909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:33.939167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:33.945908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:33.946869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:33.947307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:33.948009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:33.948468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:33.948960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:34.054051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:34.062643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4246d189-4e22-4918-b37c-e4b6fc6e0bd0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1213 microversion: 2.1 time: 0.130563 Sep 07 09:58:34.063578 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1486/2974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:33 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:34.080162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:34.082211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-948de912-a0fc-4c15-92a1-4528a88e3cd1 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1c05820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:34.087335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:34.087858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:34.088302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:34.089013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:34.089497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:34.090267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:34.093692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-948de912-a0fc-4c15-92a1-4528a88e3cd1 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:34.095130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-948de912-a0fc-4c15-92a1-4528a88e3cd1 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:34.095580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-948de912-a0fc-4c15-92a1-4528a88e3cd1 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:34.109450 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-948de912-a0fc-4c15-92a1-4528a88e3cd1 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 200 len: 12 microversion: 2.26 time: 0.032544 Sep 07 09:58:34.110613 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1487/2975] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:58:34 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 12 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:34.116029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1038479826", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:34.212809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:58:34.832621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "refresh_cache-195c12a5-e815-48c9-a628-b717b87f676c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 09:58:34.833893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquired lock "refresh_cache-195c12a5-e815-48c9-a628-b717b87f676c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 09:58:34.996921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:58:34.997494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:58:34.997846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:58:34.998289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:58:34.998704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:58:35.008750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.009287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.009717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.010453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.011644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.012079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.030743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:58:35.036562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Getting quotas for user 0e051e5308924154b7d5ecc2ea7ffdf7 and project 7be6f5a8bb114c3cb556d4be75faa5a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:58:35.052447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:58:35.054910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:58:35.109318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3032e29f-6403-4458-a7e2-2592e4efd771 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997324 Sep 07 09:58:35.117491 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1488/2976] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:58:35.134398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31861f07-0287-4e2e-9f9e-0ba68d90a978 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1b16820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:35.583390 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31861f07-0287-4e2e-9f9e-0ba68d90a978 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa" status: 202 len: 0 microversion: 2.1 time: 0.464253 Sep 07 09:58:35.583934 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1489/2977] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:58:35 2022] DELETE /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:35.589083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b125d280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:35.601395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.601875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.602311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.602782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:35.610318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.611059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.611498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.612357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.612810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.613459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.645922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.646416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.646855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.666749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.671265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.672723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.709994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:35.729893 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bdebb39a-d893-4cd0-a87c-5326e2e69c8c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-395639969" status: 201 len: 0 microversion: 2.26 time: 0.144855 Sep 07 09:58:35.736192 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1490/2978] 10.222.0.60 () {62 vars in 1377 bytes} [Wed Sep 7 09:58:35 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-395639969 => generated 0 bytes in 152 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 07 09:58:35.742630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:35.743416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:35.750830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.753698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.755226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.758759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:35.759358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:35.760024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:35.954842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Building network info cache for instance {{(pid=128832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 09:58:36.060853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:36.080568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:36.082269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:36.083652 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-46354702-aee2-4f80-a977-215cbd2e5d29 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.346189 Sep 07 09:58:36.084362 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1491/2979] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:35 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:36.108929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:36.109900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:36.116118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:36.116843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:36.117463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:36.118315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:36.118945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:36.119526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:36.572285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:36.585747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:36.587647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:36.589052 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5e4afb2f-89e4-41bf-b20f-1aa9f2838c3c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.490457 Sep 07 09:58:36.590563 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1492/2980] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:36 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:36.597116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}, {"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "7db2bf51-8311-4cf4-ae79-919fe6ccada5"}, {"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "1ecfaf7d-3cc0-4159-97c4-dac53650ffa4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:36.609917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:36.610936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:36.612901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:36.651785 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Creating event network-changed:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:58:36.655419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Creating event network-changed:7db2bf51-8311-4cf4-ae79-919fe6ccada5 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:36.656779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] Creating event network-changed:1ecfaf7d-3cc0-4159-97c4-dac53650ffa4 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:58:36.679764 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-472f0681-4f0d-4933-a349-6485b0224450 req-019acb75-2ac4-4235-a899-2b8e7a91020f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.086006 Sep 07 09:58:36.682064 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1493/2981] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:36.700490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:36.704617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:36.735490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:36.736067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:36.738424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:36.741935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:36.742696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:36.743424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.336162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:37.350319 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-23264819-91f6-4db1-977c-fb66b8b28ce9 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1317 microversion: 2.1 time: 0.664888 Sep 07 09:58:37.351343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1494/2982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:36 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:37.360273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:37.372907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:37.389583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.390051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.390491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.391197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.392140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.392570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.580054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Updating instance_info_cache with network_info: [{"id": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b", "address": "fa:16:3e:76:dd:27", "network": {"id": "49fdca33-4357-4012-8837-6ad24e57961b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1480643788-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2b6e5ea5bc5b442497b1e787827630fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa79f0f04-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 09:58:37.584814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:37.595374 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df2b4cd6-c64e-4b5a-81a8-ff9d2262621b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1271 microversion: 2.1 time: 0.242292 Sep 07 09:58:37.596627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1495/2983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:37 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:37.603575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1b16820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:37.616442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Releasing lock "refresh_cache-195c12a5-e815-48c9-a628-b717b87f676c" {{(pid=128832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 09:58:37.618479 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e44c5da6-611d-44f2-9ac5-70ca00cfc5d8 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action" status: 202 len: 0 microversion: 2.1 time: 3.802581 Sep 07 09:58:37.623237 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1489/2984] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:33 2022] POST /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c/action => generated 0 bytes in 3810 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 09:58:37.632621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-83e6e20f-3165-4f47-949f-1624cd3aa096 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1bd6700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:37.643864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83e6e20f-3165-4f47-949f-1624cd3aa096 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.645290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83e6e20f-3165-4f47-949f-1624cd3aa096 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.645820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83e6e20f-3165-4f47-949f-1624cd3aa096 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.668138 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-83e6e20f-3165-4f47-949f-1624cd3aa096 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 200 len: 35 microversion: 2.26 time: 0.043169 Sep 07 09:58:37.668775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1490/2985] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:58:37 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 35 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:37.676083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:37.676716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:37.684216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.685067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.685556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.686280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.686747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.687905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.719902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fab811df-8411-4197-b743-c423663f7bfa does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:58:37.720955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group fab811df-8411-4197-b743-c423663f7bfa not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:58:37.723114 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.723114 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa HTTP/1.1 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'fab811df-8411-4197-b743-c423663f7bfa'} Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:58:37.725951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] Sep 07 09:58:37.730188 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:37.741012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:58:37.741012 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-2e1f3261-73e5-4e9e-895d-eef785a259a1'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:37.741945 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e0e3f5d-fcd0-4cc8-9350-7c9eb5fe4560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa" status: 404 len: 194 microversion: 2.1 time: 0.143588 Sep 07 09:58:37.742741 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1496/2986] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:58:37 2022] GET /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:37.749295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:37.750473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:37.758619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.759607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.760927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:37.763049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:37.763686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:37.764326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:38.332029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:38.356922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:38.363042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:38.364743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a607685e-630a-4cfb-87a7-900af6b881bf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.694530 Sep 07 09:58:38.366272 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1491/2987] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:37 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:38.369976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:38.373269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-094261fe-670f-4f92-804f-23090daac51b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '.version_select at 0x7f14b13678b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:38.391552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:38.392938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:38.394233 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-389da9f7-6aa4-4e62-a120-adf9d5f7c0c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.650786 Sep 07 09:58:38.404686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1497/2988] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:37 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:38.418516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1c05e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:38.426596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:38.427490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:38.427948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:38.429251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:38.436034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:38.436533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:38.437008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:38.438102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:38.438744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:38.439418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:38.470378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:38.471199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:38.471884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:38.476476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:38.513717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:38.536073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8da2822b-2f96-4f8a-a9fb-0ebec6502f1f tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-395639969" status: 204 len: 0 microversion: 2.26 time: 0.128336 Sep 07 09:58:38.541413 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1498/2989] 10.222.0.60 () {60 vars in 1361 bytes} [Wed Sep 7 09:58:38 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-395639969 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:38.548772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a8a2159-b7db-465f-b2a4-bfb1871ebbcd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1261af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:39.772732 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a8a2159-b7db-465f-b2a4-bfb1871ebbcd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea" status: 202 len: 0 microversion: 2.1 time: 1.229514 Sep 07 09:58:39.776772 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1499/2990] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:58:38 2022] DELETE /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea => generated 0 bytes in 1234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:39.783111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-87884474-5385-4883-92b1-35aebe5e13ac req-ba38c950-ecfe-44c7-9ace-1e652dabfdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3458b2c-d087-4154-92c9-a6faaf6f6b4d", "tag": "cb4399a3-5819-4e47-abb2-f3413a762959"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:39.807921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-87884474-5385-4883-92b1-35aebe5e13ac req-ba38c950-ecfe-44c7-9ace-1e652dabfdf7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:39.808646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-87884474-5385-4883-92b1-35aebe5e13ac req-ba38c950-ecfe-44c7-9ace-1e652dabfdf7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:39.809094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-87884474-5385-4883-92b1-35aebe5e13ac req-ba38c950-ecfe-44c7-9ace-1e652dabfdf7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:39.828164 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-87884474-5385-4883-92b1-35aebe5e13ac req-ba38c950-ecfe-44c7-9ace-1e652dabfdf7 service nova] Creating event network-changed:cb4399a3-5819-4e47-abb2-f3413a762959 for instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d on n-h1-836830-16 Sep 07 09:58:39.847733 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-87884474-5385-4883-92b1-35aebe5e13ac req-ba38c950-ecfe-44c7-9ace-1e652dabfdf7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068504 Sep 07 09:58:39.848386 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1500/2991] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:39.858589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:39.859555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:39.868374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:39.869755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:39.870686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:39.872536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:39.873273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:39.874200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.291801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:40.300935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-965c4089-25ca-47f9-b00e-1c0ac9f4b091 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1317 microversion: 2.1 time: 0.451347 Sep 07 09:58:40.301820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1501/2992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:39 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:40.308097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3173f56b-a33c-49b8-ab6c-f148a6cb0bac tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b5d79040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:40.317389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3173f56b-a33c-49b8-ab6c-f148a6cb0bac tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.318062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3173f56b-a33c-49b8-ab6c-f148a6cb0bac tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.318505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3173f56b-a33c-49b8-ab6c-f148a6cb0bac tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.328673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3173f56b-a33c-49b8-ab6c-f148a6cb0bac tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 200 len: 12 microversion: 2.26 time: 0.025070 Sep 07 09:58:40.329553 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1502/2993] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:58:40 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:40.334775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:40.335384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:40.343033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.343516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.344202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.345341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.346116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.346853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.625425 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-094261fe-670f-4f92-804f-23090daac51b tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/d7c3fc87-6f96-40b3-b5c4-e47a85fc19b4" status: 202 len: 0 microversion: 2.1 time: 2.257905 Sep 07 09:58:40.626656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1492/2994] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:58:38 2022] DELETE /compute/v2.1/os-floating-ips/d7c3fc87-6f96-40b3-b5c4-e47a85fc19b4 => generated 0 bytes in 2260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:40.634451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-bb5c4fc5-ca64-43e8-8e43-39f68f7247ce req-80a0432d-ddbe-4c84-9cd2-2cb26e3b465c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:40.641644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:40.651295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bb5c4fc5-ca64-43e8-8e43-39f68f7247ce req-80a0432d-ddbe-4c84-9cd2-2cb26e3b465c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.652033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bb5c4fc5-ca64-43e8-8e43-39f68f7247ce req-80a0432d-ddbe-4c84-9cd2-2cb26e3b465c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.653534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bb5c4fc5-ca64-43e8-8e43-39f68f7247ce req-80a0432d-ddbe-4c84-9cd2-2cb26e3b465c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.654073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c045cf2-2569-46d2-ab6a-e83962e18275 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 0.321189 Sep 07 09:58:40.654977 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1503/2995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:40 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:40.680089 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-bb5c4fc5-ca64-43e8-8e43-39f68f7247ce req-80a0432d-ddbe-4c84-9cd2-2cb26e3b465c service nova] Creating event network-changed:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:58:40.688868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:40.693626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:40.695285 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-bb5c4fc5-ca64-43e8-8e43-39f68f7247ce req-80a0432d-ddbe-4c84-9cd2-2cb26e3b465c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067158 Sep 07 09:58:40.695916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1493/2996] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:40.708774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:40.712543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:40.713357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:40.714397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.715584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.716219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.717373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.718059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.718681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.723519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.724028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.724477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:40.725221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:40.725699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:40.726138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:41.447718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:41.458115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:41.460116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:41.461445 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0cd98646-3b29-4cc5-a4f0-e5fa230a410b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.787827 Sep 07 09:58:41.469664 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1504/2997] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:40 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:41.478161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1c52e50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:41.523210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:41.534064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:41.536255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:41.537946 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2dbffd7b-e765-49ae-8c38-9b601a1f5cac tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.840596 Sep 07 09:58:41.538838 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1494/2998] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:40 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:41.544692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1993550>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:41.563453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:41.564018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:41.564461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:41.564943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:41.570689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:41.571041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:41.572847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:58:41.573621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:58:41.574058 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.574058 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea HTTP/1.1 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea'} Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:58:41.576056 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-0faf0ab0-0fa0-4fe9-be4a-dd44ebd35e66'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aaec345f-9c50-4cf0-b511-c731023986d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea" status: 404 len: 194 microversion: 2.1 time: 0.106215 Sep 07 09:58:41.581518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1505/2999] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:58:41 2022] GET /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:41.588938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8c473f9-4e90-42d2-b2e9-633fabbe72af tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '.version_select at 0x7f14b1c05b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:41.589110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:41.589110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:41.589715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:41.590685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:41.627042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:41.628361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:41.629117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:41.646585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:41.666262 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f92135a-2cf9-4dc2-af6b-a18bcabfd681 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 204 len: 0 microversion: 2.26 time: 0.125927 Sep 07 09:58:41.666838 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1495/3000] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 7 09:58:41 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:41.674093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:41.674838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:41.681955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:41.682589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:41.683920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:41.684597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:41.685278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:41.685855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.545094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:42.552790 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c66f99c-7722-46b3-913f-f2c99def24b6 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1317 microversion: 2.1 time: 0.884203 Sep 07 09:58:42.553397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1496/3001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:41 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:42.560360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8d16c0e-e413-492a-ae04-fe0233dc5eef tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1bd6310>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:42.816077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:42.831410 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8c473f9-4e90-42d2-b2e9-633fabbe72af tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/aab323b7-8d88-4f89-b80e-80fc59ecbf21" status: 202 len: 0 microversion: 2.1 time: 1.252322 Sep 07 09:58:42.832698 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1506/3002] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:58:41 2022] DELETE /compute/v2.1/os-security-groups/aab323b7-8d88-4f89-b80e-80fc59ecbf21 => generated 0 bytes in 1254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:42.838166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1d621f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:42.848462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.848977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.849424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.849934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:42.856447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.856980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.857448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.858149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.858827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.859918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.867238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:42.899139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.899741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.900195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.912407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.913131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.913614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.945527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:42.962900 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00edc7a3-8f69-471f-b8a1-29a95f942409 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1068610129" status: 201 len: 0 microversion: 2.26 time: 0.128478 Sep 07 09:58:42.963757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1507/3003] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 7 09:58:42 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1068610129 => generated 0 bytes in 130 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 09:58:42.973223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:42.974091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:42.982371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.982835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.983283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:42.983991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:42.984454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:42.984882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.269721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.286161 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-587f6133-20c9-4a73-9d3c-77b57965c7ca tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 0.318868 Sep 07 09:58:43.290493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8d16c0e-e413-492a-ae04-fe0233dc5eef tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d" status: 202 len: 0 microversion: 2.1 time: 0.735984 Sep 07 09:58:43.294057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1497/3004] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:58:42 2022] DELETE /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:43.298585 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1508/3005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:42 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:43.306192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:43.307753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:43.319363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.320642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.322017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.324532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.326549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.327656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.344392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:43.346142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:43.357761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.358900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.372047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.373878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.375130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.377949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.783260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.803034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.804519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.805845 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21970a30-e2f5-40a5-84c1-0a0d34a6cbdb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.510217 Sep 07 09:58:43.807347 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1498/3006] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:43 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:43.810767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.813313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:43.814086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:43.820415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.821851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.822411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.822709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.824615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:43.824764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.825356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.825999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.826748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8b7b218-e6d9-4766-b579-ad1d4557c14d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.494364 Sep 07 09:58:43.827326 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1509/3007] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:43 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:43.835136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1acbc10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:43.846412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=1,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:43.850992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.851490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.851935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.852509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:43.860777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.861588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.862431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.863442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.864076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.864852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.865441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:58:43.896867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.897492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.897938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.913621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:43.914567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:43.915252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:43.946297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:43.970054 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-17aa55fd-c8d3-4f4b-a770-84b1f843b021 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1413053434" status: 201 len: 0 microversion: 2.26 time: 0.141610 Sep 07 09:58:43.971544 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1510/3008] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 7 09:58:43 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1413053434 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 09:58:43.987486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1f75c8e2-0103-43d9-846f-f480259d90b4 req-39a89f9d-cd0e-4685-bc12-bbc74d1dce1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:43.997774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d96cc3ab-f668-43d6-8f37-cac5bdb1e506 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "DELETE /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 204 len: 0 microversion: 2.1 time: 0.187177 Sep 07 09:58:43.999286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1499/3009] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:58:43 2022] DELETE /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:58:44.006911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1c1cb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.014233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1f75c8e2-0103-43d9-846f-f480259d90b4 req-39a89f9d-cd0e-4685-bc12-bbc74d1dce1e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.014793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1f75c8e2-0103-43d9-846f-f480259d90b4 req-39a89f9d-cd0e-4685-bc12-bbc74d1dce1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.015234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1f75c8e2-0103-43d9-846f-f480259d90b4 req-39a89f9d-cd0e-4685-bc12-bbc74d1dce1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.029495 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1f75c8e2-0103-43d9-846f-f480259d90b4 req-39a89f9d-cd0e-4685-bc12-bbc74d1dce1e service nova] Creating event network-changed:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h2-836830-16 Sep 07 09:58:44.034844 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1f75c8e2-0103-43d9-846f-f480259d90b4 req-39a89f9d-cd0e-4685-bc12-bbc74d1dce1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061272 Sep 07 09:58:44.035944 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1511/3010] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:44.041995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.042911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.049503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.049992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.050595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.051456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.052070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.052656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.076760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:58:44.079042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 77690da7-4f57-4d3d-a314-4473f62d278d not found {{(pid=128832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:58:44.081508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.081508 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d HTTP/1.1 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: exception: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '77690da7-4f57-4d3d-a314-4473f62d278d'} Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:58:44.084612 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:58:44.088560 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-06ea5d44-2acb-4e63-930d-16c94ad77044'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:44.091773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a51eef65-06be-46c6-95ec-efcd87db5efa tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d" status: 404 len: 194 microversion: 2.1 time: 0.088149 Sep 07 09:58:44.091773 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1500/3011] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:58:43 2022] GET /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:44.098406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1367280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.108116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.108604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.109037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.109694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.115403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.115888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.116320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.117004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.117492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.117915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.141553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.142362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.142837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.159807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:44.179620 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88fabe81-c81f-4a10-8ebe-6dfdbf265488 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 204 len: 0 microversion: 2.26 time: 0.086378 Sep 07 09:58:44.180792 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1501/3012] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 7 09:58:44 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:44.187012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.187823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.194565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.195196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.195759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.197097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.197738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.198340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.239927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:44.249864 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3cc651d-3665-4a39-b1f5-3dec7077aff3 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1317 microversion: 2.1 time: 0.212096 Sep 07 09:58:44.250593 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1512/3013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:44 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:44.271541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1f1dad2-6adc-4205-83ef-be3bfb026fe1 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b125d160>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.404881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:44.417047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1aeff380-da18-4dcd-aad1-dd76d98f3fb1 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1511 microversion: 2.1 time: 0.234622 Sep 07 09:58:44.442376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1502/3014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:44 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:44.458038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b4a5c143-3693-40a4-8892-4b097275d83a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1c2d700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.466975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4a5c143-3693-40a4-8892-4b097275d83a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.467349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4a5c143-3693-40a4-8892-4b097275d83a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.468030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4a5c143-3693-40a4-8892-4b097275d83a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.478917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b4a5c143-3693-40a4-8892-4b097275d83a tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 200 len: 12 microversion: 2.26 time: 0.035135 Sep 07 09:58:44.479797 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1503/3015] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:58:44 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:44.484566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.485272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.492455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.493026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.493574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.494351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.494876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.495390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.521448 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1f1dad2-6adc-4205-83ef-be3bfb026fe1 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.253422 Sep 07 09:58:44.522412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1513/3016] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 09:58:44 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:44.527901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1acb4c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.538321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.538916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.539439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.539976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.546880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.547427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.548078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.548986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.549542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.549966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.579781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.580977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.581503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.597748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:44.615129 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5dbb655-c71f-4fe9-b81a-484a5bda1466 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 204 len: 0 microversion: 2.26 time: 0.091605 Sep 07 09:58:44.616173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1514/3017] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 7 09:58:44 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:44.625378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d25a7ec8-e210-40e8-a0c4-7b9b9217d725 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b5deb160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1265703331", "description": "tempest-description-1235338812"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:44.675733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:44.688147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7bf5775a-763b-4124-8cd0-87bc4c3f32e1 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 0.206729 Sep 07 09:58:44.689056 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1504/3018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:44 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:44.706066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b19acdc0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.720860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.721388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.721976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.722477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.729007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.730619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.731147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.732100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.732672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.733301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.765242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.765746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.766194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.778114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.778765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.779250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.808308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:44.832622 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d25a7ec8-e210-40e8-a0c4-7b9b9217d725 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.215325 Sep 07 09:58:44.834109 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1515/3019] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:44.838708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fa9baebc-e5d0-497b-9066-5756a63724cb req-b1a83bb3-a8e1-40d3-b336-e048e6c65a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3458b2c-d087-4154-92c9-a6faaf6f6b4d", "name": "network-vif-plugged", "status": "completed", "tag": "cb4399a3-5819-4e47-abb2-f3413a762959"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:44.844478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9dedbf3-538f-43bd-b6dc-2baf29a48ffd tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-389608891" status: 201 len: 0 microversion: 2.26 time: 0.154048 Sep 07 09:58:44.847417 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1505/3020] 10.222.0.60 () {62 vars in 1377 bytes} [Wed Sep 7 09:58:44 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-389608891 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 07 09:58:44.858604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:44.859432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:44.861081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fa9baebc-e5d0-497b-9066-5756a63724cb req-b1a83bb3-a8e1-40d3-b336-e048e6c65a04 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.861623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fa9baebc-e5d0-497b-9066-5756a63724cb req-b1a83bb3-a8e1-40d3-b336-e048e6c65a04 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.862358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fa9baebc-e5d0-497b-9066-5756a63724cb req-b1a83bb3-a8e1-40d3-b336-e048e6c65a04 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.868668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.869426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.870172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.871291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:44.872018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:44.872634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:44.878691 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fa9baebc-e5d0-497b-9066-5756a63724cb req-b1a83bb3-a8e1-40d3-b336-e048e6c65a04 service nova] Creating event network-vif-plugged:cb4399a3-5819-4e47-abb2-f3413a762959 for instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d on n-h1-836830-16 Sep 07 09:58:44.885172 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fa9baebc-e5d0-497b-9066-5756a63724cb req-b1a83bb3-a8e1-40d3-b336-e048e6c65a04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049139 Sep 07 09:58:44.887047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1516/3021] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:44.894147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b08c4a64-3356-4cd5-ae04-6c256f1fa773 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b11d2940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1006092236", "description": "tempest-description-1344206345"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:45.022061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:45.045163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:45.157536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.167320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.169116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.170505 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2278b877-d379-44f0-b87a-4c053cbefca8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.321663 Sep 07 09:58:45.171274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1506/3022] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:44 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:45.176098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:45.176713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:45.184472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.184960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.185417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.186313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.186768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.187311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.204133 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b08c4a64-3356-4cd5-ae04-6c256f1fa773 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.315094 Sep 07 09:58:45.204734 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1517/3023] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:58:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:45.209599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1d15310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:45.220765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.222063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.222777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.223531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:45.230694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.231462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.231934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.232611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.233206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.233797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.263998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.264497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.264933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.268529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:45.280797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.281570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.282393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.341802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:45.360597 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce10a625-46bb-4f0e-90ea-5bab2eb3c6e8 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1722630951" status: 201 len: 0 microversion: 2.26 time: 0.154573 Sep 07 09:58:45.361366 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1518/3024] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 7 09:58:45 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags/tempest-tag-1722630951 => generated 0 bytes in 156 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 09:58:45.369152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:45.369791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:45.376944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.377681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.378128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.378882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.379302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.379735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.466605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.479146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.481679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.482873 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8c957df7-4063-4c39-8830-70750faf762c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.310514 Sep 07 09:58:45.483436 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1507/3025] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:45 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:45.488974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2136816027", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "f73e1c51-3b7c-466f-9296-75cc24b60851"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:45.547835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] validate_networks() for [('f73e1c51-3b7c-466f-9296-75cc24b60851', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:58:45.551254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.559824 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7328aa2-8359-462c-aca1-1ae47ac3c5d0 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1317 microversion: 2.1 time: 0.196975 Sep 07 09:58:45.573205 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1519/3026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:45 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:45.573205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Action: 'update_all', calling method: .version_select at 0x7f14b1d62f70>, body: {"tags": ["tempest-tag-539108235", "tempest-tag-1426112345"]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:45.584306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.585009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.585476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.586021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:45.592775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.593387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.594058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.595004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.597044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.597044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.622485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.623059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.623508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.648762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:45.678440 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d910eb28-1e6f-4131-80a0-c3a781a2e81c tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 200 len: 61 microversion: 2.26 time: 0.116943 Sep 07 09:58:45.681385 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1520/3027] 10.222.0.60 () {62 vars in 1312 bytes} [Wed Sep 7 09:58:45 2022] PUT /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 61 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:45.687159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:45.687663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:45.694744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.695272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.695714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.696680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.697236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.697678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.921757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:45.930278 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-287569c0-f3cc-4962-a1d1-5af91505d1ef tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1511 microversion: 2.1 time: 0.247813 Sep 07 09:58:45.945939 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1521/3028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:45 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:45.952252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bde593a6-ae42-41f3-840a-40b9678da786 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1d623a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:45.960130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bde593a6-ae42-41f3-840a-40b9678da786 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.960764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bde593a6-ae42-41f3-840a-40b9678da786 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.961228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bde593a6-ae42-41f3-840a-40b9678da786 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.972039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bde593a6-ae42-41f3-840a-40b9678da786 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 200 len: 61 microversion: 2.26 time: 0.024701 Sep 07 09:58:45.974747 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1522/3029] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 7 09:58:45 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 61 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:45.982122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:45.982909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:45.990029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.990682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.991240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:45.992006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:45.992585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:45.992940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.082498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:58:46.083012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:58:46.083414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:58:46.083829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:58:46.084232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:58:46.094249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.094732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.095164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.095883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.096529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.097110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.117357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Getting quotas for project f1519d78849c4223b6024a32d5607308. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:58:46.119803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:46.124529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Getting quotas for user d5f63b87c6474177a7705deed6a4365a and project f1519d78849c4223b6024a32d5607308. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:58:46.141373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:58:46.144211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:58:46.156515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.164682 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e47b5b5a-873b-4743-8080-fbe114c02a38 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 0.190645 Sep 07 09:58:46.180381 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1523/3030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:45 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:46.188092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '.version_select at 0x7f14b1acbc10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.196294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.196773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6206b664-9115-4fe3-99b1-ecde8964671b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711607 Sep 07 09:58:46.197290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1508/3031] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:58:46.197682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.198314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.200111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.205885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.206745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.207033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.207742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.208437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.209378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.210080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.210601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.227895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.228454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.228918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.229691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.230814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.231258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.237971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.238770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.239424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.256680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'flavor' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:46.277779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ccf0cdd3-9f00-4e13-b30f-cadf7367ef4d tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags" status: 204 len: 0 microversion: 2.26 time: 0.095075 Sep 07 09:58:46.279230 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1524/3032] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 7 09:58:46 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2/tags => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:46.284798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50cde546-b765-4ec9-9881-2d4eb71266c0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.285712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-50cde546-b765-4ec9-9881-2d4eb71266c0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.366235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-50cde546-b765-4ec9-9881-2d4eb71266c0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.375848 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-50cde546-b765-4ec9-9881-2d4eb71266c0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1216 microversion: 2.1 time: 0.095139 Sep 07 09:58:46.378464 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1525/3033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:46 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:46.393844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.397302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.413857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.414490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.417539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.418945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.419493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.420999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.464919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:58:46.581663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.596155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.597682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.598857 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00b84527-1a18-4c98-b32c-edd4b09e3658 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.400647 Sep 07 09:58:46.599412 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1509/3034] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:46 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:46.614731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.617972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.625221 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-426df128-e862-4966-9866-01f5ff0c7543 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 204 len: 0 microversion: 2.26 time: 0.243711 Sep 07 09:58:46.625368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.625793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.626388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.626509 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1526/3035] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 09:58:46 2022] DELETE /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 09:58:46.627059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.627454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.628045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.640765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.641806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.648406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.648918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.649504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.650273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.650813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.651303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.928896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.939894 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fe0728ac-8f49-4b61-b159-e0d0f764af7d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1505 microversion: 2.1 time: 0.309329 Sep 07 09:58:46.954029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.954241 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1527/3036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:46 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:46.969158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:46.970049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:46.972693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.974283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:46.975748 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71359483-f658-444d-8e11-281cbcd24051 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.367158 Sep 07 09:58:46.976862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1510/3037] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:46 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:46.987739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.990276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.993026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.994898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:46.996726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:46.997860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:46.998709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:47.000299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.012291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.012788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.013268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.013964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.014603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.015829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.243468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.251877 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee4b78c4-1108-4e58-82ad-9ad98e16865e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1511 microversion: 2.1 time: 0.273540 Sep 07 09:58:47.252712 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1511/3038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:46 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:47.258010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:47.258845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.264030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.272809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.274084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.274668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.275075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.275206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.275968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.276478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.277910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.278318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ce7c54d-414c-4b96-bb2e-a1a5363e4582 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1549 microversion: 2.26 time: 0.323067 Sep 07 09:58:47.279526 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1528/3039] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:46 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:47.286351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:47.287295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.295322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.296552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.297204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.298098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.298775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.299759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.340742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.341834 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62e56316-3797-4b9e-93a1-ce5011898a3d tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d/os-instance-actions/req-861b158e-6410-405f-94ee-b516130f8622" status: 200 len: 313 microversion: 2.1 time: 0.087951 Sep 07 09:58:47.351171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1512/3040] 10.222.0.60 () {58 vars in 1419 bytes} [Wed Sep 7 09:58:47 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d/os-instance-actions/req-861b158e-6410-405f-94ee-b516130f8622 => generated 313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:47.357454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:47.360104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.367587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.368301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.368926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.369801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.370415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.371852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.447611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:47.489983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e3f09d5c-4039-45dd-8484-e2d9e0846b00 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "POST /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d/action" status: 202 len: 0 microversion: 2.1 time: 0.136913 Sep 07 09:58:47.493226 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1513/3041] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:47 2022] POST /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:47.498891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:47.499727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.508025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.508700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.509306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.510118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.510689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.511888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.534309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.543862 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97085a3e-69e3-4bd2-8e15-39c5aed93303 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 0.261483 Sep 07 09:58:47.545136 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1529/3042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:47 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:47.550402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:47.551284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.558134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.566173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.566717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.567611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.568326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.568829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.590979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.599196 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03bdc7b9-ddad-474f-ac8c-c09f9b09ead0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1268 microversion: 2.1 time: 0.107021 Sep 07 09:58:47.599996 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1514/3043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:47 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1268 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:47.626507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:47.627226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:47.633658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.634230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.634846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.635644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:47.636273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:47.636775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:47.762596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:47.779385 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7cf0959a-7be5-4123-8b5d-4d86ce502712 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1507 microversion: 2.1 time: 0.232767 Sep 07 09:58:47.780007 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1530/3044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:47 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:48.008285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:48.009635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:48.023518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:48.024336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:48.024942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:48.026013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:48.029503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:48.030159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:48.050666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:48.063056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:48.072300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:48.073760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca108709-7eda-4c5c-834e-331c0a93fc6b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.451274 Sep 07 09:58:48.076979 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1515/3045] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:47 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:48.283444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:48.286637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:48.312948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:48.315317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:48.316047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:48.321795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:48.322693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:48.323374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:48.385207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:48.401122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:48.404486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:48.407070 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0dda97ed-b925-477e-934b-85f3761a19e2 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.402950 Sep 07 09:58:48.407877 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1531/3046] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:48 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:58:48.414237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:48.415990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:48.423844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:48.424346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:48.424790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:48.425542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:48.434295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:48.435565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:48.441835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:49.141070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:49.171598 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9a2ab2d-bad7-4fb7-9ebc-03e5e5848cad tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1511 microversion: 2.1 time: 0.898048 Sep 07 09:58:49.186391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1516/3047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:48 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1511 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:49.203528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:49.213362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:49.223843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:49.227612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:49.228835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:49.231439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:49.233616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:49.234385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:49.354718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:49.383716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:49.385279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:49.387311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-47a6736c-6ce2-4eea-9380-8171d1846e14 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1549 microversion: 2.26 time: 0.977554 Sep 07 09:58:49.387895 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1532/3048] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:48 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1549 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:49.419430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:49.420061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:49.429331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:49.430236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:49.432696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:49.434552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:49.442907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:49.443793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:49.654871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:49.663300 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fdb6485e-b755-408a-86e1-f6bf4afb76d5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1274 microversion: 2.1 time: 0.264254 Sep 07 09:58:49.678139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1533/3049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:49 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1274 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:49.686644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:49.687326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:49.694215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:49.694678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:49.695400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:49.697611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:49.699786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:49.700788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:50.215967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:50.224710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0796d1f4-a688-4368-acc3-ea52019e9441 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1505 microversion: 2.1 time: 0.545190 Sep 07 09:58:50.238171 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1534/3050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:49 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:50.251320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:50.259050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:50.282389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:50.283154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:50.283946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:50.284893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:50.285825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:50.286522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:50.378264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:50.392389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d4fd4d6-4ef3-40de-9172-34525b183f3e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 1.200134 Sep 07 09:58:50.393209 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1517/3051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:49 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:50.399065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:50.399747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:50.406089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:50.406611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:50.407053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:50.407742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:50.408352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:50.409256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.445211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.478173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.479813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.481490 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69e75165-b616-406b-884b-db054c6b8c78 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 1.242127 Sep 07 09:58:51.482076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1535/3052] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:50 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:51.514243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:51.514951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:51.536453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.536961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.537451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.538163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.538625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.539057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.650306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.673863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.676657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.680774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8aa79095-7041-486b-966b-139dc12e48ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 1.286353 Sep 07 09:58:51.682418 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1518/3053] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:50 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:51.691427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '.version_select at 0x7f14b1c49790>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:51.693837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:51.707350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.708430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.720066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.721128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.721786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.722381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.825674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b90c4c24-4c23-4f7d-a9ae-c3b9f7b89b7e tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.141369 Sep 07 09:58:51.837739 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1519/3054] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 7 09:58:51 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d/os-instance-actions => generated 611 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:51.843313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:51.847011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:51.858379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.859131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.859734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.860610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.861265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.861868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.873066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528af86591194a5dae2ba78847d7bc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6e5ea5bc5b442497b1e787827630fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:51.883356 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ed63b7f-a423-4ba5-a587-3b61e8e25583 tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 200 len: 1469 microversion: 2.1 time: 0.388791 Sep 07 09:58:51.888666 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1536/3055] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:51 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 1469 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:51.898206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:51.899006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:51.926853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.929393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.930094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.932060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.934006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.935438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:51.935936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:51.936382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:51.936851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lazy-loading 'fault' on Instance uuid 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:51.937146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.130982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:52.140672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:52.142444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e32b61b3bf6947de8a78a6f448462a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df7057507da417682ba9bd2728443c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:52.146888 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0702bb79-a67e-46e2-a69a-f6cf10ffd50e tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 200 len: 1351 microversion: 2.26 time: 0.307835 Sep 07 09:58:52.161735 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1520/3056] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:51 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 1351 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:52.172892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-385cf118-47c3-4f22-9a50-442c61eadb33 req-940b7430-43b6-4fa2-8356-e63febf73798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab92bde-2c38-40d4-a36a-a17a55fa01f2", "name": "network-vif-deleted", "tag": "d547ddec-f190-4e7c-a0ee-f180a69e25b0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:52.186974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-385cf118-47c3-4f22-9a50-442c61eadb33 req-940b7430-43b6-4fa2-8356-e63febf73798 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.189963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-385cf118-47c3-4f22-9a50-442c61eadb33 req-940b7430-43b6-4fa2-8356-e63febf73798 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.190596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-385cf118-47c3-4f22-9a50-442c61eadb33 req-940b7430-43b6-4fa2-8356-e63febf73798 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.232275 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-385cf118-47c3-4f22-9a50-442c61eadb33 req-940b7430-43b6-4fa2-8356-e63febf73798 service nova] Creating event network-vif-deleted:d547ddec-f190-4e7c-a0ee-f180a69e25b0 for instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 on n-h2-836830-16 Sep 07 09:58:52.240555 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-385cf118-47c3-4f22-9a50-442c61eadb33 req-940b7430-43b6-4fa2-8356-e63febf73798 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076795 Sep 07 09:58:52.241286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1521/3057] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:52.247545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7fa64dcd-9ae9-4ab3-b64c-0f4a3e09cc78 req-de4867a0-82bd-4316-a7fd-de1f8078bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "name": "network-vif-plugged", "status": "completed", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:52.258929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7fa64dcd-9ae9-4ab3-b64c-0f4a3e09cc78 req-de4867a0-82bd-4316-a7fd-de1f8078bf9a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.260573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7fa64dcd-9ae9-4ab3-b64c-0f4a3e09cc78 req-de4867a0-82bd-4316-a7fd-de1f8078bf9a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.262036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7fa64dcd-9ae9-4ab3-b64c-0f4a3e09cc78 req-de4867a0-82bd-4316-a7fd-de1f8078bf9a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.279029 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7fa64dcd-9ae9-4ab3-b64c-0f4a3e09cc78 req-de4867a0-82bd-4316-a7fd-de1f8078bf9a service nova] Creating event network-vif-plugged:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h2-836830-16 Sep 07 09:58:52.295859 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7fa64dcd-9ae9-4ab3-b64c-0f4a3e09cc78 req-de4867a0-82bd-4316-a7fd-de1f8078bf9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052741 Sep 07 09:58:52.300907 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1522/3058] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:52.314817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:52.316481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:52.338362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.340369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.341008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.356032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.358005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.359254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.367555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:52.376475 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b034a759-6d05-41f3-849f-525b0c36cffd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.484605 Sep 07 09:58:52.386920 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1537/3059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:51 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:52.392263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:52.393346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:52.419833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.420343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.420786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.421528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.421990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.422420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.490636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:58:52.656958 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e09ae598-8e30-4967-869b-613db2808b72 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 204 len: 0 microversion: 2.1 time: 0.268198 Sep 07 09:58:52.665770 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1538/3060] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:58:52 2022] DELETE /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:58:52.675687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7bb744fc-0033-4191-919d-df6d575fb6e6 req-4b5a31d5-1c13-49c7-9ed0-7bf0eee37774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195c12a5-e815-48c9-a628-b717b87f676c", "name": "network-vif-deleted", "tag": "a79f0f04-0fd8-400e-b0bd-e1e8628e920b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:52.710064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7bb744fc-0033-4191-919d-df6d575fb6e6 req-4b5a31d5-1c13-49c7-9ed0-7bf0eee37774 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.710789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7bb744fc-0033-4191-919d-df6d575fb6e6 req-4b5a31d5-1c13-49c7-9ed0-7bf0eee37774 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.711363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7bb744fc-0033-4191-919d-df6d575fb6e6 req-4b5a31d5-1c13-49c7-9ed0-7bf0eee37774 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.730624 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7bb744fc-0033-4191-919d-df6d575fb6e6 req-4b5a31d5-1c13-49c7-9ed0-7bf0eee37774 service nova] Creating event network-vif-deleted:a79f0f04-0fd8-400e-b0bd-e1e8628e920b for instance 195c12a5-e815-48c9-a628-b717b87f676c on n-h2-836830-16 Sep 07 09:58:52.744575 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7bb744fc-0033-4191-919d-df6d575fb6e6 req-4b5a31d5-1c13-49c7-9ed0-7bf0eee37774 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076732 Sep 07 09:58:52.747282 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1539/3061] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:52.763039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:52.764013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:52.781292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.783757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.801141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:52.802238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:52.802900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:52.803604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.371832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:53.383854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e14189d-f4ae-4a00-9956-d291d1b40c39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1313 microversion: 2.1 time: 1.081228 Sep 07 09:58:53.388057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1523/3062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:52 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:53.399876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:53.400499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:53.414484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.418618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.419206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.419956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.421760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.425299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.533419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:53.548686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:53.550198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:53.551395 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-efa3b852-71c8-4489-8cc1-c8f9f267e8e5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.802169 Sep 07 09:58:53.578517 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1540/3063] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:52 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:53.592754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:53.618560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:53.643143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.643661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.644118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.655389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.655971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.656423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.781672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:53.793264 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2ab4343-9ac4-46f4-bbbe-ba41412c7191 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1511 microversion: 2.1 time: 0.402724 Sep 07 09:58:53.793264 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1524/3064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:53 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:53.797887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:53.798504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] [instance: 195c12a5-e815-48c9-a628-b717b87f676c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:53.821108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.821941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.822388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.823095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.824131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.824565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.865385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] HTTP exception thrown: Instance 195c12a5-e815-48c9-a628-b717b87f676c could not be found. Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Request method failure captured: Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c HTTP/1.1 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGrmNKb0IBtJ4lc1mA6X9lErkucVLchqV7kpZU2MDKueOLNoNPquOa0oildHgNJP7ca0mOUEVYqBHppBM2MrAlwgteOkXlV627iVpUX4WoNbdiNMBN0b8LyjKFZIK8wBi_0YfYlwHxDmboWCGXojs_YggSM1TY-0TMQ-hhVolCyykaE Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 2b6e5ea5bc5b442497b1e787827630fa Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-520499266 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b6e5ea5bc5b442497b1e787827630fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b6e5ea5bc5b442497b1e787827630fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b6e5ea5bc5b442497b1e787827630fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b6e5ea5bc5b442497b1e787827630fa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-520499266 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 2b6e5ea5bc5b442497b1e787827630fa Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-520499266 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerRescueTestJSONUnderV235-520499266-project Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 528af86591194a5dae2ba78847d7bc06 Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-520499266-project Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 195c12a5-e815-48c9-a628-b717b87f676c could not be found. Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '195c12a5-e815-48c9-a628-b717b87f676c'} Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195c12a5-e815-48c9-a628-b717b87f676c could not be found. Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195c12a5-e815-48c9-a628-b717b87f676c could not be found. Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.867335 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195c12a5-e815-48c9-a628-b717b87f676c could not be found. Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] Returning 404 to user: Instance 195c12a5-e815-48c9-a628-b717b87f676c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d52d0b16-a6b8-4c80-b2a9-5fa8535f763e tempest-ServerRescueTestJSONUnderV235-520499266 tempest-ServerRescueTestJSONUnderV235-520499266-project] 10.222.0.60 "GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c" status: 404 len: 111 microversion: 2.1 time: 0.074603 Sep 07 09:58:53.874537 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1525/3065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:53 2022] GET /compute/v2.1/servers/195c12a5-e815-48c9-a628-b717b87f676c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:53.885048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:53.885761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] [instance: 9ab92bde-2c38-40d4-a36a-a17a55fa01f2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:53.892341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.892830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.893294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.894174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.894857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.905272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.927038 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] HTTP exception thrown: Instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 could not be found. Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Request method failure captured: Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 HTTP/1.1 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsebtlNMS4ns6lxn8f3qpsul86K9oO2B7tWWN3nsFTtoMVmHeNj1hFKy-eObzrTs6OCNOd1TupiUmEDnUBoRHEGK_lKR5cmTfsE-jXigg4GgC7N0_g1kkNMk1hv_YT9XtPYetJrUCgCpIMnRZmRwI_r7OR5bd4y8ABYwNo7e9dhQkk Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.26 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 4df7057507da417682ba9bd2728443c9 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerTagsTestJSON-605035541 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4df7057507da417682ba9bd2728443c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4df7057507da417682ba9bd2728443c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4df7057507da417682ba9bd2728443c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4df7057507da417682ba9bd2728443c9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerTagsTestJSON-605035541 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 4df7057507da417682ba9bd2728443c9 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerTagsTestJSON-605035541 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerTagsTestJSON-605035541-project Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e32b61b3bf6947de8a78a6f448462a81 Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerTagsTestJSON-605035541-project Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 could not be found. Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '9ab92bde-2c38-40d4-a36a-a17a55fa01f2'} Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 could not be found. Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 could not be found. Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:53.928907 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 could not be found. Sep 07 09:58:53.934864 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:53.936831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] Returning 404 to user: Instance 9ab92bde-2c38-40d4-a36a-a17a55fa01f2 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:53.937902 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4f87c49-d675-46ed-a823-f934cf14cd04 tempest-ServerTagsTestJSON-605035541 tempest-ServerTagsTestJSON-605035541-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2" status: 404 len: 111 microversion: 2.26 time: 0.067263 Sep 07 09:58:53.938963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1526/3066] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:53 2022] GET /compute/v2.1/servers/9ab92bde-2c38-40d4-a36a-a17a55fa01f2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:58:53.943903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:53.944787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:53.952142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.952953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.953616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:53.954477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:53.955199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:53.955797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:54.842831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:54.851289 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c08aef1f-518a-4d68-9e10-05d1014d603b tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.911033 Sep 07 09:58:54.851877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1527/3067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:53 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:54.868211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:54.869230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:54.877874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:54.878765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:54.879450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:54.880956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:54.881684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:54.882347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:54.905966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:54.920062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:54.921595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:54.922797 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d879e3a-278e-402b-9771-6b5e5bac7b7f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 1.342963 Sep 07 09:58:54.924028 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1541/3068] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:53 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:54.928857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:54.929771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:54.936700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:54.937691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:54.938359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:54.939305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:54.939992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:54.940670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.744105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:55.755823 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-085e75ea-e1ac-4e8c-a757-5bdb7174d7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1462 microversion: 2.1 time: 0.891866 Sep 07 09:58:55.756395 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1528/3069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:54 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1462 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:55.772470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:55.774658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:55.791577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.796002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.801273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.802048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.802592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.802952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.837829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:55.853065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:55.855022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:55.857065 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-079c051b-3085-4e79-af0f-ce5f60544abd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.931776 Sep 07 09:58:55.858348 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1542/3070] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:54 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:55.864067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9ba040ac-c96c-4454-b4b1-e4cdfc6278c2 req-55591e64-1bea-43b2-8154-fbdbfe4e01e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3458b2c-d087-4154-92c9-a6faaf6f6b4d", "name": "network-vif-deleted", "tag": "cb4399a3-5819-4e47-abb2-f3413a762959"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:55.876622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9ba040ac-c96c-4454-b4b1-e4cdfc6278c2 req-55591e64-1bea-43b2-8154-fbdbfe4e01e4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.877418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9ba040ac-c96c-4454-b4b1-e4cdfc6278c2 req-55591e64-1bea-43b2-8154-fbdbfe4e01e4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.877857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9ba040ac-c96c-4454-b4b1-e4cdfc6278c2 req-55591e64-1bea-43b2-8154-fbdbfe4e01e4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.891856 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9ba040ac-c96c-4454-b4b1-e4cdfc6278c2 req-55591e64-1bea-43b2-8154-fbdbfe4e01e4 service nova] Creating event network-vif-deleted:cb4399a3-5819-4e47-abb2-f3413a762959 for instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d on n-h1-836830-16 Sep 07 09:58:55.898531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.899069 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9ba040ac-c96c-4454-b4b1-e4cdfc6278c2 req-55591e64-1bea-43b2-8154-fbdbfe4e01e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038197 Sep 07 09:58:55.899811 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1543/3071] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:55.900748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.903658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.904674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lazy-loading 'fault' on Instance uuid b3458b2c-d087-4154-92c9-a6faaf6f6b4d {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:58:55.907153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ff762d05-4b82-4cb8-b680-8b042d8526e0 req-9b70b9ce-6718-47b6-ae4e-729a956d6ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f0aee9-79d2-48d1-8fbb-21d7442ba42e", "tag": "4f25ae9e-0db0-41f7-9805-2d622ecae55c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:55.918138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ff762d05-4b82-4cb8-b680-8b042d8526e0 req-9b70b9ce-6718-47b6-ae4e-729a956d6ade service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.918774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ff762d05-4b82-4cb8-b680-8b042d8526e0 req-9b70b9ce-6718-47b6-ae4e-729a956d6ade service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.919446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ff762d05-4b82-4cb8-b680-8b042d8526e0 req-9b70b9ce-6718-47b6-ae4e-729a956d6ade service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.931251 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ff762d05-4b82-4cb8-b680-8b042d8526e0 req-9b70b9ce-6718-47b6-ae4e-729a956d6ade service nova] Creating event network-changed:4f25ae9e-0db0-41f7-9805-2d622ecae55c for instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e on n-h1-836830-16 Sep 07 09:58:55.949841 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ff762d05-4b82-4cb8-b680-8b042d8526e0 req-9b70b9ce-6718-47b6-ae4e-729a956d6ade service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048370 Sep 07 09:58:55.951009 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1544/3072] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:58:55.957554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:55.958553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:55.969099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.970874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.971520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:55.972603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:55.973743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:55.974385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.057269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1507622fe2c4f3496a8bee52eea5bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233b50b19372481f9e1a43a4da277194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:56.069717 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3ce8a03d-176f-4b01-aae3-82cd42d02947 tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 200 len: 1307 microversion: 2.1 time: 0.312068 Sep 07 09:58:56.096535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1529/3073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:55 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:56.112108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:56.120090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:56.124170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:56.130983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:56.131467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:56.138132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.139453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:56.141783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:56.142512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.145201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:56.375733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:56.616222 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49cb4eee-cba6-448e-87ee-dffe63e45144 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1615 microversion: 2.1 time: 0.662790 Sep 07 09:58:56.617892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1545/3074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:55 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1615 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:56.624630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:56.625524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:56.629166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:56.634195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:56.634977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:56.635604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.637489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:56.640859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:56.641754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.685458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:56.705820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7fcff7eb-d25c-47a4-9492-76fb0dc1dcf2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.607777 Sep 07 09:58:56.711397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1530/3075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:56 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:56.725948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:58:56.726847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:56.735150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:56.736485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:56.736485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.737201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:56.737763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:56.738539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:56.830702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '56dde78e93f44d5ab460e8fa71b8d7ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72fb1502184da0b77d1eba7cc1159f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:56.831403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] flavor_id is None. Assuming migration. {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 09:58:56.831811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 09:58:56.837299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:58:57.000494 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be9dc480-9107-415b-b937-1928b88de71d tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827/action" status: 202 len: 0 microversion: 2.1 time: 0.286768 Sep 07 09:58:57.002994 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1531/3076] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:58:56 2022] POST /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:58:57.009623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:57.010901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:57.019919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:57.020544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:57.021159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:57.022367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:57.022858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:57.023358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:57.787440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:57.805071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:57.806575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:57.808312 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-daddf364-021b-4b20-88b3-f6827de41582 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 1.188514 Sep 07 09:58:57.834184 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1546/3077] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:56 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:57.843506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:57.844457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:57.852300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:57.853142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:57.853880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:57.855092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:57.855848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:57.856497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.176831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:58.187132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:58.188626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:58.189871 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28d3f457-e28c-454d-a7fa-ee66639b4b02 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 1.185508 Sep 07 09:58:58.190443 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1532/3078] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:57 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:58.230807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:58.231437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] [instance: b3458b2c-d087-4154-92c9-a6faaf6f6b4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:58.244466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:58.244977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:58.245687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.246586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:58.247064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:58.247503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.257141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:58.272448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] HTTP exception thrown: Instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d could not be found. Sep 07 09:58:58.273274 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01d5d048-b32f-44c5-a3fc-09a719b840e9 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1471 microversion: 2.1 time: 0.437695 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Request method failure captured: Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d HTTP/1.1 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGtDpngg2pLNHfoOqFmk9Uzsp_wKBZnp-6kQUFvpWLyNZGX-UXwbuXoShyoUBRnLgMHEHojUgwbNIYZWXzfBFoKY_NZMFCGQYLTyAMFx12Klac7MaDm-oxmWIiWNsswXiHsCL1fPpi34upMlA5Xnn-_M_mUWlZRmfTzXulxSWPkOJbE Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 233b50b19372481f9e1a43a4da277194 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-InstanceActionsTestJSON-105500903 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/233b50b19372481f9e1a43a4da277194"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/233b50b19372481f9e1a43a4da277194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/233b50b19372481f9e1a43a4da277194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_233b50b19372481f9e1a43a4da277194", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-InstanceActionsTestJSON-105500903 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 233b50b19372481f9e1a43a4da277194 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-InstanceActionsTestJSON-105500903 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-InstanceActionsTestJSON-105500903-project Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b1507622fe2c4f3496a8bee52eea5bd7 Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-InstanceActionsTestJSON-105500903-project Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d could not be found. Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b3458b2c-d087-4154-92c9-a6faaf6f6b4d'} Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d could not be found. Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d could not be found. Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:58:58.274057 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d could not be found. Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] Returning 404 to user: Instance b3458b2c-d087-4154-92c9-a6faaf6f6b4d could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3dff7021-88a9-4073-ac60-b811a857a96b tempest-InstanceActionsTestJSON-105500903 tempest-InstanceActionsTestJSON-105500903-project] 10.222.0.60 "GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d" status: 404 len: 111 microversion: 2.1 time: 0.049199 Sep 07 09:58:58.279502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1533/3079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:58 2022] GET /compute/v2.1/servers/b3458b2c-d087-4154-92c9-a6faaf6f6b4d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:58:58.289273 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1547/3080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:57 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:58.298121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:58.298758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:58.315707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:58.316583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:58.317318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.318277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:58.318962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:58.319634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.849283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:58.850680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:58.861928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:58.865468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:58.866251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.868376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:58.870243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:58.872241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:58.910798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:58.933681 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-10201875-02aa-406f-8e6b-4c10319ba0ee tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.644338 Sep 07 09:58:58.934599 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1534/3081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:58 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:58:59.220647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:59.221386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:59.238179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:59.238893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:59.239516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:59.240397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:59.241025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:59.241691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:59.825861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:59.838450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:59.840734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:58:59.847433 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca1107b6-a544-49c6-af00-bc97d5bf7819 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 1.002819 Sep 07 09:58:59.848704 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1548/3082] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:58 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:58:59.853777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:58:59.855302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:58:59.861616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:59.862447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:59.863064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:59.863918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:58:59.864523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:58:59.865205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:58:59.876900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:00.860387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:00.869812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:00.872205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:00.873663 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19e038e4-64d8-468a-bad4-652bd5687faf tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 1.656946 Sep 07 09:59:00.886810 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1535/3083] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:58:59 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:00.900176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:00.902329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:00.909306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:00.909893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:00.910415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:00.911232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:00.911762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:00.912429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:00.977228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:00.989503 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a618421-38b1-40c0-a1c6-35a92cbf15d4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1471 microversion: 2.1 time: 1.139358 Sep 07 09:59:00.990128 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1549/3084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:58:59 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1471 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:00.995369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:00.996276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:01.003390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:01.004088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:01.004718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:01.005763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:01.007025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:01.007765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:01.844443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:01.854063 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd74763a-7c7a-4db9-8d6d-4039cc2f25bb tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.965852 Sep 07 09:59:01.865567 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1536/3085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:00 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:01.904491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:01.905429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:01.913123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:01.918237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:01.927686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:01.928658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:01.929351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:01.930144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:02.069152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:02.091270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:02.094720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:02.101448 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8631eaf5-ede4-4376-99cc-fd0bc6e21835 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 1.110002 Sep 07 09:59:02.109881 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1550/3086] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:00 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:02.123817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:02.124785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:02.139169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:02.140147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:02.141571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:02.142614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:02.143290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:02.151142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:03.338036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:03.349356 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-477f24f3-41ea-4a6f-98f9-7529dbf185d5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1471 microversion: 2.1 time: 1.238000 Sep 07 09:59:03.350185 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1551/3087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:02 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1471 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:03.356744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-05d538eb-7aaa-4911-8bf8-ff6abe256a02 req-69a9510f-202d-4433-ad02-65db3265a3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "34db865d-7ea1-4f47-b238-dd9dea03cc4f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:03.367314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-05d538eb-7aaa-4911-8bf8-ff6abe256a02 req-69a9510f-202d-4433-ad02-65db3265a3b6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:03.368077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-05d538eb-7aaa-4911-8bf8-ff6abe256a02 req-69a9510f-202d-4433-ad02-65db3265a3b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:03.368737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-05d538eb-7aaa-4911-8bf8-ff6abe256a02 req-69a9510f-202d-4433-ad02-65db3265a3b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:03.383236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:03.394270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:03.403273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:03.410611 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1e29219-42be-4b5e-88f3-385b071b4eb1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 1.508157 Sep 07 09:59:03.412061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1537/3088] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:01 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:03.413856 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-05d538eb-7aaa-4911-8bf8-ff6abe256a02 req-69a9510f-202d-4433-ad02-65db3265a3b6 service nova] Creating event network-vif-plugged:34db865d-7ea1-4f47-b238-dd9dea03cc4f for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:03.424952 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-05d538eb-7aaa-4911-8bf8-ff6abe256a02 req-69a9510f-202d-4433-ad02-65db3265a3b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073078 Sep 07 09:59:03.425992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:03.426703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:03.428674 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1552/3089] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:03.437742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:03.442312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:03.443414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:03.443794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:03.444708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:03.447438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:03.450570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:03.451136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:03.461744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:03.469013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:03.470037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:03.470957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:03.471551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:03.472096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:04.028237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:04.050258 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b170716-c1de-4a4d-8f88-c23da9c45aec tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.636527 Sep 07 09:59:04.077995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:04.088297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:04.089291 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1538/3090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:03 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:04.094836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:04.096454 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5a127c2-2f7a-4951-9afc-f093089c76ed tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.666521 Sep 07 09:59:04.097004 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1553/3091] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:03 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:04.376390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:04.377421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:04.388664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:04.391891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:04.392554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:04.397647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:04.398560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:04.399167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:04.442902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:04.445140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:04.455687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:04.456490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:04.457089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:04.458190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:04.459202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:04.459805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:05.049647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.065130 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67791f16-9ccd-4c2b-95be-b935e93af5b0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.691973 Sep 07 09:59:05.068672 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1539/3092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:04 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:05.087436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:05.088439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:05.097633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:05.098500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:05.100976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:05.106165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:05.107096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:05.108759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:05.261540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.272166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.274863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.277108 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0bb3630b-d275-4be8-b886-05c5a3070f80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 0.838526 Sep 07 09:59:05.278391 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1554/3093] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:04 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:05.284854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:05.285773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:05.293091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:05.294770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:05.295679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:05.296798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:05.299597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:05.300343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:05.702038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.710293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c2e643f1-9ca4-4e90-9940-13b544a10560 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.635479 Sep 07 09:59:05.731673 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1540/3094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:05 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:05.743798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "a8ae0eeb-5f67-4acd-8aba-e2102c88e845"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "57936009-91d6-4234-b99f-5d420c0e3ffd"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "c4ddaf2a-dc3f-43a5-93a8-6635d7547448"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "86b5436c-53b2-4b67-9ddb-a9339f76af52"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "33dd40eb-4159-4612-af0e-40b1cdaa02ad"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:05.769864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:05.770350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:05.770838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:05.810696 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Creating event network-vif-plugged:a8ae0eeb-5f67-4acd-8aba-e2102c88e845 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:05.811720 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Creating event network-vif-plugged:57936009-91d6-4234-b99f-5d420c0e3ffd for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:05.812579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Creating event network-vif-plugged:c4ddaf2a-dc3f-43a5-93a8-6635d7547448 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:05.813356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Creating event network-vif-plugged:86b5436c-53b2-4b67-9ddb-a9339f76af52 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:05.815353 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] Creating event network-vif-plugged:33dd40eb-4159-4612-af0e-40b1cdaa02ad for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:05.831375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1d8ee626-ba5c-4c7c-a14f-fc96a8ee95dc req-7f615a35-d6da-4ae7-95f0-a9e710501d27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.097616 Sep 07 09:59:05.832704 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1541/3095] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:05.972409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.986847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.988666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:05.994062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e63edb5a-6442-4f8e-b201-af4f454e4f20 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.714303 Sep 07 09:59:05.997061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1555/3096] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:05 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:06.100382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:06.101630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:06.111781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:06.112668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:06.113584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:06.115023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:06.115740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:06.116405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:06.310647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:06.311662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:06.337047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:06.338444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:06.341357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:06.344450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:06.347464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:06.348777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:07.201939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:07.223255 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-daa63a61-c106-41e0-826d-612669d1d322 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 1.130625 Sep 07 09:59:07.224848 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1542/3097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:06 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:07.239341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:07.240291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:07.251455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:07.252156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:07.252767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:07.253788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:07.254637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:07.255444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:07.274996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:07.303869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:07.309089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:07.317689 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd9e9e13-9463-41c0-8fe4-6744fb9ee89f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 1.009724 Sep 07 09:59:07.339972 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1556/3098] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:06 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:07.586896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1005200912", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "5a472afb-e49c-4e28-99c3-f0f700fc338c"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:07.662772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] validate_networks() for [('5a472afb-e49c-4e28-99c3-f0f700fc338c', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:59:07.887866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:07.931785 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46965f1b-ad15-466f-832d-e6f65cde498f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.702605 Sep 07 09:59:07.933217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1543/3099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:07 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:07.978430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:07.980776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:08.003736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.004253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.004699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.007048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.008165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.009694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.533435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:08.551131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:08.552850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:08.554739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:08.555383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:08.556430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:08.579569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:08.584434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.585630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:08.586051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.587428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.590792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.591745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ddb075c4-6a1a-4ad0-99da-45a31caa20a0 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.654457 Sep 07 09:59:08.593736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.596656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1544/3100] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:07 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:08.597370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.612625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "7942dc19-0d73-4b64-8443-ed7290abd41e"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "7db2bf51-8311-4cf4-ae79-919fe6ccada5"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "388c8aab-43f8-4b1f-81d6-1de595152f6e"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "ebd2b93f-9339-4996-b73d-d6aba65c7eb9"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-plugged", "status": "completed", "tag": "da887d2b-904a-42ea-907a-bd6e5039d46e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:08.647051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.648916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.650246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.652190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Getting quotas for project ccd771f0096f47edb69e93f4c80771de. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:08.662294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Getting quotas for user 0ac570950aec4d919c8ed8543fa0d3c9 and project ccd771f0096f47edb69e93f4c80771de. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:08.679581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:59:08.682270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:59:08.711853 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Creating event network-vif-plugged:7942dc19-0d73-4b64-8443-ed7290abd41e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:08.713082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Creating event network-vif-plugged:7db2bf51-8311-4cf4-ae79-919fe6ccada5 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:08.715763 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Creating event network-vif-plugged:388c8aab-43f8-4b1f-81d6-1de595152f6e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:08.718275 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Creating event network-vif-plugged:ebd2b93f-9339-4996-b73d-d6aba65c7eb9 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:08.720662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] Creating event network-vif-plugged:da887d2b-904a-42ea-907a-bd6e5039d46e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:08.744193 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-add1f8de-75f3-4fb3-8d4c-e2a00f225c0a req-62f39f83-3cc6-4579-8aa5-0470cc494f00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.143703 Sep 07 09:59:08.749214 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1545/3101] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:08.771536 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c1c19cbc-de68-4c4b-89a7-541b50d92dd2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430241 Sep 07 09:59:08.774501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1557/3102] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:59:08.789939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:08.791876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:08.799182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:08.800991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.802263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.802882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.803920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.804576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.805438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.809728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:08.832693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.840282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.842351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:08.844741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:08.848866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:08.851180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:09.701626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:09.709886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a17e5d2-d2d9-4e95-8c05-66f271600ec2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.957997 Sep 07 09:59:09.714942 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1546/3103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:08 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:09.719840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:09.732523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:09.741226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:09.741603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:09.742262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:09.742985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:09.743988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:09.744675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:09.909244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:09.925081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:09.926869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:09.929426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05d1e871-74b3-4632-860f-11c2bc488e7a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1879 microversion: 2.42 time: 1.151390 Sep 07 09:59:09.932470 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1558/3104] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:08 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1879 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:09.937746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-528556454", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "5a472afb-e49c-4e28-99c3-f0f700fc338c"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:10.070612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] validate_networks() for [('5a472afb-e49c-4e28-99c3-f0f700fc338c', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:59:10.243105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:10.265745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e249a0d7-c07d-4e4f-baa0-e08d8feb4c33 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.547779 Sep 07 09:59:10.268623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1547/3105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:09 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:10.286264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:10.287116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:10.302540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:10.303240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:10.303699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:10.304609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:10.306284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:10.306738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:10.951751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:10.956818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:10.974305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:10.976497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:10.984136 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e30a1137-dd0f-4a40-8294-d3fbd894020d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.713947 Sep 07 09:59:11.003056 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1548/3106] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:10 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:11.247770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:11.248816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:11.249644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:11.250251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:11.251113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:11.270172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.271006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.271663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:11.272827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.283471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.289790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:11.340872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Getting quotas for project ccd771f0096f47edb69e93f4c80771de. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:11.348710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Getting quotas for user 0ac570950aec4d919c8ed8543fa0d3c9 and project ccd771f0096f47edb69e93f4c80771de. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:11.377323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:59:11.379959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:59:11.438310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-987067745", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:11.502472 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2b9ca4c8-6a78-4884-bb1f-070263ca702e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568394 Sep 07 09:59:11.504047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1559/3107] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:59:11.555238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:11.560368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:11.577934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.579448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.580170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:11.581761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.582465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.583130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:11.619528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:11.620019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:11.622709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:11.623412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:11.627439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:11.674697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.677465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.679089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:11.690061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.691530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.692301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:11.718771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:11.730066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Getting quotas for project a0fb47fd474948c080aed7e5d0061dd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:11.742025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Getting quotas for user d58e65ef71c544168c30448efadbd789 and project a0fb47fd474948c080aed7e5d0061dd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:11.766175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:59:11.773260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:59:11.910668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dbd6980c-9779-4dc1-9915-9fbffdcba904 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.906114 Sep 07 09:59:11.914064 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1549/3108] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:59:11.934664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "1ecfaf7d-3cc0-4159-97c4-dac53650ffa4"}, {"server_uuid": "b7f0aee9-79d2-48d1-8fbb-21d7442ba42e", "name": "network-vif-plugged", "status": "completed", "tag": "4f25ae9e-0db0-41f7-9805-2d622ecae55c"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "7b601b14-198e-469c-b95a-239bd800b1e0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:11.988390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:11.991143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:11.993639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:12.026854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Creating event network-vif-plugged:1ecfaf7d-3cc0-4159-97c4-dac53650ffa4 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:12.029840 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Creating event network-vif-plugged:4f25ae9e-0db0-41f7-9805-2d622ecae55c for instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e on n-h1-836830-16 Sep 07 09:59:12.031597 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] Creating event network-vif-plugged:7b601b14-198e-469c-b95a-239bd800b1e0 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:12.059212 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8ed04e8b-a09e-49dc-9455-18d47da92a06 req-8fe0b909-08f5-4458-9fff-8048f0625623 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.143251 Sep 07 09:59:12.062852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1550/3109] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:12.078999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:12.080053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:12.099156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:12.107269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:12.108085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:12.109058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:12.111042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:12.111743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:12.199014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:12.216046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70727966-4b3e-4361-95db-9f38af26a77e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.710763 Sep 07 09:59:12.229203 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1560/3110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:11 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:12.229203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:12.229203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:12.236938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:12.237468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:12.237915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:12.238635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:12.239100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:12.239540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:13.041079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.057117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.059884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.061450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f566c1e6-5bc9-43ab-8857-221f4f9f5f00 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2836 microversion: 2.42 time: 0.997107 Sep 07 09:59:13.075865 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1551/3111] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:12 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2836 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:13.089298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.092069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1907391547", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "451", "networks": [{"uuid": "5a472afb-e49c-4e28-99c3-f0f700fc338c"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:13.101678 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f97d018-7efb-4f2e-9aee-7b6f4ad44607 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1316 microversion: 2.1 time: 0.883703 Sep 07 09:59:13.105998 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1561/3112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:12 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:13.128055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:13.128730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:13.136500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:13.137601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:13.138265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:13.139872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:13.140566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:13.142090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:13.154680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] validate_networks() for [('5a472afb-e49c-4e28-99c3-f0f700fc338c', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 09:59:13.272660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.282540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.284416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:13.285684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa95eca4-9eaa-40f0-8839-7dccd1c37be1 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1273 microversion: 2.54 time: 0.161865 Sep 07 09:59:13.286891 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1562/3113] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:13 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:13.536364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-305716614", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:13.630309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:13.631183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:13.632811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:13.633524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:13.634167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:13.647643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:13.648508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:13.649492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:13.651897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:13.652723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:13.653864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:13.677413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Getting quotas for project 9513f5dbaf46496ea925df77103fc06b. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:13.685688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Getting quotas for user fdda27dce4a04bbab7f98407ba1ea327 and project 9513f5dbaf46496ea925df77103fc06b. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:13.702551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:59:13.706113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:59:13.768035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d00f186-7443-4476-a7ef-d0a5c3b23015 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.479213 Sep 07 09:59:13.768892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1563/3114] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:59:13.792012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:13.796834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:13.809495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:13.810311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:13.810912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:13.811800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:13.812404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:13.813161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:14.003367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:14.003896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:14.004532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:14.005395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:14.005912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:14.022151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:14.023599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:14.025351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:14.029619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:14.030972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:14.032548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:14.085849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Getting quotas for project ccd771f0096f47edb69e93f4c80771de. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:14.109650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Getting quotas for user 0ac570950aec4d919c8ed8543fa0d3c9 and project ccd771f0096f47edb69e93f4c80771de. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:14.143539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:59:14.155884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:59:14.243373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:14.266825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:14.271087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:14.278236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9575d14-d957-4d34-bec0-8c26e12f3b09 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 0.505968 Sep 07 09:59:14.284487 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1564/3115] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:13 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:14.301895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:14.302403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:14.316647 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75fa0d2b-a51b-4bcc-b4e4-658b4ddfabc8 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239911 Sep 07 09:59:14.324229 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1552/3116] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 09:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 09:59:14.335394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:14.336008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:14.337222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:14.338876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:14.340069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:14.344698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:14.346689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:14.349064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:14.381017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:14.391939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:14.394986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:14.397215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:14.397994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:14.403462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.002396 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adc76d5a-9ee3-4635-af81-dc4f1b0c81d5 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.716300 Sep 07 09:59:15.003731 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1565/3117] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 09:59:14 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160/os-interface => generated 1831 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:15.013843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:15.015290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:15.033030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.036906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.039399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.040876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.042227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.042691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.301347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.318545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.320283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.321952 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a6d25048-2199-4719-85dd-16bc26229171 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 200 len: 1281 microversion: 2.47 time: 0.315746 Sep 07 09:59:15.323333 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1566/3118] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:15 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:15.339663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cc4406ec-83a9-4f5e-871b-58fb84fbffaf req-7f10392d-818d-42a9-b3f3-00ec1dea0a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-plugged", "status": "completed", "tag": "f1db77bf-0c02-4148-82fb-f59530d17e45"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:15.364401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc4406ec-83a9-4f5e-871b-58fb84fbffaf req-7f10392d-818d-42a9-b3f3-00ec1dea0a72 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.364894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc4406ec-83a9-4f5e-871b-58fb84fbffaf req-7f10392d-818d-42a9-b3f3-00ec1dea0a72 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.365368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc4406ec-83a9-4f5e-871b-58fb84fbffaf req-7f10392d-818d-42a9-b3f3-00ec1dea0a72 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.387807 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cc4406ec-83a9-4f5e-871b-58fb84fbffaf req-7f10392d-818d-42a9-b3f3-00ec1dea0a72 service nova] Creating event network-vif-plugged:f1db77bf-0c02-4148-82fb-f59530d17e45 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:15.412428 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cc4406ec-83a9-4f5e-871b-58fb84fbffaf req-7f10392d-818d-42a9-b3f3-00ec1dea0a72 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087329 Sep 07 09:59:15.413439 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1567/3119] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:15.427830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:15.428855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:15.441983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.443800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.451152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.451690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.452529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.453073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.453606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.507498 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-348a2166-57e4-4a13-8ab2-4a4a47016e73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 1.147978 Sep 07 09:59:15.514801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1553/3120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:14 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:15.534965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:15.535839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:15.551477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.551988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.552612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.553654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.555867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.556507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.875014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.889528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.891189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:15.895361 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e7aad22-fac9-4eec-bd04-246fd94a4bc6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1329 microversion: 2.54 time: 0.379179 Sep 07 09:59:15.897595 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1554/3121] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:15 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1329 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:15.906739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:15.909950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:15.925679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.926459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.927278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:15.928304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:15.929356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:15.930820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.216204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:16.233967 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-50eea8e9-76c4-422d-a57b-7158e36007eb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1217 microversion: 2.1 time: 0.335148 Sep 07 09:59:16.234575 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1555/3122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:15 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:16.254095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:16.255088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:16.262053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:16.262877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:16.263520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.274487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:16.275226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:16.275876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.337634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:16.347553 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4bf39d6-48d7-40f5-968d-5e3877b6924f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1504 microversion: 2.1 time: 0.932181 Sep 07 09:59:16.366344 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1568/3123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:15 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1504 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:16.374037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-582646184", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:16.507965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:16.508397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:16.508893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:16.509331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:16.509749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:16.526085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:16.529252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:16.531565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.536129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:16.537809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:16.538255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.599204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Getting quotas for project 9513f5dbaf46496ea925df77103fc06b. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:16.615135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Getting quotas for user fdda27dce4a04bbab7f98407ba1ea327 and project 9513f5dbaf46496ea925df77103fc06b. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:16.654323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 09:59:16.660746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 09:59:16.689444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:16.766263 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7aaf5ed-bfe8-4cf9-aa29-9edcf32a525a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.398426 Sep 07 09:59:16.767024 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1569/3124] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 09:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 09:59:16.780096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1265703331"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:16.780649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:16.788254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:16.788755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:16.789222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.790024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:16.790391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:16.790814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:16.800008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:17.594176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:17.610487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:17.612442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:17.614332 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c83b4895-af51-42b9-85d2-9612290de71c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1879 microversion: 2.32 time: 1.364069 Sep 07 09:59:17.623688 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1556/3125] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:16 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1879 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:17.638362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:17.640077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:17.651351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:17.652064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:17.652700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:17.653767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:17.654441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:17.655021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:17.846625 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.network.security_group_api [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Adding security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 to port 4f25ae9e-0db0-41f7-9805-2d622ecae55c Sep 07 09:59:18.285131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:18.294142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f54cbd74-2865-4753-a6e1-49641eee78a0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.669104 Sep 07 09:59:18.294759 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1557/3126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:17 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:18.299952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:18.302809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:18.311707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.312201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.312646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.313382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.313841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.314273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.356404 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d8ad66e3-373a-43e3-be33-9a141c999c32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "PUT /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 991 microversion: 2.47 time: 0.060210 Sep 07 09:59:18.358262 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1558/3127] 10.222.0.60 () {62 vars in 1297 bytes} [Wed Sep 7 09:59:18 2022] PUT /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 09:59:18.363802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:18.364605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:18.371640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.372633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.373323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.374190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.374999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.375574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.517661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:18.530331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:18.532286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:18.535351 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1619db84-b60e-47b8-aef4-d9581b90c9ed tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1335 microversion: 2.54 time: 0.175500 Sep 07 09:59:18.549820 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1559/3128] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:18 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:18.552452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:18.555258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:18.562914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.563551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.564131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.565339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.567143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.567666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.814295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:18.823150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c20937bc-db68-4b3d-beb8-2e17f7f966e3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1273 microversion: 2.1 time: 0.277731 Sep 07 09:59:18.839867 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1560/3129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:18 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:18.844940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:18.846118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:18.852249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.852890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.853464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:18.854987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:18.855685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:18.856219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:19.051446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:19.065449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:19.070741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:19.072341 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88f1a0b9-ea0e-4ec6-8a6d-641bec38fbd1 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1329 microversion: 2.47 time: 0.231259 Sep 07 09:59:19.084052 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1561/3130] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:18 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1329 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:19.090174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:19.091084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:19.104474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:19.105407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:19.108146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:19.109076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:19.109735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:19.126185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:19.537369 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-73b22adc-447e-4cf1-bf72-6483faab26a0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e/action" status: 202 len: 0 microversion: 2.1 time: 2.769055 Sep 07 09:59:19.538947 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1570/3131] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:59:16 2022] POST /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e/action => generated 0 bytes in 2771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:19.546343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-da51fb09-f826-49cd-ace1-db82078566b2 req-e7a6d734-108e-4e89-b5ac-ef781f55933b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97f3cff-8a42-4913-b243-4f367a9b64da", "tag": "267dd117-6168-4faf-b836-8b40e724b438"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:19.571203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-da51fb09-f826-49cd-ace1-db82078566b2 req-e7a6d734-108e-4e89-b5ac-ef781f55933b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:19.574108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-da51fb09-f826-49cd-ace1-db82078566b2 req-e7a6d734-108e-4e89-b5ac-ef781f55933b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:19.577335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-da51fb09-f826-49cd-ace1-db82078566b2 req-e7a6d734-108e-4e89-b5ac-ef781f55933b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:19.613367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-da51fb09-f826-49cd-ace1-db82078566b2 req-e7a6d734-108e-4e89-b5ac-ef781f55933b service nova] Creating event network-changed:267dd117-6168-4faf-b836-8b40e724b438 for instance e97f3cff-8a42-4913-b243-4f367a9b64da on n-h2-836830-16 Sep 07 09:59:19.629663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-da51fb09-f826-49cd-ace1-db82078566b2 req-e7a6d734-108e-4e89-b5ac-ef781f55933b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086285 Sep 07 09:59:19.631715 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1571/3132] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:19.638654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:19.639953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:19.647116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:19.648000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:19.649829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:19.651545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:19.652315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:19.652968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:20.048194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:20.061606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:20.063430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:20.065269 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01db79ad-2ecc-4d0c-9b24-315687ced193 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2831 microversion: 2.32 time: 0.980125 Sep 07 09:59:20.067587 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1562/3133] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:19 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2831 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:20.093284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0619625f-12aa-425b-a2ff-a654584740a5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1d34af0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:20.816709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:20.827651 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-12475f3e-e866-44f2-839c-99ce9b9ab850 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 1.193921 Sep 07 09:59:20.856305 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1572/3134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:19 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:20.864293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:20.866518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:20.879793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:20.880509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:20.881139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:20.882228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:20.883183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:20.883768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.107915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-0619625f-12aa-425b-a2ff-a654584740a5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use.", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:21.110086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-0619625f-12aa-425b-a2ff-a654584740a5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.110086 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] Sep 07 09:59:21.114355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0619625f-12aa-425b-a2ff-a654584740a5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5 HTTP/1.1 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: exception: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3b04f37c-0f42-4272-b75d-0fe85b3391f5'} Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:21.121574 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] Sep 07 09:59:21.126692 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:21.135045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0619625f-12aa-425b-a2ff-a654584740a5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 400 to user: Security Group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 in use. Sep 07 09:59:21.135045 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-bc13b5ee-c89c-4171-9a13-08f74186fc43'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:21.137479 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0619625f-12aa-425b-a2ff-a654584740a5 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5" status: 400 len: 185 microversion: 2.1 time: 1.068578 Sep 07 09:59:21.142057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1563/3135] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:20 2022] DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5 => generated 185 bytes in 1073 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:59:21.152921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.155921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.158791 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25dc43e3-ddc6-448f-b0bf-1e64b6530831 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1356 microversion: 2.54 time: 0.301024 Sep 07 09:59:21.160187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:21.160547 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1573/3136] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:20 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1356 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:21.162750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:21.183912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.185529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.186246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.188552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.189344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.190148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.195294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:21.195819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:21.215640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.216166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.216618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.217520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.218136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.218581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.357515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.367697 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d2cf1cd-b09a-4564-b85a-300f57f66569 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1279 microversion: 2.1 time: 0.224060 Sep 07 09:59:21.368647 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1564/3137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:21 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:21.375248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:21.376060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:21.382928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.383636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.384176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.385223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.385990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.386550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.656664 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07733628-42e8-4d30-98db-1661de407768 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.478795 Sep 07 09:59:21.657425 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1574/3138] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 09:59:21 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6/os-interface => generated 1831 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:21.669852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.671307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:21.673770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:21.679051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.685444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:21.687420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.688318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.688558 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0fd10a35-ce86-4637-8ecd-e5124d4f5105 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1335 microversion: 2.47 time: 0.317039 Sep 07 09:59:21.688995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.690003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.691301 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1565/3139] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:21 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1335 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:21.692479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.693743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.712895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d35c4c8-f2bb-430c-9347-bcb00e867e8b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Action: 'create', calling method: .version_select at 0x7f14b22c6e50>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-26514637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyL+ErYygDyhJ5fIT9oEuZ22mhF47UWL3px9Y8kUuYeqRqzzsXHfH5hNzTxlBv9K3wj/8m0Ms3NpW4fYxfbaQ8neudLuE+1zQeLH+6aqyz1kOGBkGfmFSz//m+F4WDNnQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:21.737502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5d35c4c8-f2bb-430c-9347-bcb00e867e8b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Getting quotas for project a0fb47fd474948c080aed7e5d0061dd2. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 09:59:21.747742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5d35c4c8-f2bb-430c-9347-bcb00e867e8b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Getting quotas for user d58e65ef71c544168c30448efadbd789 and project a0fb47fd474948c080aed7e5d0061dd2. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 09:59:21.784285 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d35c4c8-f2bb-430c-9347-bcb00e867e8b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.079431 Sep 07 09:59:21.791824 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1566/3140] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 09:59:21 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 09:59:21.800289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f0aee9-79d2-48d1-8fbb-21d7442ba42e", "tag": "4f25ae9e-0db0-41f7-9805-2d622ecae55c"}, {"name": "network-changed", "server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "tag": "7942dc19-0d73-4b64-8443-ed7290abd41e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:21.818612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.820679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.821408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.822704 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c616829-4555-41e6-8422-acd89c385dbe tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e/action" status: 202 len: 0 microversion: 2.1 time: 0.163738 Sep 07 09:59:21.829040 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1575/3141] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:59:21 2022] POST /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:21.837049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-26514637", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:21.840828 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] Creating event network-changed:4f25ae9e-0db0-41f7-9805-2d622ecae55c for instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e on n-h1-836830-16 Sep 07 09:59:21.841684 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] Creating event network-changed:7942dc19-0d73-4b64-8443-ed7290abd41e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 09:59:21.843084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:21.851928 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-dc01c75f-a66a-4484-8f07-7ab711c7e1c3 req-ae0d175d-678b-4323-902b-2b35b045261f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057233 Sep 07 09:59:21.853280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.853539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1567/3142] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:21.855780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.856412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.857584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.858311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.858927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.861831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:21.863298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:21.871809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.872453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.873285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.875955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:21.877766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:21.878504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:21.982372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:21.983167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:21.983821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:21.984379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:21.985329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:22.093665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:22.106529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.112815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.113599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.114324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.114796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.115256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.168944 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c33055b-9164-4839-84cc-2f731b936b74 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "POST /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638/action" status: 202 len: 1137 microversion: 2.54 time: 0.337764 Sep 07 09:59:22.194711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1576/3143] 10.222.0.60 () {62 vars in 1320 bytes} [Wed Sep 7 09:59:21 2022] POST /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638/action => generated 1137 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 09:59:22.214877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:22.215849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:22.224965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.237006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.237595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.248474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.249082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.249767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.648000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:22.657441 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d93d9cff-08b2-43a7-ad10-bcb3daf9a41d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1575 microversion: 2.1 time: 0.801910 Sep 07 09:59:22.658323 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1568/3144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:21 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1575 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:22.678644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:22.679614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:22.694984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.696956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.699016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.702060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.702637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.703153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.858549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:22.862717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:22.867723 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a31a5def-8970-49ab-aeb9-fb7821cdb398 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.670750 Sep 07 09:59:22.871853 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1577/3145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:22 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:22.882597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:22.883464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:22.887925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:22.889719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:22.891618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b35cd85e-e5ec-4472-a7bd-8c7f15e708ff tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.231299 Sep 07 09:59:22.892838 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1569/3146] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:22 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:22.895542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.896046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.896492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.897218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.897686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.898117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.898813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:22.899570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:22.908001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.908710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.909364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.910244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:22.910852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:22.911431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:22.936232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:23.067510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.085432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.088155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.092943 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9cbbd03-3244-4446-a05d-aa7635e6e97a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1356 microversion: 2.47 time: 0.195879 Sep 07 09:59:23.103246 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1570/3147] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:22 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:23.103548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.116076 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77dc6c83-ac78-4598-83b8-0dc46adb76c3 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1279 microversion: 2.1 time: 0.241667 Sep 07 09:59:23.117377 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1578/3148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:22 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:23.134334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:23.140261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:23.148207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.149007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.149731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.150634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.152392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.153079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.259486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 09:59:23.259967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 09:59:23.260522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 09:59:23.261126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 09:59:23.261996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 09:59:23.415252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:23.423111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.423701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.424239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.425386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.426075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.426848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.468103 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-615d7774-9d13-49bb-9e37-fa1674c4bd38 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "POST /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc/action" status: 202 len: 1078 microversion: 2.47 time: 0.345045 Sep 07 09:59:23.469115 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1571/3149] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 09:59:23 2022] POST /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc/action => generated 1078 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 09:59:23.499674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:23.500875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:23.533952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.534495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.535032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.538862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.540694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.541072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.683280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:23.684946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:23.701484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.702076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.702605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.704244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:23.704814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:23.705516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:23.764378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.774475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.776191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:23.777541 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c672d898-1d38-4c13-9bd8-de0014cd8ed3 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.287279 Sep 07 09:59:23.778164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1579/3150] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:23 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:24.056203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:24.098202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:24.099938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:24.107178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.108082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.108874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.109881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.110635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.111384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.834814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:24.844163 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0e3f50c-b347-47c9-84b0-ea4b6b79ab32 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.955910 Sep 07 09:59:24.845128 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1580/3151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:23 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:24.850479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-479af3eb-ac66-4c36-83fa-10e2f1399922 req-2c9f4d65-93f5-4a54-bb6e-47f0e41abec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b33289-890e-4c7a-a076-234e7732e92e", "tag": "26d8a2ef-d142-4b97-a6ed-91de5398da33"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:24.862388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-479af3eb-ac66-4c36-83fa-10e2f1399922 req-2c9f4d65-93f5-4a54-bb6e-47f0e41abec5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.863110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-479af3eb-ac66-4c36-83fa-10e2f1399922 req-2c9f4d65-93f5-4a54-bb6e-47f0e41abec5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.863700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-479af3eb-ac66-4c36-83fa-10e2f1399922 req-2c9f4d65-93f5-4a54-bb6e-47f0e41abec5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.867323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:24.877081 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-479af3eb-ac66-4c36-83fa-10e2f1399922 req-2c9f4d65-93f5-4a54-bb6e-47f0e41abec5 service nova] Creating event network-changed:26d8a2ef-d142-4b97-a6ed-91de5398da33 for instance 17b33289-890e-4c7a-a076-234e7732e92e on n-h1-836830-16 Sep 07 09:59:24.883315 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-479af3eb-ac66-4c36-83fa-10e2f1399922 req-2c9f4d65-93f5-4a54-bb6e-47f0e41abec5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035931 Sep 07 09:59:24.883679 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d8f41b9-0fa7-46a6-b2dd-5a1f33206469 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1575 microversion: 2.1 time: 1.205503 Sep 07 09:59:24.884089 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1581/3152] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:24.884256 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1572/3153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:23 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1575 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:24.890937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fe44fde6-ee8c-41e0-ae89-366bc391254b req-92d77dd5-7e83-4503-bcef-34434bc83969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "tag": "34db865d-7ea1-4f47-b238-dd9dea03cc4f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:24.892167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:24.892801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:24.902410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fe44fde6-ee8c-41e0-ae89-366bc391254b req-92d77dd5-7e83-4503-bcef-34434bc83969 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.903197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fe44fde6-ee8c-41e0-ae89-366bc391254b req-92d77dd5-7e83-4503-bcef-34434bc83969 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.903834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fe44fde6-ee8c-41e0-ae89-366bc391254b req-92d77dd5-7e83-4503-bcef-34434bc83969 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.915766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.918549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fe44fde6-ee8c-41e0-ae89-366bc391254b req-92d77dd5-7e83-4503-bcef-34434bc83969 service nova] Creating event network-changed:34db865d-7ea1-4f47-b238-dd9dea03cc4f for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 09:59:24.918818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.919378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.920532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.921354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.924214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.929142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fe44fde6-ee8c-41e0-ae89-366bc391254b req-92d77dd5-7e83-4503-bcef-34434bc83969 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042217 Sep 07 09:59:24.930493 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1582/3154] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:24.936379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:24.937231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:24.944854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.945489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.946013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:24.947000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:24.947475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:24.948101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:25.150702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.169300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.170360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.172543 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e622bbc1-e441-4f5d-8495-f2de9e37968d tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.286967 Sep 07 09:59:25.187815 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1573/3155] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:24 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:25.198283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:25.198990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:25.205284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:25.205783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:25.206272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:25.211923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:25.212420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:25.214003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:25.360840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.373205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.374691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.377006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-457dab56-8416-4ea4-8823-cda8cb33468a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.186928 Sep 07 09:59:25.389706 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1574/3156] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:25 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:25.429607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:25.472993 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8076eeec-c280-4c3c-b512-8d8c712fdc26 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.532779 Sep 07 09:59:25.474245 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1583/3157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:24 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:25.874141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:25.875436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:25.884890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:25.886554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:25.887269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:25.888151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:25.888827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:25.889507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:25.912390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:25.913589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:25.921637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:25.922394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:25.923025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:25.924767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:25.925423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:25.926009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.404672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.422487 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e8511bc-59e9-46af-b9fe-950329b73e39 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1476 microversion: 2.1 time: 0.554188 Sep 07 09:59:26.433660 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1575/3158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:25 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1476 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:26.443755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:26.444379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:26.451481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:26.451975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:26.452413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.453120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:26.453611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:26.454040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.531132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.542636 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9b9665a-7559-4cfc-97ca-c855d8746f2d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1575 microversion: 2.1 time: 0.634221 Sep 07 09:59:26.543493 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1584/3159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:25 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1575 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:26.550429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:26.551334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:26.558580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:26.560898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:26.561586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:26.562252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.563951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:26.565090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:26.566567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.610123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.623294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.624792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.626178 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df8fc3fc-4bd3-4b5f-9627-c2ac951005cf tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.191429 Sep 07 09:59:26.627791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1576/3160] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:26 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:26.630222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=24 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:26.633326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:26.634166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:26.640626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:26.641870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:26.642473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.643371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:26.644003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:26.644591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:26.694139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.703207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.706873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:26.708080 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fac07bef-3dc7-4594-b550-db0b60058476 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.163364 Sep 07 09:59:26.708642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1585/3161] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:26 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:27.165608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:27.177245 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb33c0cf-4243-4eee-b9a0-fcf8657f6c5c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.547947 Sep 07 09:59:27.187502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1577/3162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:26 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:27.195452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-15f51fb5-0b01-4116-92e0-190adba7776d req-441c1978-066b-4f8c-8131-4d2e4406c5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e009df-4506-4ce7-89e0-cae9dc86149b", "tag": "8b9ea828-efb1-498a-93a5-a1e7f93c8d59"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:27.219286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-15f51fb5-0b01-4116-92e0-190adba7776d req-441c1978-066b-4f8c-8131-4d2e4406c5d9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:27.226038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-15f51fb5-0b01-4116-92e0-190adba7776d req-441c1978-066b-4f8c-8131-4d2e4406c5d9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:27.226750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-15f51fb5-0b01-4116-92e0-190adba7776d req-441c1978-066b-4f8c-8131-4d2e4406c5d9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:27.234533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:27.243467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-15f51fb5-0b01-4116-92e0-190adba7776d req-441c1978-066b-4f8c-8131-4d2e4406c5d9 service nova] Creating event network-changed:8b9ea828-efb1-498a-93a5-a1e7f93c8d59 for instance 96e009df-4506-4ce7-89e0-cae9dc86149b on n-h2-836830-16 Sep 07 09:59:27.250046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-15f51fb5-0b01-4116-92e0-190adba7776d req-441c1978-066b-4f8c-8131-4d2e4406c5d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059383 Sep 07 09:59:27.250867 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1586/3163] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:27.450465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:27.451160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:27.458075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:27.458668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:27.459172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:27.459871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:27.460327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:27.460759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:27.573645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:27.574366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:27.581704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:27.582199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:27.582635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:27.583528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:27.583999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:27.584422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.374708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.394775 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-293f2bf3-d359-4c18-97cc-5e922e480b4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1475 microversion: 2.1 time: 0.948644 Sep 07 09:59:28.396900 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1578/3164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:27 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1475 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:28.407859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:28.409275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:28.424808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.425427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.425976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.427656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.429591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.430817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.624405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.626665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.636760 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac6d8298-b95b-4370-8119-6c54d4bd1493 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1580 microversion: 2.1 time: 1.069047 Sep 07 09:59:28.639229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.640720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.641969 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ef6b3ae6-d690-4efd-ac80-6d8d080d64c5 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.243748 Sep 07 09:59:28.642700 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1579/3165] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:28 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:28.647508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:28.648358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:28.654678 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1587/3166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:27 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1580 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:28.658067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.658818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.659503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.660453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.661123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.661786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.673915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bdd8835d-f1da-42e9-a3cc-b185db0adfd7 req-756991f9-6031-4130-bf99-3bf6af46f62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97f3cff-8a42-4913-b243-4f367a9b64da", "name": "network-vif-plugged", "status": "completed", "tag": "267dd117-6168-4faf-b836-8b40e724b438"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:28.693646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bdd8835d-f1da-42e9-a3cc-b185db0adfd7 req-756991f9-6031-4130-bf99-3bf6af46f62d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.694259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bdd8835d-f1da-42e9-a3cc-b185db0adfd7 req-756991f9-6031-4130-bf99-3bf6af46f62d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.701017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bdd8835d-f1da-42e9-a3cc-b185db0adfd7 req-756991f9-6031-4130-bf99-3bf6af46f62d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.727156 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bdd8835d-f1da-42e9-a3cc-b185db0adfd7 req-756991f9-6031-4130-bf99-3bf6af46f62d service nova] Creating event network-vif-plugged:267dd117-6168-4faf-b836-8b40e724b438 for instance e97f3cff-8a42-4913-b243-4f367a9b64da on n-h2-836830-16 Sep 07 09:59:28.732949 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bdd8835d-f1da-42e9-a3cc-b185db0adfd7 req-756991f9-6031-4130-bf99-3bf6af46f62d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077024 Sep 07 09:59:28.733856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1588/3167] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:28.743808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:28.744658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:28.757472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.758760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.759360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.760812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:28.761484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:28.762161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:28.820499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.842792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.845163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:28.846433 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d642331d-6bc2-48d5-b721-bacef45f7075 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.202551 Sep 07 09:59:28.856117 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1580/3168] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:28 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:29.295926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "name": "network-vif-unplugged", "status": "completed", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:29.303408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:29.319527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.320085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.320331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.338156 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] Creating event network-vif-unplugged:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h1-836830-16 Sep 07 09:59:29.338918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:29.355287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4fd49b9e-dd93-40a4-bf24-d56d1654b4fb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.615165 Sep 07 09:59:29.367599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:59:29.369312 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1589/3169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:28 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:29.375062 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d00046ae-36fc-4619-b591-e6235f2bbb29 req-32c9bef7-33bb-4c19-b925-10e83537e2bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084210 Sep 07 09:59:29.376115 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1581/3170] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:59:29.424241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:29.424869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:29.435982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.436486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.440129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.440974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.441493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.441965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.684757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:29.686592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:29.698428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.701090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.702663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.703931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.704568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.705347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.720844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:29.735985 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc7a6eda-8f81-43e6-bac3-46d82c83e6e3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1475 microversion: 2.1 time: 0.315693 Sep 07 09:59:29.738815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1590/3171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:29 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:29.748666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:29.752597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:29.768487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.770430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.781239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.786301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.787564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.788418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.835090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:29.850043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:29.851867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:29.855292 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15975aca-6998-4c87-810e-c981d18e9251 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.185377 Sep 07 09:59:29.856801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1582/3172] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:29 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:29.885685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:29.886717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:29.904650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.912111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.913061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:29.914033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:29.914649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:29.915022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:30.013070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:30.026906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:30.033449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:30.038215 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4215cb36-fc97-4d17-bb82-beff3981dfba tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.162412 Sep 07 09:59:30.039339 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1583/3173] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:29 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:30.218474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:30.227268 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbc1def7-ad79-4524-82a2-c58a5a768313 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1573 microversion: 2.1 time: 0.487111 Sep 07 09:59:30.237750 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1591/3174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:29 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1573 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:30.261276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1006092236"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:30.263370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:30.272671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:30.273170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:30.274852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:30.275698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:30.277513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:30.277936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:30.386462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:30.391027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:30.405725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:30.406593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:30.408001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:30.409014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:30.410476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:30.411118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:30.623709 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Adding security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd to port 4f25ae9e-0db0-41f7-9805-2d622ecae55c Sep 07 09:59:30.934369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:30.950796 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b821ef88-f290-420d-81a5-3958ece3ccc0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.572732 Sep 07 09:59:30.966101 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1592/3175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:30 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:30.966101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:30.966101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:30.970008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:30.971185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:30.972042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:30.973482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:30.974421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:30.975083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.369800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.384298 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea05bb6f-4e10-47ae-8af0-1a2035e3be15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1475 microversion: 2.1 time: 0.431092 Sep 07 09:59:31.394850 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1593/3176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:30 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1475 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:31.421877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:31.422496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:31.431467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:31.432504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:31.433155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.433984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:31.434517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:31.435285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.534280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.549445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.563661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.576116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18c2e676-765c-404b-8a4d-75cb83e8ba61 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.158941 Sep 07 09:59:31.579658 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1594/3177] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:31 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:31.589565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:31.596164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:31.616701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:31.617238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:31.627698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.628733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:31.637935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:31.638649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.758825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:31.777071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.794136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.797803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:31.802773 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d35c5897-81e7-49a0-98ea-f81b86be6c05 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.219917 Sep 07 09:59:31.803641 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1595/3178] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:31 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:31.831086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:31.863245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:31.863748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:31.868124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.885775 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1683c9b6-ea87-4de1-97f1-6b3472f01532 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e/action" status: 202 len: 0 microversion: 2.1 time: 1.632518 Sep 07 09:59:31.887582 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1584/3179] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:59:30 2022] POST /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e/action => generated 0 bytes in 1637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:31.897764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8360352b-fba1-4ae8-8976-5421efbbc9cd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b5d7fa60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:31.910970 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] Creating event network-changed:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h1-836830-16 Sep 07 09:59:31.920673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:59:31.940549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ad57ff2a-9c9e-496a-b0b5-26414005835d req-084d4bf2-f249-43ad-8405-ea3d38d85fae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133703 Sep 07 09:59:31.967896 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1596/3180] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:31.987735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:31.988963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:31.997255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:31.998043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:31.998652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:31.999975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:32.000739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:32.001372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:32.751156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:32.761050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b8b0446-899b-47cc-8919-5bbe9748e236 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.777874 Sep 07 09:59:32.762364 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1597/3181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:31 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:32.767323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3556159a-a245-4ddb-93b4-42e304f1ae46 req-21ab6870-f280-46e5-bba5-32f16144aa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b33289-890e-4c7a-a076-234e7732e92e", "name": "network-vif-plugged", "status": "completed", "tag": "26d8a2ef-d142-4b97-a6ed-91de5398da33"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:32.779800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-8360352b-fba1-4ae8-8976-5421efbbc9cd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use.", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:32.781137 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8360352b-fba1-4ae8-8976-5421efbbc9cd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.781137 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8360352b-fba1-4ae8-8976-5421efbbc9cd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd HTTP/1.1 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: exception: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '028791f4-6186-4ff3-b8bc-668c9bdb30cd'} Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:32.783492 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] Sep 07 09:59:32.787518 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:32.797293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8360352b-fba1-4ae8-8976-5421efbbc9cd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 400 to user: Security Group 028791f4-6186-4ff3-b8bc-668c9bdb30cd in use. Sep 07 09:59:32.797293 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-da0d6a8a-a8a9-48d2-bac8-c8fdca8b2271'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:32.797293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8360352b-fba1-4ae8-8976-5421efbbc9cd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd" status: 400 len: 185 microversion: 2.1 time: 0.902745 Sep 07 09:59:32.797293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1585/3182] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:31 2022] DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd => generated 185 bytes in 905 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 09:59:32.800479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3556159a-a245-4ddb-93b4-42e304f1ae46 req-21ab6870-f280-46e5-bba5-32f16144aa1f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:32.804207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:32.805038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3556159a-a245-4ddb-93b4-42e304f1ae46 req-21ab6870-f280-46e5-bba5-32f16144aa1f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:32.805802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3556159a-a245-4ddb-93b4-42e304f1ae46 req-21ab6870-f280-46e5-bba5-32f16144aa1f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:32.808936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:32.822347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:32.823422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:32.823876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:32.824218 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3556159a-a245-4ddb-93b4-42e304f1ae46 req-21ab6870-f280-46e5-bba5-32f16144aa1f service nova] Creating event network-vif-plugged:26d8a2ef-d142-4b97-a6ed-91de5398da33 for instance 17b33289-890e-4c7a-a076-234e7732e92e on n-h1-836830-16 Sep 07 09:59:32.824600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:32.825069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:32.825534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:32.832914 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3556159a-a245-4ddb-93b4-42e304f1ae46 req-21ab6870-f280-46e5-bba5-32f16144aa1f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068978 Sep 07 09:59:32.834448 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1598/3183] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:32.841448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:32.842967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:32.850245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:32.851230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:32.852004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:32.853116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:32.854392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:32.855076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:32.979398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.000732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.003521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.004975 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8f633fe-04f6-4097-84b7-0a4563c34157 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.169113 Sep 07 09:59:33.018439 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1599/3184] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:32 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:33.031244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:33.032382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:33.039581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.040107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.040584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.041421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.042200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.042801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.079548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:59:33.158044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.167458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:33.178363 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eaed2b1c-0029-4aec-b1b8-8d208fa44d52 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1473 microversion: 2.1 time: 0.380620 Sep 07 09:59:33.179187 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1586/3185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:32 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:33.185756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:33.187183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:33.196148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.196938 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b61b931-00c1-4549-b3c9-28a8c051b18d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 204 len: 0 microversion: 2.1 time: 0.176166 Sep 07 09:59:33.197384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.198420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.199345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.202317 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1600/3186] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:59:33 2022] DELETE /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:59:33.205294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.206050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.212682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:33.212682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:33.224667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.225431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.225893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.226674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.227610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.227610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.321335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.350382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.354753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.356753 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c14766c5-4f00-4729-8958-50e4620863a6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.176318 Sep 07 09:59:33.357979 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1587/3187] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:33 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:33.577855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:33.588859 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9451bb82-f6ff-4e93-a833-0cfaa324e331 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1648 microversion: 2.1 time: 0.384534 Sep 07 09:59:33.590608 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1601/3188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:33 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1648 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:33.785384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:33.786757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:33.794974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.795733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.796595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:33.797724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:33.798998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:33.799767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.008760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-364f8d39-0e91-43f6-94d6-5d893cc75b5a req-cb256403-689e-4c45-bc73-f55ec0259823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f0aee9-79d2-48d1-8fbb-21d7442ba42e", "tag": "4f25ae9e-0db0-41f7-9805-2d622ecae55c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:34.023751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-364f8d39-0e91-43f6-94d6-5d893cc75b5a req-cb256403-689e-4c45-bc73-f55ec0259823 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.024893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-364f8d39-0e91-43f6-94d6-5d893cc75b5a req-cb256403-689e-4c45-bc73-f55ec0259823 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.026459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-364f8d39-0e91-43f6-94d6-5d893cc75b5a req-cb256403-689e-4c45-bc73-f55ec0259823 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.034157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.042360 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-364f8d39-0e91-43f6-94d6-5d893cc75b5a req-cb256403-689e-4c45-bc73-f55ec0259823 service nova] Creating event network-changed:4f25ae9e-0db0-41f7-9805-2d622ecae55c for instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e on n-h1-836830-16 Sep 07 09:59:34.044532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f8b26ff-765e-429e-8cc1-56307a51f226 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.263050 Sep 07 09:59:34.061142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-364f8d39-0e91-43f6-94d6-5d893cc75b5a req-cb256403-689e-4c45-bc73-f55ec0259823 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046178 Sep 07 09:59:34.061142 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1602/3189] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:34.061142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:34.061142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:34.061996 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1588/3190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:33 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:34.072008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.072008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.072008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.072008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.072008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.072008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.185829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.194916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.196471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.199214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7677c5db-f936-486f-91e6-9d1e15ba6c07 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.147766 Sep 07 09:59:34.204614 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1603/3191] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:34 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:34.211599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:34.212844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:34.222358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.222796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.223357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.224067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.224736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.225170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.384066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:34.384683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:34.392032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.392522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.392993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.394108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.394241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.394826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.401671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:34.484212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.493025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.495138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.496353 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2e2f156-67d4-4aa9-9c16-6f79192b1586 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.116331 Sep 07 09:59:34.497161 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1604/3192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:34 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:34.523689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.532506 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f9f44d5-4c9f-4f53-9816-dede8f39041e tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1473 microversion: 2.1 time: 0.325005 Sep 07 09:59:34.533150 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1589/3193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:34 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:34.613823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:34.614445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:34.623076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.624215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.625275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.626255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:34.626830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:34.627254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:34.887135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:34.895587 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e092abd3-ba57-47a5-9d56-cff6a8098f23 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1648 microversion: 2.1 time: 0.285840 Sep 07 09:59:34.896166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1605/3194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:34 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1648 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:35.068288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:35.068909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:35.076389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.076874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.077335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.078065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.078522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.078944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.228065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:35.228930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:35.235491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.236078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.236643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.237457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.238048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.238546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.376057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.384837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.387024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.388212 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60d7d095-0003-40a8-b7e3-b1480c5a48c7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.164315 Sep 07 09:59:35.388778 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1606/3195] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:35 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:35.395998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.411848 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebe79c02-e4a3-4a6a-bfc8-74c5b47d4203 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.347380 Sep 07 09:59:35.412670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1590/3196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:35 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:35.524089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:35.524715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:35.531475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.531975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.532527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.533262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.533732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.534161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.556057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:35.556697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:35.564358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.564849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.565323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.566034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.566491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.566919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.627711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.639559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.641496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.642899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00f6cbec-54bb-4005-b79b-e0deed1ec720 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.122981 Sep 07 09:59:35.643614 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1607/3197] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:35 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:35.920223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:35.920966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:35.934225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.935627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.936240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.937756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:35.938527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:35.939963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:35.944788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:35.958186 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6010e16-07a6-4ea7-b6f5-0d27cbd1ade2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1473 microversion: 2.1 time: 0.406143 Sep 07 09:59:35.960887 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1591/3198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:35 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1473 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:36.020019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e5904ff1-0439-477f-9841-b1eb9beae150 req-918f2fba-0d66-42be-a5ea-b0551e3f849e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e009df-4506-4ce7-89e0-cae9dc86149b", "name": "network-vif-plugged", "status": "completed", "tag": "8b9ea828-efb1-498a-93a5-a1e7f93c8d59"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:36.034533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e5904ff1-0439-477f-9841-b1eb9beae150 req-918f2fba-0d66-42be-a5ea-b0551e3f849e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.035958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e5904ff1-0439-477f-9841-b1eb9beae150 req-918f2fba-0d66-42be-a5ea-b0551e3f849e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.036779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e5904ff1-0439-477f-9841-b1eb9beae150 req-918f2fba-0d66-42be-a5ea-b0551e3f849e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.051867 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e5904ff1-0439-477f-9841-b1eb9beae150 req-918f2fba-0d66-42be-a5ea-b0551e3f849e service nova] Creating event network-vif-plugged:8b9ea828-efb1-498a-93a5-a1e7f93c8d59 for instance 96e009df-4506-4ce7-89e0-cae9dc86149b on n-h2-836830-16 Sep 07 09:59:36.058816 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e5904ff1-0439-477f-9841-b1eb9beae150 req-918f2fba-0d66-42be-a5ea-b0551e3f849e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043024 Sep 07 09:59:36.059652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1592/3199] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:59:36.376015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.391452 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-260b3765-3ab5-4af0-a08f-4e9921438769 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1648 microversion: 2.1 time: 0.475645 Sep 07 09:59:36.392269 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1608/3200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:35 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1648 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:36.416975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:36.417733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:36.434636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:36.435260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:36.439324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.439823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.440261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.440984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.441610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.442158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.442275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.442718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.443163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.444042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.444697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.445604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.593420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.604720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.607450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.608733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-090571f9-1d1d-4090-a73c-2cd55a338fee tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.197159 Sep 07 09:59:36.609600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1593/3201] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:36 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:36.670348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:36.671065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:36.677563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.678266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.678777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.679548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.680234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.680831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.826222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.845068 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b11d2758-d167-4fa6-865e-6149afb0a596 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1321 microversion: 2.1 time: 0.414272 Sep 07 09:59:36.857282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.857759 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1609/3202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:36 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:36.858416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a4441dba-f99b-46b8-9733-7978098b32e7 req-3c78a865-d4a6-4e0c-9b03-6a399c7002e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f0aee9-79d2-48d1-8fbb-21d7442ba42e", "name": "network-vif-deleted", "tag": "4f25ae9e-0db0-41f7-9805-2d622ecae55c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:36.868813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a4441dba-f99b-46b8-9733-7978098b32e7 req-3c78a865-d4a6-4e0c-9b03-6a399c7002e8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.869354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a4441dba-f99b-46b8-9733-7978098b32e7 req-3c78a865-d4a6-4e0c-9b03-6a399c7002e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.870362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a4441dba-f99b-46b8-9733-7978098b32e7 req-3c78a865-d4a6-4e0c-9b03-6a399c7002e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.873816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.877495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:36.878981 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a64bc49-e671-497c-b5df-edbce1077a18 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.213743 Sep 07 09:59:36.880087 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1594/3203] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:36 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:36.882843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a4441dba-f99b-46b8-9733-7978098b32e7 req-3c78a865-d4a6-4e0c-9b03-6a399c7002e8 service nova] Creating event network-vif-deleted:4f25ae9e-0db0-41f7-9805-2d622ecae55c for instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e on n-h1-836830-16 Sep 07 09:59:36.888598 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a4441dba-f99b-46b8-9733-7978098b32e7 req-3c78a865-d4a6-4e0c-9b03-6a399c7002e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Sep 07 09:59:36.892273 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1610/3204] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:59:36.985950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:36.987443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:36.996018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.997447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:36.998074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:36.998963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:36.999714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.000298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.417418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:37.418137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:37.428633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.429535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.429981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.430721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.431181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.431609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.468875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:37.475237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.476070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.476667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.478085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lazy-loading 'fault' on Instance uuid b7f0aee9-79d2-48d1-8fbb-21d7442ba42e {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:59:37.567271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:37.583890 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e63e4916-5e91-432b-a3d5-fa177f03fde8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 200 len: 1306 microversion: 2.1 time: 0.170794 Sep 07 09:59:37.585489 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1611/3205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:37 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 1306 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:37.625601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:37.634267 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9c0c5c3e-7d3f-4644-91e4-1cbbd777a7a4 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1470 microversion: 2.1 time: 0.654011 Sep 07 09:59:37.638972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:37.639925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:37.649517 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1595/3206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:36 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1470 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:37.659077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:37.659784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:37.662803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.663368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.663817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.664554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.665016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.665506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.669687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.670174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.670611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.671306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.671942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.672370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.752901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:37.765429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:37.767181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:37.768415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07f25130-13f9-414d-998a-8faca914d8b2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.134077 Sep 07 09:59:37.769506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1612/3207] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:37 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:37.836584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-503f16d5-a01a-4bf8-8269-335cbb75fdc3 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "POST /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827/action" status: 202 len: 0 microversion: 2.1 time: 0.181185 Sep 07 09:59:37.837208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1596/3208] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:59:37 2022] POST /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:59:37.846063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:37.846695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:37.852747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.853500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.855138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.856191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.856973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.857617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.886750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:37.889955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:37.900910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.902165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.902734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:37.903777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:37.904376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:37.904818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.179509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.188779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd5d35c2-69aa-4fc7-b7fa-74f01617d644 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.346565 Sep 07 09:59:38.195076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1613/3209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:37 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:38.195076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:38.196427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:38.202808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.203623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.204153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.204476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.205326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.205987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.206753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.217045 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-408f17dc-086f-460c-b2e8-935355e0efec tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1513 microversion: 2.1 time: 0.340770 Sep 07 09:59:38.217670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1597/3210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:37 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:38.224276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "name": "network-vif-plugged", "status": "completed", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:38.234845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.235583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.236194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.249130 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] Creating event network-vif-plugged:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h1-836830-16 Sep 07 09:59:38.255103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:59:38.266958 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d0a71594-777b-4773-9ddd-6bf735e27d4f req-9684ba7c-1313-4a06-b327-5ca188158e91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047617 Sep 07 09:59:38.267573 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1598/3211] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:38.278340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:38.279064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:38.285692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.286187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.286629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.287333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.287793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.288231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.297455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.308712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.310899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.313029 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4543a65b-8e71-4a96-a7ca-99def42815c6 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.122135 Sep 07 09:59:38.313991 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1614/3212] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:38 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:38.529678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.540249 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5eda49ba-647a-4844-9b5e-37ac3c474584 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1512 microversion: 2.1 time: 0.271415 Sep 07 09:59:38.540834 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1599/3213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:38 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:38.565320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:38.566857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:38.575362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.576242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.576926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.578170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.578878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.580233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.612924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:38.613572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:38.624444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.624944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.625398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.626128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.626764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.627209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.641978 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e HTTP/1.1 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b7f0aee9-79d2-48d1-8fbb-21d7442ba42e'} Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:38.643981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ce668da6-2825-46f9-b03a-caad812459a2 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 404 len: 111 microversion: 2.1 time: 0.036442 Sep 07 09:59:38.652468 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1600/3214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:38 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:59:38.654403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2f5bcc0-4008-494d-95e8-dbe59da9a2dc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b5d7fb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:38.909482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:38.918623 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c461033-85fc-47b1-89b9-66e7efb60f81 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 200 len: 1512 microversion: 2.1 time: 0.358574 Sep 07 09:59:38.919482 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1615/3215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:38 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:38.924691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:38.925336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:38.931405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.932593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.933274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:38.934303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:38.934931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:38.935526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.055674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.065587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.067039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.068458 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-102e8934-6fc0-4b0b-9177-841967d85ae7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.147804 Sep 07 09:59:39.068980 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1616/3216] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:38 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:39.074938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:39.080105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.081030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:39.094056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.094803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.095237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.095959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.096598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.097231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.198069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:39.231957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2f5bcc0-4008-494d-95e8-dbe59da9a2dc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5" status: 202 len: 0 microversion: 2.1 time: 0.581450 Sep 07 09:59:39.232775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1601/3217] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:38 2022] DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5 => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:39.239111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:39.240049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:39.247348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.248445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.249456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.250590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.251288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.252479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.300828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.308264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.308974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.309620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.534662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.537995 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1efc278-178c-4b77-8305-eed3b8973ad0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.467759 Sep 07 09:59:39.538631 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1617/3218] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 7 09:59:39 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:39.545253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f130a3c-ae57-46d8-8992-7119472a18e1 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b277c1f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:39.551916 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ef8af8a-4c9f-40d5-acce-25105c9775d8 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.317297 Sep 07 09:59:39.552504 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1602/3219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:39 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:39.560811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:39.564349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:39.571063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.572220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.573484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.574328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.575194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.575728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.659050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.670630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.672893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.674368 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-10f3edc8-7384-48fe-ae32-6d01ceaa182c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.120498 Sep 07 09:59:39.679535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1603/3220] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:39 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:39.684624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:39.701210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.702310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1005200912', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:39.707819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.708290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.708726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.709481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.710448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.710448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:39.805043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:39.810742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:39.894711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:39.902527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:39.903190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:39.903786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.025324 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f130a3c-ae57-46d8-8992-7119472a18e1 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd" status: 202 len: 0 microversion: 2.1 time: 0.484330 Sep 07 09:59:40.027228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1618/3221] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:39 2022] DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:40.042682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-17686aba-976a-4d14-a730-97ccaa59230c tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'create', calling method: .version_select at 0x7f14b1dd2d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1926320413", "description": "tempest-description-1308845488"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:40.209283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5cf14c3a-8fc0-445a-a1a0-cbe13fd81e61 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1005200912" status: 200 len: 1515 microversion: 2.1 time: 0.528555 Sep 07 09:59:40.210733 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1604/3222] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 09:59:39 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1005200912 => generated 1515 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:40.216298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:40.217131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:40.223112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.224005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.224627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.225394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.226073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.226564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.348241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.358518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.360490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.361413 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a82640b-8b7b-4dc0-bd7e-bccd67f0ee30 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.150100 Sep 07 09:59:40.361863 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1605/3223] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:40 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:40.366265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:40.372939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.373861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:40.380054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.380639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.381095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.381834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.382285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.382705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.471027 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-17686aba-976a-4d14-a730-97ccaa59230c tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.432763 Sep 07 09:59:40.471575 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1619/3224] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 09:59:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:59:40.484551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:40.485876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce91f84e-4e78-4d63-9726-06cda163de38 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Action: 'update', calling method: .version_select at 0x7f14b1ec4280>, body: {"security_group": {"name": "tempest-sg-hth-168553139", "description": "tempest-description-hth-655033578"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:40.553937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.562042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.562576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.563019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.789232 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4079398e-794c-49b1-83e6-111b27abeb25 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.426287 Sep 07 09:59:40.789960 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1606/3225] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 7 09:59:40 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:40.795485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:40.796179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:40.816515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.816814 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce91f84e-4e78-4d63-9726-06cda163de38 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/7db07ca3-ced2-4b1d-8ee1-25f44ad48138" status: 200 len: 216 microversion: 2.1 time: 0.335236 Sep 07 09:59:40.817706 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1620/3226] 10.222.0.60 () {60 vars in 1290 bytes} [Wed Sep 7 09:59:40 2022] PUT /compute/v2.1/os-security-groups/7db07ca3-ced2-4b1d-8ee1-25f44ad48138 => generated 216 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:40.824184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.824184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.824184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.824184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.824660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.832975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:40.833947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:40.843336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.844158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.844943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.845882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:40.846587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:40.847315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:40.970183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.979335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.981708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.983342 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9775ac9b-6a4a-46f9-9eb5-2d3afa142ffa tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.157358 Sep 07 09:59:40.984301 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1621/3227] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:40 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:40.992823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:40.998859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:40.999609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.servers [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Removing options 'limit' from query {{(pid=128833) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 09:59:41.000555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:41.006597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.007296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.008023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.009054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.010579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.011381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.084861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.092644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.101985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.102744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.103248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.106788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a3af289-59f3-48dd-8928-723426295641 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.314909 Sep 07 09:59:41.121231 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1607/3228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:40 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:41.121231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31d82801-9f0c-4540-bbcd-19ea431f5a67 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1932940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.238179 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31d82801-9f0c-4540-bbcd-19ea431f5a67 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/7db07ca3-ced2-4b1d-8ee1-25f44ad48138" status: 200 len: 216 microversion: 2.1 time: 0.129133 Sep 07 09:59:41.239373 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1608/3229] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/os-security-groups/7db07ca3-ced2-4b1d-8ee1-25f44ad48138 => generated 216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:41.256471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7eea9906-b2fa-4397-8098-1d63a09a6072 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b5d7fe50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.335743 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b72a937-a49b-4c76-8bb5-d9d2e12fd349 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.349613 Sep 07 09:59:41.336669 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1622/3230] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 09:59:40 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:41.364959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.373492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.374855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:41.400275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.400800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.404355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.409958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.410952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.411578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.470704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:41.476200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:41.549623 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e9123b1-b112-40b3-8442-fc2390662f97 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.189368 Sep 07 09:59:41.550249 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1623/3231] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:41.565617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.566546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:41.576877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.577876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.580937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.581910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.582401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.582950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.658687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7eea9906-b2fa-4397-8098-1d63a09a6072 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7db07ca3-ced2-4b1d-8ee1-25f44ad48138" status: 202 len: 0 microversion: 2.1 time: 0.407663 Sep 07 09:59:41.659683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1609/3232] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:41 2022] DELETE /compute/v2.1/os-security-groups/7db07ca3-ced2-4b1d-8ee1-25f44ad48138 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 09:59:41.665837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.672040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.672582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.compute.servers [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Removing options 'limit' from query {{(pid=128832) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 09:59:41.673343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:41.680465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.680956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.681606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.684294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.685040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.685970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.714195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.738775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.759819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:41.762982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.766639 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70b897da-c490-412c-ad13-e8abaa078f1f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.213072 Sep 07 09:59:41.767337 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1624/3233] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:41.774711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.775406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:41.781676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.782422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.783090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.784039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.784698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.785512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.816608 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e HTTP/1.1 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'b7f0aee9-79d2-48d1-8fbb-21d7442ba42e'} Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:59:41.819427 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5eff7c59-c1ab-4994-9f5a-2c3163896dca tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 404 len: 111 microversion: 2.1 time: 0.052442 Sep 07 09:59:41.825686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1625/3234] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:59:41 2022] DELETE /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:41.827214 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-508a16db-f550-4e59-a57b-e6de492b2817 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.164180 Sep 07 09:59:41.827214 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1610/3235] 10.222.0.60 () {58 vars in 1150 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:41.831446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.832087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: b7f0aee9-79d2-48d1-8fbb-21d7442ba42e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:41.840437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.840936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.841097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.841433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.842343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.842987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.843860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.848529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.849232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:41.856973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.858472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.858974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.860243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:41.860733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:41.861261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:41.863655 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e HTTP/1.1 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'b7f0aee9-79d2-48d1-8fbb-21d7442ba42e'} Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.866803 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. Sep 07 09:59:41.874209 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.878519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Instance b7f0aee9-79d2-48d1-8fbb-21d7442ba42e could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:41.880086 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0e006e3-7ff3-47d4-82b3-4aaa084711bd tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e" status: 404 len: 111 microversion: 2.1 time: 0.052468 Sep 07 09:59:41.881375 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1626/3236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/servers/b7f0aee9-79d2-48d1-8fbb-21d7442ba42e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 09:59:41.890847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1e3d9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.909802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:41.922540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:41.923669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:59:41.924657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.924657 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd HTTP/1.1 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '028791f4-6186-4ff3-b8bc-668c9bdb30cd'} Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:41.928069 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] Sep 07 09:59:41.933881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:41.938606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 028791f4-6186-4ff3-b8bc-668c9bdb30cd does not exist Sep 07 09:59:41.938606 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-8cdfdab6-563d-4be2-a436-b3c06dce74f2'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:41.939931 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2fbcae77-b2a8-4aa6-9b68-0277ba9fa7db tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd" status: 404 len: 194 microversion: 2.1 time: 0.053815 Sep 07 09:59:41.940852 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1627/3237] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:41 2022] DELETE /compute/v2.1/os-security-groups/028791f4-6186-4ff3-b8bc-668c9bdb30cd => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:41.950719 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9b8e800-5c11-49e7-bb59-8619a38a243a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.116282 Sep 07 09:59:41.951860 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1611/3238] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/servers => generated 1011 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:41.953523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1dd1310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.968748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:41.979921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:41.980907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:41.985688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:41.986893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:59:41.988403 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:41.988403 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5 HTTP/1.1 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3b04f37c-0f42-4272-b75d-0fe85b3391f5'} Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:41.996014 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 3b04f37c-0f42-4272-b75d-0fe85b3391f5 does not exist Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-5158ea6c-5e67-4dcd-b217-22d8c1a80b52'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f8f89031-edd0-4cbe-9d36-91b781f64cf0 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5" status: 404 len: 194 microversion: 2.1 time: 0.053510 Sep 07 09:59:42.001373 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1628/3239] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:41 2022] DELETE /compute/v2.1/os-security-groups/3b04f37c-0f42-4272-b75d-0fe85b3391f5 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:42.008494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.009851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.011736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.012643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b25ef280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.012986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.013675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.014334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.041971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:42.042626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 77690da7-4f57-4d3d-a314-4473f62d278d not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:59:42.043371 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.043371 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d HTTP/1.1 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '77690da7-4f57-4d3d-a314-4473f62d278d'} Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:42.045274 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] Sep 07 09:59:42.050538 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.057306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 77690da7-4f57-4d3d-a314-4473f62d278d does not exist Sep 07 09:59:42.057306 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-590e6863-36da-4fe0-89f0-78fa4e24b22c'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:42.058486 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7a1395d-66f2-48fe-b4cb-de0bb9d96fb3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d" status: 404 len: 194 microversion: 2.1 time: 0.053740 Sep 07 09:59:42.061576 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1629/3240] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:42 2022] DELETE /compute/v2.1/os-security-groups/77690da7-4f57-4d3d-a314-4473f62d278d => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:42.067725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.068753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:42.077211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.077957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.078761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.079690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.080331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.080960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.135598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:42.197639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:42.209837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:42.211534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:42.212738 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03b0ec7b-f3ee-4b32-8233-49c81129bea2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.149812 Sep 07 09:59:42.213918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1630/3241] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:42 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:42.219022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b2411af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.236948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71489749-4f61-40ca-af07-d20506e094f4 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.274333 Sep 07 09:59:42.248000 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1612/3242] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 09:59:41 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:42.251909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:42.252636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:59:42.253294 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.253294 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] Sep 07 09:59:42.254750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.255555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea HTTP/1.1 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea'} Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:42.258633 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea does not exist Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-f8636764-85fa-4277-8e7b-3692c62b1c1e'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:42.264935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0fe362f5-3556-4025-b12f-71a9eda6144d tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea" status: 404 len: 194 microversion: 2.1 time: 0.046652 Sep 07 09:59:42.268106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.268106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.268106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.269175 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1631/3243] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:42 2022] DELETE /compute/v2.1/os-security-groups/0b2a5b93-3b90-4974-a69a-6ee7f9dd00ea => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:42.269315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.269451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.269903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.271886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.278497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:42.278964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.servers [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Removing options 'limit' from query {{(pid=128833) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 09:59:42.279631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:42.287638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.288887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.289356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.290090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.290686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.291710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.333749 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f068caa-b52c-438b-9ec5-b0ee2b609b93 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.063727 Sep 07 09:59:42.336096 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1632/3244] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 7 09:59:42 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:42.347830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1842790>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.391699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG neutronclient.v2_0.client [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fab811df-8411-4197-b743-c423663f7bfa does not exist", "detail": ""}} {{(pid=128833) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:42.392311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.security_group_api [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group fab811df-8411-4197-b743-c423663f7bfa not found {{(pid=128833) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:59:42.392843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.392843 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa HTTP/1.1 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'fab811df-8411-4197-b743-c423663f7bfa'} Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:42.394928 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group fab811df-8411-4197-b743-c423663f7bfa does not exist Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: Neutron server returns request_ids: ['req-0300e0d4-813f-4cbd-bce7-82daa5ed250a'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bddbde03-1939-4ad0-9ff6-789330de15a3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa" status: 404 len: 194 microversion: 2.1 time: 0.059538 Sep 07 09:59:42.399632 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1633/3245] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:42 2022] DELETE /compute/v2.1/os-security-groups/fab811df-8411-4197-b743-c423663f7bfa => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:42.424349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.436195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:42.436195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1005200912', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 09:59:42.442573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.443067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.443511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.444673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.445157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.445658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.529801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:42.547360 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f18b96d-fb60-4abb-8088-0248d0a58202 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.296941 Sep 07 09:59:42.548112 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1613/3246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:42 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:42.557606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b2310280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.561194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 09:59:42.597047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 09:59:42.597875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Neutron security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 not found {{(pid=128832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 09:59:42.598832 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.598832 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345 HTTP/1.1 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: exception: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '42ad52cb-b3f4-4fe8-9e91-0846660c4345'} Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 09:59:42.606337 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Security group 42ad52cb-b3f4-4fe8-9e91-0846660c4345 does not exist Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-8e5e6926-ba57-49c9-bc39-5af107c0b796'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:42.613334 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28b094f0-2589-4d73-8fea-21ab8626debc tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345" status: 404 len: 194 microversion: 2.1 time: 0.060571 Sep 07 09:59:42.621085 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1614/3247] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:42 2022] DELETE /compute/v2.1/os-security-groups/42ad52cb-b3f4-4fe8-9e91-0846660c4345 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:42.626903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.629710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:42.637567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.639033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.646684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31f4521a-f706-454b-add0-c1a29f96b710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1005200912" status: 200 len: 346 microversion: 2.1 time: 0.227275 Sep 07 09:59:42.648065 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1634/3248] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 09:59:42 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1005200912 => generated 346 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:42.654929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.656137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.657921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.658390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.662821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15a96099-56cf-4c2c-bdbd-011833908e65 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:42.672777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15a96099-56cf-4c2c-bdbd-011833908e65 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.673609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15a96099-56cf-4c2c-bdbd-011833908e65 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.674711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15a96099-56cf-4c2c-bdbd-011833908e65 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.689565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:59:42.751767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15a96099-56cf-4c2c-bdbd-011833908e65 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Going to try to stop instance {{(pid=128833) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 09:59:42.835507 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15a96099-56cf-4c2c-bdbd-011833908e65 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "POST /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da/action" status: 202 len: 0 microversion: 2.1 time: 0.173430 Sep 07 09:59:42.836974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1635/3249] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 09:59:42 2022] POST /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:42.848042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cca736a0-1402-4b96-bde2-d26b6187fe95 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 204 len: 0 microversion: 2.1 time: 0.233353 Sep 07 09:59:42.849464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1615/3250] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:59:42 2022] DELETE /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:59:42.866455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.867984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:42.872176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:42.873174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:42.879994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.881086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.881611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.881831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.882050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.882620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.882982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.883445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.883871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:42.887754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:42.888458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:42.888989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.053280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.064065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.066831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.068302 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-14411bc7-a4f7-4696-9fa0-a677e1afb59a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.229899 Sep 07 09:59:43.069432 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1636/3251] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:42 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:43.076287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:43.077221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:43.084627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.092826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.093774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.098587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.099147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.101606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.273392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.283733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0a02a10-2ea0-433f-8123-a9a06209dd95 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.432512 Sep 07 09:59:43.284367 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1616/3252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:42 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:43.294126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:43.299281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:43.318125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.318514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.319215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.319944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.320407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.321029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.444207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.456967 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cff7b192-bc22-449b-98e1-86bb9f92fa2f tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1645 microversion: 2.1 time: 0.386080 Sep 07 09:59:43.457664 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1637/3253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:43 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1645 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:43.486030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.507037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.508749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.512560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-526ad357-922e-40a2-9156-a12100e57a89 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.226367 Sep 07 09:59:43.514829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1617/3254] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:43 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:43.575027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:43.575543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:43.581791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.582298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.582743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.583451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.584186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.584627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.723224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "name": "network-vif-unplugged", "status": "completed", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:43.748744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:43.749258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:43.749708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:43.785414 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] Creating event network-vif-unplugged:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h2-836830-16 Sep 07 09:59:43.802942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:59:43.835325 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-472b6134-8be9-4b49-8b06-89abf6a6b6f4 req-ed18f3c4-4214-431e-9460-e149dc67faa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.218646 Sep 07 09:59:43.836011 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1618/3255] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:59:43.968309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:43.980066 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-57a4668a-8f5a-4c4a-89e7-35cff640837d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.408565 Sep 07 09:59:43.983250 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1638/3256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:43 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:44.102472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:44.104414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:44.118000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.118960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.120445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.121419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.122184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.122859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.222794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.243575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.245449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.247295 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cccd3649-9fc0-4433-9902-a91d7c9ab901 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.148791 Sep 07 09:59:44.247860 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1619/3257] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:44 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:44.315290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:44.315978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:44.325060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.325714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.326203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.327142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.327762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.328241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.488723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:44.489804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:44.498068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.498554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.499401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.500208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.500656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.501528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.520176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:44.789366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.802124 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-608bd87d-62d4-4cf8-af92-9b628cfdcd59 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.493065 Sep 07 09:59:44.802878 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1639/3258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:44 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:44.810715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:44.811655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:44.819237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.820072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.820594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.821609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:44.822900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:44.823750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:44.945210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.955756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.957208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:44.958552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68788c2a-70da-44e0-b145-1363bc60dc90 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.154262 Sep 07 09:59:44.959123 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1640/3259] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:44 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:45.010691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:45.012179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:45.018273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.018982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.019465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.020342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.020835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.021778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.045824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:45.060066 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46d072f2-5905-4d24-953e-77121019e8e3 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1645 microversion: 2.1 time: 0.579555 Sep 07 09:59:45.065321 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1620/3260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:44 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1645 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:45.275602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:45.277192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:45.288730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.289409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.290280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.291576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.292360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.292948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.745839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:45.762480 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d256419-0b9f-42cd-9213-a5f0a4346c46 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.756123 Sep 07 09:59:45.777625 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1641/3261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:45 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:45.788395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:45.799742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:45.801412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:45.802848 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1669348-2065-4968-b4db-aae455c6b295 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.531873 Sep 07 09:59:45.814711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1621/3262] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:45 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:45.831506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:45.832127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:45.842230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.842729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.843176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.843999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.844460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.844890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.904200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:45.919614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:45.922177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:45.924526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:45.940609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] Creating event network-changed:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h2-836830-16 Sep 07 09:59:45.951018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 09:59:45.967666 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b397a867-6ce9-4ec3-b9b2-df6522e08a4b req-9c673ee5-42e5-4d9b-8354-e9ad9ab4650a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067637 Sep 07 09:59:45.969062 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1622/3263] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 09:59:45.990069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:45.991550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:46.001967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.002894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.003707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.004894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.005495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.006317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.160422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.169261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.170985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.172413 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-666a0461-1a54-4655-a994-9ddd56fdb425 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.186995 Sep 07 09:59:46.173390 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1623/3264] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:45 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:46.178258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:46.179224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:46.185800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.186472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.187090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.188054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.188665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.189293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.202951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.214868 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61263aaa-a180-440a-a7c0-21c0ae337048 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.390605 Sep 07 09:59:46.216035 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1642/3265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:45 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:46.278432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f63b87c6474177a7705deed6a4365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1519d78849c4223b6024a32d5607308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.294205 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c90f129-3af2-4e06-a100-d45357e503b8 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 200 len: 1468 microversion: 2.1 time: 0.119544 Sep 07 09:59:46.295841 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1624/3266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:46 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 1468 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:46.788867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:46.789618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:46.799168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.799762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.800354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.801148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.801786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.802287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.832545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:46.833226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:46.841584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.842075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.842759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.843593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:46.844107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:46.844603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:46.928289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.936657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.938465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:46.939839 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c75ea0d4-038b-494b-8d71-51856fe6ad16 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.111745 Sep 07 09:59:46.940902 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1625/3267] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:46 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:46.985947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:47.007877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f9daa92-71f5-4f75-884f-06676e5317ff tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.223864 Sep 07 09:59:47.009018 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1643/3268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:46 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:47.201138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:47.201717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:47.208037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.208523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.208962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.209699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.210154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.210585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.246628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:47.247478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:47.257233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.258019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.259470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.262853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.263525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.264117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.423079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:47.439452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:47.441512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:47.442994 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-618a4a48-927d-461b-bcf2-354853151706 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.246737 Sep 07 09:59:47.443622 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1626/3269] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:47 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:47.461058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:47.467556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] [instance: 43ad764e-8eec-446f-8244-b67c4aa7572e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:47.474651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.475412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.476064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.476981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.477862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.479265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.501079 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] HTTP exception thrown: Instance 43ad764e-8eec-446f-8244-b67c4aa7572e could not be found. Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Request method failure captured: Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e HTTP/1.1 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGsPqq-JmLgaIWYDjpuNeCMq3vYQ0Wu2w73UVwtAVKdRpIAuXylTycVf3emdpLatSHkVi28SUlzuwtHB2r41iovmaoDluqyZTS5K3cyvGoV2R5Rkvp8-_zjXKYy3jzipZZNUJ14H5hTqz80hJ1Y1uohmtdC0thXJwn8J0Rw_6kLpKdY Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f1519d78849c4223b6024a32d5607308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f1519d78849c4223b6024a32d5607308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f1519d78849c4223b6024a32d5607308", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f1519d78849c4223b6024a32d5607308 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1808603227 Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5f63b87c6474177a7705deed6a4365a Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupsTestJSON-1808603227-project Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 43ad764e-8eec-446f-8244-b67c4aa7572e could not be found. Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '43ad764e-8eec-446f-8244-b67c4aa7572e'} Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ad764e-8eec-446f-8244-b67c4aa7572e could not be found. Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ad764e-8eec-446f-8244-b67c4aa7572e could not be found. Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:47.502945 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ad764e-8eec-446f-8244-b67c4aa7572e could not be found. Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Returning 404 to user: Instance 43ad764e-8eec-446f-8244-b67c4aa7572e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72af5027-a427-4054-9cb6-17960e914b52 tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e" status: 404 len: 111 microversion: 2.1 time: 0.059574 Sep 07 09:59:47.509086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1627/3270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:47 2022] GET /compute/v2.1/servers/43ad764e-8eec-446f-8244-b67c4aa7572e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:47.530163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7541f67d-0de7-49dd-90a1-9b240c8ee73c tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1c491f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:47.613880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:47.623950 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26cd84dd-47f3-46a8-b0a0-634231966e6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.381926 Sep 07 09:59:47.624797 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1644/3271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:47 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:47.972593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:47.974087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:47.987526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.989324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.990087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:47.990882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:47.991419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:47.991924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.015629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:48.112064 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7541f67d-0de7-49dd-90a1-9b240c8ee73c tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/86320ec8-10b5-4800-8ed7-39d1203666a0" status: 202 len: 0 microversion: 2.1 time: 0.600408 Sep 07 09:59:48.116190 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1628/3272] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:47 2022] DELETE /compute/v2.1/os-security-groups/86320ec8-10b5-4800-8ed7-39d1203666a0 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:48.120705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:48.124240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.125904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:48.132862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:48.149302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.151544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.152139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.152660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.155016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.155536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.156239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.156660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.161725 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b0c8313-a3e8-4c19-9ced-67d8d56d5973 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.192813 Sep 07 09:59:48.162424 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1645/3273] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:47 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:48.181998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bf2dc319-2a3c-4272-9d7a-f51e439f4b13 req-fcbaa7ec-6d06-4052-9b56-f7a53dcb261d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ad764e-8eec-446f-8244-b67c4aa7572e", "name": "network-vif-deleted", "tag": "8edec6c7-02b8-49db-a1ed-0679991755e3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:48.198882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bf2dc319-2a3c-4272-9d7a-f51e439f4b13 req-fcbaa7ec-6d06-4052-9b56-f7a53dcb261d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.200865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bf2dc319-2a3c-4272-9d7a-f51e439f4b13 req-fcbaa7ec-6d06-4052-9b56-f7a53dcb261d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.202821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bf2dc319-2a3c-4272-9d7a-f51e439f4b13 req-fcbaa7ec-6d06-4052-9b56-f7a53dcb261d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.224417 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bf2dc319-2a3c-4272-9d7a-f51e439f4b13 req-fcbaa7ec-6d06-4052-9b56-f7a53dcb261d service nova] Creating event network-vif-deleted:8edec6c7-02b8-49db-a1ed-0679991755e3 for instance 43ad764e-8eec-446f-8244-b67c4aa7572e on n-h1-836830-16 Sep 07 09:59:48.233245 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bf2dc319-2a3c-4272-9d7a-f51e439f4b13 req-fcbaa7ec-6d06-4052-9b56-f7a53dcb261d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060973 Sep 07 09:59:48.234857 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1646/3274] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:48.247700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6201552c-a025-4640-9ee8-4fdb2e57a8df tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] Calling method '.version_select at 0x7f14b1b548b0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:48.661353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.677063 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b380f575-b3e5-43d2-b2b2-46328aa28c2b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1469 microversion: 2.1 time: 0.562283 Sep 07 09:59:48.677751 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1629/3275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:48 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1469 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:48.686571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:48.695184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:48.706397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.707118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.707725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.709721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.712129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.713448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.842394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.854680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.856457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:48.858408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3147ed63-7266-4d46-ad72-925094770888 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.179373 Sep 07 09:59:48.859122 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1630/3276] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:48 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:48.865292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:48.866196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:48.873935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.874671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.875336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.876263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:48.876919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:48.878130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:48.973772 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6201552c-a025-4640-9ee8-4fdb2e57a8df tempest-SecurityGroupsTestJSON-1808603227 tempest-SecurityGroupsTestJSON-1808603227-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b478e135-9baf-42aa-8e95-76357eab71b2" status: 202 len: 0 microversion: 2.1 time: 0.736447 Sep 07 09:59:48.974652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1647/3277] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 09:59:48 2022] DELETE /compute/v2.1/os-security-groups/b478e135-9baf-42aa-8e95-76357eab71b2 => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 09:59:49.104329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:49.114496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8170961-b8b6-4785-96b4-43ab9564e15d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.253594 Sep 07 09:59:49.115242 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1631/3278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:48 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:49.192136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:49.193076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:49.205988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:49.219786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:49.220695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:49.222506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:49.223947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:49.224402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:49.334859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:49.347485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:49.349948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:49.351953 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-972049a3-d21d-4369-848e-57763c91771e tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.165854 Sep 07 09:59:49.352836 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1648/3279] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:49 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:49.709455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:49.711159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:49.722800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:49.723551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:49.726470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:49.727552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:49.728242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:49.731383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:49.886713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:49.887757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:49.894611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:49.895481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:49.896008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:49.896933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:49.898051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:49.898553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.045003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.056930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.059768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.061273 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d82ffdf-26ba-4214-9275-5b5314a5bc8c tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.179333 Sep 07 09:59:50.062911 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1649/3280] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:49 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:50.141932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.146075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:50.147407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:50.154077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8c9d1c04-4f86-4187-b2dd-f8835ef27b15 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1462 microversion: 2.1 time: 0.447640 Sep 07 09:59:50.154657 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1632/3281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:49 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1462 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:50.176475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.177116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.177724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.179892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.180723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.182055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.367530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:50.368399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:50.376227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.376973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.377602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.379097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.379757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.380337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.532861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.543160 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05a74495-851e-4409-b1d7-dff18b3d7a32 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.405303 Sep 07 09:59:50.550753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:50.562248 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1650/3282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:50 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:50.573484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:50.574796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:50.582616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.583372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.584014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.585920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.586571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.587171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.701167 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-240b71df-e2fb-40ee-85bf-c96fc86cb024 tempest-MigrationsAdminTest-910775036 tempest-MigrationsAdminTest-910775036-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1615 microversion: 2.1 time: 0.520379 Sep 07 09:59:50.720587 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1633/3283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:50 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1615 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:50.735988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2f3437d5-aa80-45be-8a37-acc4cb34c87d req-7dc5966a-cddb-4524-9d82-b4d937d1f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "name": "network-vif-plugged", "status": "completed", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:50.767514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2f3437d5-aa80-45be-8a37-acc4cb34c87d req-7dc5966a-cddb-4524-9d82-b4d937d1f6fb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.769169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2f3437d5-aa80-45be-8a37-acc4cb34c87d req-7dc5966a-cddb-4524-9d82-b4d937d1f6fb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.769900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2f3437d5-aa80-45be-8a37-acc4cb34c87d req-7dc5966a-cddb-4524-9d82-b4d937d1f6fb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.786017 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2f3437d5-aa80-45be-8a37-acc4cb34c87d req-7dc5966a-cddb-4524-9d82-b4d937d1f6fb service nova] Creating event network-vif-plugged:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h2-836830-16 Sep 07 09:59:50.793714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2f3437d5-aa80-45be-8a37-acc4cb34c87d req-7dc5966a-cddb-4524-9d82-b4d937d1f6fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070580 Sep 07 09:59:50.794851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1634/3284] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:50.804806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:50.805674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:50.815024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.816263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.816935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.818433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:50.819120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:50.819760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:50.876458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:59:50.928925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.938462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.940395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:50.941889 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3722b3ab-bf01-490c-bdb6-7ee52ab20f2a tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.378552 Sep 07 09:59:50.957814 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1651/3285] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:50 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:51.035082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc2645f0-8687-4da6-ba50-09f4152871ef tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 204 len: 0 microversion: 2.1 time: 0.237481 Sep 07 09:59:51.036193 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1635/3286] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:59:50 2022] DELETE /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:59:51.045113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:51.045992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:51.059289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.060374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.061213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.062467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.063159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.063926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.095662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:51.096538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:51.098276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:51.122001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.122533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.128326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.129546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.130801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.130801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.254198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:51.267770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:51.272397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:51.274643 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f245a116-3e33-41ca-b1ba-d3376bfd521d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.189110 Sep 07 09:59:51.275652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1636/3287] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:51 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:51.574202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:51.575825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:51.589602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.590487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.591202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.592232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.593275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.593944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.807946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:51.819884 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c0a555f-be36-4edf-9a6d-1dcc7ea4b531 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1468 microversion: 2.1 time: 0.779203 Sep 07 09:59:51.839138 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1652/3288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:51 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1468 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:51.953637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:51.962512 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a055a9ac-e45d-48a6-aa60-59ab4abc3964 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.397691 Sep 07 09:59:51.965263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1637/3289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:51 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:51.971496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:51.972212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:51.985031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.986149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.988422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:51.990493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:51.993032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:51.993757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:52.230160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:52.242557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:52.246048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:52.247491 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ce7e5d6-35d3-46b5-9323-927c59638b25 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.281080 Sep 07 09:59:52.254186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1653/3290] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:51 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 09:59:52.306182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:52.307434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:52.317252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:52.320488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:52.321443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:52.323041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:52.324233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:52.324705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:52.325140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:52.330939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:52.457313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:52.472388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:52.475117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:52.481288 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-180e6d5b-dcd7-4499-85c1-f419bd83a937 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.176427 Sep 07 09:59:52.482320 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1638/3291] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:52 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:52.847755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:52.848581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:52.850852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:52.862619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:52.863106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:52.863610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:52.864325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:52.864788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:52.873499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:52.988777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:52.989457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:53.012038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:53.012401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:53.012846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:53.013589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:53.014045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:53.014473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:53.750148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:53.763535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bfdcfb13-793a-4fb2-a28f-2b42277a02de tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.780867 Sep 07 09:59:53.764786 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1639/3292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:52 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 09:59:53.773223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:53.774557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:53.782593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:53.783424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:53.784090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:53.785038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:53.785773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:53.786441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:53.895185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:53.904933 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b46362c-8eba-42e9-a057-89b2384fcaa0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1468 microversion: 2.1 time: 1.061858 Sep 07 09:59:53.910550 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1654/3293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:52 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1468 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:53.925905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:53.926767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:53.942212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:53.950969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:53.951711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:53.952694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:53.953462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:53.954144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:54.057439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:54.067492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:54.069259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:54.071375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-517c895b-7385-4ed5-8436-9e12db09d666 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.305353 Sep 07 09:59:54.081275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1640/3294] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:53 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:54.158649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:54.182298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:54.184624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:54.186217 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9914f6ca-a079-43ec-ac77-a4f85ef8a89d tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.274427 Sep 07 09:59:54.200494 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1655/3295] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:53 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:54.778252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-02a7ce39-1d4e-452a-9aee-628d05a6b7ca req-02e7c818-693b-40af-b8e0-03d7d3dc3562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5db27-a39f-4a69-bdfc-ac6156958827", "name": "network-vif-deleted", "tag": "0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 09:59:54.788700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:54.789419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:54.801935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-02a7ce39-1d4e-452a-9aee-628d05a6b7ca req-02e7c818-693b-40af-b8e0-03d7d3dc3562 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:54.805258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-02a7ce39-1d4e-452a-9aee-628d05a6b7ca req-02e7c818-693b-40af-b8e0-03d7d3dc3562 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:54.806273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-02a7ce39-1d4e-452a-9aee-628d05a6b7ca req-02e7c818-693b-40af-b8e0-03d7d3dc3562 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:54.807803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:54.808410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:54.809746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:54.810593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:54.811155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:54.811932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:54.843669 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-02a7ce39-1d4e-452a-9aee-628d05a6b7ca req-02e7c818-693b-40af-b8e0-03d7d3dc3562 service nova] Creating event network-vif-deleted:0b858fea-0f8d-4dbc-a9a0-0fc45cd6dcec for instance 23f5db27-a39f-4a69-bdfc-ac6156958827 on n-h2-836830-16 Sep 07 09:59:54.863313 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-02a7ce39-1d4e-452a-9aee-628d05a6b7ca req-02e7c818-693b-40af-b8e0-03d7d3dc3562 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089755 Sep 07 09:59:54.864834 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1641/3296] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 09:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 09:59:54.939046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:54.940043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:54.951977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:54.954036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:54.954495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:54.955221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:54.955689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:54.956125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:55.035567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:55.036854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:55.037776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:55.038699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lazy-loading 'fault' on Instance uuid 23f5db27-a39f-4a69-bdfc-ac6156958827 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 09:59:55.143061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.167729 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f65b0827-8a07-4f35-b0f1-cbbd47368470 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 200 len: 1303 microversion: 2.1 time: 0.236346 Sep 07 09:59:55.169993 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1642/3297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:54 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 1303 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:55.183280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:55.186804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:55.204862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.206349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:55.206932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:55.207456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:55.208338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:55.214575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:55.215309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:55.219659 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1ee26413-2b63-429f-8cf7-9dbf05ce14e6 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.434579 Sep 07 09:59:55.242675 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1656/3298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:54 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:55.250225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:55.250843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:55.260572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:55.261445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:55.262100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:55.263496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:55.265618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:55.266420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:55.403093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.411067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.424193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.426204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.427255 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5204596-32c6-4b2c-890d-4eff47e03fd0 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.183437 Sep 07 09:59:55.427817 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1657/3299] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:55 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:55.434262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.438052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:55.445558 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68d3a877-4045-4174-bb48-775dab480c43 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1406 microversion: 2.54 time: 0.271320 Sep 07 09:59:55.449215 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1643/3300] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:55 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:56.199208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:56.199939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 23f5db27-a39f-4a69-bdfc-ac6156958827] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:56.212371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.213742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.214351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.215261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.216858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.217476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.234552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] HTTP exception thrown: Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 could not be found. Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Request method failure captured: Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 HTTP/1.1 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGpLafxUgzeD2Fj4e8vQGAvWTIJvNWT0o8s5X6KfMABRi5hK_dpOMGCPtNDPPH5F2268VCXT-lkEvOElKchUb8EJwdOzm84Q0DXzBNWyj-q3SzqeBRiyuWIigqHek3bMQoBH3bhW0N05jzqh6BBbkqaNFXEDMPTjAVeXkvtbCExXclM Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-MigrationsAdminTest-392607978 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7be6f5a8bb114c3cb556d4be75faa5a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-MigrationsAdminTest-392607978 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-MigrationsAdminTest-392607978 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-MigrationsAdminTest-392607978-project Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0e051e5308924154b7d5ecc2ea7ffdf7 Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-MigrationsAdminTest-392607978-project Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 could not be found. Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '23f5db27-a39f-4a69-bdfc-ac6156958827'} Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 could not be found. Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 could not be found. Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 09:59:56.236861 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 could not be found. Sep 07 09:59:56.241871 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 09:59:56.243452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Returning 404 to user: Instance 23f5db27-a39f-4a69-bdfc-ac6156958827 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 09:59:56.245350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d2d6aa6-1927-4c27-98df-b025730ac064 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827" status: 404 len: 111 microversion: 2.1 time: 0.051235 Sep 07 09:59:56.246422 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1658/3301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:56 2022] GET /compute/v2.1/servers/23f5db27-a39f-4a69-bdfc-ac6156958827 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 09:59:56.253818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:56.254675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:56.255947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:56.257700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:56.265015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.265739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.266345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.267602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.268411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.268882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.269222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.271837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.272337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.274347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.275752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.276411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.308337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 09:59:56.489918 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6fbce6f-3f55-40c8-ad85-e284c9c17787 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 204 len: 0 microversion: 2.1 time: 0.239206 Sep 07 09:59:56.492386 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1659/3302] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 09:59:56 2022] DELETE /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 09:59:56.500105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:56.501482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:56.515630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.521907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.522846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.523735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.527004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.527566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.563404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.571612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5003c9db-da33-4163-a153-ca5334df4561 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.324986 Sep 07 09:59:56.588775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1644/3303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:56 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:56.598101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:56.598728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:56.608450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.609217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.610337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.611507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.612136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.612896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.659005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.671878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.673453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.674693 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d123fe9d-88aa-4569-840b-ee5912adc0cf tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.180874 Sep 07 09:59:56.675267 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1660/3304] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:56 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:56.682696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:56.683580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:56.696361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.697572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.698238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.699607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:56.700348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:56.701026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:56.758369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.782774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.801530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:56.809608 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb9b4fb1-c412-477c-a9c2-f1de9f59ba2b tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1412 microversion: 2.54 time: 0.215347 Sep 07 09:59:56.810198 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1645/3305] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:56 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1412 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:57.007610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:57.017069 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-578c7232-eff5-4b83-80a6-d7161b3b6436 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1534 microversion: 2.1 time: 0.340753 Sep 07 09:59:57.033277 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1661/3306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:56 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1534 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:57.598720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:57.600483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:57.610540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:57.611333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:57.611993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:57.612937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:57.613600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:57.614211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:57.712310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:57.714172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:57.742357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:57.743098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:57.744451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:57.745685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:57.746321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:57.747219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:57.894374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:57.898208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:57.907798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:57.913779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:57.918832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c94b688d-f9da-48e0-9d9e-d4fc3f6778e8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.211968 Sep 07 09:59:57.923227 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1662/3307] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:57 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:57.945905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:57.947527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:57.955345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:57.956173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:57.956825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:57.957811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:57.960197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:57.960886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:57.984607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:58.003188 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55c06d58-73ee-4cf2-9ac1-a9e3bfc15c72 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.408885 Sep 07 09:59:58.008989 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1646/3308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:57 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:58.045566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:58.046897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:58.054452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:58.054948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:58.057009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:58.061349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:58.062300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:58.063211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:58.230355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:58.251289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:58.254068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:58.259033 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f0f53690-2193-4339-be91-dba086e1dcfc tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1412 microversion: 2.54 time: 0.327941 Sep 07 09:59:58.260211 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1663/3309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:57 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1412 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:58.452435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:58.491238 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-473fead5-5a6c-4bbf-8123-5d04d6dd41b2 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1534 microversion: 2.1 time: 0.451212 Sep 07 09:59:58.499330 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1647/3310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:58 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1534 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:58.954082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:58.956236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:58.959416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 09:59:58.975114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:58.975893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:58.976510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:58.979013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:58.980230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:58.980838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.037457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:59.038240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:59.055438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:59.057517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:59.058399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.059417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:59.063711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:59.077204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.078530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.086983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.089097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.090631 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2964431-ba50-4fff-9115-f8d6a185bb32 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.141841 Sep 07 09:59:59.101212 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1664/3311] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:58 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:59.289459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:59.290082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:59.300561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:59.300851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.301623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:59.302273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.303179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:59.303871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:59.304480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.314538 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a79d39e-2ef5-4e5c-b8f2-3f03098c01fd tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.281902 Sep 07 09:59:59.317998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1648/3312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:59 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 09:59:59.414098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.426360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.428703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.430247 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5912490f-993c-4dfc-9ec8-06febb74a3d0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1412 microversion: 2.54 time: 0.144778 Sep 07 09:59:59.431712 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1665/3313] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 09:59:59 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 09:59:59.524030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 09:59:59.524648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 09:59:59.531460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:59.531951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:59.532384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.533084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 09:59:59.533577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 09:59:59.534001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 09:59:59.744758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 09:59:59.753657 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d6b69ee1-ebdd-4178-b6a1-6a212ceb73e0 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1534 microversion: 2.1 time: 0.233317 Sep 07 09:59:59.767512 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1649/3314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 09:59:59 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1534 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:00.119827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:00.120822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:00.132841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.133873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.135381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.136864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.137846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.139805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.226294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.243059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.245921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.247902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8d7087f-e955-4fe0-85b0-85265d8dd097 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.132561 Sep 07 10:00:00.261652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1666/3315] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:00 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:00.342648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:00.343287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:00.350066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.350831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.351439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.352309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.353021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.353937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.458448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:00.459402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:00.478172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.479452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.480287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.481292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.482432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.483063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.582300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.592050 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b84f0589-58af-40a5-a003-4138d2a4808b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.253337 Sep 07 10:00:00.592710 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1650/3316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:00 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:00.664079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-65ed5432-7a68-452c-9db7-a138e9580cab req-2bd8b9f5-4659-4222-9f01-e65be7f846b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da840644-19ee-4750-9302-a4b5e3e7af36", "name": "network-vif-deleted", "tag": "666ccbef-e28e-48ce-b549-135110b04879"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:00.685305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-65ed5432-7a68-452c-9db7-a138e9580cab req-2bd8b9f5-4659-4222-9f01-e65be7f846b6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.686037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-65ed5432-7a68-452c-9db7-a138e9580cab req-2bd8b9f5-4659-4222-9f01-e65be7f846b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.687287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-65ed5432-7a68-452c-9db7-a138e9580cab req-2bd8b9f5-4659-4222-9f01-e65be7f846b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.688872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.707545 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-65ed5432-7a68-452c-9db7-a138e9580cab req-2bd8b9f5-4659-4222-9f01-e65be7f846b6 service nova] Creating event network-vif-deleted:666ccbef-e28e-48ce-b549-135110b04879 for instance da840644-19ee-4750-9302-a4b5e3e7af36 on n-h1-836830-16 Sep 07 10:00:00.720866 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-65ed5432-7a68-452c-9db7-a138e9580cab req-2bd8b9f5-4659-4222-9f01-e65be7f846b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061040 Sep 07 10:00:00.726066 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1651/3317] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:00.730090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.736807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:00.743229 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18ceccf5-a45f-40f5-8e57-0dfb4678d53f tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1397 microversion: 2.54 time: 0.285974 Sep 07 10:00:00.753496 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1667/3318] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:00 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1397 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:00.777137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b85db5a6-6ba3-4798-9e6d-c1a317068ae4 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '.version_select at 0x7f14b19e5040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:00.786171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:00.786789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:00.798224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.806214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.807035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.811132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.812945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.817001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.841097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b85db5a6-6ba3-4798-9e6d-c1a317068ae4 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-26514637" status: 204 len: 0 microversion: 2.54 time: 0.068895 Sep 07 10:00:00.841792 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1652/3319] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Sep 7 10:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-26514637 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:00:00.861644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:00.862281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:00.875919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.876428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.879868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.885881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.886472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.886938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.940351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:00.941083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:00.942426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:00.943201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lazy-loading 'fault' on Instance uuid da840644-19ee-4750-9302-a4b5e3e7af36 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:00.974223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:01.169077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a447acfd-024e-4840-b70a-2d392fddc0a6 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 204 len: 0 microversion: 2.54 time: 0.308050 Sep 07 10:00:01.173444 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1653/3320] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:00:00 2022] DELETE /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:00:01.193141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:01.194209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:01.202683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:01.203120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:01.205797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:01.222651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:01.225118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:01.226329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:01.569343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:01.627434 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-245b4028-eedb-4226-b974-a43bfcfa5a7c tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 200 len: 1368 microversion: 2.1 time: 0.826287 Sep 07 10:00:01.628246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:01.658425 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1668/3321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:00 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 1368 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:01.664319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:01.672636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:01.680357 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37547499-ed21-4d9c-a623-95ba5295d6d7 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1403 microversion: 2.54 time: 0.500910 Sep 07 10:00:01.684218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1654/3322] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:01 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1403 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:01.686420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:01.687817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:01.703393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:01.709849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:01.714636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:01.716110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:01.719051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:01.722648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:01.723809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:01.725279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:01.742556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:01.746209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:01.750226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:01.751626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:01.752554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:01.754800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:01.823891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:02.124051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.160064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.163748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.165396 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-43686989-5465-426e-838b-0fd8ce873de2 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.497431 Sep 07 10:00:02.167389 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1669/3323] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:01 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:02.343235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.360750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-676b4db7-0ab8-4c85-9c04-585f959f8523 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1522 microversion: 2.1 time: 0.674685 Sep 07 10:00:02.387947 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1655/3324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:01 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:02.678177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:02.678856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: da840644-19ee-4750-9302-a4b5e3e7af36] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:02.695705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:02.696566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:02.697759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:02.698795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:02.701442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:02.702118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:02.722593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:02.723203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:02.732986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:02.733599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:02.734211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:02.737688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:02.738393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:02.738832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:02.749165 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] HTTP exception thrown: Instance da840644-19ee-4750-9302-a4b5e3e7af36 could not be found. Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Request method failure captured: Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 HTTP/1.1 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGpLafxUgzeD2Fj4e8vQGAvWTIJvNWT0o8s5X6KfMABRi5hK_dpOMGCPtNDPPH5F2268VCXT-lkEvOElKchUb8EJwdOzm84Q0DXzBNWyj-q3SzqeBRiyuWIigqHek3bMQoBH3bhW0N05jzqh6BBbkqaNFXEDMPTjAVeXkvtbCExXclM Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7be6f5a8bb114c3cb556d4be75faa5a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-MigrationsAdminTest-392607978-project Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0e051e5308924154b7d5ecc2ea7ffdf7 Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-MigrationsAdminTest-392607978-project Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance da840644-19ee-4750-9302-a4b5e3e7af36 could not be found. Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'da840644-19ee-4750-9302-a4b5e3e7af36'} Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da840644-19ee-4750-9302-a4b5e3e7af36 could not be found. Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da840644-19ee-4750-9302-a4b5e3e7af36 could not be found. Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:02.756342 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da840644-19ee-4750-9302-a4b5e3e7af36 could not be found. Sep 07 10:00:02.763517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:02.765458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Returning 404 to user: Instance da840644-19ee-4750-9302-a4b5e3e7af36 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:02.766589 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-593c0fd8-260f-4793-8d15-f30876f0b227 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36" status: 404 len: 111 microversion: 2.1 time: 0.100871 Sep 07 10:00:02.767365 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1670/3325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:02 2022] GET /compute/v2.1/servers/da840644-19ee-4750-9302-a4b5e3e7af36 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:00:02.776801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7af70740-c255-4714-8e11-40610fff8226 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '.version_select at 0x7f14b2098550>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:02.812087 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7af70740-c255-4714-8e11-40610fff8226 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903180541" status: 202 len: 0 microversion: 2.1 time: 0.039688 Sep 07 10:00:02.814020 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1671/3326] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:00:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903180541 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:00:02.832581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.845055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.846960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:02.850097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0e0eb2d-6ebb-495a-8b0d-70c1276d4b33 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1403 microversion: 2.54 time: 0.131433 Sep 07 10:00:02.865207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1656/3327] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:02 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1403 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:03.204399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:03.205242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:03.226774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.227290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.227743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.230575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.231068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.233326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.394552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:03.395566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:03.437784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.439188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.440848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.441811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.444328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.445337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.458795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:03.475448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:03.481264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:03.484307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-035c3555-7113-4f52-87de-cbb6119db05b tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.284104 Sep 07 10:00:03.486692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1672/3328] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:03 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:03.883935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:03.886039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:03.902941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.903452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.905813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.907830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.908354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.908795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.986365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:03.987099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:03.987556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:03.988626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lazy-loading 'fault' on Instance uuid ac04d2ae-6cb0-4c14-b605-10cd827f8638 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:04.150591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:04.163070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:04.171353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58e65ef71c544168c30448efadbd789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fb47fd474948c080aed7e5d0061dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:04.174790 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2041ce4d-d1ba-4262-8976-70a5b7aed1e0 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 200 len: 1408 microversion: 2.54 time: 0.298995 Sep 07 10:00:04.177521 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1673/3329] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:03 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:04.365676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:04.392897 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c2386c13-4f43-4a5d-a650-ed60b667be0c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1499 microversion: 2.1 time: 0.993663 Sep 07 10:00:04.394276 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1657/3330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:03 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1499 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:04.434247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:04.445401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:04.447991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:04.457498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:04.460714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:04.460714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:04.460714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:04.460714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:04.460714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:04.501904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:04.516095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:04.516807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:04.532686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:04.536531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:04.543433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:04.548116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:04.549713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:04.552897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:04.719422 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-584d4484-d393-4347-8066-eb6690876ddb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.296262 Sep 07 10:00:04.733818 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1674/3331] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Sep 7 10:00:04 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:04.760790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0640fb90-2e5d-4b0b-96da-3a99e7e4a07e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:04.789594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0640fb90-2e5d-4b0b-96da-3a99e7e4a07e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:04.793804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0640fb90-2e5d-4b0b-96da-3a99e7e4a07e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:04.795767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0640fb90-2e5d-4b0b-96da-3a99e7e4a07e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:04.862023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0640fb90-2e5d-4b0b-96da-3a99e7e4a07e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Going to try to start instance {{(pid=128833) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 10:00:05.075869 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0640fb90-2e5d-4b0b-96da-3a99e7e4a07e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "POST /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da/action" status: 202 len: 0 microversion: 2.1 time: 0.337883 Sep 07 10:00:05.077650 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1675/3332] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:00:04 2022] POST /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:00:05.108377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:05.117640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:05.136988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:05.137578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:05.137975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:05.142823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:05.143507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:05.143964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:05.827390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:05.840077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:05.857316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:05.864829 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e58fa987-5e1e-4b7d-9ec0-26e5ac9d7ee8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 1.350879 Sep 07 10:00:05.895015 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1658/3333] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:04 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:05.909736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:05.912193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] [instance: ac04d2ae-6cb0-4c14-b605-10cd827f8638] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:05.936672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:05.939235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:05.940114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:05.941436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:05.942746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:05.943392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:05.983474 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] HTTP exception thrown: Instance ac04d2ae-6cb0-4c14-b605-10cd827f8638 could not be found. Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Request method failure captured: Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 HTTP/1.1 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGtu6UlVgspSAQBMfdLyfGUjwLEPByYZU-mcbXPoErpLB9A3912I9qrq9Oc1fwmeTsnW3nhDNr7RalYHrGa2yTNY7TCWwqZ1QfClqWNQfpH1h6D3j2XD1nDkRW7cepMitEKbgsvHtzrKEJm14NIb92mvNiqKu9mORkZcXjqPkaKxV2I Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.54 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: a0fb47fd474948c080aed7e5d0061dd2 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerShowV254Test-1836672460 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0fb47fd474948c080aed7e5d0061dd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0fb47fd474948c080aed7e5d0061dd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0fb47fd474948c080aed7e5d0061dd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0fb47fd474948c080aed7e5d0061dd2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerShowV254Test-1836672460 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: a0fb47fd474948c080aed7e5d0061dd2 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerShowV254Test-1836672460 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerShowV254Test-1836672460-project Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d58e65ef71c544168c30448efadbd789 Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerShowV254Test-1836672460-project Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance ac04d2ae-6cb0-4c14-b605-10cd827f8638 could not be found. Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ac04d2ae-6cb0-4c14-b605-10cd827f8638'} Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac04d2ae-6cb0-4c14-b605-10cd827f8638 could not be found. Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac04d2ae-6cb0-4c14-b605-10cd827f8638 could not be found. Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:05.985610 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac04d2ae-6cb0-4c14-b605-10cd827f8638 could not be found. Sep 07 10:00:05.989782 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:05.995635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] Returning 404 to user: Instance ac04d2ae-6cb0-4c14-b605-10cd827f8638 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:05.996991 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-29d0bda2-4304-4b9d-8756-e829604597f2 tempest-ServerShowV254Test-1836672460 tempest-ServerShowV254Test-1836672460-project] 10.222.0.60 "GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638" status: 404 len: 111 microversion: 2.54 time: 0.100887 Sep 07 10:00:06.003298 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1659/3334] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:05 2022] GET /compute/v2.1/servers/ac04d2ae-6cb0-4c14-b605-10cd827f8638 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:00:06.505652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:06.506156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:06.513500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:06.513999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:06.514432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:06.515150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:06.515606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:06.516036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:06.528297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:06.540320 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fab342b5-7111-4cd7-bc7b-5168810d3857 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1508 microversion: 2.1 time: 1.453142 Sep 07 10:00:06.546589 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1676/3335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:05 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1508 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:06.629872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:06.842300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb958b4b-4784-49db-a9a9-1471093c73bd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 204 len: 0 microversion: 2.1 time: 0.340109 Sep 07 10:00:06.848912 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1660/3336] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:00:06 2022] DELETE /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:06.857462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:06.857968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:06.870560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:06.871109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:06.872567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:06.873100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:06.879566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:06.880447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:06.897716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:06.898727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:06.914342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:06.915083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:06.916517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:06.917468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:06.919925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:06.920549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:07.187734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:07.208991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:07.214647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:07.218322 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82a72a4b-b335-469a-9a02-ccd8a3bdcc35 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1365 microversion: 2.47 time: 0.323641 Sep 07 10:00:07.223279 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1661/3337] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:06 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:07.455193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-280804769", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "fcc953f5-e3ca-402d-a7b1-6dcfc3bd59c5"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:07.529047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] validate_networks() for [('fcc953f5-e3ca-402d-a7b1-6dcfc3bd59c5', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:00:07.532367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:07.546359 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74d44881-46fc-40fa-9d9e-bf00351bd9c5 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1468 microversion: 2.1 time: 0.693324 Sep 07 10:00:07.546959 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1677/3338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:06 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1468 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:07.570039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:07.570671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:07.584395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:07.584893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:07.585371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:07.586083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:07.586541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:07.586967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:08.480799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:08.496073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c911c10b-493e-48e8-8290-577440f3815f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1508 microversion: 2.1 time: 0.927465 Sep 07 10:00:08.497330 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1678/3339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:07 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1508 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:08.506720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:08.507734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:08.522303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:08.523050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:08.523888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:08.524596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:08.525095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:08.525600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:08.578071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:08.656906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:08.671631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:08.675916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:08.677139 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01d57b06-ffad-4efa-9156-02e183f45e5e tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1371 microversion: 2.47 time: 0.178718 Sep 07 10:00:08.677735 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1679/3340] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:08 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:08.691379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:08.692293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:08.707732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:08.709120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:08.709831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:08.710942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:08.711621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:08.712322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.039357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:09.050460 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6a885d4-568f-46fd-a7a4-bd48bfe5fe4d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1468 microversion: 2.1 time: 0.365392 Sep 07 10:00:09.066923 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1680/3341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:08 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:09.438069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:00:09.439011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:00:09.439669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:00:09.440249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:00:09.440802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:00:09.457812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:09.458639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:09.471276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.475134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:09.476104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:09.476653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.522135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:09.522758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:09.523710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Getting quotas for project 22d9ee58994b49ec8484555c36ad3ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:09.530619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:09.531028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:09.543130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.543901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:09.544393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:09.544894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.545909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Getting quotas for user dbed9a3e044149c58ab45d4249fc258b and project 22d9ee58994b49ec8484555c36ad3ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:09.589646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:00:09.601779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:00:09.629073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:09.735547 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd9de956-a7c4-41b5-bf7f-c162f9c859a6 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.510845 Sep 07 10:00:09.736220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1662/3342] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 10:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 10:00:09.741307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:09.741939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:09.761935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:09.762743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:09.763377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.764705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:09.765381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:09.765978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:09.961898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:09.977573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:09.985141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:09.989203 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3422d83f-446a-40fe-b936-29c0bd731103 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1371 microversion: 2.47 time: 0.251531 Sep 07 10:00:09.990348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1663/3343] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:09 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:10.000434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:10.004026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a04becf8-8eff-4791-a1e5-ed52fdcef8be tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:10.005730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a04becf8-8eff-4791-a1e5-ed52fdcef8be tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:10.010195 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3265937b-62cf-4be9-ba26-37062c626b6a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1512 microversion: 2.1 time: 0.490691 Sep 07 10:00:10.011961 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1681/3344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:09 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:10.232295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-311b104d-9e13-436d-a074-78c69ea2db3d tempest-ExtensionsTest-1683163832 tempest-ExtensionsTest-1683163832-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:10.233860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a04becf8-8eff-4791-a1e5-ed52fdcef8be tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:10.234757 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-311b104d-9e13-436d-a074-78c69ea2db3d tempest-ExtensionsTest-1683163832 tempest-ExtensionsTest-1683163832-project] 10.222.0.60 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.221167 Sep 07 10:00:10.235636 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1682/3345] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 7 10:00:10 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:10.248113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a04becf8-8eff-4791-a1e5-ed52fdcef8be tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:10.250034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a04becf8-8eff-4791-a1e5-ed52fdcef8be tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:10.251958 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a04becf8-8eff-4791-a1e5-ed52fdcef8be tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1258 microversion: 2.21 time: 0.258311 Sep 07 10:00:10.252330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:10.253076 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1664/3346] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:09 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:10.258468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:10.260999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:10.267239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:10.267772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.servers [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Removing options 'limit' from query {{(pid=128833) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 10:00:10.268582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:10.268786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.269403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.269788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.270049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.270918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.271728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.272634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.273286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.273850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.274588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.276112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.277580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.279057 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c84b6076-6f85-4f35-8ae6-db9e2c5b3d05 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.041312 Sep 07 10:00:10.287805 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1683/3347] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 7 10:00:10 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:00:10.293775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1460adbb-2bc5-4dfb-bdc0-fdb42583d0fe tempest-ExtensionsTest-1683163832 tempest-ExtensionsTest-1683163832-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:10.296462 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1460adbb-2bc5-4dfb-bdc0-fdb42583d0fe tempest-ExtensionsTest-1683163832 tempest-ExtensionsTest-1683163832-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007407 Sep 07 10:00:10.308349 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1684/3348] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 7 10:00:10 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:00:10.343504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:10.345682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:10.360190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.360881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.361801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.375656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.376439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.377934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.543525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:10.569005 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56e74750-c0e9-427a-8d01-875ed6ac90cd tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 200 len: 1426 microversion: 2.1 time: 0.314479 Sep 07 10:00:10.574475 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1665/3349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:10 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 1426 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:10.591986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-16311b6f-c915-47e1-bc1b-8e2d0964e501 req-cb1f0478-b2e4-4702-ba4d-8287aca01d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1caf64-97d3-4d37-b66b-4fdc9bff03ab", "name": "network-vif-deleted", "tag": "ad4cd55f-c2ec-4458-9b22-5d93adec48a5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:10.637790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-16311b6f-c915-47e1-bc1b-8e2d0964e501 req-cb1f0478-b2e4-4702-ba4d-8287aca01d61 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:10.639451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-16311b6f-c915-47e1-bc1b-8e2d0964e501 req-cb1f0478-b2e4-4702-ba4d-8287aca01d61 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:10.641725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-16311b6f-c915-47e1-bc1b-8e2d0964e501 req-cb1f0478-b2e4-4702-ba4d-8287aca01d61 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:10.700472 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-16311b6f-c915-47e1-bc1b-8e2d0964e501 req-cb1f0478-b2e4-4702-ba4d-8287aca01d61 service nova] Creating event network-vif-deleted:ad4cd55f-c2ec-4458-9b22-5d93adec48a5 for instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab on n-h1-836830-16 Sep 07 10:00:10.715563 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-16311b6f-c915-47e1-bc1b-8e2d0964e501 req-cb1f0478-b2e4-4702-ba4d-8287aca01d61 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139423 Sep 07 10:00:10.716180 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1666/3350] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:11.033545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:11.034331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:11.053231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.058362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.060034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.060814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.060955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.062352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.062828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.072643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6846e2e5-34e2-4091-8026-1dcbaa88fefa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1512 microversion: 2.1 time: 0.760759 Sep 07 10:00:11.073422 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1685/3351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:10 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1512 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:11.096346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:11.097534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:11.109983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.110896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.111795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.113122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.113892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.114478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.232045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.245147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.247544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.250508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71e5c43a-94fe-418a-a32f-2baac448ed30 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1356 microversion: 2.47 time: 0.221976 Sep 07 10:00:11.255808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1667/3352] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:11 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:11.285156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:11.296290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.299170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Searching by: {'deleted': False, 'project_id': '9513f5dbaf46496ea925df77103fc06b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:11.310731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.312592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.313289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.316765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.318127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.318945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.521640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.532750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67e0aafb-06b5-4547-b3e1-045efcd5771a tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 200 len: 1512 microversion: 2.1 time: 0.440024 Sep 07 10:00:11.534475 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1686/3353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:11 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:11.540311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:11.541721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:11.558673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.559175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.559629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.560331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.560847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.566195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.705394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:11.829901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.845786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.862218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:11.863431 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f731deee-9724-4823-bb99-c2688cbd8e50 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1254 microversion: 2.21 time: 0.327823 Sep 07 10:00:11.888553 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1687/3354] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:11 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1254 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:11.888553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:11.896458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:11.906254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.906749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.907311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:11.908477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:11.909566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:11.910154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.036889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:12.060710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.061233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.061831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.083457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:12.084922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:12.172713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:12.182437 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd4645ab-5be7-42e6-b7f8-81181ebd46b2 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1513 microversion: 2.1 time: 0.309459 Sep 07 10:00:12.185546 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1688/3355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:11 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:12.195476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:12.196103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:12.207191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.207688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.208125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.215038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.215530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.215976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.252025 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] HTTP exception thrown: Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab could not be found. Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Request method failure captured: Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab HTTP/1.1 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGpLafxUgzeD2Fj4e8vQGAvWTIJvNWT0o8s5X6KfMABRi5hK_dpOMGCPtNDPPH5F2268VCXT-lkEvOElKchUb8EJwdOzm84Q0DXzBNWyj-q3SzqeBRiyuWIigqHek3bMQoBH3bhW0N05jzqh6BBbkqaNFXEDMPTjAVeXkvtbCExXclM Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7be6f5a8bb114c3cb556d4be75faa5a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-MigrationsAdminTest-392607978-project Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0e051e5308924154b7d5ecc2ea7ffdf7 Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-MigrationsAdminTest-392607978-project Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab could not be found. Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5e1caf64-97d3-4d37-b66b-4fdc9bff03ab'} Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab could not be found. Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab could not be found. Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:12.255894 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab could not be found. Sep 07 10:00:12.262705 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:12.265242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Returning 404 to user: Instance 5e1caf64-97d3-4d37-b66b-4fdc9bff03ab could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:12.267493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0383c47d-ffde-4bc8-b7c5-8b61b27c831b tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab" status: 404 len: 111 microversion: 2.1 time: 0.080036 Sep 07 10:00:12.268628 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1689/3356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:12 2022] GET /compute/v2.1/servers/5e1caf64-97d3-4d37-b66b-4fdc9bff03ab => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:00:12.275614 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9cac3da-717c-41f7-815c-3904ca325375 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.994320 Sep 07 10:00:12.276459 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1668/3357] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 7 10:00:11 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:12.278296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:12.281330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:12.281833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:12.286502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:12.291323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:12.299785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.300416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.300851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.302350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.302977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.303551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.363957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:12.644802 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0eecfad8-181b-4937-b70d-11eb7d40aa73 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 204 len: 0 microversion: 2.1 time: 0.364597 Sep 07 10:00:12.664998 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1669/3358] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:00:12 2022] DELETE /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:12.670692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.671785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.673131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.679772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.681549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.682200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.695720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:12.698240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:12.722337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.723304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.723649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.724631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:12.726646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:12.727486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:12.796827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:12.807501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:12.930689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:13.038207 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85493e46-a315-456e-aea7-8705145caf94 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 204 len: 0 microversion: 2.47 time: 0.352119 Sep 07 10:00:13.040435 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1670/3359] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:00:12 2022] DELETE /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:00:13.067991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:13.069036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:13.078194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.078900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.079507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.080765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.081476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.083327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.178013 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4d31900-8ba9-422e-8eb7-6c23e4b89e4f tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.908001 Sep 07 10:00:13.179686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1690/3360] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Sep 7 10:00:12 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:13.189570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:13.190751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:13.205045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.205793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.206419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.207377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.208131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.208728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.742842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:13.770224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:13.775177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:13.782389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a5b964b7-ebfc-4fed-949b-df0204028509 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2955 microversion: 2.42 time: 0.597153 Sep 07 10:00:13.793289 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1691/3361] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:13 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2955 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:13.803982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:13.811447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:13.854623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.855986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.856400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.859533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.871518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:13.883684 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b246f854-eef8-474b-94a7-5fac393d0270 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1469 microversion: 2.1 time: 0.842216 Sep 07 10:00:13.891319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.891319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.915159 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1671/3362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:13 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1469 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:13.938592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:13.953283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:13.975360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.976311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.980819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:13.981866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:13.982516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:13.983118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.169574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.182205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.189078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.190708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e8b96a1-39fa-4d8f-bfe7-4c03790f9476 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1316 microversion: 2.21 time: 0.402013 Sep 07 10:00:14.193210 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1692/3363] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:13 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:14.205617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:14.207089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:14.223921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.226090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.226536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.227253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.227708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.232544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.238859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.262391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.264070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.268856 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc15490f-c465-4e0b-b559-0e0211ebf525 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1362 microversion: 2.47 time: 0.348186 Sep 07 10:00:14.272003 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1672/3364] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:13 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:14.288729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:14.293032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:14.329142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.329857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.330371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.331172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.331704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.332211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.703843 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b364f73f-0cae-4020-b41f-18755b5be361 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.428033 Sep 07 10:00:14.704446 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1673/3365] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 10:00:14 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160/os-interface => generated 1831 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:14.887277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:14.906590 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93abf3ce-3a89-487a-aa10-515babb998f5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1512 microversion: 2.1 time: 0.711695 Sep 07 10:00:14.917991 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1693/3366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:14 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1512 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:14.936977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:14.938330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:14.946035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.948084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.948715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:14.949072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.949399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:14.950465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.951167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.951820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.970035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.970737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.971221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:14.972027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:14.972490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:14.972927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:15.638076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:15.656372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:15.661054 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-725c5c29-6b5b-4255-8aba-432cd8885e4b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 200 len: 1512 microversion: 2.1 time: 0.719146 Sep 07 10:00:15.673876 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1674/3367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:14 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:15.677547 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b811d77b-23f5-42ac-a0d4-d8a9c59b3e9d tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1469 microversion: 2.1 time: 0.732326 Sep 07 10:00:15.688092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:15.692762 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1694/3368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:14 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1469 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:15.693906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:15.703417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:15.705452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:15.706089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:15.707026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:15.707657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:15.708260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:15.717410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:15.720731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:15.741792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:15.746627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:15.747517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:15.749568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:15.750854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:15.751557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:15.886381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:15.887732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:15.889053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:15.890212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lazy-loading 'fault' on Instance uuid 3021912f-0eac-4903-8531-fc1aefd318bc {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:16.012785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.034483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.048484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.054869 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5bf846f2-9a68-408d-9db2-9a6e595bd21a tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 200 len: 1367 microversion: 2.47 time: 0.357858 Sep 07 10:00:16.059841 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1695/3369] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:15 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:16.075532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:16.077414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:16.092403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.094512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.096627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.097652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.101877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.103090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.143995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.160616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.170060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.175670 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c858c941-297b-4970-9ce2-b0727052887e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.500473 Sep 07 10:00:16.191305 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1675/3370] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:15 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:16.487901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-31720fff-d9f9-47c3-bbcf-b158a1cfb702 req-a893b454-5f77-450b-81a4-b3c0239e3ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbfe500-4014-4f0d-b630-2aeafd3f5324", "name": "network-vif-deleted", "tag": "f68f8e09-24ba-4b81-9bfe-4485238abe37"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:16.511904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-31720fff-d9f9-47c3-bbcf-b158a1cfb702 req-a893b454-5f77-450b-81a4-b3c0239e3ccf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.533569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-31720fff-d9f9-47c3-bbcf-b158a1cfb702 req-a893b454-5f77-450b-81a4-b3c0239e3ccf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.534022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-31720fff-d9f9-47c3-bbcf-b158a1cfb702 req-a893b454-5f77-450b-81a4-b3c0239e3ccf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.565851 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-31720fff-d9f9-47c3-bbcf-b158a1cfb702 req-a893b454-5f77-450b-81a4-b3c0239e3ccf service nova] Creating event network-vif-deleted:f68f8e09-24ba-4b81-9bfe-4485238abe37 for instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 on n-h2-836830-16 Sep 07 10:00:16.594062 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-31720fff-d9f9-47c3-bbcf-b158a1cfb702 req-a893b454-5f77-450b-81a4-b3c0239e3ccf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105697 Sep 07 10:00:16.599303 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1676/3371] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:16.675282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:16.678240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:16.678972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:16.691032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.694714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.696511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.701623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.705567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.705767 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5be1ca45-a6e2-42cf-812f-29fec9a01c9b tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1513 microversion: 2.1 time: 0.638437 Sep 07 10:00:16.708504 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1696/3372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:16 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1513 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:16.714099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.732432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:16.735170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:16.754615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.755527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.757587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.758657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.761108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.763757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.882832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:16.886503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:16.888538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:16.891234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lazy-loading 'fault' on Instance uuid 0fbfe500-4014-4f0d-b630-2aeafd3f5324 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:17.020183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e051e5308924154b7d5ecc2ea7ffdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be6f5a8bb114c3cb556d4be75faa5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.031228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cf179eb-7152-4678-8e7b-85c521f60862 tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 200 len: 1303 microversion: 2.1 time: 0.320027 Sep 07 10:00:17.031798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1697/3373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:16 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 1303 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:17.036502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:17.066027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.066802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:17.119752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.123435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.123898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.124779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.125271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.125757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.183597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:17.193674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:17.340482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.368183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.372400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.373842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.410730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.426610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.428493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.430708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc2f5bf5-5559-40d6-9fc8-22a1974b4880 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2950 microversion: 2.32 time: 0.757619 Sep 07 10:00:17.434992 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1677/3374] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:16 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2950 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:17.439449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:17.440387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 3021912f-0eac-4903-8531-fc1aefd318bc] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:17.447568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.448568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.449125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.449966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.450672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.451306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.471583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] HTTP exception thrown: Instance 3021912f-0eac-4903-8531-fc1aefd318bc could not be found. Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Request method failure captured: Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc HTTP/1.1 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGtvmUyufx5gOqQ9K24JgWzbJQjXN0RC7bI7Eyj3XnwZvDMeEBYfyuML1HtWV930PA9PFTmAs0M_132C5y0Zwt0Diw9azR-W_YwS7fRVM6IzJjKGu8kOubfTp__BrGnan9V1W-CfwrjY0LM0boYXbnbfkxp-cphJZUOvxef1iA8fuSE Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.47 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 9513f5dbaf46496ea925df77103fc06b Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerShowV247Test-1695987518 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9513f5dbaf46496ea925df77103fc06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9513f5dbaf46496ea925df77103fc06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9513f5dbaf46496ea925df77103fc06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9513f5dbaf46496ea925df77103fc06b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerShowV247Test-1695987518 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 9513f5dbaf46496ea925df77103fc06b Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerShowV247Test-1695987518 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerShowV247Test-1695987518-project Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fdda27dce4a04bbab7f98407ba1ea327 Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerShowV247Test-1695987518-project Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3021912f-0eac-4903-8531-fc1aefd318bc could not be found. Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3021912f-0eac-4903-8531-fc1aefd318bc'} Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3021912f-0eac-4903-8531-fc1aefd318bc could not be found. Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3021912f-0eac-4903-8531-fc1aefd318bc could not be found. Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:17.473481 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3021912f-0eac-4903-8531-fc1aefd318bc could not be found. Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Returning 404 to user: Instance 3021912f-0eac-4903-8531-fc1aefd318bc could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1eea2a6-b7a9-4086-a7ea-b70d5a691974 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc" status: 404 len: 111 microversion: 2.47 time: 0.040603 Sep 07 10:00:17.480691 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1678/3375] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:17 2022] GET /compute/v2.1/servers/3021912f-0eac-4903-8531-fc1aefd318bc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:00:17.488150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:17.488927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:17.505039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.507570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.511614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.513546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.514347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.516125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.715177 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-320395f6-abd7-4cb8-9887-2002e5407020 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.682295 Sep 07 10:00:17.733806 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1698/3376] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:00:17 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:17.744283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:17.745145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:17.752252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.753032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.756232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.757393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.758696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.759868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.904973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.920254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.924076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:17.932004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4693400d-2ee4-45d0-801e-de1728910e41 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.448122 Sep 07 10:00:17.937447 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1679/3377] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:17 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:17.952422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:17.962007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:17.979771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.980768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.981500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:17.982600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:17.983630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:17.986173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.037081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:18.038687 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02a31d9a-e5e4-4d38-a0ae-49aa9f0ba7c1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.303592 Sep 07 10:00:18.039648 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1699/3378] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 10:00:17 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6/os-interface => generated 1831 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:18.044994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ee7b6f8-e53d-459f-b953-dcdb01baef6d tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b180b5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:18.159086 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ee7b6f8-e53d-459f-b953-dcdb01baef6d tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/abf99cd8-b3c2-4870-81d3-5eae83a0be73" status: 200 len: 351 microversion: 2.1 time: 0.117914 Sep 07 10:00:18.159664 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1700/3379] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:00:18 2022] GET /compute/v2.1/os-volumes/abf99cd8-b3c2-4870-81d3-5eae83a0be73 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:18.165151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:18.177729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:18.178418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:18.243098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f87eb7c-ab18-4444-9ff8-c4a0978b3ffe tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 204 len: 0 microversion: 2.47 time: 0.301452 Sep 07 10:00:18.244404 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1680/3380] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:00:17 2022] DELETE /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:00:18.258185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:18.260443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] [instance: 0fbfe500-4014-4f0d-b630-2aeafd3f5324] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:18.274920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.279503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.280028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.280762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.281280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.281781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.290045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.291284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.292101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.293092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.293092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.293686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.318777 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] HTTP exception thrown: Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 could not be found. Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Request method failure captured: Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 HTTP/1.1 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGpLafxUgzeD2Fj4e8vQGAvWTIJvNWT0o8s5X6KfMABRi5hK_dpOMGCPtNDPPH5F2268VCXT-lkEvOElKchUb8EJwdOzm84Q0DXzBNWyj-q3SzqeBRiyuWIigqHek3bMQoBH3bhW0N05jzqh6BBbkqaNFXEDMPTjAVeXkvtbCExXclM Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7be6f5a8bb114c3cb556d4be75faa5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7be6f5a8bb114c3cb556d4be75faa5a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 7be6f5a8bb114c3cb556d4be75faa5a1 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-MigrationsAdminTest-392607978 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-MigrationsAdminTest-392607978-project Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0e051e5308924154b7d5ecc2ea7ffdf7 Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-MigrationsAdminTest-392607978-project Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 could not be found. Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '0fbfe500-4014-4f0d-b630-2aeafd3f5324'} Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 could not be found. Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 could not be found. Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:18.324790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 could not be found. Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] Returning 404 to user: Instance 0fbfe500-4014-4f0d-b630-2aeafd3f5324 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01cf914d-4ad6-4f7b-992c-60b30d7647fe tempest-MigrationsAdminTest-392607978 tempest-MigrationsAdminTest-392607978-project] 10.222.0.60 "GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324" status: 404 len: 111 microversion: 2.1 time: 0.080558 Sep 07 10:00:18.331179 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1681/3381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:18 2022] GET /compute/v2.1/servers/0fbfe500-4014-4f0d-b630-2aeafd3f5324 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:00:18.340953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:18.343398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:18.356591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.357696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.360833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.362695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.364048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.366269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.373459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:18.459596 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ecd45fea-8be4-49cc-89b9-31065e375c33 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.298543 Sep 07 10:00:18.460208 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1701/3382] 10.222.0.60 () {58 vars in 1150 bytes} [Wed Sep 7 10:00:18 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:18.477515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:18.484225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:18.484911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:18.506227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.506895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.516546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.517519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.518174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.518696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.674304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:18.709533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:18.720472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:18.724973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dcd7c53e-9d91-441e-8200-f21994fd1378 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 200 len: 1362 microversion: 2.47 time: 0.393723 Sep 07 10:00:18.728312 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1682/3383] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:18 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:18.742368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c52d6810-8615-47f5-9c8d-159ac17be8e6 req-fd2a2808-04f1-47e2-bb9a-e88670ad620e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109f562a-8111-4417-958e-25e80d45b929", "tag": "9a389bf3-582e-4b45-a7df-003822914506"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:18.761454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:18.773106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c52d6810-8615-47f5-9c8d-159ac17be8e6 req-fd2a2808-04f1-47e2-bb9a-e88670ad620e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.774603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c52d6810-8615-47f5-9c8d-159ac17be8e6 req-fd2a2808-04f1-47e2-bb9a-e88670ad620e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.777399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c52d6810-8615-47f5-9c8d-159ac17be8e6 req-fd2a2808-04f1-47e2-bb9a-e88670ad620e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.812323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c52d6810-8615-47f5-9c8d-159ac17be8e6 req-fd2a2808-04f1-47e2-bb9a-e88670ad620e service nova] Creating event network-changed:9a389bf3-582e-4b45-a7df-003822914506 for instance 109f562a-8111-4417-958e-25e80d45b929 on n-h1-836830-16 Sep 07 10:00:18.826449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c52d6810-8615-47f5-9c8d-159ac17be8e6 req-fd2a2808-04f1-47e2-bb9a-e88670ad620e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095852 Sep 07 10:00:18.829252 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1683/3384] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:18.971326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:18.972364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:18.983132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.984301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.985083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:18.986230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:18.986886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:18.987574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.000038 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9501618b-9a6f-4dd8-9a0f-155cb08dd39d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.525391 Sep 07 10:00:19.006263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1702/3385] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 7 10:00:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:19.026374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:19.034269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:19.035229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:19.042992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.043739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.044356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.045599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.046313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.048324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.177308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:19.255821 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3fc9c38-434d-4457-9f90-0b65e22093fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.235286 Sep 07 10:00:19.257459 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1703/3386] 10.222.0.60 () {58 vars in 1196 bytes} [Wed Sep 7 10:00:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:19.271958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:19.278763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:19.280312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': '1005200912', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:19.286733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.287512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.288373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.291192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.292263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.292872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.417953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:19.502677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8e9dade-35db-4c9c-a091-82ac40ea53d0 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?name=1005200912" status: 200 len: 346 microversion: 2.1 time: 0.236049 Sep 07 10:00:19.504382 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1704/3387] 10.222.0.60 () {58 vars in 1156 bytes} [Wed Sep 7 10:00:19 2022] GET /compute/v2.1/servers?name=1005200912 => generated 346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:19.518749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:19.531393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:19.532641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:19.544503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.548319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.549027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.552587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.553359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.553959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.690637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:19.780633 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3240fe82-feef-46cb-8b46-ae57654df6fa tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.266272 Sep 07 10:00:19.781571 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1705/3388] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Sep 7 10:00:19 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:19.788327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:19.802154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:19.820043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.821022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.822467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:19.823988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:19.826430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:19.828582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:20.080242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.095739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.098311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.099877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-87c2ea0e-db6d-4ea9-8d86-b6cbb912d8f8 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 200 len: 1362 microversion: 2.47 time: 0.317489 Sep 07 10:00:20.101026 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1706/3389] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:19 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:20.105893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:20.111583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.112764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-100520091', 'deleted': False, 'project_id': 'ccd771f0096f47edb69e93f4c80771de'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:00:20.131327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:20.134903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:20.135822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:20.136601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:20.137081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:20.145352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:20.246594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.283437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.286802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:20.287974 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57fe88cb-77a2-4386-b9d0-163e70d79a00 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 1.323877 Sep 07 10:00:20.297809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1684/3390] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:18 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:20.489832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:00:21.131286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:21.140178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:21.152300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.156668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.157481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.158459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.160352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.161699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.210301 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1fd4759-b96c-4445-8c94-d4c9991874ea tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-100520091" status: 200 len: 346 microversion: 2.1 time: 1.107938 Sep 07 10:00:21.211211 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1707/3391] 10.222.0.60 () {58 vars in 1228 bytes} [Wed Sep 7 10:00:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-100520091 => generated 346 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:21.217069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7370d84c-fbe9-4bff-8212-d840b737c7ac tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b1264a60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:21.258318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:21.270390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:21.271887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:21.273174 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9dc94ecc-dc0f-4e07-a596-50a1b1790bfb tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 200 len: 1362 microversion: 2.47 time: 0.149028 Sep 07 10:00:21.274104 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1685/3392] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:21 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:21.292416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:21.293205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:21.299655 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7370d84c-fbe9-4bff-8212-d840b737c7ac tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/566b87d8-ce71-484a-95dd-702f951aff08" status: 200 len: 351 microversion: 2.1 time: 0.082531 Sep 07 10:00:21.302604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.303113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.303558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.304273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.304764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.305277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.309612 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1708/3393] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:00:21 2022] GET /compute/v2.1/os-volumes/566b87d8-ce71-484a-95dd-702f951aff08 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:21.323165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:21.327385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:21.340533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:21.342702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.345433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.357324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.359661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.360903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.361737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.375419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:21.443458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:21.467843 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-49f4668e-935c-4344-83c0-7f8011165f6c tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "DELETE /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 204 len: 0 microversion: 2.1 time: 0.190791 Sep 07 10:00:21.473405 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1686/3394] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:00:21 2022] DELETE /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:21.488893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:21.490613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:21.505530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.506128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.506644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:21.507741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:21.508637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:21.509507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:22.023341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:22.063713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.076700 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c36fb14-ff63-4c75-bd1b-ccbe11b8f4bc tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1519 microversion: 2.1 time: 0.601297 Sep 07 10:00:22.079686 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1687/3395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:21 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1519 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:22.083578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.096785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.100241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.103330 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4481bbf-5836-4af1-ac39-f47633567337 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.784873 Sep 07 10:00:22.104622 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1709/3396] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:21 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:22.306192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:22.307070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:22.318280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:22.324437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:22.326235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:22.327298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:22.327784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:22.329881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:22.425048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:22.427157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:22.428983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:22.430393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lazy-loading 'fault' on Instance uuid 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:22.687854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.702014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.706194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:22.713031 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f4b86c51-1777-4775-a30c-908c52eff203 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 200 len: 1367 microversion: 2.47 time: 0.411026 Sep 07 10:00:22.742927 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1688/3397] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:22 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:23.100203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:23.100837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:23.114931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:23.115432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:23.115884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:23.116617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:23.126423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:23.127088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:23.130834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:23.131584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:23.153708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:23.155002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:23.158634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:23.159707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:23.160298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:23.162073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:23.956087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:23.976567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:23.979821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:23.984065 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-285275a1-f834-4cd2-ba24-26c9ecef7174 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.855774 Sep 07 10:00:23.985961 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1689/3398] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:23 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:24.005885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:24.006802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:24.019224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:24.020336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:24.021713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:24.023963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:24.028835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:24.029688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:24.126485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:24.127390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:24.128055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:24.128807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lazy-loading 'fault' on Instance uuid 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:24.371003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:24.379712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:24.381143 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c52cd588-dbc0-4b40-bb5d-b5b8e645a8c5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1519 microversion: 2.1 time: 1.284341 Sep 07 10:00:24.400537 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1710/3399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:23 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1519 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:24.417229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:24.421626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdda27dce4a04bbab7f98407ba1ea327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513f5dbaf46496ea925df77103fc06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:24.425999 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c17bcf4-dbc7-4bab-8dc9-d5f0ab994bc4 tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 200 len: 1367 microversion: 2.47 time: 0.436914 Sep 07 10:00:24.426782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-970b1dac-ce72-4340-b466-6c590e5e4108 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b180b040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:24.427457 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1690/3400] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:23 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:24.507441 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-970b1dac-ce72-4340-b466-6c590e5e4108 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a93d3336-5196-49a7-ab1d-2697f4b99314" status: 200 len: 350 microversion: 2.1 time: 0.105223 Sep 07 10:00:24.508254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1711/3401] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:00:24 2022] GET /compute/v2.1/os-volumes/a93d3336-5196-49a7-ab1d-2697f4b99314 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:24.523507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-111bd901-4fde-4e83-9862-f01665845980 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b134b790>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:24.705844 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-111bd901-4fde-4e83-9862-f01665845980 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.186375 Sep 07 10:00:24.707650 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1691/3402] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 7 10:00:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:24.726973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2c78b53-8d7f-47fb-aa4f-bf9b0ed4ec61 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b25ef820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:24.893733 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2c78b53-8d7f-47fb-aa4f-bf9b0ed4ec61 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.171889 Sep 07 10:00:24.894527 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1712/3403] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 7 10:00:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:24.910326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-da2bc165-8c18-4865-a9c7-1795f0b428e2 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b17f1310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.006507 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-da2bc165-8c18-4865-a9c7-1795f0b428e2 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100655 Sep 07 10:00:25.007343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1713/3404] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 7 10:00:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:25.023028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e72045f-48af-475d-8bbc-a0e1d37eaf93 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b1b82280>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.086596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53c08ac8-51fa-4e80-bf8f-392cc350cb24 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '.version_select at 0x7f14b134b4c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.167492 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e72045f-48af-475d-8bbc-a0e1d37eaf93 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.149643 Sep 07 10:00:25.168085 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1714/3405] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:00:25.182716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.183344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:25.193798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.194510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.195127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.196017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.197697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.198955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.218076 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-53c08ac8-51fa-4e80-bf8f-392cc350cb24 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f" status: 200 len: 371 microversion: 2.1 time: 0.369417 Sep 07 10:00:25.219027 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1692/3406] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 10:00:24 2022] GET /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f => generated 371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:25.225817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b9148f45-c1d2-43c1-a45e-00bfdd865a01 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b19a0940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.347761 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b9148f45-c1d2-43c1-a45e-00bfdd865a01 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127578 Sep 07 10:00:25.348558 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1693/3407] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:25.353368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Action: 'update', calling method: .version_select at 0x7f14b0c56940>, body: {"quota_set": {"ram": "5120"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:25.449966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.450794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.451360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.453220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.453887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.454490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.488726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:UPDATE=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:25.583668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d797b16-4e83-4f27-8951-948b689036c1 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f" status: 200 len: 328 microversion: 2.1 time: 0.233709 Sep 07 10:00:25.587156 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1694/3408] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 10:00:25 2022] PUT /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f => generated 328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:25.605892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6887f12a-7e82-45a5-96f8-ef4aff48fcd0 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b126e0d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.670440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:25.685725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:25.694236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:25.698642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b36f4839-287f-48c7-9a69-e9bfb941764f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.519729 Sep 07 10:00:25.700143 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1715/3409] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:25.705799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.706714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:25.717450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.718324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.719266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.720636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.721308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.721900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.782036 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6887f12a-7e82-45a5-96f8-ef4aff48fcd0 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184896 Sep 07 10:00:25.782985 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1695/3410] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:25.803355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9f0b7dc2-0e3c-44a9-b91e-9f8b5abbebca req-5435400a-9f39-4a30-801a-60dd69971c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e009df-4506-4ce7-89e0-cae9dc86149b", "name": "network-vif-deleted", "tag": "8b9ea828-efb1-498a-93a5-a1e7f93c8d59"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:25.820753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.823023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.825313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.827951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lazy-loading 'fault' on Instance uuid 96e009df-4506-4ce7-89e0-cae9dc86149b {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:25.850429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9f0b7dc2-0e3c-44a9-b91e-9f8b5abbebca req-5435400a-9f39-4a30-801a-60dd69971c70 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.851034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9f0b7dc2-0e3c-44a9-b91e-9f8b5abbebca req-5435400a-9f39-4a30-801a-60dd69971c70 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.852817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9f0b7dc2-0e3c-44a9-b91e-9f8b5abbebca req-5435400a-9f39-4a30-801a-60dd69971c70 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.888099 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9f0b7dc2-0e3c-44a9-b91e-9f8b5abbebca req-5435400a-9f39-4a30-801a-60dd69971c70 service nova] Creating event network-vif-deleted:8b9ea828-efb1-498a-93a5-a1e7f93c8d59 for instance 96e009df-4506-4ce7-89e0-cae9dc86149b on n-h2-836830-16 Sep 07 10:00:25.896801 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9f0b7dc2-0e3c-44a9-b91e-9f8b5abbebca req-5435400a-9f39-4a30-801a-60dd69971c70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112393 Sep 07 10:00:25.898356 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1696/3411] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:25.905055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.906174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] [instance: 1f87c72c-01d5-4b49-8bfe-9bc2bd360377] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:25.915772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.917358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.918224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.919222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:25.919932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:25.920769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:25.943301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] HTTP exception thrown: Instance 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 could not be found. Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Request method failure captured: Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 HTTP/1.1 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGtvmUyufx5gOqQ9K24JgWzbJQjXN0RC7bI7Eyj3XnwZvDMeEBYfyuML1HtWV930PA9PFTmAs0M_132C5y0Zwt0Diw9azR-W_YwS7fRVM6IzJjKGu8kOubfTp__BrGnan9V1W-CfwrjY0LM0boYXbnbfkxp-cphJZUOvxef1iA8fuSE Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.47 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 9513f5dbaf46496ea925df77103fc06b Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerShowV247Test-1695987518 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9513f5dbaf46496ea925df77103fc06b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9513f5dbaf46496ea925df77103fc06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9513f5dbaf46496ea925df77103fc06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9513f5dbaf46496ea925df77103fc06b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerShowV247Test-1695987518 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 9513f5dbaf46496ea925df77103fc06b Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerShowV247Test-1695987518 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerShowV247Test-1695987518-project Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fdda27dce4a04bbab7f98407ba1ea327 Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerShowV247Test-1695987518-project Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 could not be found. Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1f87c72c-01d5-4b49-8bfe-9bc2bd360377'} Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 could not be found. Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 could not be found. Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:25.945596 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 could not be found. Sep 07 10:00:25.951187 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:25.953540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:25.954948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] Returning 404 to user: Instance 1f87c72c-01d5-4b49-8bfe-9bc2bd360377 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:25.955159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-243a9e3f-35f1-4d44-85a8-8d21d6172ece tempest-ServerShowV247Test-1695987518 tempest-ServerShowV247Test-1695987518-project] 10.222.0.60 "GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377" status: 404 len: 111 microversion: 2.47 time: 0.055315 Sep 07 10:00:25.959116 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1697/3412] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/servers/1f87c72c-01d5-4b49-8bfe-9bc2bd360377 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:00:25.962832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36444082-c9e6-4c5c-930f-5a22ea659182 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 200 len: 1311 microversion: 2.1 time: 0.260849 Sep 07 10:00:25.963632 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1716/3413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:25.968873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5475ce99-0c7e-41fe-919b-d868ff19db02 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.984941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2895073-718e-4455-afe0-72a094ad5a1e tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b1adb4c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:25.997850 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5475ce99-0c7e-41fe-919b-d868ff19db02 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f" status: 202 len: 0 microversion: 2.1 time: 0.041148 Sep 07 10:00:25.998479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1698/3414] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:00:25 2022] DELETE /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:00:26.153344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-da278b60-e44e-4bf5-b1eb-b295f62192e0 req-b4db2b35-0174-429f-a582-51962545cfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109f562a-8111-4417-958e-25e80d45b929", "name": "network-vif-plugged", "status": "completed", "tag": "9a389bf3-582e-4b45-a7df-003822914506"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:26.182976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-da278b60-e44e-4bf5-b1eb-b295f62192e0 req-b4db2b35-0174-429f-a582-51962545cfc6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:26.186421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-da278b60-e44e-4bf5-b1eb-b295f62192e0 req-b4db2b35-0174-429f-a582-51962545cfc6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:26.187303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-da278b60-e44e-4bf5-b1eb-b295f62192e0 req-b4db2b35-0174-429f-a582-51962545cfc6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:26.219588 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2895073-718e-4455-afe0-72a094ad5a1e tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.238516 Sep 07 10:00:26.221045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1717/3415] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Sep 7 10:00:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:26.231780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-da278b60-e44e-4bf5-b1eb-b295f62192e0 req-b4db2b35-0174-429f-a582-51962545cfc6 service nova] Creating event network-vif-plugged:9a389bf3-582e-4b45-a7df-003822914506 for instance 109f562a-8111-4417-958e-25e80d45b929 on n-h1-836830-16 Sep 07 10:00:26.235945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d9a4419-03aa-4154-b94e-0544ba9ac1b6 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '.version_select at 0x7f14b1264700>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:26.259533 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-da278b60-e44e-4bf5-b1eb-b295f62192e0 req-b4db2b35-0174-429f-a582-51962545cfc6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258848 Sep 07 10:00:26.260154 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1699/3416] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:26.272991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13a0b84f-ed92-429e-99a9-c70af819ba03 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] Calling method '.version_select at 0x7f14b0c991f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:26.555210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13a0b84f-ed92-429e-99a9-c70af819ba03 tempest-VolumesTestJSON-224083848 tempest-VolumesTestJSON-224083848-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.293838 Sep 07 10:00:26.556467 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1700/3417] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 10:00:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:26.648422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:26.661333 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d9a4419-03aa-4154-b94e-0544ba9ac1b6 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f" status: 200 len: 371 microversion: 2.1 time: 0.438736 Sep 07 10:00:26.666785 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1718/3418] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 10:00:26 2022] GET /compute/v2.1/os-quota-sets/303c75c211614cebb81a8d91dc78313f => generated 371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:26.728556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:26.729204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:26.747314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:26.748249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:26.748878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:26.749847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:26.750708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:26.751512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:26.980059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b56b7de1-6e90-400b-85b4-f78de7764062 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '.version_select at 0x7f14b17bddc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:27.210997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:27.220091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:27.226629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:27.228580 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89e44908-360d-445b-b430-da80f0dbcfff tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.503940 Sep 07 10:00:27.231393 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1701/3419] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:26 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:27.244274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:27.249796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 96e009df-4506-4ce7-89e0-cae9dc86149b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:27.258173 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b56b7de1-6e90-400b-85b4-f78de7764062 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.282220 Sep 07 10:00:27.268785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.270457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.271150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.272136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.272855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.273584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.280581 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1719/3420] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:00:26 2022] GET /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4/defaults => generated 371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:00:27.302329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] HTTP exception thrown: Instance 96e009df-4506-4ce7-89e0-cae9dc86149b could not be found. Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Request method failure captured: Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b HTTP/1.1 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGtq0giFfIXJ0DFSn-TockFLrszSFl4mg5j2XY_02sfZhYpwKwUSt3ope9u_AyXc88qd8S82acoQ1mqj_Uzjndh3txaRc1nqA5CpS4gkkbCMX_CGdyICuYkYxlcVTZTrnA4o21nG4e-kTBGppvM5QW8hqwSRwdppnqA8AtmB86twjUo Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: ccd771f0096f47edb69e93f4c80771de Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ccd771f0096f47edb69e93f4c80771de", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: ccd771f0096f47edb69e93f4c80771de Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServerFiltersTestJSON-1478384019-project Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0ac570950aec4d919c8ed8543fa0d3c9 Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServerFiltersTestJSON-1478384019-project Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 96e009df-4506-4ce7-89e0-cae9dc86149b could not be found. Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '96e009df-4506-4ce7-89e0-cae9dc86149b'} Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e009df-4506-4ce7-89e0-cae9dc86149b could not be found. Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e009df-4506-4ce7-89e0-cae9dc86149b could not be found. Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:27.309236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e009df-4506-4ce7-89e0-cae9dc86149b could not be found. Sep 07 10:00:27.313711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:27.316677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Returning 404 to user: Instance 96e009df-4506-4ce7-89e0-cae9dc86149b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:27.320894 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-18f971cb-7e32-42e4-a15c-f0b8ca36307d tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b" status: 404 len: 111 microversion: 2.1 time: 0.088204 Sep 07 10:00:27.323165 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1702/3421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:27 2022] GET /compute/v2.1/servers/96e009df-4506-4ce7-89e0-cae9dc86149b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:00:27.333969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:27.334774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:27.351601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.353544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.357710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.365866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.366909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.367676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.411646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:27.465644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:27.592482 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-198d4397-91ab-4dac-b481-bbaa80489d91 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "DELETE /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 204 len: 0 microversion: 2.1 time: 0.264189 Sep 07 10:00:27.594697 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1720/3422] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:00:27 2022] DELETE /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:00:27.603226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:27.603846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:27.615592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.616390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.620485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.621401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.622067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.622611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.684012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Action: 'update', calling method: .version_select at 0x7f14b17f1310>, body: {"quota_set": {"ram": "5120"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:27.892789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.895221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.898424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:27.899166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:27.900687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:27.901286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:28.036415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4a7f03c-8036-44c2-a6dd-5f50753b6b25 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0" status: 200 len: 328 microversion: 2.1 time: 0.357708 Sep 07 10:00:28.046243 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1721/3423] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 10:00:27 2022] PUT /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0 => generated 328 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:28.052158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '.version_select at 0x7f14b17bdaf0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:28.348991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:28.350028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:28.350568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:28.351448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:28.354557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:28.355121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:28.390418 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93d7372b-b563-456d-acc8-1b2f848e8beb tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0/detail" status: 200 len: 916 microversion: 2.1 time: 0.342497 Sep 07 10:00:28.407475 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1722/3424] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 10:00:28 2022] GET /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0/detail => generated 916 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:28.419285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:28.420786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:28.433250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:28.437272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:28.438742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:28.439748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:28.442135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:28.446736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:28.669117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:28.682560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ccf680dc-f784-4dbf-96d4-a6056d4e079e tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 200 len: 1518 microversion: 2.1 time: 1.083644 Sep 07 10:00:28.693248 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1703/3425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:27 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 1518 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:28.834106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Action: 'update', calling method: .version_select at 0x7f14b1ec3790>, body: {"quota_set": {"ram": "2048"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:28.881813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:28.896000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:28.897517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:28.905128 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31a45c3a-a747-418d-9928-197429953dde tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1358 microversion: 2.21 time: 0.494556 Sep 07 10:00:28.906472 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1723/3426] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:28 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1358 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:29.089717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.089983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:29.110086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:29.115303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.116109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:29.119820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:29.251803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.252545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:29.254540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:29.255600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.258326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:29.262261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:29.425161 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57625d56-303d-4a7f-b8e3-b7f1ab752cd7 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0?user_id=6b284c516f0b48a3b759dfa774ffab67" status: 200 len: 328 microversion: 2.1 time: 0.586741 Sep 07 10:00:29.426453 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1704/3427] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:00:28 2022] PUT /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0?user_id=6b284c516f0b48a3b759dfa774ffab67 => generated 328 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:00:29.442665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa67aec2-b0c9-4a57-b2fd-e3aadca184f3 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '.version_select at 0x7f14b1adbf70>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:29.707642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:29.708977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:29.730934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.731562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:29.732277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:29.733264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.733976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:29.735410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:29.928000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aa67aec2-b0c9-4a57-b2fd-e3aadca184f3 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0?user_id=6b284c516f0b48a3b759dfa774ffab67" status: 200 len: 370 microversion: 2.1 time: 0.488134 Sep 07 10:00:29.929196 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1724/3428] 10.222.0.60 () {58 vars in 1323 bytes} [Wed Sep 7 10:00:29 2022] GET /compute/v2.1/os-quota-sets/796053f6381f4e959a990f79a9d26ae0?user_id=6b284c516f0b48a3b759dfa774ffab67 => generated 370 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:29.955207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:29.956252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:29.986667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:29.992142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:30.003190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:30.006636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:30.008280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:30.010413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:30.613267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:30.627023 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcf16e8d-3ccf-49af-9b0a-5f44c7ae8ad5 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 200 len: 1518 microversion: 2.1 time: 0.923732 Sep 07 10:00:30.628816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1705/3429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:29 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 1518 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:30.667766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3ecf9812-a619-4fe9-8bd6-f42c30d86f10 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Calling method '.version_select at 0x7f14b0bf51f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:30.707568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:30.724974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:30.726472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:30.728271 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e323f12-f918-44f1-8631-e41cfd0be26d tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1550 microversion: 2.21 time: 0.784306 Sep 07 10:00:30.728847 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1725/3430] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:29 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1550 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:30.754249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:30.754756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:30.774946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:30.775446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:30.775890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:30.776603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:30.777056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:30.780241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:30.843799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:31.083825 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-045f61f9-8505-4e7a-ae37-ba5bc595052f tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 204 len: 0 microversion: 2.21 time: 0.332098 Sep 07 10:00:31.085688 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1726/3431] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:00:30 2022] DELETE /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:00:31.099257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cc478051-1f38-4320-9a74-01e066e5d9d7 req-b6261cfc-00f4-4a65-b5cd-ce7d7dd9ccaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b33289-890e-4c7a-a076-234e7732e92e", "name": "network-vif-deleted", "tag": "26d8a2ef-d142-4b97-a6ed-91de5398da33"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:31.126839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc478051-1f38-4320-9a74-01e066e5d9d7 req-b6261cfc-00f4-4a65-b5cd-ce7d7dd9ccaf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.128532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc478051-1f38-4320-9a74-01e066e5d9d7 req-b6261cfc-00f4-4a65-b5cd-ce7d7dd9ccaf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.129093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc478051-1f38-4320-9a74-01e066e5d9d7 req-b6261cfc-00f4-4a65-b5cd-ce7d7dd9ccaf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.151346 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cc478051-1f38-4320-9a74-01e066e5d9d7 req-b6261cfc-00f4-4a65-b5cd-ce7d7dd9ccaf service nova] Creating event network-vif-deleted:26d8a2ef-d142-4b97-a6ed-91de5398da33 for instance 17b33289-890e-4c7a-a076-234e7732e92e on n-h1-836830-16 Sep 07 10:00:31.168708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cc478051-1f38-4320-9a74-01e066e5d9d7 req-b6261cfc-00f4-4a65-b5cd-ce7d7dd9ccaf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081276 Sep 07 10:00:31.171044 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1727/3432] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:31.177827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:31.179303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:31.194176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.195035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.195668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.197467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.198290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.198881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.210059 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3ecf9812-a619-4fe9-8bd6-f42c30d86f10 tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.549116 Sep 07 10:00:31.211615 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1706/3433] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:00:30 2022] GET /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4/defaults => generated 371 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:31.226795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Action: 'update', calling method: .version_select at 0x7f14b0c00dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:31.332492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.333460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.334126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.335048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.335690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.336290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.733064 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99d0ab6c-2f82-4d6d-8892-21a5cc58d4fc tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4" status: 200 len: 329 microversion: 2.1 time: 0.511325 Sep 07 10:00:31.735320 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1707/3434] 10.222.0.60 () {60 vars in 1263 bytes} [Wed Sep 7 10:00:31 2022] PUT /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4 => generated 329 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:31.741629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:31.742859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:31.751359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.752252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.753126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.754089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.754328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:31.755534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.756178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.767861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:31.769431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:31.770861 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6680eb97-d190-4482-8e8e-73fa1812edb4 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1556 microversion: 2.21 time: 0.598198 Sep 07 10:00:31.777883 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1728/3435] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:31 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1556 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:31.783059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Action: 'update', calling method: .version_select at 0x7f14b5f23040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:31.837931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.842577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.843286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.843784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lazy-loading 'fault' on Instance uuid 17b33289-890e-4c7a-a076-234e7732e92e {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:31.936293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.936783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.937252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:31.937994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:31.938455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:31.938887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:32.068971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:32.094934 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1c22a960-f143-4fe7-a0be-6a36b1ee4326 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 200 len: 1310 microversion: 2.1 time: 0.345590 Sep 07 10:00:32.096529 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1708/3436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:31 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:32.460785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=11,nova_api:INSERT=11 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:32.665555 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8cb60f0-b8fd-4b86-9175-37972d6ffdfd tempest-QuotasAdminTestJSON-136261867 tempest-QuotasAdminTestJSON-136261867-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4" status: 200 len: 329 microversion: 2.1 time: 0.885377 Sep 07 10:00:32.670349 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1729/3437] 10.222.0.60 () {60 vars in 1263 bytes} [Wed Sep 7 10:00:31 2022] PUT /compute/v2.1/os-quota-sets/5ba8719c185e4060a4209cfd502c8ac4 => generated 329 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:32.803250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:32.804612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:32.819830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:32.820326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:32.820796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:32.822344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:32.822804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:32.823232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.121515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:33.122827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: 17b33289-890e-4c7a-a076-234e7732e92e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:33.141160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:33.143586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:33.145420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.147434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:33.147434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:33.147813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.172182 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] HTTP exception thrown: Instance 17b33289-890e-4c7a-a076-234e7732e92e could not be found. Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Request method failure captured: Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e HTTP/1.1 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGtq0giFfIXJ0DFSn-TockFLrszSFl4mg5j2XY_02sfZhYpwKwUSt3ope9u_AyXc88qd8S82acoQ1mqj_Uzjndh3txaRc1nqA5CpS4gkkbCMX_CGdyICuYkYxlcVTZTrnA4o21nG4e-kTBGppvM5QW8hqwSRwdppnqA8AtmB86twjUo Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ccd771f0096f47edb69e93f4c80771de Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ccd771f0096f47edb69e93f4c80771de", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ccd771f0096f47edb69e93f4c80771de Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListServerFiltersTestJSON-1478384019-project Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0ac570950aec4d919c8ed8543fa0d3c9 Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListServerFiltersTestJSON-1478384019-project Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 17b33289-890e-4c7a-a076-234e7732e92e could not be found. Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '17b33289-890e-4c7a-a076-234e7732e92e'} Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b33289-890e-4c7a-a076-234e7732e92e could not be found. Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b33289-890e-4c7a-a076-234e7732e92e could not be found. Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:33.174812 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b33289-890e-4c7a-a076-234e7732e92e could not be found. Sep 07 10:00:33.180158 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:33.185736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Returning 404 to user: Instance 17b33289-890e-4c7a-a076-234e7732e92e could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:33.186996 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b381a368-0c8c-4e6a-9376-db7f0e9fe8ba tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e" status: 404 len: 111 microversion: 2.1 time: 0.070877 Sep 07 10:00:33.188073 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1730/3438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:33 2022] GET /compute/v2.1/servers/17b33289-890e-4c7a-a076-234e7732e92e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:00:33.202428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:33.203414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:33.210986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:33.212242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:33.213052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.214404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:33.214980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:33.215681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.260098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:00:33.419932 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2de728f-3ca7-4300-8b89-20e0ad9198ac tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 204 len: 0 microversion: 2.1 time: 0.224659 Sep 07 10:00:33.420538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1731/3439] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:00:33 2022] DELETE /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:33.434129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:33.434857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:33.448854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:33.449384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:33.449832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.450546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:33.451007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:33.451436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:33.505474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:33.516829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:33.519070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:33.520808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-adad15a7-40ef-4462-9e9d-05c662098462 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1556 microversion: 2.21 time: 0.721415 Sep 07 10:00:33.522025 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1709/3440] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:32 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1556 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:33.779738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:33.787942 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ae55e291-f6f5-435a-854b-421c61e346cb tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1518 microversion: 2.1 time: 0.362676 Sep 07 10:00:33.791615 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1732/3441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:33 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:34.106622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-864e7bdf-e369-434d-a2b8-91ee45a8890b req-7a756564-1c11-4e80-be13-45af63489c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109f562a-8111-4417-958e-25e80d45b929", "name": "network-vif-deleted", "tag": "9a389bf3-582e-4b45-a7df-003822914506"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:34.126327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-864e7bdf-e369-434d-a2b8-91ee45a8890b req-7a756564-1c11-4e80-be13-45af63489c4d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:34.127191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-864e7bdf-e369-434d-a2b8-91ee45a8890b req-7a756564-1c11-4e80-be13-45af63489c4d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:34.127977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-864e7bdf-e369-434d-a2b8-91ee45a8890b req-7a756564-1c11-4e80-be13-45af63489c4d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:34.153890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-864e7bdf-e369-434d-a2b8-91ee45a8890b req-7a756564-1c11-4e80-be13-45af63489c4d service nova] Creating event network-vif-deleted:9a389bf3-582e-4b45-a7df-003822914506 for instance 109f562a-8111-4417-958e-25e80d45b929 on n-h1-836830-16 Sep 07 10:00:34.163929 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-864e7bdf-e369-434d-a2b8-91ee45a8890b req-7a756564-1c11-4e80-be13-45af63489c4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061322 Sep 07 10:00:34.197726 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1710/3442] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:34.552152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:34.552836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:34.570045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:34.571198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:34.572588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:34.573823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:34.574288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:34.575051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:34.664305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:34.665627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:34.668799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:34.669346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lazy-loading 'fault' on Instance uuid 109f562a-8111-4417-958e-25e80d45b929 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:00:34.822021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:34.823040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:34.827552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=16,nova_api:DELETE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:34.847401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:34.851961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:34.853901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:34.855929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:34.857404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:34.861937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:35.522502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:35.531330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:35.533198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbed9a3e044149c58ab45d4249fc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22d9ee58994b49ec8484555c36ad3ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:35.534589 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-118e9228-51d6-4114-8025-4cb9dde99724 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 200 len: 1348 microversion: 2.21 time: 0.988780 Sep 07 10:00:35.535656 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1733/3443] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:34 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 1348 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:35.885218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:35.902979 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e0e9cb5-e776-49f8-ac3c-2deccacbf710 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1518 microversion: 2.1 time: 1.086562 Sep 07 10:00:35.903566 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1711/3444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:34 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1518 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:36.565002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:36.565658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:36.607253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:36.607817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:36.610403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:36.611381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:36.614424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:36.615335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:36.684510 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] HTTP exception thrown: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Request method failure captured: Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 HTTP/1.1 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGumjdmaylRTtU0MOT9HSgOVbKn5iPcyUxz6r07W-8XQ26vyzGPnW1Or1JLnRVGGPNARXmw765PKjGaedok2WB7QhgtRPfqGYrzjTcH4H8Dcgtw8HrzzZ8jY46nZ5c8gVVOzmWh5fwnTvPUeX9dEERbiNyQwguCrN5KGS8MDRn_zJB8 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.21 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 22d9ee58994b49ec8484555c36ad3ff7 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9ee58994b49ec8484555c36ad3ff7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 22d9ee58994b49ec8484555c36ad3ff7 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-InstanceActionsV221TestJSON-1137841969-project Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: dbed9a3e044149c58ab45d4249fc258b Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-InstanceActionsV221TestJSON-1137841969-project Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '109f562a-8111-4417-958e-25e80d45b929'} Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:36.691027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:36.696474 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:36.698756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Returning 404 to user: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:36.699838 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3981bf3-58f7-4dd2-ab54-4b4d4e02005e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 404 len: 111 microversion: 2.21 time: 0.141888 Sep 07 10:00:36.702692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1734/3445] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:36 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:00:36.713854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '.version_select at 0x7f14b0c56670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:36.715063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:36.729006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:36.732176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:36.733605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:36.734489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:36.735374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:36.737155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:36.929576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:36.930584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:36.943031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:36.945166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:36.951708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c1e847f-72f4-4133-a2ff-588605ee2f92 tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.244298 Sep 07 10:00:36.952423 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1712/3446] 10.222.0.60 () {60 vars in 1337 bytes} [Wed Sep 7 10:00:36 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929/os-instance-actions => generated 611 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:00:36.953273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:36.953731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:36.954473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:36.954931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:36.955545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:36.984129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:36.985107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:37.014622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:37.019993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:37.020766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:37.022967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:37.025874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:37.027677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:37.084499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] HTTP exception thrown: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Request method failure captured: Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 HTTP/1.1 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGumjdmaylRTtU0MOT9HSgOVbKn5iPcyUxz6r07W-8XQ26vyzGPnW1Or1JLnRVGGPNARXmw765PKjGaedok2WB7QhgtRPfqGYrzjTcH4H8Dcgtw8HrzzZ8jY46nZ5c8gVVOzmWh5fwnTvPUeX9dEERbiNyQwguCrN5KGS8MDRn_zJB8 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.21 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 22d9ee58994b49ec8484555c36ad3ff7 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9ee58994b49ec8484555c36ad3ff7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 22d9ee58994b49ec8484555c36ad3ff7 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-InstanceActionsV221TestJSON-1137841969-project Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: dbed9a3e044149c58ab45d4249fc258b Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-InstanceActionsV221TestJSON-1137841969-project Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '109f562a-8111-4417-958e-25e80d45b929'} Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:37.096300 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.101549 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.103736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Returning 404 to user: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:37.104774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-53bc20c9-520f-496f-94ea-a5d15e38043e tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 404 len: 111 microversion: 2.21 time: 0.143032 Sep 07 10:00:37.105652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1713/3447] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:00:36 2022] DELETE /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:00:37.114143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:37.114968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] [instance: 109f562a-8111-4417-958e-25e80d45b929] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:37.129433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:37.135041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:37.137357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:37.138309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:37.138949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:37.139561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:37.183355 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] HTTP exception thrown: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Request method failure captured: Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 HTTP/1.1 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGumjdmaylRTtU0MOT9HSgOVbKn5iPcyUxz6r07W-8XQ26vyzGPnW1Or1JLnRVGGPNARXmw765PKjGaedok2WB7QhgtRPfqGYrzjTcH4H8Dcgtw8HrzzZ8jY46nZ5c8gVVOzmWh5fwnTvPUeX9dEERbiNyQwguCrN5KGS8MDRn_zJB8 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.21 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 22d9ee58994b49ec8484555c36ad3ff7 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/22d9ee58994b49ec8484555c36ad3ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_22d9ee58994b49ec8484555c36ad3ff7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 22d9ee58994b49ec8484555c36ad3ff7 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1137841969 Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-InstanceActionsV221TestJSON-1137841969-project Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: dbed9a3e044149c58ab45d4249fc258b Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-InstanceActionsV221TestJSON-1137841969-project Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '109f562a-8111-4417-958e-25e80d45b929'} Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.188346 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:00:37.193845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] Returning 404 to user: Instance 109f562a-8111-4417-958e-25e80d45b929 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:37.198442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab2de987-f040-4351-b474-2e507aed5efe tempest-InstanceActionsV221TestJSON-1137841969 tempest-InstanceActionsV221TestJSON-1137841969-project] 10.222.0.60 "GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929" status: 404 len: 111 microversion: 2.21 time: 0.088382 Sep 07 10:00:37.199030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1714/3448] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:37 2022] GET /compute/v2.1/servers/109f562a-8111-4417-958e-25e80d45b929 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:00:37.350169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac570950aec4d919c8ed8543fa0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd771f0096f47edb69e93f4c80771de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:37.364425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4dd4d7a0-0d06-4205-8d25-65ad1613a1bf tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 200 len: 1476 microversion: 2.1 time: 0.441371 Sep 07 10:00:37.372194 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1735/3449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:36 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:37.415126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f662c181-f5eb-48a6-b2d3-2cc2be6a1fa4 req-f6a38738-55cf-47a0-b8c7-6330ab459156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97f3cff-8a42-4913-b243-4f367a9b64da", "name": "network-vif-deleted", "tag": "267dd117-6168-4faf-b836-8b40e724b438"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:37.439431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f662c181-f5eb-48a6-b2d3-2cc2be6a1fa4 req-f6a38738-55cf-47a0-b8c7-6330ab459156 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:37.440022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f662c181-f5eb-48a6-b2d3-2cc2be6a1fa4 req-f6a38738-55cf-47a0-b8c7-6330ab459156 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:37.440570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f662c181-f5eb-48a6-b2d3-2cc2be6a1fa4 req-f6a38738-55cf-47a0-b8c7-6330ab459156 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:37.476880 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f662c181-f5eb-48a6-b2d3-2cc2be6a1fa4 req-f6a38738-55cf-47a0-b8c7-6330ab459156 service nova] Creating event network-vif-deleted:267dd117-6168-4faf-b836-8b40e724b438 for instance e97f3cff-8a42-4913-b243-4f367a9b64da on n-h2-836830-16 Sep 07 10:00:37.495662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f662c181-f5eb-48a6-b2d3-2cc2be6a1fa4 req-f6a38738-55cf-47a0-b8c7-6330ab459156 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098372 Sep 07 10:00:37.507047 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1715/3450] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:38.397857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:38.399668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] [instance: e97f3cff-8a42-4913-b243-4f367a9b64da] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:38.420453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:38.420976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:38.421456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:38.422619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:38.425441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:38.427378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:38.476338 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] HTTP exception thrown: Instance e97f3cff-8a42-4913-b243-4f367a9b64da could not be found. Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Request method failure captured: Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da HTTP/1.1 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGtq0giFfIXJ0DFSn-TockFLrszSFl4mg5j2XY_02sfZhYpwKwUSt3ope9u_AyXc88qd8S82acoQ1mqj_Uzjndh3txaRc1nqA5CpS4gkkbCMX_CGdyICuYkYxlcVTZTrnA4o21nG4e-kTBGppvM5QW8hqwSRwdppnqA8AtmB86twjUo Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ccd771f0096f47edb69e93f4c80771de Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd771f0096f47edb69e93f4c80771de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ccd771f0096f47edb69e93f4c80771de", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ccd771f0096f47edb69e93f4c80771de Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1478384019 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListServerFiltersTestJSON-1478384019-project Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0ac570950aec4d919c8ed8543fa0d3c9 Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListServerFiltersTestJSON-1478384019-project Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e97f3cff-8a42-4913-b243-4f367a9b64da could not be found. Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e97f3cff-8a42-4913-b243-4f367a9b64da'} Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97f3cff-8a42-4913-b243-4f367a9b64da could not be found. Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97f3cff-8a42-4913-b243-4f367a9b64da could not be found. Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:00:38.478195 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97f3cff-8a42-4913-b243-4f367a9b64da could not be found. Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] Returning 404 to user: Instance e97f3cff-8a42-4913-b243-4f367a9b64da could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:00:38.482660 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a759498f-2a73-4cfc-a6a3-162ece2a2803 tempest-ListServerFiltersTestJSON-1478384019 tempest-ListServerFiltersTestJSON-1478384019-project] 10.222.0.60 "GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da" status: 404 len: 111 microversion: 2.1 time: 0.088449 Sep 07 10:00:38.489126 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1736/3451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:38 2022] GET /compute/v2.1/servers/e97f3cff-8a42-4913-b243-4f367a9b64da => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:00:40.656073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1268279490", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:40.782698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:00:40.783054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:00:40.783536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:00:40.784050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:00:40.804127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:00:40.815641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:40.816135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:40.816713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:40.817633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:40.818244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:40.818675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:40.871295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Getting quotas for project aa2e8eba59c64f43aa53b66273458623. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:40.893106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Getting quotas for user d5c52784223c4be3856246d12927ca09 and project aa2e8eba59c64f43aa53b66273458623. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:40.934379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:00:40.938426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:00:41.072017 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a618edf8-1e63-4440-b4de-8d0cbabdd7b6 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.090435 Sep 07 10:00:41.084512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f59b2fa-1900-4c8c-9f25-6f127051bfeb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:41.088876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f59b2fa-1900-4c8c-9f25-6f127051bfeb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:41.097622 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1716/3452] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 10:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 10:00:41.338465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f59b2fa-1900-4c8c-9f25-6f127051bfeb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:41.341137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=53 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:41.354235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f59b2fa-1900-4c8c-9f25-6f127051bfeb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:41.370531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f59b2fa-1900-4c8c-9f25-6f127051bfeb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:41.384394 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f59b2fa-1900-4c8c-9f25-6f127051bfeb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "PUT /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1359 microversion: 2.75 time: 0.303226 Sep 07 10:00:41.391900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1737/3453] 10.222.0.60 () {62 vars in 1297 bytes} [Wed Sep 7 10:00:41 2022] PUT /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:41.421319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d7f097c-0b6d-4f9f-808f-0321c334c7a5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:41.421930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d7f097c-0b6d-4f9f-808f-0321c334c7a5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:41.506018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d7f097c-0b6d-4f9f-808f-0321c334c7a5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:41.514485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d7f097c-0b6d-4f9f-808f-0321c334c7a5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:41.517050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d7f097c-0b6d-4f9f-808f-0321c334c7a5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:41.523649 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d7f097c-0b6d-4f9f-808f-0321c334c7a5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1359 microversion: 2.75 time: 0.107353 Sep 07 10:00:41.526020 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1717/3454] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:41 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1359 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:42.560510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:42.561976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:42.574179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=24 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:42.591065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:42.592141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:42.593119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:42.594101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:42.594821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:42.595499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:42.726127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:42.740361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:42.742224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:42.754835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0a898dac-1f68-4130-898f-047cad011618 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1411 microversion: 2.75 time: 0.199361 Sep 07 10:00:42.756411 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1738/3455] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:42 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1411 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:43.786448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:43.787608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:43.799029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:43.800222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:43.814224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:43.815617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:43.816461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:43.817062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:43.963103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:43.972030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:43.980680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:43.991550 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-521f4910-4106-4d76-a51a-e0e2b24c67e7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1417 microversion: 2.75 time: 0.211183 Sep 07 10:00:43.992527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1718/3456] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:43 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1417 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:45.027787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:45.029232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:45.044804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:45.046190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:45.047084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:45.048807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:45.070492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:45.074824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:45.147327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:45.269984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:45.287086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:45.290314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:45.304251 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0856ae96-6b6e-4925-8667-ee8823f28e5f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1417 microversion: 2.75 time: 0.283364 Sep 07 10:00:45.306281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1739/3457] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:45 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1417 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:46.344887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:46.346805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:46.358798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:46.359583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:46.361164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:46.367361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:46.369592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:46.370058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:46.861250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:46.901600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:46.903324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:46.932052 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3ec6937c-d08c-49c3-a483-b5499de5fde3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1438 microversion: 2.75 time: 0.597532 Sep 07 10:00:46.945690 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1719/3458] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:46 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1438 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:47.016139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:47.020543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:47.030257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:47.031125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:47.031850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:47.032808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:47.033741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:47.034420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:47.210156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:00:47.213278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:00:47.214055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:00:47.214691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:00:47.215775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:00:47.424599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:47.448634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:47.449365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:47.449970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:47.450700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:47.451157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:47.451585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:47.841312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:47.854791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:47.856264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:47.881702 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b082fdc-623d-48c6-b736-365f12046d74 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "POST /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21/action" status: 202 len: 1495 microversion: 2.75 time: 0.907868 Sep 07 10:00:47.887813 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1740/3459] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:00:46 2022] POST /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21/action => generated 1495 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 10:00:47.925988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:47.927638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:47.942500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:47.944518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:47.946413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:47.949492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:47.952425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:47.954399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:48.229638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-139123374", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:48.243205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:48.263896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:48.265422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:48.280192 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c7616b0-38da-4cf1-82f8-7dd9ba257efd tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.364809 Sep 07 10:00:48.284592 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1741/3460] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:47 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:00:48.320109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] validate_networks() for [('ffb7e619-ff58-4e6d-bd05-cbb26b7295a0', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:00:49.325127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:49.325806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:49.339936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:49.340425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:49.340859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:49.341609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:49.342051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:49.342480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:49.627626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:49.662625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:49.671832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:49.707161 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42d0848c-7cc7-4ed7-8846-04a0c93da386 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.386940 Sep 07 10:00:49.711265 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1742/3461] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:49 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:49.805896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:00:49.806978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:00:49.807911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:00:49.808925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:00:49.809802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:00:49.829113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:49.830590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:49.831177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:49.833539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:49.834460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:49.836046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:49.865899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Getting quotas for project 717c98a794074ebcae407bb25e06fd41. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:49.875816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Getting quotas for user da075a784e1a40fd97c186fed2c3b2a0 and project 717c98a794074ebcae407bb25e06fd41. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:49.902704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:00:49.907072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:00:50.038315 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd47d9b4-33d8-487f-8a88-5fe566c7aae0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.491028 Sep 07 10:00:50.039793 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1720/3462] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:00:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:00:50.054457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a940ff43-82da-4b8a-966b-876961e2735d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:50.057789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a940ff43-82da-4b8a-966b-876961e2735d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:50.179494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a940ff43-82da-4b8a-966b-876961e2735d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:50.190785 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a940ff43-82da-4b8a-966b-876961e2735d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1216 microversion: 2.1 time: 0.142802 Sep 07 10:00:50.192773 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1743/3463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:50 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:50.747033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:50.747766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:50.764107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:50.765961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:50.768204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:50.770953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:50.771684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:50.772308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:50.949597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:50.976471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:50.990501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:51.010496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a48c0d6d-157f-4bce-984b-04904ca53071 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.268470 Sep 07 10:00:51.012340 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1721/3464] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:50 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:51.216244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:51.217377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:51.227882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:51.233092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:51.234378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:51.235118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:51.235617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:51.236047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:51.452035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:51.466988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3efaf7c-bb57-484e-9b38-8209102a7fa4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1212 microversion: 2.1 time: 0.254436 Sep 07 10:00:51.469044 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1744/3465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:51 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1212 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:52.042752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:52.043366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:52.082089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:52.082596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:52.086237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:52.087576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:52.101035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:52.101709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:52.440725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:52.458399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:52.462598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:52.490471 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de62f24c-b882-447e-99dc-31b3a8d6bb77 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.449305 Sep 07 10:00:52.494287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:52.495450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:52.505751 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1722/3466] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:52 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:52.526570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:52.532081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:52.534375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:52.536400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:52.542106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:52.544174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:52.972042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:52.981105 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab1f00ff-d765-493a-b266-2ddc3648379c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1274 microversion: 2.1 time: 0.491347 Sep 07 10:00:52.981743 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1745/3467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:52 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1274 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:53.523836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:53.525035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:53.542255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:53.542745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:53.543184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:53.543899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:53.544359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:53.557582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:53.973282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:53.995369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:54.024622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:54.026021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:54.029668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:54.048907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:54.064401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:54.067826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:54.069071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:54.072043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc571fee-2f54-435a-9f78-5fc60e1455e1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.552418 Sep 07 10:00:54.073671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:54.078543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1723/3468] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:53 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:54.089390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:54.457126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:54.469974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2dcd32ff-dfa0-49ff-a268-b0e0f8c90d58 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1274 microversion: 2.1 time: 0.456745 Sep 07 10:00:54.471209 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1746/3469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:54 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1274 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:55.109685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:55.110320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:55.142070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcd5005e-2e03-4916-b8af-db01403a6b77 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Action: 'create', calling method: .version_select at 0x7f14b0c0cdc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1573005028", "policies": ["affinity"]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:55.151522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:55.155921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:55.159157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:55.163826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:55.166996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:55.172885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:55.229723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=71 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:55.238529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fcd5005e-2e03-4916-b8af-db01403a6b77 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:55.267439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fcd5005e-2e03-4916-b8af-db01403a6b77 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:55.376124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fcd5005e-2e03-4916-b8af-db01403a6b77 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:55.382722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fcd5005e-2e03-4916-b8af-db01403a6b77 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:55.443131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:55.447541 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcd5005e-2e03-4916-b8af-db01403a6b77 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.844526 Sep 07 10:00:55.453562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1724/3470] 10.222.0.60 () {60 vars in 1174 bytes} [Wed Sep 7 10:00:54 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:55.467598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69b3872b-0871-48d5-9505-1ba87598d79b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Action: 'create', calling method: .version_select at 0x7f14b0c56c10>, body: {"server_group": {"name": "tempest-server-group-1871275755", "policies": ["affinity"]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:55.495845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:55.502071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:55.525360 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8adf9f48-e333-4ef7-83e1-5870c2b312b5 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.419766 Sep 07 10:00:55.548194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-69b3872b-0871-48d5-9505-1ba87598d79b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:55.551746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1747/3471] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:55 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:55.560430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:55.567237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:55.570145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:55.572762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-69b3872b-0871-48d5-9505-1ba87598d79b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:55.596991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:55.597517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:55.598214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:55.600152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:55.601115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:55.601943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:55.737352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-69b3872b-0871-48d5-9505-1ba87598d79b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:55.751474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-69b3872b-0871-48d5-9505-1ba87598d79b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:55.800929 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-69b3872b-0871-48d5-9505-1ba87598d79b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.337105 Sep 07 10:00:55.810455 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1725/3472] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 7 10:00:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:55.820529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e67a6296-2ac9-47c2-9e59-95479ae24217 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Action: 'create', calling method: .version_select at 0x7f14b0c46e50>, body: {"server_group": {"name": "tempest-server-group-1871275755", "policies": ["affinity"]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:55.863152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e67a6296-2ac9-47c2-9e59-95479ae24217 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:55.874842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e67a6296-2ac9-47c2-9e59-95479ae24217 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:55.998833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e67a6296-2ac9-47c2-9e59-95479ae24217 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:56.012455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e67a6296-2ac9-47c2-9e59-95479ae24217 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:56.046770 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e67a6296-2ac9-47c2-9e59-95479ae24217 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.234836 Sep 07 10:00:56.051022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1726/3473] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 7 10:00:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:56.066887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81bd1678-1422-4390-8aec-0f34d5a4767e tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.109747 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81bd1678-1422-4390-8aec-0f34d5a4767e tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/e6f12086-b9d5-4577-9c7b-471770dd7004" status: 204 len: 0 microversion: 2.1 time: 0.050571 Sep 07 10:00:56.110839 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1727/3474] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:00:56 2022] DELETE /compute/v2.1/os-server-groups/e6f12086-b9d5-4577-9c7b-471770dd7004 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:56.120083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-871a3e86-17ff-455e-bb00-45a0bf42c5bf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.141621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-871a3e86-17ff-455e-bb00-45a0bf42c5bf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.026182 Sep 07 10:00:56.143086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1728/3475] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:00:56 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:56.166155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e9c2132c-91b8-48a5-937b-a20870387f7b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.223484 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e9c2132c-91b8-48a5-937b-a20870387f7b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ee7b9139-6a17-499d-87ba-faf5404aee88" status: 204 len: 0 microversion: 2.1 time: 0.069625 Sep 07 10:00:56.224086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1729/3476] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:00:56 2022] DELETE /compute/v2.1/os-server-groups/ee7b9139-6a17-499d-87ba-faf5404aee88 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:56.232814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bca367b8-4f80-4b89-b01c-6d7872cca031 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.258871 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bca367b8-4f80-4b89-b01c-6d7872cca031 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027969 Sep 07 10:00:56.272325 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1730/3477] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:00:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:56.291616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-879b4d89-d900-480c-b1cb-c9178738685a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Action: 'create', calling method: .version_select at 0x7f14b0bda5e0>, body: {"server_group": {"name": "tempest-server-group-1575360263", "policies": ["affinity"]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:56.361159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-879b4d89-d900-480c-b1cb-c9178738685a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:56.382103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-879b4d89-d900-480c-b1cb-c9178738685a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:56.464320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-879b4d89-d900-480c-b1cb-c9178738685a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:56.471164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-879b4d89-d900-480c-b1cb-c9178738685a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:56.495167 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-879b4d89-d900-480c-b1cb-c9178738685a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.221401 Sep 07 10:00:56.502881 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1731/3478] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 7 10:00:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:56.509487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0bee6b27-75ab-4f33-a227-37ee644bb569 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.540762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:56.563438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0bee6b27-75ab-4f33-a227-37ee644bb569 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/d3b6e54f-36da-449f-812c-18d462888c50" status: 204 len: 0 microversion: 2.1 time: 0.059179 Sep 07 10:00:56.564048 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1732/3479] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:00:56 2022] DELETE /compute/v2.1/os-server-groups/d3b6e54f-36da-449f-812c-18d462888c50 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:56.580831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.581490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:56.605665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:56.606171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:56.606620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:56.607809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:56.608306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:56.608743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:56.639982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:56.652437 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54f11db5-bdab-459d-b974-152ceb507b65 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1316 microversion: 2.1 time: 1.098895 Sep 07 10:00:56.654205 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1748/3480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:55 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1316 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:56.664216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c1aada7-b70b-4776-b80b-33823770d3b7 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:56.712220 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c1aada7-b70b-4776-b80b-33823770d3b7 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.056482 Sep 07 10:00:56.715934 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1749/3481] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:00:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:56.731777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-291e0fc9-92e4-40f0-81ea-8208d0ea3ff4 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Action: 'create', calling method: .version_select at 0x7f14b1b54f70>, body: {"server_group": {"name": "tempest-server-group-800502283", "policies": ["anti-affinity"]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:56.771200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:UPDATE=6,nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:00:56.786195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-291e0fc9-92e4-40f0-81ea-8208d0ea3ff4 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:56.800866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-291e0fc9-92e4-40f0-81ea-8208d0ea3ff4 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:56.810312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:56.836177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:56.845638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:56.866710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5b6ff55-b3ef-4b0c-a636-c2007f62d0b7 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.295871 Sep 07 10:00:56.868962 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1733/3482] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:56 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:56.906192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-291e0fc9-92e4-40f0-81ea-8208d0ea3ff4 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:56.913776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-291e0fc9-92e4-40f0-81ea-8208d0ea3ff4 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_groups'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:56.960052 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-291e0fc9-92e4-40f0-81ea-8208d0ea3ff4 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.233468 Sep 07 10:00:56.966579 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1750/3483] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 7 10:00:56 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:00:56.979213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09b8d5fe-a37c-499d-9341-3ab06210620a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:57.044461 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09b8d5fe-a37c-499d-9341-3ab06210620a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/75334599-56fb-4600-8538-82ee7dac908e" status: 204 len: 0 microversion: 2.1 time: 0.074530 Sep 07 10:00:57.049196 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1734/3484] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:00:56 2022] DELETE /compute/v2.1/os-server-groups/75334599-56fb-4600-8538-82ee7dac908e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:00:57.055706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-528f6ea2-2822-475d-9a09-90a9f3f17894 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:57.083176 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-528f6ea2-2822-475d-9a09-90a9f3f17894 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032542 Sep 07 10:00:57.112913 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1751/3485] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:00:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:00:57.243956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-15be2d87-d75b-41ca-a5ed-3629a810d21c req-b2bfbb0f-4008-4659-923c-324524f1956a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0", "tag": "73e192fa-c88f-4e9d-ad1e-d46bc07c2623"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:57.291352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1038488216", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "dbac15a5-4d3e-4086-be94-9ebbd15f0b49"}]}, "os:scheduler_hints": {"group": "fa686d69-b6a1-4b37-9443-2fc16d7da9dd"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:00:57.293328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-15be2d87-d75b-41ca-a5ed-3629a810d21c req-b2bfbb0f-4008-4659-923c-324524f1956a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:57.293872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-15be2d87-d75b-41ca-a5ed-3629a810d21c req-b2bfbb0f-4008-4659-923c-324524f1956a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:57.294316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-15be2d87-d75b-41ca-a5ed-3629a810d21c req-b2bfbb0f-4008-4659-923c-324524f1956a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:57.329360 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-15be2d87-d75b-41ca-a5ed-3629a810d21c req-b2bfbb0f-4008-4659-923c-324524f1956a service nova] Creating event network-changed:73e192fa-c88f-4e9d-ad1e-d46bc07c2623 for instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 on n-h2-836830-16 Sep 07 10:00:57.343007 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-15be2d87-d75b-41ca-a5ed-3629a810d21c req-b2bfbb0f-4008-4659-923c-324524f1956a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105086 Sep 07 10:00:57.345877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1735/3486] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:00:57.408427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] validate_networks() for [('dbac15a5-4d3e-4086-be94-9ebbd15f0b49', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:00:57.684051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:57.684743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:57.692122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:57.692989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:57.693704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:57.694654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:57.696293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:57.697156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:58.755673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:58.806264 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c80e381-b980-4b65-9db6-23bdd1748a2c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1316 microversion: 2.1 time: 1.124927 Sep 07 10:00:58.824357 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1736/3487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:57 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1316 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:00:58.832726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:58.834328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:00:58.834789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:00:58.835218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:00:58.835990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:00:58.836644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:58.837054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:00:58.844150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:58.845421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:58.846315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:58.847319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:58.848015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:58.849410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:58.871763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:58.872248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:58.872706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:58.874901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:58.875378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:58.879144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:58.911120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:58.950362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:58.991938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:00:59.005234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:00:59.009960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:59.025626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:59.030654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:59.042173 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7300ec1c-1736-4d92-934d-12f8658e163f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.216186 Sep 07 10:00:59.044030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1737/3488] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:00:58 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:00:59.098310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:59.106437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:59.176724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:00:59.188144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Getting quotas for user 8b6fcafc45a14a05a7f6d6b4bbe97ee6 and project b6221c0116b54a5483481f3d27b66f68. Resources: {'server_group_members'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:00:59.277728 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3bb57149-570e-4227-9906-1d25829c1b1b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991156 Sep 07 10:00:59.278471 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1752/3489] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:00:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:00:59.291375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0348fd0c-9192-4a80-8901-cba05110d3d7 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:59.292121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0348fd0c-9192-4a80-8901-cba05110d3d7 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:59.431215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0348fd0c-9192-4a80-8901-cba05110d3d7 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:00:59.442795 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0348fd0c-9192-4a80-8901-cba05110d3d7 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1213 microversion: 2.1 time: 0.155591 Sep 07 10:00:59.443419 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1738/3490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:59 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:00:59.845789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:00:59.846641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:00:59.867252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:59.869168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:59.870366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:00:59.872302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:00:59.873744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:00:59.875045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:00.088775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:00.092178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:00.111150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=13 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:00.113475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:00.119033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:00.120551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:00.121733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:00.123337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:00.124009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:00.400603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:00.415350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:00.430564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:00.453729 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ac47173-d3b2-4505-9557-ade76e03a4f4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.377960 Sep 07 10:01:00.457761 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1739/3491] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:00 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:00.480182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:00.481409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:00.514187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:00.514691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:00.522783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:00.526536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:00.533105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:00.533801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:00.720905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:00.759976 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9e0ea5e-4d86-4fa5-b571-84c5ee8f7252 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1316 microversion: 2.1 time: 0.926394 Sep 07 10:01:00.765974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1753/3492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:00:59 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1316 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:00.925726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:00.943172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89054537-65a2-4bba-bac5-990eaaa7a128 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1209 microversion: 2.1 time: 0.475470 Sep 07 10:01:00.947153 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1740/3493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:00 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1209 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:01.490428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:01.491144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:01.512503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:01.514676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:01.517994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:01.520175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:01.523211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:01.524002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:01.791704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:01.792326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:01.804551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:01.807124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:01.807779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:01.809881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:01.811525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:01.812156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:01.838444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:01.851370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:01.852890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:01.878213 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-86612fc9-4a88-498d-a946-7d747615e66a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.391446 Sep 07 10:01:01.886547 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1754/3494] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:01 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:01.976347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:01.977750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:01.990293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:01.994844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:01.996676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:01.997722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:01.999122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:02.000994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:02.389054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:02.420039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df47fc03-8bb5-458e-9e9e-3a3183440daf tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1271 microversion: 2.1 time: 0.447191 Sep 07 10:01:02.420289 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1755/3495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:01 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1271 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:02.665426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:02.681992 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8417fb1-8378-46f2-ad1e-efc9cd7f6389 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1316 microversion: 2.1 time: 0.889420 Sep 07 10:01:02.688060 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1741/3496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:01 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1316 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:02.914079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:02.915115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:02.937760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:02.937760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:02.938098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:02.938889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:02.940912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:02.942151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:03.233204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:03.254857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:03.267333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:03.287476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d1ca858-1752-4b27-8bed-af6ca224d031 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.378907 Sep 07 10:01:03.288536 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1756/3497] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:02 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:03.455772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:03.457596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:03.495145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:03.499639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:03.501738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:03.502707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:03.503177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:03.503608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:03.715677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:03.716267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:03.726734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:03.729971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:03.730779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:03.731721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:03.732370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:03.733496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:03.771199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:03.779862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08b5996c-3a0f-47d0-b131-a9060542dff9 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1271 microversion: 2.1 time: 0.335686 Sep 07 10:01:03.800011 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1742/3498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:03 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1271 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:04.337688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:04.338343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:04.351376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:04.352648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:04.353311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:04.354249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:04.354504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:04.354941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:04.630938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:04.646502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:04.647981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:04.661528 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a56312c2-96d8-45a0-becd-e818faaa660a tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.328322 Sep 07 10:01:04.665489 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1743/3499] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:04 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:04.793468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:04.813486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:04.814346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:04.829705 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21c82112-db77-43d0-af2e-f8c13e5cbec4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1316 microversion: 2.1 time: 1.118934 Sep 07 10:01:04.831865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:04.832370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:04.832819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:04.838710 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1757/3500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:03 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1316 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:04.844663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:04.845324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:04.845914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:05.210891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:05.229281 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c067bdd6-5b43-4adf-83d3-2efc7d4f07f8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.425453 Sep 07 10:01:05.234635 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1744/3501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:04 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:05.271369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d4dedd79-653e-444a-9515-5b5a7f4c3931 req-a59e9916-7f77-4b33-b870-6fca86926a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0", "name": "network-vif-plugged", "status": "completed", "tag": "73e192fa-c88f-4e9d-ad1e-d46bc07c2623"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:05.294811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d4dedd79-653e-444a-9515-5b5a7f4c3931 req-a59e9916-7f77-4b33-b870-6fca86926a15 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:05.295286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d4dedd79-653e-444a-9515-5b5a7f4c3931 req-a59e9916-7f77-4b33-b870-6fca86926a15 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:05.296026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d4dedd79-653e-444a-9515-5b5a7f4c3931 req-a59e9916-7f77-4b33-b870-6fca86926a15 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:05.322012 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d4dedd79-653e-444a-9515-5b5a7f4c3931 req-a59e9916-7f77-4b33-b870-6fca86926a15 service nova] Creating event network-vif-plugged:73e192fa-c88f-4e9d-ad1e-d46bc07c2623 for instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 on n-h2-836830-16 Sep 07 10:01:05.337413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d4dedd79-653e-444a-9515-5b5a7f4c3931 req-a59e9916-7f77-4b33-b870-6fca86926a15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068931 Sep 07 10:01:05.338171 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1758/3502] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:05.691945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:05.692574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:05.708929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:05.710825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:05.711331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:05.713841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:05.714372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:05.714820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:05.778271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:05.855569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:05.856285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:05.869709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:05.877511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:05.879359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:05.881217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:05.883945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:05.884758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:05.895720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:05.914219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:05.925160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:05.927449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:05.940106 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e3eb5bb-3f63-4714-a60c-45b1781055d3 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.251725 Sep 07 10:01:05.944168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1745/3503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:05 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:06.255906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:06.256523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:06.267272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:06.268003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:06.268712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:06.279069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:06.279785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:06.280406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:06.453865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:06.473250 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8572f049-f757-4262-9441-65128cfe3152 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1316 microversion: 2.1 time: 0.622735 Sep 07 10:01:06.490757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1759/3504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:05 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:06.693545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:06.702994 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa07551e-953e-4b24-9cc3-bfab3e468e0d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.450935 Sep 07 10:01:06.704426 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1746/3505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:06 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:06.962373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-26ef76c2-02f2-40e1-b38d-cdeadb71d5a0 req-a5cc701c-8965-4574-83ff-d06827b26f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e517a1-e295-4d20-a24d-0fb5562ef340", "tag": "6b54e47a-6092-41dd-9fdf-2f4b4dfb4124"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:06.972272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:06.972951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:07.001941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:07.002229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-26ef76c2-02f2-40e1-b38d-cdeadb71d5a0 req-a5cc701c-8965-4574-83ff-d06827b26f38 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:07.002592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-26ef76c2-02f2-40e1-b38d-cdeadb71d5a0 req-a5cc701c-8965-4574-83ff-d06827b26f38 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:07.003639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:07.006683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:07.007677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:07.009197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:07.011603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:07.011860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-26ef76c2-02f2-40e1-b38d-cdeadb71d5a0 req-a5cc701c-8965-4574-83ff-d06827b26f38 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:07.094130 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-26ef76c2-02f2-40e1-b38d-cdeadb71d5a0 req-a5cc701c-8965-4574-83ff-d06827b26f38 service nova] Creating event network-changed:6b54e47a-6092-41dd-9fdf-2f4b4dfb4124 for instance e2e517a1-e295-4d20-a24d-0fb5562ef340 on n-h1-836830-16 Sep 07 10:01:07.100746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-26ef76c2-02f2-40e1-b38d-cdeadb71d5a0 req-a5cc701c-8965-4574-83ff-d06827b26f38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142965 Sep 07 10:01:07.102779 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1760/3506] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:01:07.200281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:07.218886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:07.226306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:07.239857 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fa1f962f-7841-4a19-a651-e9e74e42b05b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.271264 Sep 07 10:01:07.241864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1747/3507] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:06 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:07.481787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-704463116", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "e5d729c8-58c2-4645-a9e6-237a84c10af5"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:07.504766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:07.506595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:07.549831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:07.550732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:07.556044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:07.557553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:07.558449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:07.559243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:07.622321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] validate_networks() for [('e5d729c8-58c2-4645-a9e6-237a84c10af5', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:01:08.161715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:08.194828 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ed488a6a-8ef8-4ea2-bfd3-1c4d420fa1bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.693482 Sep 07 10:01:08.202191 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1748/3508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:07 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:08.250324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:08.255339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:08.286581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:08.287296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:08.287995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:08.288939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:08.290638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:08.294465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:08.585796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:08.598125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ca5ab62-9d6c-457f-b008-9ffed73d4225 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.389618 Sep 07 10:01:08.598805 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1749/3509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:08 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:08.609386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:08.610400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:08.618913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:08.619733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:08.620952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:08.622448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:08.623251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:08.623683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:08.721815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:08.734705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:08.736482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:08.750948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0587a29e-893c-4bea-a547-ea752476a3a4 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.140760 Sep 07 10:01:08.762277 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1750/3510] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:08 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:08.775811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-24117504", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:08.792999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:01:08.793564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:01:08.794318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:01:08.794850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:01:08.795500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:01:08.816459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:08.819921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:08.821337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:08.823674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:08.825812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:08.827447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:08.872175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] validate_networks() for [('ffb7e619-ff58-4e6d-bd05-cbb26b7295a0', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:01:08.873061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Getting quotas for project 2361be3a41a24cc5b168be14226a5f53. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:01:08.879925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Getting quotas for user e4f3203c31d24a6e82c382d10368a241 and project 2361be3a41a24cc5b168be14226a5f53. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:01:08.897714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:01:08.902874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:01:08.940318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:08.964074 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-55c0019a-0ffb-44f9-a30d-7fd5d531cf54 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805016 Sep 07 10:01:08.965422 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1761/3511] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 10:01:08.981585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-47645277-740b-4549-b967-33dc74580c70 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:08.982837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-47645277-740b-4549-b967-33dc74580c70 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:09.138220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47645277-740b-4549-b967-33dc74580c70 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:09.151007 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-47645277-740b-4549-b967-33dc74580c70 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1216 microversion: 2.1 time: 0.176880 Sep 07 10:01:09.171637 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1762/3512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:08 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:09.436890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=33 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:09.625491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:09.626119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:09.665196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:09.672168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:09.672827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:09.677851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:09.680000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:09.684034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.158699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:01:10.159180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:01:10.159717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:01:10.160120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:01:10.160470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:01:10.166292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:10.181155 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5c052ff-0568-4180-9b34-c62fa55fea55 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.561131 Sep 07 10:01:10.185220 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1763/3513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:09 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:10.196351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:10.198695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:10.204969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:10.205524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:10.205970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.206729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:10.207176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:10.207678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.223173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:10.227562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:10.228907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.230194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:10.235685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:10.236276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.250510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Getting quotas for project 717c98a794074ebcae407bb25e06fd41. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:01:10.261223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Getting quotas for user da075a784e1a40fd97c186fed2c3b2a0 and project 717c98a794074ebcae407bb25e06fd41. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:01:10.290851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:01:10.293823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:01:10.418200 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68da7dc0-2a53-480c-b395-14a764aabf37 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652459 Sep 07 10:01:10.420655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1751/3514] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:01:10.426076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:10.427781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:10.436234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:10.437310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:10.438972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.439962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:10.440806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:10.442554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:10.468026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:10.489509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:10.493336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:10.506714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2955d1b5-2350-4252-85d6-e1cec9d5aa9b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.318888 Sep 07 10:01:10.509150 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1764/3515] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:10 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:10.529114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9fc9bf7-8ff8-4c60-9dcb-e762bcbc0115 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:10.530459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9fc9bf7-8ff8-4c60-9dcb-e762bcbc0115 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:10.617159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:10.632091 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c7eeb2e8-1b19-4083-aa79-0c9bc1426def tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1268 microversion: 2.1 time: 0.208672 Sep 07 10:01:10.633334 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1752/3516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:10 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:10.728285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9fc9bf7-8ff8-4c60-9dcb-e762bcbc0115 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:10.762910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9fc9bf7-8ff8-4c60-9dcb-e762bcbc0115 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1215 microversion: 2.1 time: 0.235201 Sep 07 10:01:10.764504 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1765/3517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:10 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:11.217788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:11.219234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:11.240139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:11.242369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:11.243067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:11.243902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:11.244479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:11.244987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:11.543253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:11.544351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:11.561542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:11.564274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:11.572071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:11.574174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:11.580734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:11.583779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:12.016723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:12.029503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:12.032844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:12.043080 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-17aab593-2440-43e7-8cdd-90206e2f646e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.507414 Sep 07 10:01:12.057233 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1766/3518] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:11 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:12.062083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:12.064186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:12.077842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:12.079388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:12.080122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:12.081226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:12.082176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:12.082936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:12.086692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:12.100067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0746c699-0c24-417b-ac99-71b9f0fe121d tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.884350 Sep 07 10:01:12.101827 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1753/3519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:11 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:12.106897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:12.108499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:12.127000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:12.128921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:12.129608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:12.131220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:12.131695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:12.132129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:12.643672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:12.655503 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1d16974-1e8f-4c40-84cf-2c7e82fbcc85 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1274 microversion: 2.1 time: 0.603281 Sep 07 10:01:12.657545 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1767/3520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:12 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1274 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:12.700851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:12.710538 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f80ec1a9-35f3-4ae5-b94f-9d328bae7372 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1267 microversion: 2.1 time: 0.607156 Sep 07 10:01:12.725113 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1754/3521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:12 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1267 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:13.077520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:13.078195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:13.086555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.087536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.088166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.089134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.089944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.090686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.132331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:13.134296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:13.154352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.156345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.157091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.159450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.163394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.164641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.334666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:13.348126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:13.370510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:13.386673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f836ee44-a02e-4447-9684-5e3fcce7dd5e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.313228 Sep 07 10:01:13.400229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1768/3522] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:13 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:13.425135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6c97bfcb-a860-48fb-b4a9-e992380510cd req-c9ba8a05-99af-4c35-be68-718b984aeba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e517a1-e295-4d20-a24d-0fb5562ef340", "name": "network-vif-plugged", "status": "completed", "tag": "6b54e47a-6092-41dd-9fdf-2f4b4dfb4124"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:13.451120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c97bfcb-a860-48fb-b4a9-e992380510cd req-c9ba8a05-99af-4c35-be68-718b984aeba0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.453111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c97bfcb-a860-48fb-b4a9-e992380510cd req-c9ba8a05-99af-4c35-be68-718b984aeba0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.454135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c97bfcb-a860-48fb-b4a9-e992380510cd req-c9ba8a05-99af-4c35-be68-718b984aeba0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.490365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6c97bfcb-a860-48fb-b4a9-e992380510cd req-c9ba8a05-99af-4c35-be68-718b984aeba0 service nova] Creating event network-vif-plugged:6b54e47a-6092-41dd-9fdf-2f4b4dfb4124 for instance e2e517a1-e295-4d20-a24d-0fb5562ef340 on n-h1-836830-16 Sep 07 10:01:13.499413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6c97bfcb-a860-48fb-b4a9-e992380510cd req-c9ba8a05-99af-4c35-be68-718b984aeba0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097242 Sep 07 10:01:13.500409 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1769/3523] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:13.694892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:13.697330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:13.722367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.723390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.726107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.735066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.736377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.740416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.859657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:13.868834 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75fe4b8a-f35b-4444-8360-667160753249 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.740326 Sep 07 10:01:13.885293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1755/3524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:13 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:13.892021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:13.892934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:13.901303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.902088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.902734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:13.903711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:13.904398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:13.905074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:14.045438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:14.059043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5736fc71-d554-4e3a-8a82-733cfde66d5e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1273 microversion: 2.1 time: 0.171950 Sep 07 10:01:14.059794 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1756/3525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:13 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:14.345603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:14.364939 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb090c97-9baa-44d0-8631-29a9e29c1c5a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.682374 Sep 07 10:01:14.380840 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1770/3526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:13 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:14.419497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:14.423054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:14.450710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:14.451583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:14.454431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:14.458014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:14.459385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:14.460041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:14.646601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:14.666952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:14.669385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:14.686196 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba4b1bcf-adc3-4efb-8964-372815fd6f32 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.272201 Sep 07 10:01:14.706614 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1757/3527] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:14 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:14.906862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:14.907573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:14.931222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:14.932115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:14.934090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:14.935289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:14.935989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:14.936492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:15.086390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:15.088090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:15.116667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:15.121349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:15.127996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:15.129260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:15.129777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:15.133618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:15.631832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:15.655698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a2f5084-39c1-474f-8a54-d93808d9e776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.575203 Sep 07 10:01:15.656313 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1758/3528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:15 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:15.667413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:15.670110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:15.679103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:15.679761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:15.680882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:15.681675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:15.683474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:15.684879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:15.771341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:15.812409 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8d1f02eb-71c4-4d1e-a8aa-e8b47e4d9bdc tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1313 microversion: 2.1 time: 0.916847 Sep 07 10:01:15.826165 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1771/3529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:14 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:15.835636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:15.837629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:15.844227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:15.844747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:15.845214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:15.846057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:15.846912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:15.847147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:16.110000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:16.125696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:16.127474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:16.133638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-649b6fc5-e5f3-4aa8-96bf-c46c43e01ebb tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.305981 Sep 07 10:01:16.134526 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1772/3530] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:15 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:16.219445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-88961c14-c60d-48f2-aab9-8b022fc3784d req-bcaa4102-dcd6-48b8-a694-d097f252c32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5afe82d-77ef-4643-ba5e-398dab757ab7", "tag": "67f15103-0511-4de6-9f4c-11090a3c3fc3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:16.243817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-88961c14-c60d-48f2-aab9-8b022fc3784d req-bcaa4102-dcd6-48b8-a694-d097f252c32f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:16.246723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-88961c14-c60d-48f2-aab9-8b022fc3784d req-bcaa4102-dcd6-48b8-a694-d097f252c32f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:16.247350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-88961c14-c60d-48f2-aab9-8b022fc3784d req-bcaa4102-dcd6-48b8-a694-d097f252c32f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:16.263234 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-88961c14-c60d-48f2-aab9-8b022fc3784d req-bcaa4102-dcd6-48b8-a694-d097f252c32f service nova] Creating event network-changed:67f15103-0511-4de6-9f4c-11090a3c3fc3 for instance d5afe82d-77ef-4643-ba5e-398dab757ab7 on n-h2-836830-16 Sep 07 10:01:16.274558 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-88961c14-c60d-48f2-aab9-8b022fc3784d req-bcaa4102-dcd6-48b8-a694-d097f252c32f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058458 Sep 07 10:01:16.276207 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1773/3531] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:01:16.331335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:16.343647 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f82f7858-6ae2-4281-b1bf-549e90ed25e4 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.686120 Sep 07 10:01:16.344668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1759/3532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:15 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:16.683198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:16.683905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:16.705777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:16.709758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:16.710537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:16.728170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:16.729099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:16.729819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:16.854517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:16.857536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:16.878609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:16.879424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:16.882180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:16.883913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:16.884735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:16.885383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:17.924330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:17.938445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:17.942841 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ccaeb45f-d699-4653-a725-acfe4d57a8c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 1.262244 Sep 07 10:01:17.948921 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1774/3533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:16 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:17.950604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-141ed2ca-e0a4-4a1f-b1be-070d2eebcb25 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1499 microversion: 2.1 time: 1.109111 Sep 07 10:01:17.951774 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1760/3534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:16 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1499 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:17.958642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:17.959609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:17.968700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:17.969150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:17.969473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:17.969832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:17.970155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:17.970966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:17.972135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:17.972833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:17.984685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:17.985486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:17.986089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:17.989918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:17.991743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:17.992501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.269027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:18.298188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:18.301062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:18.317414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5d4747b0-5f1d-4e55-8156-d8956d9e57ea tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.363123 Sep 07 10:01:18.320686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1775/3535] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:17 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:18.339249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-40cf76e4-02a1-4cf1-bf33-d679b8cc6321 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:18.372779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_groups [None req-40cf76e4-02a1-4cf1-bf33-d679b8cc6321 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Querying cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) for 1 instances {{(pid=128833) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 10:01:18.373583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cf76e4-02a1-4cf1-bf33-d679b8cc6321 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.375219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cf76e4-02a1-4cf1-bf33-d679b8cc6321 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.376863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cf76e4-02a1-4cf1-bf33-d679b8cc6321 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.397014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:18.409389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-59ec2e30-2395-4a3c-a45a-faddfacb231a tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.455227 Sep 07 10:01:18.426551 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1761/3536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:17 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:18.446401 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-40cf76e4-02a1-4cf1-bf33-d679b8cc6321 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/fa686d69-b6a1-4b37-9443-2fc16d7da9dd" status: 200 len: 222 microversion: 2.1 time: 0.123275 Sep 07 10:01:18.458408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:18.458818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:18.465809 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1776/3537] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 10:01:18 2022] GET /compute/v2.1/os-server-groups/fa686d69-b6a1-4b37-9443-2fc16d7da9dd => generated 222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:18.470513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:18.472004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.472499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.472936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.473660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.474108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.474547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.527964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:01:18.531525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:18.630216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e41986a9-2c9a-4289-8f69-8cfb1d63f816 req-20aef235-901f-44e9-896b-e2cf51775ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3accfc03-7586-4d0b-becb-e1f3d1a0a078", "tag": "dd3d8986-5e51-4be6-b047-d9922e0f10fc"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:18.666483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e41986a9-2c9a-4289-8f69-8cfb1d63f816 req-20aef235-901f-44e9-896b-e2cf51775ccb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.666972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e41986a9-2c9a-4289-8f69-8cfb1d63f816 req-20aef235-901f-44e9-896b-e2cf51775ccb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.672751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e41986a9-2c9a-4289-8f69-8cfb1d63f816 req-20aef235-901f-44e9-896b-e2cf51775ccb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.711679 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e41986a9-2c9a-4289-8f69-8cfb1d63f816 req-20aef235-901f-44e9-896b-e2cf51775ccb service nova] Creating event network-changed:dd3d8986-5e51-4be6-b047-d9922e0f10fc for instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 on n-h1-836830-16 Sep 07 10:01:18.733087 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e41986a9-2c9a-4289-8f69-8cfb1d63f816 req-20aef235-901f-44e9-896b-e2cf51775ccb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104300 Sep 07 10:01:18.733778 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1777/3538] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:01:18.739768 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-147de216-ac82-4601-b663-6cd8fa00be81 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 204 len: 0 microversion: 2.1 time: 0.285389 Sep 07 10:01:18.740705 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1762/3539] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:01:18 2022] DELETE /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:01:18.755295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:18.756223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:18.766800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.767796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.768236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.768934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.769435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.769863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.838858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:18.950120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:18.962361 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1855825-f0f5-4c17-8591-4bffef01740b tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1505 microversion: 2.1 time: 0.211406 Sep 07 10:01:18.962964 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1778/3540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:18 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:18.969133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:18.971163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:18.983621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.984172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.984614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:18.985399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:18.986174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:18.988481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:19.348160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:19.350423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:19.351186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:19.360273 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4edf6ce0-399d-4971-8a5b-16ece7fb4c04 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.395857 Sep 07 10:01:19.363542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1763/3541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:18 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:19.365555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:19.366084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:19.366543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:19.368137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:19.369817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:19.371941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:19.449495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:19.450716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:19.483194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:19.483700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:19.484147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:19.484860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:19.492591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:19.493745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:19.873793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:19.891778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:19.894157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:19.923587 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa11afe7-28a7-4537-bbb0-79a0c18609aa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1447 microversion: 2.75 time: 0.579091 Sep 07 10:01:19.929244 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1779/3542] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:19 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1447 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:19.989146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:19.989915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:19.999982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:20.000590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:20.001210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:20.003171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:20.003991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:20.004733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:20.227281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:20.275057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:20.374105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:20.384531 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f334060d-2eba-4f26-bc97-4c2fcb745155 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.951327 Sep 07 10:01:20.385083 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1764/3543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:19 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:20.415226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:20.423335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:20.441330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:20.443030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:20.444086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:20.447902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:20.451134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:20.451609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:20.567536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:20.587616 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9b2c7609-a592-4649-8e53-39d708d344dd tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1505 microversion: 2.1 time: 0.603421 Sep 07 10:01:20.592014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1780/3544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:19 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:20.967930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:20.971744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:20.991515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=35 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:21.018460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:21.019068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:21.019818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:21.020548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:21.021011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:21.021496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:21.066805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:21.227900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:21.230174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:21.240024 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8606d2e1-5c2e-4f5e-ac9e-19144ed4e21a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.842601 Sep 07 10:01:21.240931 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1765/3545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:20 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:21.253521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:21.255226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:21.267383 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cabae94-1512-4570-bcb7-53f589468a5b tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1453 microversion: 2.75 time: 0.310561 Sep 07 10:01:21.267983 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1781/3546] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:20 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1453 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:21.416939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:21.418068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:21.431444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:21.432270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:21.434288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:21.434551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:21.440230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:21.440230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:21.620883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:21.622071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:21.639704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:21.640607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:21.643679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:21.645560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:21.647430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:21.649216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:21.842861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:21.858983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7317f4e8-53dc-4bc6-b8b9-cc1c0e779178 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.447012 Sep 07 10:01:21.860596 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1766/3547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:21 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:22.013056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:22.026195 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-070f3ca8-909f-4fd9-b7fd-9fdb63414de3 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1505 microversion: 2.1 time: 0.411873 Sep 07 10:01:22.030075 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1782/3548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:21 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:22.266586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:22.267201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:22.274217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:22.275182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:22.275789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:22.276853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:22.277536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:22.278498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:22.303343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:22.303964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:22.313973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:22.318385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:22.318850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:22.319794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:22.321219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:22.321815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:22.515215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:22.525948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:22.531557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:22.549481 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c5df54e-f18a-420e-a213-df8ac605be1e tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1453 microversion: 2.75 time: 0.249795 Sep 07 10:01:22.550090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1783/3549] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:22 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:22.658612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:22.668398 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c098696f-2229-4049-b587-356ac088aa24 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.406780 Sep 07 10:01:22.672273 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1767/3550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:22 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:22.885045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:22.885738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:22.896182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:22.900865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:22.901525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:22.902640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:22.903110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:22.903545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.055080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:23.056209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:23.063392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.064114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.064916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.065840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.066500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.066932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.201742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:23.207900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:23.216270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d7f55f5-c52d-4c12-a70a-1ab666551f0e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.336198 Sep 07 10:01:23.217460 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1784/3551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:22 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:23.218866 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f1570a3-0dc7-4097-97d2-318c746e1381 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1463 microversion: 2.1 time: 0.168333 Sep 07 10:01:23.219735 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1768/3552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:23 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:23.521739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f658b4fb-f9d4-47a4-8b0c-ed8042f93460 req-854e27a6-1a0f-46b7-8025-9bc922733d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e517a1-e295-4d20-a24d-0fb5562ef340", "name": "network-vif-deleted", "tag": "6b54e47a-6092-41dd-9fdf-2f4b4dfb4124"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:23.549355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f658b4fb-f9d4-47a4-8b0c-ed8042f93460 req-854e27a6-1a0f-46b7-8025-9bc922733d1e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.549949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f658b4fb-f9d4-47a4-8b0c-ed8042f93460 req-854e27a6-1a0f-46b7-8025-9bc922733d1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.551133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f658b4fb-f9d4-47a4-8b0c-ed8042f93460 req-854e27a6-1a0f-46b7-8025-9bc922733d1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.573915 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f658b4fb-f9d4-47a4-8b0c-ed8042f93460 req-854e27a6-1a0f-46b7-8025-9bc922733d1e service nova] Creating event network-vif-deleted:6b54e47a-6092-41dd-9fdf-2f4b4dfb4124 for instance e2e517a1-e295-4d20-a24d-0fb5562ef340 on n-h1-836830-16 Sep 07 10:01:23.580551 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f658b4fb-f9d4-47a4-8b0c-ed8042f93460 req-854e27a6-1a0f-46b7-8025-9bc922733d1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335731 Sep 07 10:01:23.592377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:23.593105 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1785/3553] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:23.596967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:23.609003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.628748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.632193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.634341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.636596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.637037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.697874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:23.698983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:23.713640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.714426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.715125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.716805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:23.717551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:23.718163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:23.981253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:24.004419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33c25344-0162-404a-a879-31a1a5169484 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.310322 Sep 07 10:01:24.007076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1786/3554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:23 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:24.020595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-41ac61d8-a259-40d4-ba11-cbe27ababc8c req-cb94e556-0878-46ce-a269-1a195b2eb5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5afe82d-77ef-4643-ba5e-398dab757ab7", "name": "network-vif-plugged", "status": "completed", "tag": "67f15103-0511-4de6-9f4c-11090a3c3fc3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:24.053760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-41ac61d8-a259-40d4-ba11-cbe27ababc8c req-cb94e556-0878-46ce-a269-1a195b2eb5c8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.055795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-41ac61d8-a259-40d4-ba11-cbe27ababc8c req-cb94e556-0878-46ce-a269-1a195b2eb5c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.056415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-41ac61d8-a259-40d4-ba11-cbe27ababc8c req-cb94e556-0878-46ce-a269-1a195b2eb5c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.100484 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-41ac61d8-a259-40d4-ba11-cbe27ababc8c req-cb94e556-0878-46ce-a269-1a195b2eb5c8 service nova] Creating event network-vif-plugged:67f15103-0511-4de6-9f4c-11090a3c3fc3 for instance d5afe82d-77ef-4643-ba5e-398dab757ab7 on n-h2-836830-16 Sep 07 10:01:24.110712 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-41ac61d8-a259-40d4-ba11-cbe27ababc8c req-cb94e556-0878-46ce-a269-1a195b2eb5c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100363 Sep 07 10:01:24.113334 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1787/3555] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:24.119571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:24.129620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:24.131837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:24.139889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b250eda-88fe-4757-b4e8-7a017a48a7b2 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1438 microversion: 2.75 time: 0.555480 Sep 07 10:01:24.141111 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1769/3556] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:23 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1438 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:24.245330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:24.246222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:24.255591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.256194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.256633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.258060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.258774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.259565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.368994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:24.371995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:24.384364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.384910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.385718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.386450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.387116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.387551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.511615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:01:24.512450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:01:24.513052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:01:24.513610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:01:24.514153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:01:24.528626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:24.545959 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-372e6cb3-41f8-4cf8-a5e0-a091e517e382 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1316 microversion: 2.1 time: 0.305745 Sep 07 10:01:24.546624 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1770/3557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:24 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:24.551134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:24.551744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:24.558983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.559722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.559866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.560616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.561207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.561817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.599979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.601095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.602214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.602684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lazy-loading 'fault' on Instance uuid e2e517a1-e295-4d20-a24d-0fb5562ef340 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:24.623071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:24.630520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.631281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.631928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.633292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.634422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.635030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.652647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6fcafc45a14a05a7f6d6b4bbe97ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6221c0116b54a5483481f3d27b66f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:24.662804 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d17f1b1-4cde-4cfa-9295-6891f467055c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 200 len: 1303 microversion: 2.1 time: 0.115128 Sep 07 10:01:24.664526 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1771/3558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:24 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:24.742643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:24.766935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85b8b0bd-f6df-4624-9413-3e3b2f080368 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21/action" status: 202 len: 1944 microversion: 2.75 time: 0.600945 Sep 07 10:01:24.767862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1788/3559] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:01:24 2022] POST /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21/action => generated 1944 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 10:01:24.796336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:24.797088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:24.803535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.804169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.804789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.805830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:24.806456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:24.806993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:24.892993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:24.911135 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58eb1bed-32e5-494f-9527-c8bb2ac8ee23 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.118418 Sep 07 10:01:24.911725 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1772/3560] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:24 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:25.030895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.031741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:25.038361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.038906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.039452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.040665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.041520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.042216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.328441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:25.339560 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d028e7e-a130-4997-a897-75f12cf7dee3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.313024 Sep 07 10:01:25.355084 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1789/3561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:25.571959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.573964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:25.588306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.588306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.588306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.588306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.588306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.588306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.769649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.774133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:25.788019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.789509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.790469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.791598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.792670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.793554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.812803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 HTTP/1.1 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e2e517a1-e295-4d20-a24d-0fb5562ef340'} Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:25.815372 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:25.822825 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:25.837825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:25.839113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:25.840805 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7bea9b1-e87c-48ab-bf8c-9e290d4cfc4c tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 404 len: 111 microversion: 2.1 time: 0.078894 Sep 07 10:01:25.842059 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1790/3562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:25.860437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65daf1ac-0285-44ea-be76-9d90e37c7398 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.866845 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37409c35-04a5-4559-a990-e9fd57831329 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1505 microversion: 2.1 time: 0.299003 Sep 07 10:01:25.878063 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1773/3563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:25.882243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_groups [None req-65daf1ac-0285-44ea-be76-9d90e37c7398 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Querying cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) for 1 instances {{(pid=128833) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 10:01:25.883704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65daf1ac-0285-44ea-be76-9d90e37c7398 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.884267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65daf1ac-0285-44ea-be76-9d90e37c7398 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.884821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65daf1ac-0285-44ea-be76-9d90e37c7398 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.907883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.908436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:25.917123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.917649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.918094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.918987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.919768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.920216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.924289 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65daf1ac-0285-44ea-be76-9d90e37c7398 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.073817 Sep 07 10:01:25.925556 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1791/3564] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:25.937721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ff76874-1b82-47c8-843b-45a6dba1e596 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.957472 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c97de65a-ae7c-442c-86f3-807b57d6270b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7/ips" status: 200 len: 109 microversion: 2.1 time: 0.053376 Sep 07 10:01:25.967093 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1774/3565] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7/ips => generated 109 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:25.972488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:25.973410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:25.978130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_groups [None req-3ff76874-1b82-47c8-843b-45a6dba1e596 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Querying cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) for 1 instances {{(pid=128833) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 10:01:25.982527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.983316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.983953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.984669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.984842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ff76874-1b82-47c8-843b-45a6dba1e596 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:25.985510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.986223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:25.986375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ff76874-1b82-47c8-843b-45a6dba1e596 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:25.986784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ff76874-1b82-47c8-843b-45a6dba1e596 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.002215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ff76874-1b82-47c8-843b-45a6dba1e596 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/fa686d69-b6a1-4b37-9443-2fc16d7da9dd" status: 200 len: 184 microversion: 2.1 time: 0.067921 Sep 07 10:01:26.003091 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1792/3566] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/os-server-groups/fa686d69-b6a1-4b37-9443-2fc16d7da9dd => generated 184 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:01:26.008522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.009320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.017001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.017810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.018425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.019304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.019938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.020539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.061777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-16338442-1899-4c65-a34e-6b0820c8b44e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7/ips" status: 200 len: 109 microversion: 2.1 time: 0.057120 Sep 07 10:01:26.062738 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1793/3567] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:01:26 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7/ips => generated 109 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:26.088560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.089563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.120205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:26.124249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.127605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.130663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.131693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.134698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.136266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.155001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:26.159766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 HTTP/1.1 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e2e517a1-e295-4d20-a24d-0fb5562ef340'} Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:01:26.161864 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.168757 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.173435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:26.174529 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b19cbf2e-1584-40fa-9e7d-6257da051eaa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 404 len: 111 microversion: 2.1 time: 0.110668 Sep 07 10:01:26.175284 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1794/3568] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:26.181266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.182279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.192123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.193260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.194023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.195018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.195780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.196388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.203209 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3e8dc29-0e5b-4713-b5a0-c46c6b672fb3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.233001 Sep 07 10:01:26.204211 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1775/3569] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:25 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:26.209118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.209855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] [instance: e2e517a1-e295-4d20-a24d-0fb5562ef340] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.220931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.221848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.222533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.223502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.225999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.227604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.240086 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c48b0ba-506a-4b3a-b1ce-f0a3ecff6151 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7/ips/tempest-ServerAddressesTestJSON-1526695765-network" status: 200 len: 94 microversion: 2.1 time: 0.063434 Sep 07 10:01:26.248189 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1795/3570] 10.222.0.60 () {58 vars in 1401 bytes} [Wed Sep 7 10:01:26 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7/ips/tempest-ServerAddressesTestJSON-1526695765-network => generated 94 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:01:26.250573 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 HTTP/1.1 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e2e517a1-e295-4d20-a24d-0fb5562ef340'} Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.252400 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. Sep 07 10:01:26.260643 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.262564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.263194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance e2e517a1-e295-4d20-a24d-0fb5562ef340 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:26.263364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.264980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-164a6eb1-ad60-4aef-b4c1-06d7377be63a tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340" status: 404 len: 111 microversion: 2.1 time: 0.059510 Sep 07 10:01:26.266155 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1776/3571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:26 2022] GET /compute/v2.1/servers/e2e517a1-e295-4d20-a24d-0fb5562ef340 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:26.272249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.276452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42b1fe0f-86f5-4481-b243-fb58910109fa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.279776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.280360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.281132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.281639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.282072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.285160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-42b1fe0f-86f5-4481-b243-fb58910109fa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance group 75334599-56fb-4600-8538-82ee7dac908e could not be found. Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42b1fe0f-86f5-4481-b243-fb58910109fa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-server-groups/75334599-56fb-4600-8538-82ee7dac908e HTTP/1.1 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance group 75334599-56fb-4600-8538-82ee7dac908e could not be found. Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '75334599-56fb-4600-8538-82ee7dac908e'} Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 75334599-56fb-4600-8538-82ee7dac908e could not be found. Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 75334599-56fb-4600-8538-82ee7dac908e could not be found. Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.289459 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.298099 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.298099 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.298099 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:26.298099 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:26.298099 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 75334599-56fb-4600-8538-82ee7dac908e could not be found. Sep 07 10:01:26.298099 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.301049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42b1fe0f-86f5-4481-b243-fb58910109fa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance group 75334599-56fb-4600-8538-82ee7dac908e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:26.304778 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-42b1fe0f-86f5-4481-b243-fb58910109fa tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/75334599-56fb-4600-8538-82ee7dac908e" status: 404 len: 117 microversion: 2.1 time: 0.030794 Sep 07 10:01:26.307098 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1777/3572] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/os-server-groups/75334599-56fb-4600-8538-82ee7dac908e => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:26.327267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c902e02-83eb-4c32-9a16-b2c7944bf148 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.336996 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-0c902e02-83eb-4c32-9a16-b2c7944bf148 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance group d3b6e54f-36da-449f-812c-18d462888c50 could not be found. Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c902e02-83eb-4c32-9a16-b2c7944bf148 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-server-groups/d3b6e54f-36da-449f-812c-18d462888c50 HTTP/1.1 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance group d3b6e54f-36da-449f-812c-18d462888c50 could not be found. Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd3b6e54f-36da-449f-812c-18d462888c50'} Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d3b6e54f-36da-449f-812c-18d462888c50 could not be found. Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d3b6e54f-36da-449f-812c-18d462888c50 could not be found. Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.339121 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.344045 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.344045 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.344045 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:26.344045 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:26.344045 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d3b6e54f-36da-449f-812c-18d462888c50 could not be found. Sep 07 10:01:26.344045 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.346269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c902e02-83eb-4c32-9a16-b2c7944bf148 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance group d3b6e54f-36da-449f-812c-18d462888c50 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:26.347707 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0c902e02-83eb-4c32-9a16-b2c7944bf148 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/d3b6e54f-36da-449f-812c-18d462888c50" status: 404 len: 117 microversion: 2.1 time: 0.036297 Sep 07 10:01:26.348026 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1778/3573] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/os-server-groups/d3b6e54f-36da-449f-812c-18d462888c50 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:26.363845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fdcfb09f-a5a5-49bc-b9f2-57b4bed121a8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.369977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:01:26.381367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fdcfb09f-a5a5-49bc-b9f2-57b4bed121a8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance group ee7b9139-6a17-499d-87ba-faf5404aee88 could not be found. Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fdcfb09f-a5a5-49bc-b9f2-57b4bed121a8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-server-groups/ee7b9139-6a17-499d-87ba-faf5404aee88 HTTP/1.1 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance group ee7b9139-6a17-499d-87ba-faf5404aee88 could not be found. Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ee7b9139-6a17-499d-87ba-faf5404aee88'} Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ee7b9139-6a17-499d-87ba-faf5404aee88 could not be found. Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ee7b9139-6a17-499d-87ba-faf5404aee88 could not be found. Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.395202 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ee7b9139-6a17-499d-87ba-faf5404aee88 could not be found. Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fdcfb09f-a5a5-49bc-b9f2-57b4bed121a8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance group ee7b9139-6a17-499d-87ba-faf5404aee88 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fdcfb09f-a5a5-49bc-b9f2-57b4bed121a8 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ee7b9139-6a17-499d-87ba-faf5404aee88" status: 404 len: 117 microversion: 2.1 time: 0.037107 Sep 07 10:01:26.400113 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1779/3574] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/os-server-groups/ee7b9139-6a17-499d-87ba-faf5404aee88 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:26.411113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.411809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.428785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.428785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.429997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.430722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.431599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.432257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.514876 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6a56455c-dd54-4192-982c-264e24251bd0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 204 len: 0 microversion: 2.1 time: 0.262404 Sep 07 10:01:26.516382 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1796/3575] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:01:26.522783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75c86422-87bb-4728-9e62-05bf7f194110 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.537369 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-75c86422-87bb-4728-9e62-05bf7f194110 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] HTTP exception thrown: Instance group e6f12086-b9d5-4577-9c7b-471770dd7004 could not be found. Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75c86422-87bb-4728-9e62-05bf7f194110 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Request method failure captured: Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-server-groups/e6f12086-b9d5-4577-9c7b-471770dd7004 HTTP/1.1 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvWdTkiykscXiBW4NvQMGL2fam5IGe_pq7Nh0QEJvYHlFpYnZvsy3RtBwWuW4i28uXTld8vnXqo3nsI2IOjIglPqA_f9V8gj1uJNmq55Lnru5Crrm3lmyH0LzSjHjCudgdJiVM036ZT1gXfOK-rxH9ZuIEJ64STns2W9MxNM10v6aY Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b6221c0116b54a5483481f3d27b66f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b6221c0116b54a5483481f3d27b66f68", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: b6221c0116b54a5483481f3d27b66f68 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerGroupTestJSON-1882226919 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 8b6fcafc45a14a05a7f6d6b4bbe97ee6 Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerGroupTestJSON-1882226919-project Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance group e6f12086-b9d5-4577-9c7b-471770dd7004 could not be found. Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e6f12086-b9d5-4577-9c7b-471770dd7004'} Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e6f12086-b9d5-4577-9c7b-471770dd7004 could not be found. Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e6f12086-b9d5-4577-9c7b-471770dd7004 could not be found. Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.543383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e6f12086-b9d5-4577-9c7b-471770dd7004 could not be found. Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75c86422-87bb-4728-9e62-05bf7f194110 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Returning 404 to user: Instance group e6f12086-b9d5-4577-9c7b-471770dd7004 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:26.555780 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75c86422-87bb-4728-9e62-05bf7f194110 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/e6f12086-b9d5-4577-9c7b-471770dd7004" status: 404 len: 117 microversion: 2.1 time: 0.034658 Sep 07 10:01:26.565682 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1797/3576] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/os-server-groups/e6f12086-b9d5-4577-9c7b-471770dd7004 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:26.569713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.574945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:26.590837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.591428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.593330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.594255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:26.595022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:26.595692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:26.704024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:26.712209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:26.715564 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1c5878f-1682-4a57-b0b8-39d32bad2181 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.314996 Sep 07 10:01:26.721723 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1780/3577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:26 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:26.727858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a277d23-3a29-4e96-a5a2-c37330e7c5b0 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:26.814546 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a277d23-3a29-4e96-a5a2-c37330e7c5b0 tempest-ServerGroupTestJSON-1882226919 tempest-ServerGroupTestJSON-1882226919-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/fa686d69-b6a1-4b37-9443-2fc16d7da9dd" status: 204 len: 0 microversion: 2.1 time: 0.090921 Sep 07 10:01:26.815693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1781/3578] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:01:26 2022] DELETE /compute/v2.1/os-server-groups/fa686d69-b6a1-4b37-9443-2fc16d7da9dd => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:01:26.922900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:26.936686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-248a3368-1bf1-4cc0-831a-c72e1692061b tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1511 microversion: 2.1 time: 0.377081 Sep 07 10:01:26.943035 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1798/3579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:26 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:27.234083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:27.235321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:27.251355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:27.251861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:27.252311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:27.253106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:27.253788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:27.254410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:27.352822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:27.375857 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00bf99e8-8cfb-43fb-81fe-5942daaea488 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.145631 Sep 07 10:01:27.376856 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1782/3580] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:27 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:27.751395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:27.752160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:27.766532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:27.768841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:27.769554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:27.774781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:27.775555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:27.776231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:27.827170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:27.980292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:27.981327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:27.989543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:27.990757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:27.992501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:27.993896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:27.994865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:27.996035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:28.046119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:28.061687 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-13c6a6ef-356b-42e8-a4bb-69c0dbf13639 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.318571 Sep 07 10:01:28.066644 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1799/3581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:27 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:28.330140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:28.343616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc65563d-f9d7-480a-aa34-f832d4affb2e tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1511 microversion: 2.1 time: 0.367282 Sep 07 10:01:28.344524 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1783/3582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:27 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:28.407246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:28.408352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:28.420424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:28.420424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:28.420874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:28.421624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:28.422217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:28.422502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:28.573220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:28.600552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf2216fb-6f05-4886-a9c0-416dc7fb9334 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.197509 Sep 07 10:01:28.601815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1800/3583] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:28 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:28.854971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-348bdd30-976b-4762-a9da-f5ebe32b2e33 req-16f02e9e-1970-45be-bf35-0bd5081c9c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5afe82d-77ef-4643-ba5e-398dab757ab7", "name": "network-vif-deleted", "tag": "67f15103-0511-4de6-9f4c-11090a3c3fc3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:28.869803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-348bdd30-976b-4762-a9da-f5ebe32b2e33 req-16f02e9e-1970-45be-bf35-0bd5081c9c1c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:28.870743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-348bdd30-976b-4762-a9da-f5ebe32b2e33 req-16f02e9e-1970-45be-bf35-0bd5081c9c1c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:28.871666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-348bdd30-976b-4762-a9da-f5ebe32b2e33 req-16f02e9e-1970-45be-bf35-0bd5081c9c1c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:28.888869 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-348bdd30-976b-4762-a9da-f5ebe32b2e33 req-16f02e9e-1970-45be-bf35-0bd5081c9c1c service nova] Creating event network-vif-deleted:67f15103-0511-4de6-9f4c-11090a3c3fc3 for instance d5afe82d-77ef-4643-ba5e-398dab757ab7 on n-h2-836830-16 Sep 07 10:01:28.908782 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-348bdd30-976b-4762-a9da-f5ebe32b2e33 req-16f02e9e-1970-45be-bf35-0bd5081c9c1c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059960 Sep 07 10:01:28.910624 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1784/3584] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:29.094784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:29.095437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:29.108012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.117805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.126682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.127737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.128234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.128678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.371158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:29.371873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:29.385152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.385591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.386028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.392750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.393272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.405642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.472332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.473856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.477882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.478258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lazy-loading 'fault' on Instance uuid d5afe82d-77ef-4643-ba5e-398dab757ab7 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:29.543707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:29.554042 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2686fde-821c-4b83-b456-676485142abe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.463071 Sep 07 10:01:29.555319 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1801/3585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:29 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:29.569141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6c7fc0ee-c143-4280-86d8-699699e2f886 req-2f189a5f-7569-447b-98c2-5d6aa85d2b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3accfc03-7586-4d0b-becb-e1f3d1a0a078", "name": "network-vif-plugged", "status": "completed", "tag": "dd3d8986-5e51-4be6-b047-d9922e0f10fc"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:29.605705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3203c31d24a6e82c382d10368a241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2361be3a41a24cc5b168be14226a5f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:29.622334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c7fc0ee-c143-4280-86d8-699699e2f886 req-2f189a5f-7569-447b-98c2-5d6aa85d2b41 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.624274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c7fc0ee-c143-4280-86d8-699699e2f886 req-2f189a5f-7569-447b-98c2-5d6aa85d2b41 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.624274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6c7fc0ee-c143-4280-86d8-699699e2f886 req-2f189a5f-7569-447b-98c2-5d6aa85d2b41 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.627882 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b42c6e6c-0dff-4747-aee6-d4345d3d9403 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 200 len: 1306 microversion: 2.1 time: 0.262318 Sep 07 10:01:29.633108 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1785/3586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:29 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 1306 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:29.638009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:29.640671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:29.658131 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6c7fc0ee-c143-4280-86d8-699699e2f886 req-2f189a5f-7569-447b-98c2-5d6aa85d2b41 service nova] Creating event network-vif-plugged:dd3d8986-5e51-4be6-b047-d9922e0f10fc for instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 on n-h1-836830-16 Sep 07 10:01:29.669876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.672097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.675966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.676725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:29.682484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:29.683327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:29.692154 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6c7fc0ee-c143-4280-86d8-699699e2f886 req-2f189a5f-7569-447b-98c2-5d6aa85d2b41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135426 Sep 07 10:01:29.693981 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1802/3587] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:29.826570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:29.860347 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-16ee5708-f16e-4b41-8683-bdb0bf3f5e2f tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.225919 Sep 07 10:01:29.862010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1786/3588] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:29 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:30.581476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:30.582922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:30.596810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:30.598721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:30.599426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:30.600445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:30.601882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:30.602511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:30.655527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:30.656133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] [instance: d5afe82d-77ef-4643-ba5e-398dab757ab7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:30.673815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:30.678087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:30.678773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:30.685768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:30.687226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:30.689037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:30.727197 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] HTTP exception thrown: Instance d5afe82d-77ef-4643-ba5e-398dab757ab7 could not be found. Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Request method failure captured: Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 HTTP/1.1 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGviOYkSGvhpYQEbSdctq5Z1abXDJTuX6VWd1GaUDz5tFHa9LUNDl3NgG56ecIqzuapIf7ABW44OONgKJ9HFs-V0LEvmLCh0xYS98P5Ti0Qjng_2wYsNPSUxiLAaDBZNVItSDiEVjjDniI5h267D16gMBxrxxdKXd5gY2ycUfUA1UKk Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 2361be3a41a24cc5b168be14226a5f53 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerAddressesTestJSON-671025940 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2361be3a41a24cc5b168be14226a5f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2361be3a41a24cc5b168be14226a5f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2361be3a41a24cc5b168be14226a5f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2361be3a41a24cc5b168be14226a5f53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerAddressesTestJSON-671025940 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 2361be3a41a24cc5b168be14226a5f53 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerAddressesTestJSON-671025940 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerAddressesTestJSON-671025940-project Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e4f3203c31d24a6e82c382d10368a241 Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerAddressesTestJSON-671025940-project Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d5afe82d-77ef-4643-ba5e-398dab757ab7 could not be found. Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd5afe82d-77ef-4643-ba5e-398dab757ab7'} Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5afe82d-77ef-4643-ba5e-398dab757ab7 could not be found. Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5afe82d-77ef-4643-ba5e-398dab757ab7 could not be found. Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:30.730380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5afe82d-77ef-4643-ba5e-398dab757ab7 could not be found. Sep 07 10:01:30.734853 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:30.738592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] Returning 404 to user: Instance d5afe82d-77ef-4643-ba5e-398dab757ab7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:30.740028 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b86e7b0-e839-48e7-aec0-611a8349a1c0 tempest-ServerAddressesTestJSON-671025940 tempest-ServerAddressesTestJSON-671025940-project] 10.222.0.60 "GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7" status: 404 len: 111 microversion: 2.1 time: 0.089181 Sep 07 10:01:30.741094 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1787/3589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:30 2022] GET /compute/v2.1/servers/d5afe82d-77ef-4643-ba5e-398dab757ab7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:30.891177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:30.892065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:30.905868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:30.906753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:30.907374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:30.908284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:30.908910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:30.909532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:30.916312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:30.931017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0ad5dde-764a-4e25-9e13-69e3692e9e9e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1315 microversion: 2.1 time: 0.354621 Sep 07 10:01:30.931357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1803/3590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:30 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:31.042076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:31.076782 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2146ef49-fca4-4819-bb13-1ee75b36bc18 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.189289 Sep 07 10:01:31.077400 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1788/3591] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:30 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:31.958223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:31.958792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:31.975652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:31.976767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:31.977438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:31.978359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:31.978816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:31.979248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:32.106781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:32.108155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:32.127638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:32.128550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:32.129294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:32.130272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:32.130967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:32.131784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:32.763615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:32.776306 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65cba428-2668-4f51-a8f3-b20dc511dae5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1504 microversion: 2.1 time: 0.821935 Sep 07 10:01:32.780348 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1804/3592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:31 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1504 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:32.802283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:32.802648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:32.803372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:32.816059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:32.816059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:32.816059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:32.816638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:32.818022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:32.819132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:32.839850 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0162ab6a-4d60-4b1d-9168-bc81169e003a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.736848 Sep 07 10:01:32.842675 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1789/3593] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:32 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:32.883032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:01:33.047195 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b8441f4-06cb-42c7-b103-1ce6a849a4e2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 204 len: 0 microversion: 2.1 time: 0.247636 Sep 07 10:01:33.049056 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1805/3594] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:01:32 2022] DELETE /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:01:33.058991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:33.060047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:33.066622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:33.067890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:33.068695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:33.070363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:33.071473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:33.072148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:33.361668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:33.372279 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ed4cdd0c-ffb3-466a-8014-d339e9cf7d46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1510 microversion: 2.1 time: 0.318571 Sep 07 10:01:33.376861 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1790/3595] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:33 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:33.879369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:33.880080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:33.889959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:33.892745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:33.896054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:33.897608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:33.899010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:33.901106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:34.084574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:34.142089 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-680b9e0e-4e8c-4dfb-8fb1-a00e55c1ea68 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.266632 Sep 07 10:01:34.165711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1806/3596] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:33 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:34.406386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:34.407608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:34.417808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:34.418671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:34.420195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:34.422272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:34.423164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:34.424678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:34.683068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:34.694063 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8803006-e35d-47af-a277-ffebd3e5ec1c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1510 microversion: 2.1 time: 0.295352 Sep 07 10:01:34.694063 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1791/3597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:34 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:35.182480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:35.183783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:35.199148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:35.199985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:35.200538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:35.201405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:35.203934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:35.204528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:35.356409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:35.424158 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5b51f55-5258-4ab7-a9e5-f88a09bf867a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.230958 Sep 07 10:01:35.425339 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1807/3598] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:35 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:35.716741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:35.717398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:35.732742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:35.736488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:35.737157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:35.738783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:35.739436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:35.740114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:36.065428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:36.076095 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c6eda96d-5612-4484-91e7-4af9fda8c1da tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1510 microversion: 2.1 time: 0.363113 Sep 07 10:01:36.076963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1792/3599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:35 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:36.456981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:36.462753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:36.472642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:36.473485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:36.474159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:36.475119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:36.475852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:36.476766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:36.539536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-00c86acb-3618-434d-953d-e0e2d7e33f50 req-beb579fd-425c-468f-a867-6362c9e7ad42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3accfc03-7586-4d0b-becb-e1f3d1a0a078", "name": "network-vif-deleted", "tag": "dd3d8986-5e51-4be6-b047-d9922e0f10fc"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:36.563296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00c86acb-3618-434d-953d-e0e2d7e33f50 req-beb579fd-425c-468f-a867-6362c9e7ad42 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:36.565908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00c86acb-3618-434d-953d-e0e2d7e33f50 req-beb579fd-425c-468f-a867-6362c9e7ad42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:36.570556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-00c86acb-3618-434d-953d-e0e2d7e33f50 req-beb579fd-425c-468f-a867-6362c9e7ad42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:36.597130 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-00c86acb-3618-434d-953d-e0e2d7e33f50 req-beb579fd-425c-468f-a867-6362c9e7ad42 service nova] Creating event network-vif-deleted:dd3d8986-5e51-4be6-b047-d9922e0f10fc for instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 on n-h1-836830-16 Sep 07 10:01:36.614862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-00c86acb-3618-434d-953d-e0e2d7e33f50 req-beb579fd-425c-468f-a867-6362c9e7ad42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079313 Sep 07 10:01:36.616348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1793/3600] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:01:36.932392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:37.002233 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6687374-7897-49d4-88e7-66d1d25d629d tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.549030 Sep 07 10:01:37.005668 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1808/3601] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:36 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:37.102350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:37.103824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:37.123234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:37.123729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:37.128462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:37.129244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:37.129759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:37.131709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:37.199374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:37.199872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:37.200322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:37.200772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lazy-loading 'fault' on Instance uuid 3accfc03-7586-4d0b-becb-e1f3d1a0a078 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:37.520949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:37.534897 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ac5fd0f-3c72-46dc-b0e6-3401f19fd884 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 200 len: 1305 microversion: 2.1 time: 0.437359 Sep 07 10:01:37.559234 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1794/3602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:37 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 1305 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:38.042759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:38.043304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:38.050708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:38.051740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:38.052330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:38.053753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:38.054727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:38.055379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:38.161459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:38.185348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66ebd719-9b58-4d5d-a273-ce40cc8bea1c tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.147427 Sep 07 10:01:38.186364 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1809/3603] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:38 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:38.571638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:38.573494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:38.584248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:38.585590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:38.586633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:38.588248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:38.590434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:38.590953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:38.612383 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 HTTP/1.1 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3accfc03-7586-4d0b-becb-e1f3d1a0a078'} Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:38.615288 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:01:38.624364 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:38.627511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:38.628728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb6c8033-f06c-4502-9b45-dd9ac461b472 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 404 len: 111 microversion: 2.1 time: 0.063848 Sep 07 10:01:38.641666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:38.642547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:38.647387 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1795/3604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:38 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:01:38.651373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:38.651858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:38.652274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:38.653065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:38.653840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:38.655484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:38.936431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:38.949227 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1a863b2-9443-4c85-a6cb-8cec2798238f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.312661 Sep 07 10:01:38.949843 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1810/3605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:38 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:39.217517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:39.218767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:39.228417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:39.229922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:39.230418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:39.230860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:39.233727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:39.234242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:39.234683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:39.335150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-102e64d8-6a27-4a48-9c38-b52528ba01d6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-102e64d8-6a27-4a48-9c38-b52528ba01d6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 163 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": 12345, "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 12345 Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:01:39.342336 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 07 10:01:39.347727 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:39.355513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-102e64d8-6a27-4a48-9c38-b52528ba01d6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:39.356386 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-102e64d8-6a27-4a48-9c38-b52528ba01d6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026800 Sep 07 10:01:39.356974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1811/3606] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:39 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:39.386320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:39.387242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:39.407016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:39.419173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:39.420874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:39.422135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:39.425121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:39.425785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:39.484272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:39.550739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9c13b781-ab3b-40dd-a6eb-c3f16f1f5947 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.336506 Sep 07 10:01:39.552130 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1796/3607] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:39 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:39.812234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:39.834982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-14e5d44e-c1c3-46e3-8819-19c8f6f8b187 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.472406 Sep 07 10:01:39.837254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1812/3608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:39 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:39.869882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:39.870651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:39.881848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:39.882407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:39.883223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:39.889264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:39.890025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:39.890650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:39.953793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-113b177f-7a5d-4f4e-956d-cbc8f7e5d74c tempest-ComputeTenantNetworksTest-730344529 tempest-ComputeTenantNetworksTest-730344529-project] Calling method '.version_select at 0x7f14b1188e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:40.858930 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-113b177f-7a5d-4f4e-956d-cbc8f7e5d74c tempest-ComputeTenantNetworksTest-730344529 tempest-ComputeTenantNetworksTest-730344529-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.305485 Sep 07 10:01:40.860287 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1797/3609] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 10:01:39 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:40.868664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:40.870182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:40.884464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:40.885220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:40.885849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:40.886742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:40.887877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:40.888518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:40.896290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:40.918871 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2a958462-1399-404a-9796-fb5aada4d003 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.057937 Sep 07 10:01:40.925389 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1813/3610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:39 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:01:40.938092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb1bf1a8-ad06-4d40-98d3-f342d19c1670 tempest-ComputeTenantNetworksTest-730344529 tempest-ComputeTenantNetworksTest-730344529-project] Calling method '.version_select at 0x7f14b1dee310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:41.152796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:41.172138 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1fe02723-556f-4c4c-b6f2-b1c6a59147e3 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.308858 Sep 07 10:01:41.195578 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1798/3611] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:40 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:41.269137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb1bf1a8-ad06-4d40-98d3-f342d19c1670 tempest-ComputeTenantNetworksTest-730344529 tempest-ComputeTenantNetworksTest-730344529-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks/03aee6bf-cee7-459f-afdd-0b6ddf05ecb2" status: 200 len: 140 microversion: 2.1 time: 0.341584 Sep 07 10:01:41.270114 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1814/3612] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:01:40 2022] GET /compute/v2.1/os-tenant-networks/03aee6bf-cee7-459f-afdd-0b6ddf05ecb2 => generated 140 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:42.202715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:42.203423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:42.218673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:42.219184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:42.219635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:42.220367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:42.229408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:42.229965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:42.292098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:42.486999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:42.546113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14506d3e-e15b-4f51-a5a5-69d526c0dfe5 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.347435 Sep 07 10:01:42.550067 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1799/3613] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:42 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:43.581640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:43.582268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:43.593548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:43.594052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:43.594499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:43.595219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:43.595686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:43.600800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:43.663922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:43.791636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:43.854943 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41632391-9233-4dc9-9f75-e3937cf806cd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.273310 Sep 07 10:01:43.877800 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1815/3614] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:43 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:44.200738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a5781e6-475c-4509-ba2f-305aa9cc2346 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-528647248", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "245a820b-b023-46bb-a75e-c04f45ed4c7f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:44.358864 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2a5781e6-475c-4509-ba2f-305aa9cc2346 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Block Device 245a820b-b023-46bb-a75e-c04f45ed4c7f is not bootable. Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a5781e6-475c-4509-ba2f-305aa9cc2346 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 357 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-528647248", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "245a820b-b023-46bb-a75e-c04f45ed4c7f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: exception: Block Device 245a820b-b023-46bb-a75e-c04f45ed4c7f is not bootable. Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-528647248', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '245a820b-b023-46bb-a75e-c04f45ed4c7f'}], 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 245a820b-b023-46bb-a75e-c04f45ed4c7f is not bootable. Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:44.367985 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 245a820b-b023-46bb-a75e-c04f45ed4c7f is not bootable. Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 245a820b-b023-46bb-a75e-c04f45ed4c7f is not bootable. Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a5781e6-475c-4509-ba2f-305aa9cc2346 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Block Device 245a820b-b023-46bb-a75e-c04f45ed4c7f is not bootable. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a5781e6-475c-4509-ba2f-305aa9cc2346 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.173704 Sep 07 10:01:44.376420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1800/3615] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:44 2022] POST /compute/v2.1/servers => generated 110 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:44.383893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:44.385155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:44.403132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:44.404182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:44.408427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:44.409994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:44.415900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:44.418491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:44.826341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:44.839434 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbee2aef-b126-4ac6-a460-fb4f9a30f084 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.460546 Sep 07 10:01:44.846853 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1816/3616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:44 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:44.876948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:44.877627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:44.888577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:44.889082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:44.890030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:44.890914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:44.891687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:44.892439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:44.900167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:44.900691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:44.906011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:44.910614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:44.911344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:44.912384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:44.913514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:44.914204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:45.086943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:45.147176 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-279e954f-5a43-42d3-9d34-ecaa4dab7bad tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.261786 Sep 07 10:01:45.161439 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1817/3617] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:44 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:45.238427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:45.249782 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0e2adbe-c91e-4533-bb3f-b2367fb686c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.378615 Sep 07 10:01:45.250622 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1801/3618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:44 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:46.188021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:46.188021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:46.213654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:46.214683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:46.216807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:46.219312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:46.221121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:46.221911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:46.540911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:46.594101 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6fd7ff9-9369-4299-b372-0f0df38ab046 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.419824 Sep 07 10:01:46.595033 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1818/3619] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:46 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:47.634409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:47.634409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:47.650993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:47.653929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:47.655043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:47.659123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:47.659824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:47.660313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:47.880626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:47.909156 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e6995d8-51af-4e33-be1c-87372aff6100 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.282311 Sep 07 10:01:47.909916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1802/3620] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:47 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:48.340907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0149cf58-9ea5-4b93-bd36-8ac879895859 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213757649", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "destination_type": "local"}, {"source_type": "volume", "uuid": "1c03d889-f07f-4ca3-a89c-ab018c9fcb82", "destination_type": "invalid"}], "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0149cf58-9ea5-4b93-bd36-8ac879895859 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 494 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213757649", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "destination_type": "local"}, {"source_type": "volume", "uuid": "1c03d889-f07f-4ca3-a89c-ab018c9fcb82", "destination_type": "invalid"}], "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-213757649', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1c03d889-f07f-4ca3-a89c-ab018c9fcb82', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:48.347011 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0149cf58-9ea5-4b93-bd36-8ac879895859 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0149cf58-9ea5-4b93-bd36-8ac879895859 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013691 Sep 07 10:01:48.351818 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1819/3621] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:48 2022] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:48.364713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:48.365476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:48.373617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:48.374109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:48.374736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:48.377698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:48.379178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:48.379796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:48.940798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:48.941445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:48.955484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:48.961431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:48.962396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:48.963535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:48.964251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:48.964938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:49.343995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:49.348842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:49.367693 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3aaef50-cd1f-4e25-ae84-ed114d3ed59a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.009108 Sep 07 10:01:49.373630 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1803/3622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:48 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:49.405555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:49.406475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:49.416170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9925fe12-d486-4f2c-b3c3-d1c6dd0b9563 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.480541 Sep 07 10:01:49.419912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:49.421320 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1820/3623] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:48 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:49.422894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:49.425966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:49.426898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:49.427524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:49.428422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:49.965011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:49.987804 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7253b722-6e40-4ea5-bc65-33146c32dd44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.587781 Sep 07 10:01:49.988412 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1804/3624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:49 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:50.236439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9dda200-63b5-469e-91d1-2aaa37410a13 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-533114721", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9dda200-63b5-469e-91d1-2aaa37410a13 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 491 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-533114721", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-533114721', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 07 10:01:50.253381 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 10:01:50.257664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:50.261522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9dda200-63b5-469e-91d1-2aaa37410a13 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:50.264731 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9dda200-63b5-469e-91d1-2aaa37410a13 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.033260 Sep 07 10:01:50.265733 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1821/3625] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:50 2022] POST /compute/v2.1/servers => generated 624 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:50.274664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:50.275342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:50.282548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:50.283057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:50.283485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:50.291103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:50.291680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:50.292138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:50.448804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:50.449340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:50.463469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:50.467547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:50.468233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:50.471676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:50.472427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:50.473150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:50.661932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:50.720508 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f6acba8-5f57-4a72-b24c-7428be92943a tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.273172 Sep 07 10:01:50.721444 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1822/3626] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:50 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:50.831030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:50.849440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2716340d-422b-453a-ba65-8d87ed6008ec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.578394 Sep 07 10:01:50.873444 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1805/3627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:50 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:50.878705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:50.879650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:50.888229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:50.889665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:50.890409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:50.891570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:50.893488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:50.894802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.216802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:51.238464 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90087d64-9a9f-4b28-9e3a-d7722d8a5a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.363972 Sep 07 10:01:51.240737 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1823/3628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:50 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:51.413388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02878fcb-720e-4bee-83cd-a01d015f1a07 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02878fcb-720e-4bee-83cd-a01d015f1a07 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 416 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.420482 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02878fcb-720e-4bee-83cd-a01d015f1a07 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-02878fcb-720e-4bee-83cd-a01d015f1a07 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028887 Sep 07 10:01:51.427913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1806/3629] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:51 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:51.441141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:51.441792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:51.450921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:51.451512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:51.451856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.452569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:51.453029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:51.453486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.729329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:51.738810 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6297c9ce-7d1a-4964-ae46-94ad7ff144c7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.308182 Sep 07 10:01:51.739883 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1824/3630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:51 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:51.756244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:51.756918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:51.769609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:51.769960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:51.770102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:51.770542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.770678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:51.771253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:51.771712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:51.772125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.778370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:51.778867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:51.779312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.780817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:51.781379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:51.781879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:51.985002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:52.040998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8bb5577-feba-4089-84ba-62aa4dbe4780 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.289239 Sep 07 10:01:52.043539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1807/3631] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:51 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:52.169459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:52.183646 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51104f21-dd10-46e8-ab52-67585ed5adf2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.416064 Sep 07 10:01:52.186239 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1825/3632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:51 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:52.472098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcc4830f-4d26-453d-ad9c-f08f5e783156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224871250", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": -1, "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:52.511157 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fcc4830f-4d26-453d-ad9c-f08f5e783156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Flavor -1 could not be found. Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcc4830f-4d26-453d-ad9c-f08f5e783156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 206 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224871250", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": -1, "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: exception: Flavor -1 could not be found. Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1224871250', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': -1, 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:52.522701 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcc4830f-4d26-453d-ad9c-f08f5e783156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcc4830f-4d26-453d-ad9c-f08f5e783156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.058044 Sep 07 10:01:52.532830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1808/3633] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:52 2022] POST /compute/v2.1/servers => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:01:52.535794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:52.536279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:52.549085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:52.549527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:52.549981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:52.552667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:52.553161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:52.554982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:52.904790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:52.915630 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ba9aae1b-f2f0-4e37-a608-45321cca2223 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.385522 Sep 07 10:01:52.921501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1826/3634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:52 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:52.942974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:52.944938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:52.955887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:52.956787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:52.957953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:52.959345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:52.962005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:52.962984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:53.075991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:53.076635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:53.089161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:53.089780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:53.092034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:53.094363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:53.096412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:53.097113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:53.297887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:53.333738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:53.351921 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9fbfeb4-43bb-43ee-92b7-22c057d93bcd tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.279862 Sep 07 10:01:53.353080 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1827/3635] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:53 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:53.355189 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6856246f-782c-4aba-b0b3-beb01a4c1a57 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.414460 Sep 07 10:01:53.373354 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1809/3636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:52 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:53.517259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4322b092-6928-4ab6-aeb8-13adb7ebb5fe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1533346848", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4322b092-6928-4ab6-aeb8-13adb7ebb5fe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 173 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1533346848", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1533346848', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi -1 Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:01:53.530191 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 07 10:01:53.536921 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:53.540429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4322b092-6928-4ab6-aeb8-13adb7ebb5fe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:53.541533 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4322b092-6928-4ab6-aeb8-13adb7ebb5fe tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.035355 Sep 07 10:01:53.542673 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1828/3637] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:53 2022] POST /compute/v2.1/servers => generated 145 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:53.555769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:53.557260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:53.579495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:53.581467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:53.582344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:53.583265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:53.583897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:53.584516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:53.892909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:53.903433 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45a82892-0014-492b-9697-5dc6c96c53fc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.355561 Sep 07 10:01:53.904960 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1810/3638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:53 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:53.936380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:53.937491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:53.947218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:53.949085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:53.949763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:53.950872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:53.951539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:53.952377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:54.138294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:54.148591 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5656be04-5119-46e8-bc91-801cd4bd0714 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.218728 Sep 07 10:01:54.149603 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1829/3639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:53 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:54.263585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-91190957-a1b4-41b8-93cb-49037a2d62a2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1252462468", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:54.274662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-91190957-a1b4-41b8-93cb-49037a2d62a2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-91190957-a1b4-41b8-93cb-49037a2d62a2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 216 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1252462468", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1252462468', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:54.279888 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-91190957-a1b4-41b8-93cb-49037a2d62a2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:54.285002 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-91190957-a1b4-41b8-93cb-49037a2d62a2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025688 Sep 07 10:01:54.287668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1811/3640] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:54 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:54.298829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:54.299460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:54.309680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:54.310169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:54.310623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:54.315682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:54.316212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:54.316652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:54.384922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:54.385689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:54.404053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:54.404627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:54.405016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:54.405769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:54.406231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:54.406660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:55.139289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:55.185896 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8cf5adad-9071-49b8-b93a-75144505c081 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.803992 Sep 07 10:01:55.188426 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1812/3641] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:54 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:55.661092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:55.686591 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27f34c64-5193-42c0-af19-e4e6a2327b99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.392215 Sep 07 10:01:55.690711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1830/3642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:54 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:55.725564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:55.726842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:55.742265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:55.742771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:55.743216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:55.752504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:55.753019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:55.753500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:56.084902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:56.097641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-caf6c0cf-2b37-4bb2-8475-892dbcb2bd55 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.374471 Sep 07 10:01:56.104579 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1813/3643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:55 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:56.207828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cd5cc44-b45e-45e6-b108-b5b77afe335f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267644206", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-key-876274196", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:56.224107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:56.224662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:56.236592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:56.254915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:56.261843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:56.264951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:56.266295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:56.270163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:56.273922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:56.329810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-5cd5cc44-b45e-45e6-b108-b5b77afe335f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] validate_networks() for [('ffb7e619-ff58-4e6d-bd05-cbb26b7295a0', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:01:56.836789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:56.930762 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74e1debb-7a3a-491b-a2ed-252643abfd09 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1931 microversion: 2.75 time: 0.704865 Sep 07 10:01:56.953876 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1814/3644] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:56 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1931 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:57.220680 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5cd5cc44-b45e-45e6-b108-b5b77afe335f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Invalid key_name provided. Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cd5cc44-b45e-45e6-b108-b5b77afe335f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 246 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267644206", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-key-876274196", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid key_name provided. Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1267644206', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'key_name': 'tempest-key-876274196', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-876274196 not found for user da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:57.226925 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 07 10:01:57.233278 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:01:57.240089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cd5cc44-b45e-45e6-b108-b5b77afe335f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid key_name provided. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:57.245138 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cd5cc44-b45e-45e6-b108-b5b77afe335f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.040625 Sep 07 10:01:57.247687 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1831/3645] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 1045 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:01:57.256750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:57.257797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:57.265026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:57.265558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:57.266185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:57.266920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:57.267391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:57.267888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:57.813599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:57.826129 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8fd39df0-a5dd-41c9-ad5f-cf24a0ef9d7e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.574091 Sep 07 10:01:57.826733 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1815/3646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:57 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:57.858386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:57.859020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:57.872791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:57.873122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:57.873616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:57.874337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:57.874804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:57.875232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:57.967956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:57.968585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:57.981862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:57.982637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:57.983418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:57.985069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:57.985810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:57.988050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:58.207407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:58.258648 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2ede342-f26f-47be-9851-0577c114a3c4 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1937 microversion: 2.75 time: 0.294230 Sep 07 10:01:58.262026 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1816/3647] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:57 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1937 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:01:58.439637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:58.450096 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7bd2e879-a6c9-4eac-b844-e3ee89da83ad tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.595630 Sep 07 10:01:58.450699 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1832/3648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:57 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:58.625322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08bf106c-7128-4517-9f4e-77407ded6a12 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1349843234", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:58.900977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-08bf106c-7128-4517-9f4e-77407ded6a12 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Neutron security group does_not_exist not found {{(pid=128832) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 07 10:01:58.901851 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-08bf106c-7128-4517-9f4e-77407ded6a12 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08bf106c-7128-4517-9f4e-77407ded6a12 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 258 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1349843234", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1349843234', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 07 10:01:58.914851 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:01:58.919393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08bf106c-7128-4517-9f4e-77407ded6a12 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:01:58.931001 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08bf106c-7128-4517-9f4e-77407ded6a12 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.297932 Sep 07 10:01:58.931001 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1817/3649] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:01:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:01:58.940722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:58.941743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:58.950252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:58.951516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:58.952206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:58.953195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:58.953904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:58.954587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:59.155597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f50b357f-667f-4b5e-978a-9aaf28dfab32 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: .version_select at 0x7f14b1deee50>, body: {"keypair": {"name": "tempest-keypair-1282856202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWG5IXBq6FxqDJDgd2TdJi1Lp4zpgTSo1VI0zv0bKh/VRDkXQ2sEhi+9xctR/HyHCFUDGhTPEd6igXcCaw8R9hiWfYF3tc3FugvXyVGav778b3Bwj7K2F8SSkJ3K0VI2Q=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:01:59.191797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f50b357f-667f-4b5e-978a-9aaf28dfab32 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for project 357930c7a1e64d09bac384b1c27d002c. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:01:59.208390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f50b357f-667f-4b5e-978a-9aaf28dfab32 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for user 8ffce8dfc8c640328effeb5ae97acc66 and project 357930c7a1e64d09bac384b1c27d002c. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:01:59.259845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f50b357f-667f-4b5e-978a-9aaf28dfab32 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.428389 Sep 07 10:01:59.268243 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1833/3650] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:01:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:01:59.299167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:59.300225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:59.313801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:59.317295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:59.318231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:59.320456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:59.323183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:59.323938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:59.684837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:01:59.693595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:01:59.746060 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-797778d7-e595-454b-af54-3ec68eaeb831 tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1937 microversion: 2.75 time: 0.454603 Sep 07 10:01:59.747661 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1834/3651] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:01:59 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1937 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:01:59.908601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:01:59.923300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-64cf479f-0f0f-40cc-bd9f-d536b24124ee tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.990212 Sep 07 10:01:59.933882 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1818/3652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:58 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:01:59.961044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:01:59.961530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:01:59.989689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:01:59.992913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:01:59.997722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:01:59.999842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:00.001507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:00.003870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:00.357703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:00.370313 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c65a8acd-34a6-4da7-a78f-507fc6cd2d25 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.413016 Sep 07 10:02:00.373329 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1835/3653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:01:59 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:00.400518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81253473-2a41-424c-a6d3-317f3ca3d7f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:00.401435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81253473-2a41-424c-a6d3-317f3ca3d7f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 81e4b477-af53-4c2d-b8f7-8462e03fc61e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:00.422864 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-81253473-2a41-424c-a6d3-317f3ca3d7f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 81e4b477-af53-4c2d-b8f7-8462e03fc61e could not be found. Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81253473-2a41-424c-a6d3-317f3ca3d7f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/81e4b477-af53-4c2d-b8f7-8462e03fc61e HTTP/1.1 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 81e4b477-af53-4c2d-b8f7-8462e03fc61e could not be found. Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '81e4b477-af53-4c2d-b8f7-8462e03fc61e'} Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e4b477-af53-4c2d-b8f7-8462e03fc61e could not be found. Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e4b477-af53-4c2d-b8f7-8462e03fc61e could not be found. Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:00.424473 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e4b477-af53-4c2d-b8f7-8462e03fc61e could not be found. Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:00.429993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81253473-2a41-424c-a6d3-317f3ca3d7f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 81e4b477-af53-4c2d-b8f7-8462e03fc61e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:00.435061 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81253473-2a41-424c-a6d3-317f3ca3d7f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81e4b477-af53-4c2d-b8f7-8462e03fc61e" status: 404 len: 111 microversion: 2.1 time: 0.039093 Sep 07 10:02:00.439247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1819/3654] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:02:00 2022] DELETE /compute/v2.1/servers/81e4b477-af53-4c2d-b8f7-8462e03fc61e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:00.445757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:00.446387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:00.464827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:00.465377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:00.465830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:00.466564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:00.471408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:00.471984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:00.781536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:00.782504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:00.795028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:00.798208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:00.798880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:00.799832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:00.801114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:00.802275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:00.816666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:01.027025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] Lazy-loading 'services' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:02:01.175759 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d167bd2-c141-4fc6-97c0-c21602c274ed tempest-ServersAdmin275Test-1474674397 tempest-ServersAdmin275Test-1474674397-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1922 microversion: 2.75 time: 0.397830 Sep 07 10:02:01.176472 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1820/3655] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:00 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1922 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:02:01.226810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:01.226810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:01.234632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:01.235294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:01.235571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:01.236299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:01.237663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:01.238365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:01.306913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:02:01.548542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:01.569761 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f2d849b-6d6c-4687-b6ee-2b8adfd58208 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.128306 Sep 07 10:02:01.591827 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1836/3656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:00 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:01.613421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:01.616571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:01.662051 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5248e63b-1bc2-495b-a8bb-8dc4fc4f6f64 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 204 len: 0 microversion: 2.75 time: 0.442943 Sep 07 10:02:01.662674 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1821/3657] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:02:01 2022] DELETE /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:02:01.675370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:01.675720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:01.676165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:01.677033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:01.677526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:01.677954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:01.680484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:01.682481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:01.717165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:01.717677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:01.718132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:01.718864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:01.719325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:01.719761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:01.943975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:01.963240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:01.974965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:02.003279 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2e20f43-248d-40b0-97d8-96359e0c268f tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1444 microversion: 2.75 time: 0.332819 Sep 07 10:02:02.005524 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1822/3658] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:01 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1444 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:02.822210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:02.839560 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-061958c3-a667-4bc6-81d3-86f132d55776 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.239797 Sep 07 10:02:02.840164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1837/3659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:01 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:02.878203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d29ae02-a400-4a1f-a464-a430ad14855f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:02.879401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d29ae02-a400-4a1f-a464-a430ad14855f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 10:02:02.880123 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9d29ae02-a400-4a1f-a464-a430ad14855f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d29ae02-a400-4a1f-a464-a430ad14855f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 9223372036854775808 could not be found. Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '9223372036854775808'} Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:02.883056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:02.888902 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:02.888902 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:02.888902 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:02.888902 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 07 10:02:02.888902 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:02.894076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d29ae02-a400-4a1f-a464-a430ad14855f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:02.898304 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d29ae02-a400-4a1f-a464-a430ad14855f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024822 Sep 07 10:02:02.899467 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1823/3660] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Sep 7 10:02:02 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 10:02:02.910311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:02.911537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:02.931113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:02.932175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:02.932798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:02.940038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:02.940858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:02.941493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:03.035912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:03.036594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:03.055524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:03.056134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:03.060145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:03.061211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:03.062187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:03.063015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:03.283115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:03.332683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:03.337803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:03.353692 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0638ab7a-6dec-428c-9ec2-2b4feed5d316 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1444 microversion: 2.75 time: 0.320413 Sep 07 10:02:03.355004 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1824/3661] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:03 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1444 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:02:03.632946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:03.641875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-528140f0-6fd5-42c1-87a7-45b0ac6033f6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.736473 Sep 07 10:02:03.650317 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1838/3662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:02 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:03.680854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:03.681794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:03.710700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:03.711439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:03.712541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:03.713858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:03.716710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:03.717440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:04.391125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:04.392489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:04.431538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:04.446636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3056083-2b1d-4dca-91c1-2447a3a90eb3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.767880 Sep 07 10:02:04.449404 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1825/3663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:03 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:04.460525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:04.460525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:04.461628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:04.462445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:04.462938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:04.463381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:04.498622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c308a6e-56cc-4c69-8b3a-f9677fa253df tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:04.499190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c308a6e-56cc-4c69-8b3a-f9677fa253df tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Failed to fetch instance by id -1 {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 10:02:04.505757 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7c308a6e-56cc-4c69-8b3a-f9677fa253df tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance -1 could not be found. Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c308a6e-56cc-4c69-8b3a-f9677fa253df tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance -1 could not be found. Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '-1'} Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:04.516977 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:04.521796 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:04.521796 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:04.521796 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 07 10:02:04.521796 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:04.521796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c308a6e-56cc-4c69-8b3a-f9677fa253df tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:04.521796 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c308a6e-56cc-4c69-8b3a-f9677fa253df tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.050626 Sep 07 10:02:04.525354 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1826/3664] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 10:02:04 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:02:04.555199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:04.561694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:04.562551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:04.563426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lazy-loading 'fault' on Instance uuid dfa20119-34c3-43dd-8e48-5c66b2809f21 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:02:04.565999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:04.583023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:04.614264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:04.618736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:04.619326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:04.621067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:04.625564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:04.626146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:04.641576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:04.653281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:04.655102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5c52784223c4be3856246d12927ca09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2e8eba59c64f43aa53b66273458623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:04.661009 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e712507b-ec50-4e17-acd5-ec98b4fc14a1 tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 200 len: 1449 microversion: 2.75 time: 0.274525 Sep 07 10:02:04.675437 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1839/3665] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:04 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 1449 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:02:04.934211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:04.960714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6579e6fa-42e5-4359-b68c-f34881390826 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.431880 Sep 07 10:02:04.962039 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1827/3666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:04 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:04.990015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:04.990843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:05.001993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:05.002810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:05.003442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:05.006907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:05.007669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:05.008323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:05.655617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:05.691909 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6dfddba-a564-40b8-b143-83a4056471b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.705806 Sep 07 10:02:05.693362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:05.713626 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1840/3667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:04 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:05.731544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] [instance: dfa20119-34c3-43dd-8e48-5c66b2809f21] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:05.738706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f26fe25e-e09e-4653-a3e6-20bd923056dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:05.739417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f26fe25e-e09e-4653-a3e6-20bd923056dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 0cfbf307-d7f9-42c5-b646-38ae7e43e055] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:05.753864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:05.759490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:05.760555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:05.767394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:05.768200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:05.768764 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f26fe25e-e09e-4653-a3e6-20bd923056dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 0cfbf307-d7f9-42c5-b646-38ae7e43e055 could not be found. Sep 07 10:02:05.769478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f26fe25e-e09e-4653-a3e6-20bd923056dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/0cfbf307-d7f9-42c5-b646-38ae7e43e055/action HTTP/1.1 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 19 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: {"forceDelete": {}} Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 0cfbf307-d7f9-42c5-b646-38ae7e43e055 could not be found. Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '0cfbf307-d7f9-42c5-b646-38ae7e43e055', 'body': {'forceDelete': {}}} Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cfbf307-d7f9-42c5-b646-38ae7e43e055 could not be found. Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cfbf307-d7f9-42c5-b646-38ae7e43e055 could not be found. Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:05.777341 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cfbf307-d7f9-42c5-b646-38ae7e43e055 could not be found. Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f26fe25e-e09e-4653-a3e6-20bd923056dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 0cfbf307-d7f9-42c5-b646-38ae7e43e055 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f26fe25e-e09e-4653-a3e6-20bd923056dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/0cfbf307-d7f9-42c5-b646-38ae7e43e055/action" status: 404 len: 111 microversion: 2.1 time: 0.047199 Sep 07 10:02:05.783947 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1841/3668] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:05 2022] POST /compute/v2.1/servers/0cfbf307-d7f9-42c5-b646-38ae7e43e055/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:05.792851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:05.798764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:05.801428 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] HTTP exception thrown: Instance dfa20119-34c3-43dd-8e48-5c66b2809f21 could not be found. Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Request method failure captured: Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 HTTP/1.1 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvGr39T1b8xZCrV85r_7NPv886GIsiNzuQn-jtqZ_P5U0HjTaEAtt2Ccs4svqWjeCyxxsgi0HetAamT4YuAXnpWs1bao1UlBDPLeHxZ43rrRdijhQGkCN3riRIaT3MxubFvdASE7n7kM8UbA_LeDqkZOOw_KHl3pE4xMXZRwJYwrpE Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.75 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: aa2e8eba59c64f43aa53b66273458623 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdmin275Test-894691989 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aa2e8eba59c64f43aa53b66273458623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aa2e8eba59c64f43aa53b66273458623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aa2e8eba59c64f43aa53b66273458623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aa2e8eba59c64f43aa53b66273458623", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdmin275Test-894691989 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: aa2e8eba59c64f43aa53b66273458623 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdmin275Test-894691989 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdmin275Test-894691989-project Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d5c52784223c4be3856246d12927ca09 Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdmin275Test-894691989-project Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance dfa20119-34c3-43dd-8e48-5c66b2809f21 could not be found. Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'dfa20119-34c3-43dd-8e48-5c66b2809f21'} Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa20119-34c3-43dd-8e48-5c66b2809f21 could not be found. Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa20119-34c3-43dd-8e48-5c66b2809f21 could not be found. Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:05.807484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa20119-34c3-43dd-8e48-5c66b2809f21 could not be found. Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:05.817339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] Returning 404 to user: Instance dfa20119-34c3-43dd-8e48-5c66b2809f21 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:05.819547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:05.819727 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1404eac1-f503-4895-a015-d458ca3dfdaa tempest-ServersAdmin275Test-894691989 tempest-ServersAdmin275Test-894691989-project] 10.222.0.60 "GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21" status: 404 len: 111 microversion: 2.75 time: 0.120269 Sep 07 10:02:05.819912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:05.819912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:05.819912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:05.820437 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1828/3669] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:05 2022] GET /compute/v2.1/servers/dfa20119-34c3-43dd-8e48-5c66b2809f21 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:02:05.820648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:05.820648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:05.821209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1926972905", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e09fd04b-8409-45b6-802a-0ddc09260d65"}], "security_groups": [{"name": "tempest-securitygroup--1405716460"}], "key_name": "tempest-keypair-1282856202", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:06.240308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:06.245610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] validate_networks() for [('e09fd04b-8409-45b6-802a-0ddc09260d65', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:02:06.263479 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c38cf7e-1179-4745-a88e-9ad8f8d0563e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.473667 Sep 07 10:02:06.264569 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1842/3670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:05 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:06.656536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1004097884", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "22ee3e1e-9cfe-459e-80c6-c6e953b443f1"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:06.747498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] validate_networks() for [('22ee3e1e-9cfe-459e-80c6-c6e953b443f1', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:02:07.479092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:02:07.480174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:02:07.480833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:02:07.481467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:02:07.482058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:02:07.502817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:07.503299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:07.503761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:07.504486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:07.504944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:07.505409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:07.552827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for project 357930c7a1e64d09bac384b1c27d002c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:02:07.573925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for user 8ffce8dfc8c640328effeb5ae97acc66 and project 357930c7a1e64d09bac384b1c27d002c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:02:07.594014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:02:07.596953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:02:07.647587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:07.734897 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a99b45bf-0b5f-4e0e-a0e6-37a60fe8511d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.922947 Sep 07 10:02:07.750839 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1829/3671] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:02:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:02:07.771023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:07.788839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:07.833686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:07.835976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:07.836465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:07.838142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:07.840179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:07.840790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:07.891947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:02:07.892941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:02:07.893638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:02:07.894409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:02:07.895002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:02:07.912239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:07.914144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:07.915446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:07.916403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:07.917173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:07.917971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:07.950390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Getting quotas for project 72ee55bcd47446788d54a6c114e9b88c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:02:07.957385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Getting quotas for user f2655105ab29436ba12c79423eaecaf0 and project 72ee55bcd47446788d54a6c114e9b88c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:02:07.989913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:02:07.992703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:02:08.086571 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70a9de14-0878-4cae-aeec-7fd58612dfb6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820816 Sep 07 10:02:08.087252 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1843/3672] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:02:08.104420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-13e901a3-de0d-4f41-aa62-cc8c9ab2829c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:08.107870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-13e901a3-de0d-4f41-aa62-cc8c9ab2829c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:08.237731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-13e901a3-de0d-4f41-aa62-cc8c9ab2829c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:08.247521 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-13e901a3-de0d-4f41-aa62-cc8c9ab2829c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1238 microversion: 2.1 time: 0.152734 Sep 07 10:02:08.248122 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1844/3673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:08 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1238 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:08.283308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e772fa1-7c47-4624-a198-7f0d862df3e1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:08.285366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1e772fa1-7c47-4624-a198-7f0d862df3e1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:08.329723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:08.338867 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b68526f-509d-4760-b3a4-a10afa67cb83 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.586858 Sep 07 10:02:08.345006 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1830/3674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:07 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:08.371742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dcdb2bd-604f-4c85-9dad-bb27ebf43550 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:08.374448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3dcdb2bd-604f-4c85-9dad-bb27ebf43550 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 9bb7e347-f26a-407a-9506-3735a75e3853] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:08.386925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3dcdb2bd-604f-4c85-9dad-bb27ebf43550 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 9bb7e347-f26a-407a-9506-3735a75e3853 could not be found. Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dcdb2bd-604f-4c85-9dad-bb27ebf43550 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/9bb7e347-f26a-407a-9506-3735a75e3853/action HTTP/1.1 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 39 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: {"os-getConsoleOutput": {"length": 10}} Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 9bb7e347-f26a-407a-9506-3735a75e3853 could not be found. Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '9bb7e347-f26a-407a-9506-3735a75e3853', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb7e347-f26a-407a-9506-3735a75e3853 could not be found. Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb7e347-f26a-407a-9506-3735a75e3853 could not be found. Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:08.401390 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:08.410001 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:08.410001 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:08.410001 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:08.410001 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:08.410001 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb7e347-f26a-407a-9506-3735a75e3853 could not be found. Sep 07 10:02:08.410001 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:08.414379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dcdb2bd-604f-4c85-9dad-bb27ebf43550 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 9bb7e347-f26a-407a-9506-3735a75e3853 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:08.430147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3dcdb2bd-604f-4c85-9dad-bb27ebf43550 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/9bb7e347-f26a-407a-9506-3735a75e3853/action" status: 404 len: 111 microversion: 2.1 time: 0.055540 Sep 07 10:02:08.432842 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1831/3675] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:08 2022] POST /compute/v2.1/servers/9bb7e347-f26a-407a-9506-3735a75e3853/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:08.448397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:08.451781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:08.469671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:08.474377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:08.476174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:08.477501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:08.480300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:08.481557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:08.502758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e772fa1-7c47-4624-a198-7f0d862df3e1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:08.523662 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e772fa1-7c47-4624-a198-7f0d862df3e1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1228 microversion: 2.1 time: 0.249124 Sep 07 10:02:08.526303 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1845/3676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:08 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1228 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:08.973502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:08.997683 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-012e600d-40c4-4bc3-a76d-700965b32c5f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.558372 Sep 07 10:02:08.999405 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1832/3677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:08 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:09.029722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:09.030365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:09.039594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.054484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.054883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.055901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.056556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.057269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.273327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:09.274329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:09.284599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.288135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.288843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.290538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.292324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.294881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.478732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:09.487900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:09.512184 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db5f3106-0725-414e-a394-527d7b1142f8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1234 microversion: 2.1 time: 0.243817 Sep 07 10:02:09.514398 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8a2d6170-a159-41d5-8143-0e8a7c03f312 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.488204 Sep 07 10:02:09.517252 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1846/3678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:09 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:09.517399 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1833/3679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:09 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1234 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:09.552070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:09.552880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:09.561571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f11e6813-000e-47ae-a6c7-828f028c3566 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:09.562634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f11e6813-000e-47ae-a6c7-828f028c3566 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: ccd71b12-0d6f-49e8-b77f-bd8dee7302bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:09.578674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f11e6813-000e-47ae-a6c7-828f028c3566 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance ccd71b12-0d6f-49e8-b77f-bd8dee7302bf could not be found. Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f11e6813-000e-47ae-a6c7-828f028c3566 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/ccd71b12-0d6f-49e8-b77f-bd8dee7302bf HTTP/1.1 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance ccd71b12-0d6f-49e8-b77f-bd8dee7302bf could not be found. Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ccd71b12-0d6f-49e8-b77f-bd8dee7302bf'} Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd71b12-0d6f-49e8-b77f-bd8dee7302bf could not be found. Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd71b12-0d6f-49e8-b77f-bd8dee7302bf could not be found. Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:09.582259 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:09.590439 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:09.590439 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:09.590439 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:09.590439 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd71b12-0d6f-49e8-b77f-bd8dee7302bf could not be found. Sep 07 10:02:09.590439 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:09.591176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.591486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f11e6813-000e-47ae-a6c7-828f028c3566 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance ccd71b12-0d6f-49e8-b77f-bd8dee7302bf could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:09.592054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.593770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.594320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f11e6813-000e-47ae-a6c7-828f028c3566 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/ccd71b12-0d6f-49e8-b77f-bd8dee7302bf" status: 404 len: 111 microversion: 2.1 time: 0.034914 Sep 07 10:02:09.595444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.596200 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1834/3680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:09 2022] GET /compute/v2.1/servers/ccd71b12-0d6f-49e8-b77f-bd8dee7302bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:09.599606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.601002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.623446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:09.626434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:09.638766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.639275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.639777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.641109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.643556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.644297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.720289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:09.737751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7dc233a-abdd-4bdc-a805-3494792ec65c tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1224 microversion: 2.1 time: 0.186477 Sep 07 10:02:09.739105 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1847/3681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:09 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1224 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:09.899766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:09.909130 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99189cbe-4c9c-473c-bb1f-86a25c43d035 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.305411 Sep 07 10:02:09.914975 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1835/3682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:09 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:09.939558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:09.940562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:09.953125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.953997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.954630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:09.956328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:09.959752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:09.960751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.318257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:10.342097 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49ae2940-51ce-4c50-9d7e-6a0e8df788b6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.406626 Sep 07 10:02:10.342736 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1848/3683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:09 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:10.550941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:10.551676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:10.562037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:10.562543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:10.562997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.567603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:10.568722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:10.569798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.636731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d404670-1194-47b0-a8f9-a7413850a49c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640743750", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d404670-1194-47b0-a8f9-a7413850a49c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 238 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640743750", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1640743750', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.666869 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d404670-1194-47b0-a8f9-a7413850a49c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d404670-1194-47b0-a8f9-a7413850a49c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037909 Sep 07 10:02:10.675819 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1849/3684] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:02:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:02:10.691313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:10.702805 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15159a99-cece-4f43-81a3-45f98739ebf0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1290 microversion: 2.1 time: 0.155916 Sep 07 10:02:10.704028 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1836/3685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:10 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:10.705821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:10.706612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:10.734807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:10.735327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:10.735779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.740288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:10.741364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:10.745269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.766401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:10.767471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:10.779176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:10.782726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:10.785042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.786121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:10.786823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:10.787450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:10.961445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:11.016163 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe1cd69f-3e1e-4207-89c2-5aea46de8f53 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1224 microversion: 2.1 time: 0.247283 Sep 07 10:02:11.020667 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1837/3686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:10 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1224 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:11.191220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:11.203236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb2f3b00-3353-4866-8d1e-30771ed3582c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.529051 Sep 07 10:02:11.204651 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1850/3687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:10 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:11.247046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:11.248663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:11.301426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:11.301940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:11.302391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:11.303647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:11.304130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:11.304695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:11.644437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:11.659957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58768f7c-f95e-4084-85b7-e6931aa0f1af tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.428114 Sep 07 10:02:11.752491 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1838/3688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:11 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:11.756038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:11.756038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:11.767953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:11.769527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:11.770000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:11.772879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:11.775145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:11.775603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:11.971948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:11.991781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5d52b04-33ff-4140-a35c-0325031ae1b8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1429194039", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:12.006792 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5078009c-fcf6-4c1a-9c66-609cd1c0d3a2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1296 microversion: 2.1 time: 0.281218 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5d52b04-33ff-4140-a35c-0325031ae1b8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 235 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1429194039", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1429194039', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.007787 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 07 10:02:12.010676 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.014312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5d52b04-33ff-4140-a35c-0325031ae1b8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:12.015376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1851/3689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:11 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1296 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:12.016855 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5d52b04-33ff-4140-a35c-0325031ae1b8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.034139 Sep 07 10:02:12.017916 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1839/3690] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:02:11 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:02:12.060589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:12.062869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:12.065082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:12.066705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:12.079547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.081059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.081952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.082866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.084186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.085980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.092123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.094028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.094737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.103067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.105751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.107833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.435182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:12.463776 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-256c9186-bde1-4f68-b162-9d78438c6352 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1286 microversion: 2.1 time: 0.418411 Sep 07 10:02:12.465054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1852/3691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:12 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1286 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:12.514053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:12.536355 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9663ad1-1211-41d4-93b6-f8e6ae26dc62 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.487759 Sep 07 10:02:12.558106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1840/3692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:12 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:12.565740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:12.566512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:12.578308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.578917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.579448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.593877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.595121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.596974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.883013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:12.894692 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-16935066-7cd3-41c5-870a-66b347047ac0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.334763 Sep 07 10:02:12.897976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1853/3693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:12 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:12.924652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfb05a2c-7ce5-474f-a2bd-d726c03952bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:12.931029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bfb05a2c-7ce5-474f-a2bd-d726c03952bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 764f5d14-5482-4529-84c1-0f0fcda08f50] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:12.941043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-bfb05a2c-7ce5-474f-a2bd-d726c03952bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 764f5d14-5482-4529-84c1-0f0fcda08f50 could not be found. Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfb05a2c-7ce5-474f-a2bd-d726c03952bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/764f5d14-5482-4529-84c1-0f0fcda08f50/action HTTP/1.1 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 13 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: {"pause": {}} Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 764f5d14-5482-4529-84c1-0f0fcda08f50 could not be found. Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '764f5d14-5482-4529-84c1-0f0fcda08f50', 'body': {'pause': {}}} Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764f5d14-5482-4529-84c1-0f0fcda08f50 could not be found. Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764f5d14-5482-4529-84c1-0f0fcda08f50 could not be found. Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:12.953325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764f5d14-5482-4529-84c1-0f0fcda08f50 could not be found. Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfb05a2c-7ce5-474f-a2bd-d726c03952bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 764f5d14-5482-4529-84c1-0f0fcda08f50 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bfb05a2c-7ce5-474f-a2bd-d726c03952bd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/764f5d14-5482-4529-84c1-0f0fcda08f50/action" status: 404 len: 111 microversion: 2.1 time: 0.036464 Sep 07 10:02:12.956299 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1841/3694] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:12 2022] POST /compute/v2.1/servers/764f5d14-5482-4529-84c1-0f0fcda08f50/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:02:12.966013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:12.966649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:12.978403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.978794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.979242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:12.979967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:12.980432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:12.980857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.048305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:13.048927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:13.070314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.070857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.074701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.077943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.078462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.080315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.095955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:13.240170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:13.262594 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7a91ebe6-bb4c-4414-adb5-ef7afc9720c4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1296 microversion: 2.1 time: 0.217819 Sep 07 10:02:13.265655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1842/3695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:13 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1296 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:13.352166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:13.366270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea159b9e-1b24-4e8e-b0f5-553200e4b995 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.403913 Sep 07 10:02:13.366865 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1854/3696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:12 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:13.390967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:13.391883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:13.404669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.405447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.406051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.406901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.407498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.408437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.491705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:13.492211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:13.498663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.499361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.509915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.510901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.511517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.512089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.677623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:13.690985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:13.701257 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b586179-002f-4c3a-ad11-4a391a6036cb tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1286 microversion: 2.1 time: 0.213973 Sep 07 10:02:13.709520 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1855/3697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:13 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:13.750543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:13.761980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-419087f3-035a-418b-89e3-caad326daa8c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.374520 Sep 07 10:02:13.763158 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1843/3698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:13 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:13.789632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:13.790246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:13.800232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.801593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.802126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.803083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.804208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.804887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.956869 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62913ccd-03c5-451d-bb00-6bd137f79f05 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.173199 Sep 07 10:02:13.958583 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1856/3699] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:13 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:02:13.969008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:13.969730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:13.986873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.987903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.988535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:13.990693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:13.992553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:13.993397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:14.289163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:14.290012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:14.309090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:14.309614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:14.310439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:14.311117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:14.311579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:14.312004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:14.624802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:14.637987 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-527dac2a-fb8b-4e30-8f50-c7a15db2cddf tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1509 microversion: 2.1 time: 0.672895 Sep 07 10:02:14.653218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1844/3700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:13 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1509 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:14.738987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:14.739669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:14.763202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:14.764331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:14.765018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:14.766050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:14.766915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:14.767668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:15.326707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:15.339896 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df815c5d-fea5-4e31-a35e-5e5fd18778aa tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 1.056634 Sep 07 10:02:15.341883 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1857/3701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:14 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:15.445577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:15.461542 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-066bcfdd-5e64-49b7-9ef8-18add5055198 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.731139 Sep 07 10:02:15.463614 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1845/3702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:14 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:15.666114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:15.667102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:15.673725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:15.674404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:15.674975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:15.675800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:15.676383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:15.677115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:15.950759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:15.960566 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c78055a6-8c23-4321-8daf-ca64ec56829b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1489 microversion: 2.1 time: 0.298328 Sep 07 10:02:15.961699 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1858/3703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:15 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1489 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:15.990044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:15.990643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:16.002122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.003084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.003642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.004536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.005409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.007964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.050326 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'pause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state paused Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 13 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: {"pause": {}} Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'pause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state paused Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'pause': {}}} Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state paused. Cannot pause while the instance is in this state. Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state paused Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:16.054447 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:16.057699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:16.057699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:16.057699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:16.057699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state paused Sep 07 10:02:16.057699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:16.062511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'pause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state paused {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:16.063857 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb6e6e10-246b-4ef1-af1c-b1c65442178e tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 143 microversion: 2.1 time: 0.079819 Sep 07 10:02:16.069456 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1846/3704] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:15 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 143 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:02:16.075096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:16.075637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:16.087181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.087686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.088126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.089958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.090625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.092091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.234131 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e35475c1-ecf8-4a68-97e1-976da5decef0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.162578 Sep 07 10:02:16.236904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1859/3705] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:16 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:02:16.244564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:16.245829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:16.253854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.254810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.255752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.257454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.258431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.259104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.346963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ca08971a-7bf7-4997-b4bd-84274d563859 req-16b4a5b5-3dc7-4a73-92ff-3cec6979db15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74168d1b-4b40-480d-add9-d409e18a5490", "tag": "03fbf564-e9a2-48e8-941f-9b647e2a9696"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:16.383912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ca08971a-7bf7-4997-b4bd-84274d563859 req-16b4a5b5-3dc7-4a73-92ff-3cec6979db15 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.384613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ca08971a-7bf7-4997-b4bd-84274d563859 req-16b4a5b5-3dc7-4a73-92ff-3cec6979db15 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.385223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ca08971a-7bf7-4997-b4bd-84274d563859 req-16b4a5b5-3dc7-4a73-92ff-3cec6979db15 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.399904 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ca08971a-7bf7-4997-b4bd-84274d563859 req-16b4a5b5-3dc7-4a73-92ff-3cec6979db15 service nova] Creating event network-changed:03fbf564-e9a2-48e8-941f-9b647e2a9696 for instance 74168d1b-4b40-480d-add9-d409e18a5490 on n-h1-836830-16 Sep 07 10:02:16.405993 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ca08971a-7bf7-4997-b4bd-84274d563859 req-16b4a5b5-3dc7-4a73-92ff-3cec6979db15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064020 Sep 07 10:02:16.408058 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1860/3706] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:02:16.436297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:16.437977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:16.462629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.467697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.469468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.471765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.473948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.475801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.855363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:16.870692 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a440db17-effe-4bcf-86f8-1829ec447b2a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1496 microversion: 2.1 time: 0.630156 Sep 07 10:02:16.872335 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1847/3707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:16 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1496 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:16.887283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:16.888934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:16.895923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.896602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.898221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:16.899032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:16.899795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:16.900582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:17.329148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:17.344810 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-28682ffc-2a0a-4790-b61c-31676ddce41a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 0.934407 Sep 07 10:02:17.347666 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1861/3708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:16 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:17.500424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:17.512351 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a707e13-27ef-4563-9410-2cf7efcb2ff5 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.638483 Sep 07 10:02:17.513661 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1848/3709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:16 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:17.899760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:17.900860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:17.910740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:17.911587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:17.912169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:17.913115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:17.913815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:17.914459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:17.951144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:18.376827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:18.377516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:18.380744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:18.382156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:18.401648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:18.402820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:18.404383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:18.405518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:18.406260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:18.408308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:18.436105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:18.451238 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b3841ad-e188-463c-a55f-0bfe531a51f0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.557864 Sep 07 10:02:18.457337 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1862/3710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:17 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:18.482106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:18.482791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:18.498456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:18.498963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:18.499564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:18.500584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:18.501581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:18.502243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:18.508041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:18.942233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:18.954607 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-757a9314-9f9b-42aa-a1bc-371914f8078e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 0.583872 Sep 07 10:02:18.955207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1849/3711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:18 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:18.965793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:18.969707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:18.981231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:18.981741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:18.982183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:18.982901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:18.983361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:18.983792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.000611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:19.013863 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88b7d6db-96eb-4ad5-b5a4-08a9edd23ba7 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.539046 Sep 07 10:02:19.020543 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1863/3712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:18 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:19.027248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0ed24f5c-b5bd-4cc1-b0d1-fc1f5fefcc0f req-deea9fa5-dddb-45ca-9c77-03df44e12434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4792bda1-d558-4e8f-b31e-79cb13e6e231", "tag": "cbb9bc22-0656-4f8f-a28d-2830e7ffba53"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:19.048461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:19.050793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0ed24f5c-b5bd-4cc1-b0d1-fc1f5fefcc0f req-deea9fa5-dddb-45ca-9c77-03df44e12434 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.051601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0ed24f5c-b5bd-4cc1-b0d1-fc1f5fefcc0f req-deea9fa5-dddb-45ca-9c77-03df44e12434 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.052587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0ed24f5c-b5bd-4cc1-b0d1-fc1f5fefcc0f req-deea9fa5-dddb-45ca-9c77-03df44e12434 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.083746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0ed24f5c-b5bd-4cc1-b0d1-fc1f5fefcc0f req-deea9fa5-dddb-45ca-9c77-03df44e12434 service nova] Creating event network-changed:cbb9bc22-0656-4f8f-a28d-2830e7ffba53 for instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 on n-h1-836830-16 Sep 07 10:02:19.097724 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0ed24f5c-b5bd-4cc1-b0d1-fc1f5fefcc0f req-deea9fa5-dddb-45ca-9c77-03df44e12434 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073945 Sep 07 10:02:19.100578 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1864/3713] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:19.129856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:19.136986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:19.163232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.167275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.174885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.190099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.192482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.195860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.243135 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078/action HTTP/1.1 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 28 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: {"reboot": {"type": "SOFT"}} Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3accfc03-7586-4d0b-becb-e1f3d1a0a078', 'body': {'reboot': {'type': 'SOFT'}}} Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:19.248130 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:19.251269 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:19.254764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:19.259397 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5589810-06a0-402b-a341-496f951d88cb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078/action" status: 404 len: 111 microversion: 2.1 time: 0.156942 Sep 07 10:02:19.262078 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1865/3714] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:19 2022] POST /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078/action => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:19.277449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:19.278627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:19.290033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.290773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.291357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.292278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.292875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.293565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.533708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:19.542440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-265e87a4-44da-4355-be08-c487a8459b01 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.586151 Sep 07 10:02:19.548629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1850/3715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:18 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:19.899568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:19.914840 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8834d2b3-4f98-45cb-ab19-22518d4accb0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.646899 Sep 07 10:02:19.915757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1866/3716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:19 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:19.942501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:19.943128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:19.950210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.950707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.951153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.954888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.955436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.955796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:19.979191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:19.979817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:19.996819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:19.997340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:19.997777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:20.003392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:20.005655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:20.006295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:21.052313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:21.075584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5cbe1278-2cba-43b7-aded-d64f450267f5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.137235 Sep 07 10:02:21.083523 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1851/3717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:19 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:21.104399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:21.104977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:21.110993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:21.120103 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96c9675f-c074-489e-ab96-5ce10907378c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 1.144417 Sep 07 10:02:21.122810 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1867/3718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:19 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:21.125209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:21.129606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-150b8a9e-db9b-408c-a0bf-d672c8a6dc93 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:21.130268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:21.130735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:21.132443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:21.132864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-150b8a9e-db9b-408c-a0bf-d672c8a6dc93 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: fcb137dd-58ac-4388-a723-133ca059985b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:21.133004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:21.133477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:21.153643 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-150b8a9e-db9b-408c-a0bf-d672c8a6dc93 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance fcb137dd-58ac-4388-a723-133ca059985b could not be found. Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-150b8a9e-db9b-408c-a0bf-d672c8a6dc93 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/fcb137dd-58ac-4388-a723-133ca059985b/action HTTP/1.1 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 28 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: {"reboot": {"type": "SOFT"}} Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance fcb137dd-58ac-4388-a723-133ca059985b could not be found. Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'fcb137dd-58ac-4388-a723-133ca059985b', 'body': {'reboot': {'type': 'SOFT'}}} Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb137dd-58ac-4388-a723-133ca059985b could not be found. Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb137dd-58ac-4388-a723-133ca059985b could not be found. Sep 07 10:02:21.155655 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb137dd-58ac-4388-a723-133ca059985b could not be found. Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-150b8a9e-db9b-408c-a0bf-d672c8a6dc93 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance fcb137dd-58ac-4388-a723-133ca059985b could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-150b8a9e-db9b-408c-a0bf-d672c8a6dc93 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/fcb137dd-58ac-4388-a723-133ca059985b/action" status: 404 len: 111 microversion: 2.1 time: 0.032917 Sep 07 10:02:21.159777 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1868/3719] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:21 2022] POST /compute/v2.1/servers/fcb137dd-58ac-4388-a723-133ca059985b/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:21.168070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:21.169688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:21.180488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:21.181462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:21.182378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:21.183219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:21.183779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:21.184400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:21.673822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:21.687351 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a7317fb8-0c22-4b17-8b98-acaa760a2771 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.586907 Sep 07 10:02:21.688881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:21.703502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1852/3720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:21 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:21.710687 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cdd04e1a-8a53-4ace-a256-66408f667245 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.547939 Sep 07 10:02:21.711271 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1869/3721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:21 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:21.735648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:21.736661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:21.744115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:21.744834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:21.745702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:21.746816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:21.747437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:21.748057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.148643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:22.150035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:22.166382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.171941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.173661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.176458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.178729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.179560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.256887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:22.274359 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aae4a71e-e93a-43b3-bdc2-10a67767e6d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.542533 Sep 07 10:02:22.274969 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1853/3722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:21 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:22.655353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:22.656099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:22.660947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:22.669853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.670336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68cf9431-7edb-47ba-9089-47e3301bada5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 0.527703 Sep 07 10:02:22.672843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.674742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.675982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1870/3723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:22 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:22.678633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.679506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.680389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.685332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:22.693835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:22.707011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.715644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.716358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.717275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.721639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.722436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.732881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:02:22.750571 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078/action HTTP/1.1 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 65 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3accfc03-7586-4d0b-becb-e1f3d1a0a078', 'body': {'rebuild': {'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7'}}} Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 07 10:02:22.752511 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:02:22.757015 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:22.758848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:22.760030 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d274c3b-97ff-49d2-8fa2-4795bba6e478 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078/action" status: 404 len: 111 microversion: 2.1 time: 0.082909 Sep 07 10:02:22.760770 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1871/3724] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:22 2022] POST /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:22.765957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:22.766774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:22.774350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.775053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.775648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.776627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.777366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.777943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.924167 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f708ee74-9c43-4660-8009-ec9b45fe264a tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 204 len: 0 microversion: 2.42 time: 0.624116 Sep 07 10:02:22.925681 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1854/3725] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:02:22 2022] DELETE /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:02:22.933326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:22.934330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:22.943778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.944539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.945095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:22.946216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:22.946798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:22.948507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:23.310054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:23.324674 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9674f4df-91a3-45c2-b0c1-c5ebb3dfaffc tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.562389 Sep 07 10:02:23.325288 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1872/3726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:22 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:23.345993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ffe8fdc4-2120-4657-a63f-6d614c409f92 req-d2cc9b4b-a36a-48f1-b4b8-bf920b1657a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74168d1b-4b40-480d-add9-d409e18a5490", "name": "network-vif-plugged", "status": "completed", "tag": "03fbf564-e9a2-48e8-941f-9b647e2a9696"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:23.365687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ffe8fdc4-2120-4657-a63f-6d614c409f92 req-d2cc9b4b-a36a-48f1-b4b8-bf920b1657a7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:23.367280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ffe8fdc4-2120-4657-a63f-6d614c409f92 req-d2cc9b4b-a36a-48f1-b4b8-bf920b1657a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:23.370068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ffe8fdc4-2120-4657-a63f-6d614c409f92 req-d2cc9b4b-a36a-48f1-b4b8-bf920b1657a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:23.403295 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ffe8fdc4-2120-4657-a63f-6d614c409f92 req-d2cc9b4b-a36a-48f1-b4b8-bf920b1657a7 service nova] Creating event network-vif-plugged:03fbf564-e9a2-48e8-941f-9b647e2a9696 for instance 74168d1b-4b40-480d-add9-d409e18a5490 on n-h1-836830-16 Sep 07 10:02:23.437136 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ffe8fdc4-2120-4657-a63f-6d614c409f92 req-d2cc9b4b-a36a-48f1-b4b8-bf920b1657a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110486 Sep 07 10:02:23.440489 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1873/3727] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:23.450988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:23.453446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:23.454304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:23.459819 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68ed9750-0c4f-4c05-bbc5-61411f25fab4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.532040 Sep 07 10:02:23.460425 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1855/3728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:22 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:23.471119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:23.471653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:23.472104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:23.478120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:23.478845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:23.479314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:23.864996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:23.866239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:23.873006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:23.873355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:23.873876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:23.874753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:23.875444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:23.876029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:23.934052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:02:23.950798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:23.953723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:23.976783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:23.979699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:23.981038 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b98ba67-06f8-4be0-8667-e8db97d024ab tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2961 microversion: 2.42 time: 0.538636 Sep 07 10:02:23.981646 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1874/3729] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:23 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2961 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:24.004371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:24.011133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:24.011930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:24.020727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.021289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.022620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.023329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.024643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.025274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.097966 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25fba379-c9da-4538-bded-8147a1d76f45 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 204 len: 0 microversion: 2.32 time: 0.619564 Sep 07 10:02:24.098908 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1856/3730] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:02:23 2022] DELETE /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:02:24.106408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:24.107289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:24.119767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.126225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.126695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.133762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.134370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.134835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.559598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:24.569628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f92b779-a4db-46e7-9a83-d1e4148a88f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.569793 Sep 07 10:02:24.581107 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1875/3731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:23 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:24.602224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:24.604054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:24.638230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.639144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.639895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.640759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.644439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.645276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.760360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:24.779471 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8bfa853a-33f9-45ed-bafc-553dee46fec4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 0.678250 Sep 07 10:02:24.800699 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1857/3732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:24 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:24.814059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:24.819413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:24.837734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.842366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.845150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:24.847557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:24.851513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:24.853396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:25.160419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.181882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.197728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.206660 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3d015b22-f461-4a18-a3b3-dc251bcac8d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2956 microversion: 2.32 time: 0.618245 Sep 07 10:02:25.212442 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1876/3733] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:24 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2956 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:25.217347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6fc8dcc-d33e-45a4-b933-86c1da5537ac tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:25.234705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d6fc8dcc-d33e-45a4-b933-86c1da5537ac tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 2bea37da-6b17-438a-858e-a854e027fe37] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:25.243115 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d6fc8dcc-d33e-45a4-b933-86c1da5537ac tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 2bea37da-6b17-438a-858e-a854e027fe37 could not be found. Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6fc8dcc-d33e-45a4-b933-86c1da5537ac tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/2bea37da-6b17-438a-858e-a854e027fe37/action HTTP/1.1 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 65 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 2bea37da-6b17-438a-858e-a854e027fe37 could not be found. Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2bea37da-6b17-438a-858e-a854e027fe37', 'body': {'rebuild': {'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7'}}} Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bea37da-6b17-438a-858e-a854e027fe37 could not be found. Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 10:02:25.244938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bea37da-6b17-438a-858e-a854e027fe37 could not be found. Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bea37da-6b17-438a-858e-a854e027fe37 could not be found. Sep 07 10:02:25.248218 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:25.248899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6fc8dcc-d33e-45a4-b933-86c1da5537ac tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 2bea37da-6b17-438a-858e-a854e027fe37 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:25.253258 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d6fc8dcc-d33e-45a4-b933-86c1da5537ac tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/2bea37da-6b17-438a-858e-a854e027fe37/action" status: 404 len: 111 microversion: 2.1 time: 0.039710 Sep 07 10:02:25.254708 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1877/3734] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:25 2022] POST /compute/v2.1/servers/2bea37da-6b17-438a-858e-a854e027fe37/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:25.265442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:25.268579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:25.285618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:25.289032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:25.291453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:25.292659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:25.293856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:25.296285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:25.365042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.381635 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-696f424c-0c26-498c-91c6-8c88d30fdf42 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.578402 Sep 07 10:02:25.382784 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1858/3735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:24 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:25.399744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:25.400382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:25.413646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:25.418254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:25.418737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:25.419484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:25.419957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:25.423192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:25.955051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.972470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.973970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:25.979608 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f67cf203-457c-46f4-b57f-25bdec727dfc tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2961 microversion: 2.42 time: 0.723503 Sep 07 10:02:25.980210 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1878/3736] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:25 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2961 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:25.992019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:25.993116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:26.013067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.013612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.014055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:26.014783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.019839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.020201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:26.607091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:26.621493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3ab89a90-fb35-4bf9-9d84-733b68d0d156 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.237331 Sep 07 10:02:26.622494 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1859/3737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:25 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:26.637021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-16b3e26e-17d6-4988-9bac-a7453ec591eb req-5d5b7f0a-aae5-477c-bb8b-7eedbc8a1eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4792bda1-d558-4e8f-b31e-79cb13e6e231", "name": "network-vif-plugged", "status": "completed", "tag": "cbb9bc22-0656-4f8f-a28d-2830e7ffba53"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:26.648186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-16b3e26e-17d6-4988-9bac-a7453ec591eb req-5d5b7f0a-aae5-477c-bb8b-7eedbc8a1eee service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.648684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-16b3e26e-17d6-4988-9bac-a7453ec591eb req-5d5b7f0a-aae5-477c-bb8b-7eedbc8a1eee service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.649127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-16b3e26e-17d6-4988-9bac-a7453ec591eb req-5d5b7f0a-aae5-477c-bb8b-7eedbc8a1eee service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:26.665799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-16b3e26e-17d6-4988-9bac-a7453ec591eb req-5d5b7f0a-aae5-477c-bb8b-7eedbc8a1eee service nova] Creating event network-vif-plugged:cbb9bc22-0656-4f8f-a28d-2830e7ffba53 for instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 on n-h1-836830-16 Sep 07 10:02:26.671000 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-16b3e26e-17d6-4988-9bac-a7453ec591eb req-5d5b7f0a-aae5-477c-bb8b-7eedbc8a1eee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038442 Sep 07 10:02:26.671816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1860/3738] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:26.679097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:26.680471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:26.686705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.687216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.687647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:26.688489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.689137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.689607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:26.872362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:26.883593 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-206bec21-6ea4-41b8-a05d-f68788a559e4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1364 microversion: 2.1 time: 0.899537 Sep 07 10:02:26.885873 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1879/3739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:25 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1364 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:26.893044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:26.894443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:26.908466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.909029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.909516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:26.910236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:26.910702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:26.911603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:27.301453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:27.317264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:27.320667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:27.324262 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-625094a8-c216-44f5-a871-b6e2c286e442 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2956 microversion: 2.32 time: 0.650055 Sep 07 10:02:27.325836 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1861/3740] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:26 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2956 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:27.339804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:27.341403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:27.360244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:27.361841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:27.364311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:27.365391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:27.366853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:27.367595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:27.504100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:27.516845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89cdca1e-74bd-4839-9c47-d36a54fefab2 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1328 microversion: 2.1 time: 0.629659 Sep 07 10:02:27.536706 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1880/3741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:26 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1328 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:27.543316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:27.544183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:27.604450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:27.611067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:27.611326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:27.612065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:27.612541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:27.613419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:28.346004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:28.358579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b1b1143-ae0c-46dd-adbc-30b71527178b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.026946 Sep 07 10:02:28.361721 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1862/3742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:27 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:28.658028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1273547077", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ac11c0d8-1462-4df6-b5ec-d6277d361200"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:28.680461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:28.693111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:28.700779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:28.702136 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2f42029-dee5-4944-8121-6eae1f174109 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2961 microversion: 2.42 time: 1.163924 Sep 07 10:02:28.706709 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1881/3743] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:27 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2961 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:28.727750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:28.728558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:28.739107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:28.742091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:28.742482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:28.746309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:28.747158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:28.747614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:28.776303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] validate_networks() for [('ac11c0d8-1462-4df6-b5ec-d6277d361200', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:02:29.423162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:29.472202 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5319e42c-e980-4d43-95a2-ea798ccb2d9a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1549 microversion: 2.1 time: 0.762942 Sep 07 10:02:29.475781 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1882/3744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:28 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1549 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:29.502007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:29.502894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:29.510664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:29.511448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:29.512080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:29.513024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:29.513704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:29.514323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:30.488716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:30.507971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:30.509657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:30.519772 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf750239-a14b-4f69-9c2a-e7d54e48a2a7 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2956 microversion: 2.32 time: 1.018107 Sep 07 10:02:30.522808 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1883/3745] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:29 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2956 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:30.556020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a0d9a85-dd8f-4f18-9fbd-7d072f30076c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:30.556722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a0d9a85-dd8f-4f18-9fbd-7d072f30076c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 232098cb-78c4-443f-a61d-ceab5fdd3b6a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:30.573423 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4a0d9a85-dd8f-4f18-9fbd-7d072f30076c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 232098cb-78c4-443f-a61d-ceab5fdd3b6a could not be found. Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a0d9a85-dd8f-4f18-9fbd-7d072f30076c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/232098cb-78c4-443f-a61d-ceab5fdd3b6a/action HTTP/1.1 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 15 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: {"restore": {}} Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 232098cb-78c4-443f-a61d-ceab5fdd3b6a could not be found. Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '232098cb-78c4-443f-a61d-ceab5fdd3b6a', 'body': {'restore': {}}} Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232098cb-78c4-443f-a61d-ceab5fdd3b6a could not be found. Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232098cb-78c4-443f-a61d-ceab5fdd3b6a could not be found. Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:30.574999 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:30.578798 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:30.578798 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:30.578798 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232098cb-78c4-443f-a61d-ceab5fdd3b6a could not be found. Sep 07 10:02:30.578798 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:30.578798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a0d9a85-dd8f-4f18-9fbd-7d072f30076c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 232098cb-78c4-443f-a61d-ceab5fdd3b6a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:30.578798 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a0d9a85-dd8f-4f18-9fbd-7d072f30076c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/232098cb-78c4-443f-a61d-ceab5fdd3b6a/action" status: 404 len: 111 microversion: 2.1 time: 0.046610 Sep 07 10:02:30.581518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1884/3746] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:30 2022] POST /compute/v2.1/servers/232098cb-78c4-443f-a61d-ceab5fdd3b6a/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:30.589667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:30.590576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:30.606044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:30.607014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:30.607689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:30.608636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:30.610044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:30.610890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:30.969982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:02:30.970828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:02:30.972084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:02:30.972508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:02:30.973124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:02:30.999381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.001042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.011507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:31.015023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.019825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.020504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:31.096008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:02:31.115954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for user 2e14f54af9f44dd28bab63c619816e67 and project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:02:31.165153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:02:31.168661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:02:31.269674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e45d2792-8dcb-4cf8-bbc8-a6525ebb859b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.902878 Sep 07 10:02:31.270366 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1863/3747] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:02:31.282405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:31.295441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:31.331673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.332457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.333619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:31.335843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.336557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.339679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:31.827235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:31.850719 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44af65b7-f6ca-4431-bf53-0191ace141f1 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1527 microversion: 2.1 time: 1.266546 Sep 07 10:02:31.852106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1885/3748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:30 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1527 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:31.857519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:31.858384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:31.865493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.866746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.867625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:31.868548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.869263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.870684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:31.941948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d3687971-dd09-4c71-85ad-1e0f699dbc7e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.663491 Sep 07 10:02:31.942886 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1864/3749] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:02:31 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-interface => generated 284 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:31.954229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c925b545-53e7-4232-b024-f6e6c0801e6f req-976f90df-0994-44b7-9fa7-c1273f81bda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-unplugged", "status": "completed", "tag": "c4ddaf2a-dc3f-43a5-93a8-6635d7547448"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:31.979651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c925b545-53e7-4232-b024-f6e6c0801e6f req-976f90df-0994-44b7-9fa7-c1273f81bda5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:31.981974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c925b545-53e7-4232-b024-f6e6c0801e6f req-976f90df-0994-44b7-9fa7-c1273f81bda5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:31.982623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c925b545-53e7-4232-b024-f6e6c0801e6f req-976f90df-0994-44b7-9fa7-c1273f81bda5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:32.011573 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c925b545-53e7-4232-b024-f6e6c0801e6f req-976f90df-0994-44b7-9fa7-c1273f81bda5 service nova] Creating event network-vif-unplugged:c4ddaf2a-dc3f-43a5-93a8-6635d7547448 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:32.019203 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c925b545-53e7-4232-b024-f6e6c0801e6f req-976f90df-0994-44b7-9fa7-c1273f81bda5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068779 Sep 07 10:02:32.025795 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1865/3750] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:32.036041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:32.036856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:32.059850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:32.060607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:32.061769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:32.064664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:32.065151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:32.065623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.011429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:33.027602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:33.040274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:33.042133 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08c0bc13-87b8-4a23-99ec-95fc0a1f8420 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2872 microversion: 2.42 time: 1.188731 Sep 07 10:02:33.042869 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1886/3751] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:31 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2872 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:33.047655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8372eefc-64f6-416a-b3c7-7527ba25227c req-03d6120d-3fdb-4ef4-96c3-00e513e31fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-deleted", "tag": "da887d2b-904a-42ea-907a-bd6e5039d46e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:33.072218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8372eefc-64f6-416a-b3c7-7527ba25227c req-03d6120d-3fdb-4ef4-96c3-00e513e31fa7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.073099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8372eefc-64f6-416a-b3c7-7527ba25227c req-03d6120d-3fdb-4ef4-96c3-00e513e31fa7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.074875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8372eefc-64f6-416a-b3c7-7527ba25227c req-03d6120d-3fdb-4ef4-96c3-00e513e31fa7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.089471 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8372eefc-64f6-416a-b3c7-7527ba25227c req-03d6120d-3fdb-4ef4-96c3-00e513e31fa7 service nova] Creating event network-vif-deleted:da887d2b-904a-42ea-907a-bd6e5039d46e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:33.096451 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8372eefc-64f6-416a-b3c7-7527ba25227c req-03d6120d-3fdb-4ef4-96c3-00e513e31fa7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052257 Sep 07 10:02:33.097773 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1887/3752] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:33.103691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:33.105046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:33.115059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.117170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.117862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.118974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.120164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.121199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.318022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:33.329979 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86fa984c-4899-45ea-a15f-eb4967bf2529 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.302335 Sep 07 10:02:33.332666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1866/3753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:32 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:33.343331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:33.346632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:33.364926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:33.366523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:33.371658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.374304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.376128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.379715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.380377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.383896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.384227 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2b011685-4d56-40ab-ba58-ad29aa6c4b8c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1260 microversion: 2.1 time: 0.284972 Sep 07 10:02:33.385372 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1888/3754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:33 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:33.404674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:33.405612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:33.422700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.423566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.424261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:33.425235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:33.425956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:33.430033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:34.775638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:34.824167 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37cdd25d-c94e-4990-9259-2f8ef5ef4344 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1527 microversion: 2.1 time: 1.437401 Sep 07 10:02:34.826343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1889/3755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:33 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1527 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:34.833555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:34.835011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:34.843025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:34.843805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:34.844444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:34.847506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:34.848221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:34.848846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:34.918772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:34.932773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:34.936286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:34.939451 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4472c015-3147-4249-9337-91ae2a96e799 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2935 microversion: 2.32 time: 1.605596 Sep 07 10:02:34.941824 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1867/3756] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:33 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2935 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:34.954991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-unplugged", "status": "completed", "tag": "86b5436c-53b2-4b67-9ddb-a9339f76af52"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-unplugged", "status": "completed", "tag": "7942dc19-0d73-4b64-8443-ed7290abd41e"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-unplugged", "status": "completed", "tag": "388c8aab-43f8-4b1f-81d6-1de595152f6e"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-unplugged", "status": "completed", "tag": "34db865d-7ea1-4f47-b238-dd9dea03cc4f"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-unplugged", "status": "completed", "tag": "a8ae0eeb-5f67-4acd-8aba-e2102c88e845"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-unplugged", "status": "completed", "tag": "7db2bf51-8311-4cf4-ae79-919fe6ccada5"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-unplugged", "status": "completed", "tag": "ebd2b93f-9339-4996-b73d-d6aba65c7eb9"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-unplugged", "status": "completed", "tag": "1ecfaf7d-3cc0-4159-97c4-dac53650ffa4"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-unplugged", "status": "completed", "tag": "7b601b14-198e-469c-b95a-239bd800b1e0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:34.980488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:34.981308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:34.981899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:35.001062 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:86b5436c-53b2-4b67-9ddb-a9339f76af52 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:35.001798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:7942dc19-0d73-4b64-8443-ed7290abd41e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:35.002571 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:388c8aab-43f8-4b1f-81d6-1de595152f6e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:35.003252 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:34db865d-7ea1-4f47-b238-dd9dea03cc4f for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:35.004052 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:a8ae0eeb-5f67-4acd-8aba-e2102c88e845 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:35.004722 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:7db2bf51-8311-4cf4-ae79-919fe6ccada5 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:35.005413 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:ebd2b93f-9339-4996-b73d-d6aba65c7eb9 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:35.006660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:1ecfaf7d-3cc0-4159-97c4-dac53650ffa4 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:35.008356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] Creating event network-vif-unplugged:7b601b14-198e-469c-b95a-239bd800b1e0 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:35.029102 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c9b5b30d-c660-4af2-8b29-2c89c5281963 req-6d0aa9fd-51ba-4727-bc39-e472e8f9cad1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1569 microversion: 2.1 time: 0.085786 Sep 07 10:02:35.030538 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1868/3757] 10.222.0.60 () {64 vars in 1318 bytes} [Wed Sep 7 10:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 1569 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:35.042845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:35.046134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:35.059336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:35.059856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:35.060786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:35.063460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:35.064287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:35.064907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.114199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:36.141170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:36.143620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:36.145164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:36.150029 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e86ab564-af54-4bbc-b72f-4a06a64a68dd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 2664 microversion: 2.42 time: 1.117571 Sep 07 10:02:36.150206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1869/3758] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:35 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 2664 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:36.170072 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03f7c921-0347-4dcd-b034-178012510ada tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.341244 Sep 07 10:02:36.188198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:36.189409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:36.193200 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1890/3759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:34 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:36.208146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.208706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.209716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.210610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.217326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.217982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.515351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:36.516164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:36.545128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.545688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.546151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.553666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.554176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.554628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.587380 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] HTTP exception thrown: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Request method failure captured: Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 HTTP/1.1 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwdnHkyGhs-ZVL9AK5lntrLI2-nq36oyAQ3oHNfmMWFUFti1NIKc9ZNRIxnGpZvS-WER4h3X5IJJ9gKGeyamGQoq2lIAH-zdbcnv6VYmX8H_LLKswEUZNT9hCqwOQ8DhsHJYEkBaiIBEwYNcEWK83QgA_m8K1VKBQtoi338lKVGmOE Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 5e916d6260744213812f445462cad365 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-206874012 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e916d6260744213812f445462cad365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e916d6260744213812f445462cad365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e916d6260744213812f445462cad365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e916d6260744213812f445462cad365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-206874012 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 5e916d6260744213812f445462cad365 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-206874012 Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestMultiTenantJSON-206874012-project Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fa4caad9ece847e79a8ce60dcc46392e Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-206874012-project Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4792bda1-d558-4e8f-b31e-79cb13e6e231'} Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:36.589323 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:36.592952 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:36.594833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Returning 404 to user: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:36.595880 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-987e9166-8af5-4768-83de-b6cd424138ac tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 404 len: 111 microversion: 2.1 time: 0.400844 Sep 07 10:02:36.602841 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1891/3760] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:02:36 2022] DELETE /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 111 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:36.611873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-deleted", "tag": "86b5436c-53b2-4b67-9ddb-a9339f76af52"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-deleted", "tag": "7942dc19-0d73-4b64-8443-ed7290abd41e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:36.627022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.627753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.628464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.651105 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] Creating event network-vif-deleted:86b5436c-53b2-4b67-9ddb-a9339f76af52 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:36.652150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] Creating event network-vif-deleted:7942dc19-0d73-4b64-8443-ed7290abd41e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:36.663668 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bf5b08c1-d2c7-4b9f-978c-3e641599c87a req-f59a77a5-c6d5-45d0-af9c-5e1cca99d291 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059155 Sep 07 10:02:36.664922 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1892/3761] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:36.670800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:36.689406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:36.705148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.705704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.706160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.707012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:36.707517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:36.707968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:36.974699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:36.990793 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ccb6330b-6b5b-4ac6-94ec-a0b88dc33f42 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1308 microversion: 2.1 time: 0.812069 Sep 07 10:02:36.991869 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1870/3762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:36 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1308 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:37.003745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:37.009582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:37.019042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:37.019918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:37.020571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:37.021794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:37.022483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:37.023166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:37.058794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'restore' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 15 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: {"restore": {}} Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'restore' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'restore': {}}} Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state active. Cannot restore while the instance is in this state. Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:37.062243 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:37.066244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:37.066244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:37.066244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:37.066244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:37.066244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:37.067909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'restore' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:37.069035 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2fdfb0b2-8e7c-4fc6-ae9d-bd4542518fab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 145 microversion: 2.1 time: 0.076197 Sep 07 10:02:37.070209 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1871/3763] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:36 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:02:37.076942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:37.077997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:37.084518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:37.085344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:37.085987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:37.086899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:37.087720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:37.088368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:37.466102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:37.493667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:37.499948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:37.501361 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30a2942a-6f55-4ec6-b634-1fb0b1e281bd tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2914 microversion: 2.32 time: 0.835062 Sep 07 10:02:37.501953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1893/3764] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:36 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2914 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:37.542082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:37.547724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:37.565419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:37.566160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:37.570558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:37.572056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:37.572780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:37.573781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.140894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:38.154055 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-77e9e8e5-1e37-4a47-99bc-566253afd48f tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1527 microversion: 2.1 time: 1.082368 Sep 07 10:02:38.155461 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1872/3765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:37 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1527 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:38.165991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:38.175456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:38.189492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.191324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.192394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.193704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.194887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.196475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.211357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:38.226584 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8293bf46-99e3-4696-b370-fc352ac9bf75 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.710892 Sep 07 10:02:38.227508 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1894/3766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:37 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:38.239107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:38.239730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:38.248328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.249054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.249723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.250602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.251321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.251947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.269614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:38.429652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:38.444471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:38.447510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:38.450530 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-139e937f-3a2a-4882-aec4-4017a0730fcb tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.292572 Sep 07 10:02:38.451302 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1873/3767] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:38 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:38.457202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Action: 'update', calling method: >, body: {"server": {"name": "4792bda1-d558-4e8f-b31e-79cb13e6e231_new"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:38.461154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:38.468836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.469560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.470211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.471248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.472163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.473785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.495842 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] HTTP exception thrown: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Request method failure captured: Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 HTTP/1.1 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 64 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwdnHkyGhs-ZVL9AK5lntrLI2-nq36oyAQ3oHNfmMWFUFti1NIKc9ZNRIxnGpZvS-WER4h3X5IJJ9gKGeyamGQoq2lIAH-zdbcnv6VYmX8H_LLKswEUZNT9hCqwOQ8DhsHJYEkBaiIBEwYNcEWK83QgA_m8K1VKBQtoi338lKVGmOE Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 5e916d6260744213812f445462cad365 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-206874012 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e916d6260744213812f445462cad365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e916d6260744213812f445462cad365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e916d6260744213812f445462cad365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e916d6260744213812f445462cad365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-206874012 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 5e916d6260744213812f445462cad365 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-206874012 Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestMultiTenantJSON-206874012-project Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fa4caad9ece847e79a8ce60dcc46392e Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-206874012-project Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "4792bda1-d558-4e8f-b31e-79cb13e6e231_new"}} Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4792bda1-d558-4e8f-b31e-79cb13e6e231', 'body': {'server': {'name': '4792bda1-d558-4e8f-b31e-79cb13e6e231_new'}}} Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:38.497554 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:38.501238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:38.504949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] Returning 404 to user: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:38.507820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57c1b533-5f81-40e0-bdc3-119e04198e0c tempest-ServersNegativeTestMultiTenantJSON-206874012 tempest-ServersNegativeTestMultiTenantJSON-206874012-project] 10.222.0.60 "PUT /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 404 len: 111 microversion: 2.1 time: 0.055173 Sep 07 10:02:38.509353 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1874/3768] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:02:38 2022] PUT /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:38.517101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:38.518511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:38.526166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.526927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.527558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:38.528481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:38.531577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:38.532251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.256452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:39.262026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:39.268406 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15ff46b3-3108-4702-a019-af386716dcfd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1308 microversion: 2.1 time: 1.039757 Sep 07 10:02:39.270868 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1895/3769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:38 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1308 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:39.282448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-32ee61e9-c130-44fb-8910-9e5cb812f732 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.768451 Sep 07 10:02:39.285375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:39.296591 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1875/3770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:38 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:39.296794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:39.298546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:39.305836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:39.310397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.311287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.311756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.312517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.312987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.317389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.319501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.321125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.321657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.324961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.325532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.325985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.378512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:39.387230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:02:39.532478 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d7d2e2b-935d-425b-8e7c-76df820fedaf tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 204 len: 0 microversion: 2.1 time: 0.258279 Sep 07 10:02:39.555842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1896/3771] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:02:39 2022] DELETE /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:02:39.568981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-deleted", "tag": "388c8aab-43f8-4b1f-81d6-1de595152f6e"}, {"server_uuid": "6689b9fa-2da1-481d-8792-e43f5cb49160", "name": "network-vif-deleted", "tag": "c4ddaf2a-dc3f-43a5-93a8-6635d7547448"}, {"name": "network-changed", "server_uuid": "14558c21-bf17-4cc2-9443-0280ee2e4db5", "tag": "f728cd6a-52de-45f2-87a6-c0004189aac0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:39.589626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.590347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.591557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.609515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Creating event network-vif-deleted:388c8aab-43f8-4b1f-81d6-1de595152f6e for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:39.617817 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Creating event network-vif-deleted:c4ddaf2a-dc3f-43a5-93a8-6635d7547448 for instance 6689b9fa-2da1-481d-8792-e43f5cb49160 on n-h1-836830-16 Sep 07 10:02:39.618652 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] Creating event network-changed:f728cd6a-52de-45f2-87a6-c0004189aac0 for instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 on n-h2-836830-16 Sep 07 10:02:39.642632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6a4e28b8-0e51-47be-a407-89bf5ea14c40 req-b21b3526-380d-45bc-a33e-f5deec3b6d8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.082193 Sep 07 10:02:39.644481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1897/3772] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:39.655071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0424e579-18b5-4a51-b8df-64007112e149 req-ed895216-d02a-420e-8932-0c788dbe8712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74168d1b-4b40-480d-add9-d409e18a5490", "tag": "03fbf564-e9a2-48e8-941f-9b647e2a9696"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:39.667376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0424e579-18b5-4a51-b8df-64007112e149 req-ed895216-d02a-420e-8932-0c788dbe8712 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.668140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0424e579-18b5-4a51-b8df-64007112e149 req-ed895216-d02a-420e-8932-0c788dbe8712 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.668957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0424e579-18b5-4a51-b8df-64007112e149 req-ed895216-d02a-420e-8932-0c788dbe8712 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.686498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0424e579-18b5-4a51-b8df-64007112e149 req-ed895216-d02a-420e-8932-0c788dbe8712 service nova] Creating event network-changed:03fbf564-e9a2-48e8-941f-9b647e2a9696 for instance 74168d1b-4b40-480d-add9-d409e18a5490 on n-h1-836830-16 Sep 07 10:02:39.712362 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0424e579-18b5-4a51-b8df-64007112e149 req-ed895216-d02a-420e-8932-0c788dbe8712 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065672 Sep 07 10:02:39.715104 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1898/3773] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:39.732452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20d5d621-0c24-4eb5-9bff-713234958482 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:39.736798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-20d5d621-0c24-4eb5-9bff-713234958482 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: f9e223da-c860-4dcb-97bc-4b0d32beeeb1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:39.751071 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-20d5d621-0c24-4eb5-9bff-713234958482 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance f9e223da-c860-4dcb-97bc-4b0d32beeeb1 could not be found. Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20d5d621-0c24-4eb5-9bff-713234958482 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/f9e223da-c860-4dcb-97bc-4b0d32beeeb1/action HTTP/1.1 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 14 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: {"resume": {}} Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance f9e223da-c860-4dcb-97bc-4b0d32beeeb1 could not be found. Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'f9e223da-c860-4dcb-97bc-4b0d32beeeb1', 'body': {'resume': {}}} Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e223da-c860-4dcb-97bc-4b0d32beeeb1 could not be found. Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e223da-c860-4dcb-97bc-4b0d32beeeb1 could not be found. Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:39.762418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:39.766239 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:39.766239 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:39.766239 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e223da-c860-4dcb-97bc-4b0d32beeeb1 could not be found. Sep 07 10:02:39.766239 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:39.770933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20d5d621-0c24-4eb5-9bff-713234958482 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance f9e223da-c860-4dcb-97bc-4b0d32beeeb1 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:39.773821 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20d5d621-0c24-4eb5-9bff-713234958482 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/f9e223da-c860-4dcb-97bc-4b0d32beeeb1/action" status: 404 len: 111 microversion: 2.1 time: 0.056987 Sep 07 10:02:39.781922 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1899/3774] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:39 2022] POST /compute/v2.1/servers/f9e223da-c860-4dcb-97bc-4b0d32beeeb1/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:39.790963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:39.794357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:39.819696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.820475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.821108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:39.825286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:39.828684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:39.830706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:40.091646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:40.116010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:40.120611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:40.126387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cf52f39-1f71-4d96-9c75-ae36ca2f24b0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.343323 Sep 07 10:02:40.127234 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1900/3775] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:39 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:40.132983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:40.150063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:40.166088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:40.166587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:40.167035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:40.167756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:40.168218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:40.168645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:40.209443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:40.242030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:40.247213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:40.248877 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc06ec56-9845-4e72-90a0-8c3d903f336f tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2867 microversion: 2.32 time: 0.961674 Sep 07 10:02:40.250789 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1876/3776] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:39 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2867 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:40.268833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:40.279778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:40.300642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:40.301143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:40.314949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:40.324268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:40.325142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:40.325999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.002961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:41.016221 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b9ef50b0-6eee-48c5-910e-ccc261acb02d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.763497 Sep 07 10:02:41.037946 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1877/3777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:40 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:41.053506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:41.054391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:41.065385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:41.069815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.070322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.070779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.071506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.071972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.072411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.073161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:41.093035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84ed58df-daeb-43b6-99eb-53d717f5dd9e tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1533 microversion: 2.1 time: 0.963619 Sep 07 10:02:41.094506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1901/3778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:40 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1533 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:41.103204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:41.104189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:41.118813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.119313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.119752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.121448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.123349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.123819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.149484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:41.794790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:41.804691 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7cf23796-d338-4d8c-bf1a-030094db131a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.708685 Sep 07 10:02:41.805308 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1902/3779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:41 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:41.817514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:41.824159 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e3eb99c2-16b4-4bc1-8afa-b3db5acf8588 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1308 microversion: 2.1 time: 0.782536 Sep 07 10:02:41.824159 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1878/3780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:41 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1308 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:41.828974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:41.829817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:41.830175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:41.830985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:41.838037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.838688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.840342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.841421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.841937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.842468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.844258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.844768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.845238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:41.845950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:41.846414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:41.846847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.037685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.059807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.063044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.066511 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54cacc98-c805-4fde-937d-c3b3ed7f06e9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.242082 Sep 07 10:02:42.073136 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1879/3781] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:41 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:42.087311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8bcb7c2c-ba20-496d-844f-3bab2ef028d6 req-2adc09ad-bc13-40e6-be3d-2c7f630bf6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-deleted", "tag": "1ecfaf7d-3cc0-4159-97c4-dac53650ffa4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:42.116038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8bcb7c2c-ba20-496d-844f-3bab2ef028d6 req-2adc09ad-bc13-40e6-be3d-2c7f630bf6eb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.124023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8bcb7c2c-ba20-496d-844f-3bab2ef028d6 req-2adc09ad-bc13-40e6-be3d-2c7f630bf6eb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.124700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8bcb7c2c-ba20-496d-844f-3bab2ef028d6 req-2adc09ad-bc13-40e6-be3d-2c7f630bf6eb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.141590 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8bcb7c2c-ba20-496d-844f-3bab2ef028d6 req-2adc09ad-bc13-40e6-be3d-2c7f630bf6eb service nova] Creating event network-vif-deleted:1ecfaf7d-3cc0-4159-97c4-dac53650ffa4 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:42.149014 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8bcb7c2c-ba20-496d-844f-3bab2ef028d6 req-2adc09ad-bc13-40e6-be3d-2c7f630bf6eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074236 Sep 07 10:02:42.150217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1880/3782] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:42.155877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:42.156709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:42.164610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.165378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.168173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.169079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.169756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.175397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.239467 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'resume' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 14 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: {"resume": {}} Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'resume' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'resume': {}}} Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state active. Cannot resume while the instance is in this state. Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:42.241839 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'resume' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1562ebf-e116-4ac0-be9c-f65a089a7e39 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 144 microversion: 2.1 time: 0.092196 Sep 07 10:02:42.246862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1881/3783] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:42 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 144 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:02:42.254813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:42.255460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:42.264194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.264689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.265129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.279648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.283637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.285905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.592266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.608637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.613935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.617244 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7592dc16-1d16-4736-9640-f0a79b31579b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2820 microversion: 2.32 time: 0.790607 Sep 07 10:02:42.618805 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1903/3784] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:41 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2820 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:42.626649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d00cc2c2-9226-4bd1-abd6-cdcf33c0632f req-fcba32e5-d058-42ef-a6f2-47d2117cb45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14558c21-bf17-4cc2-9443-0280ee2e4db5", "name": "network-vif-plugged", "status": "completed", "tag": "f728cd6a-52de-45f2-87a6-c0004189aac0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:42.645970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d00cc2c2-9226-4bd1-abd6-cdcf33c0632f req-fcba32e5-d058-42ef-a6f2-47d2117cb45f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.647434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d00cc2c2-9226-4bd1-abd6-cdcf33c0632f req-fcba32e5-d058-42ef-a6f2-47d2117cb45f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.648146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d00cc2c2-9226-4bd1-abd6-cdcf33c0632f req-fcba32e5-d058-42ef-a6f2-47d2117cb45f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.667129 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d00cc2c2-9226-4bd1-abd6-cdcf33c0632f req-fcba32e5-d058-42ef-a6f2-47d2117cb45f service nova] Creating event network-vif-plugged:f728cd6a-52de-45f2-87a6-c0004189aac0 for instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 on n-h2-836830-16 Sep 07 10:02:42.674552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d00cc2c2-9226-4bd1-abd6-cdcf33c0632f req-fcba32e5-d058-42ef-a6f2-47d2117cb45f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052315 Sep 07 10:02:42.709105 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1904/3785] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:42.716097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:42.717028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:42.727321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.728008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.728941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.730177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.730889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.732746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.764506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:42.786672 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe52960a-3acc-4082-bfd7-009e526ffd84 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1533 microversion: 2.1 time: 0.541214 Sep 07 10:02:42.788514 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1882/3786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:42 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1533 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:42.857046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:42.857870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:42.874329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.875624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.878082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:42.880070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:42.883909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:42.885706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.320017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:43.335517 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36664dd0-6fa7-451b-8846-8c2cce319f87 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1308 microversion: 2.1 time: 0.482441 Sep 07 10:02:43.345607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1883/3787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:42 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1308 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:43.345948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:43.354326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:43.356624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:43.375471 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a99ca35d-3f44-424a-81ec-5ac6f3de96e3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.662584 Sep 07 10:02:43.376134 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1905/3788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:42 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:43.377464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.378109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.379763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.381878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.382665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.383210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.405200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:43.405846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:43.416002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.418386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.421262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.422392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.422889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.423345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.650503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:43.666068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:43.672534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:43.676173 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9df1ca09-06b6-471c-abeb-08714559d560 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.336812 Sep 07 10:02:43.678864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1884/3789] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:43 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:43.696006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:43.697616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:43.706432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.709795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.710494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.711413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.712046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.712926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.749545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:43.759555 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-397142b8-0a75-4fa3-ae94-5ca841440c26 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.358747 Sep 07 10:02:43.766858 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1906/3790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:43 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:43.814886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:43.815503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:43.828118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.828614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.829093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.830144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.830602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.831019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.931266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:43.931761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:43.932210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:43.935304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lazy-loading 'fault' on Instance uuid 4792bda1-d558-4e8f-b31e-79cb13e6e231 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:02:44.102686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2655105ab29436ba12c79423eaecaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ee55bcd47446788d54a6c114e9b88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:44.116348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-73c6e8e3-727a-420e-aa86-e0fcfe441eda tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 200 len: 1318 microversion: 2.1 time: 0.304788 Sep 07 10:02:44.118877 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1907/3791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:43 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:44.132402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ebe744c-f1f6-4c7b-9c1e-3cce98af8467 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ebe744c-f1f6-4c7b-9c1e-3cce98af8467 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 160 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ffb7e619-ff58-4e6d-bd05-cbb26b7295a0"}]}} Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': '', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'networks': [{'uuid': 'ffb7e619-ff58-4e6d-bd05-cbb26b7295a0'}]}}} Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi '' Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:02:44.143363 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:02:44.148496 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:44.150399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ebe744c-f1f6-4c7b-9c1e-3cce98af8467 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:44.151417 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ebe744c-f1f6-4c7b-9c1e-3cce98af8467 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.030367 Sep 07 10:02:44.155940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1908/3792] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:02:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:02:44.171367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:44.172084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:44.188363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:44.190247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:44.190845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:44.197016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:44.197740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:44.198709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:44.299128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:44.315595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:44.317083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:44.318539 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5586f264-ce8b-43d5-926a-2ba91226027c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2659 microversion: 2.32 time: 0.637811 Sep 07 10:02:44.333277 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1885/3793] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:43 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2659 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:44.345468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-deleted", "tag": "ebd2b93f-9339-4996-b73d-d6aba65c7eb9"}, {"server_uuid": "4792bda1-d558-4e8f-b31e-79cb13e6e231", "name": "network-vif-deleted", "tag": "cbb9bc22-0656-4f8f-a28d-2830e7ffba53"}, {"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-deleted", "tag": "7b601b14-198e-469c-b95a-239bd800b1e0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:44.368266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:44.368770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:44.369235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:44.409538 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Creating event network-vif-deleted:ebd2b93f-9339-4996-b73d-d6aba65c7eb9 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:44.410047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Creating event network-vif-deleted:cbb9bc22-0656-4f8f-a28d-2830e7ffba53 for instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 on n-h1-836830-16 Sep 07 10:02:44.418954 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] Creating event network-vif-deleted:7b601b14-198e-469c-b95a-239bd800b1e0 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:44.434587 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3e565ccb-3222-4d24-bdb9-e5063be23c6a req-50baa33d-77b8-4592-b174-878cb9334b07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.095845 Sep 07 10:02:44.435641 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1886/3794] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:44.443667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:44.444394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:44.461167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:44.467779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:44.467779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:44.467779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:44.468126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:44.468471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.128784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:45.144488 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4283b5cc-c869-4cae-b075-83ee0dbf3d99 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.982307 Sep 07 10:02:45.146897 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1909/3795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:44 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:45.156286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:45.158084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:45.179890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.180636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.181263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.182143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.182761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.183345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.234630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:45.248170 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34a68ffd-8051-4d42-af3f-6bc8fcbb3ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1488 microversion: 2.1 time: 0.808756 Sep 07 10:02:45.251475 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1887/3796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:44 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1488 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:45.261199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:45.263633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] [instance: 4792bda1-d558-4e8f-b31e-79cb13e6e231] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:45.299297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.304255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.305036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.306027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.306720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.308713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.357880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:45.362564 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] HTTP exception thrown: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Request method failure captured: Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 HTTP/1.1 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwNPz1gHVYeqeS4IKxxXSHbjlWlW494vEi2vR6b9mOyumyfhbZldPqNri4MdQL2EghlZF9-6fHzbpJZKm0ITXboNGDJWmYQZpp4GlrZIwu_A-sjLq3ACKurvV1gwAS7QM_eAeT_SjvbqCBYaXRUNSx5NdwPLjckXaFsd5CMSUMtVGA Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 72ee55bcd47446788d54a6c114e9b88c Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-548713205 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72ee55bcd47446788d54a6c114e9b88c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72ee55bcd47446788d54a6c114e9b88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72ee55bcd47446788d54a6c114e9b88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72ee55bcd47446788d54a6c114e9b88c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-548713205 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 72ee55bcd47446788d54a6c114e9b88c Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-548713205 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestMultiTenantJSON-548713205-project Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f2655105ab29436ba12c79423eaecaf0 Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-548713205-project Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4792bda1-d558-4e8f-b31e-79cb13e6e231'} Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:45.374061 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:02:45.378394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] Returning 404 to user: Instance 4792bda1-d558-4e8f-b31e-79cb13e6e231 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:45.379175 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6900cdc7-c851-477a-96de-ac22fd8091a6 tempest-ServersNegativeTestMultiTenantJSON-548713205 tempest-ServersNegativeTestMultiTenantJSON-548713205-project] 10.222.0.60 "GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231" status: 404 len: 111 microversion: 2.1 time: 0.126499 Sep 07 10:02:45.381532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:45.383310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:45.384536 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45353489-6f90-45cd-a0d0-c0782c376701 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.236288 Sep 07 10:02:45.389556 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1888/3797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:45 2022] GET /compute/v2.1/servers/4792bda1-d558-4e8f-b31e-79cb13e6e231 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:45.394497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:45.395683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:45.403771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1910/3798] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:45 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:45.417381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:45.417948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:45.435313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.435808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.436245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.436952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.437576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.446474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:45.449006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.451487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.451983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.452418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.459237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.459918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.460367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.610350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd7f193b-da57-436f-826f-ff2adf0c4c69 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5/action" status: 202 len: 0 microversion: 2.1 time: 0.203534 Sep 07 10:02:45.612463 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1911/3799] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:45 2022] POST /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:02:45.626432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:45.628761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:45.667244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.667940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.668509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:45.670778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:45.671702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:45.672854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.040895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:46.050385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27d442d9-2639-4a5c-9239-7c6d0fbbd40b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.659664 Sep 07 10:02:46.069131 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1889/3800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:45 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:46.088794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:46.090107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:46.110707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.113874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.115248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.117539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.118523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.120415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.168870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:46.183030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:46.184789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:46.187241 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69fa9509-c636-415d-b40b-377e8147fbe6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2432 microversion: 2.32 time: 0.573534 Sep 07 10:02:46.213362 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1912/3801] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:45 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2432 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:46.222966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f81c041-4c2e-4070-b4b4-a2fa1aa6a52f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:46.223740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f81c041-4c2e-4070-b4b4-a2fa1aa6a52f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:46.241205 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2f81c041-4c2e-4070-b4b4-a2fa1aa6a52f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4 could not be found. Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f81c041-4c2e-4070-b4b4-a2fa1aa6a52f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/8591dbbf-9a70-4a30-9dc4-d3759bb97cd4/action HTTP/1.1 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 14 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: {"shelve": {}} Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4 could not be found. Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '8591dbbf-9a70-4a30-9dc4-d3759bb97cd4', 'body': {'shelve': {}}} Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4 could not be found. Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4 could not be found. Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:02:46.248006 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:02:46.252042 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:02:46.252042 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:02:46.252042 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4 could not be found. Sep 07 10:02:46.252042 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:02:46.253303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f81c041-4c2e-4070-b4b4-a2fa1aa6a52f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 8591dbbf-9a70-4a30-9dc4-d3759bb97cd4 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:02:46.254389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f81c041-4c2e-4070-b4b4-a2fa1aa6a52f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/8591dbbf-9a70-4a30-9dc4-d3759bb97cd4/action" status: 404 len: 111 microversion: 2.1 time: 0.039667 Sep 07 10:02:46.258466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1913/3802] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:46 2022] POST /compute/v2.1/servers/8591dbbf-9a70-4a30-9dc4-d3759bb97cd4/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:02:46.268530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:46.269609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:46.282389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.285529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.287407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.293483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.294382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.294939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.301119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:46.741535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:46.762836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d78fefee-2c7f-457e-acdb-3a92e3d1999f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.502934 Sep 07 10:02:46.765059 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1914/3803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:46 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:46.771094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:46.772968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:46.791914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.792705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.793352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.795903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.796631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.797258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.841716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:46.851563 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3f73ed9-05d5-4a0c-8ed9-2c0a489d28da tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 200 len: 1473 microversion: 2.1 time: 0.779430 Sep 07 10:02:46.852365 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1890/3804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:46 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 1473 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:46.857530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:46.858344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:46.865565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.869891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.870397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.875012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:46.875873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:46.876453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:46.970180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:47.001027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:47.003854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:47.010178 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-af595bf4-3a0d-46b1-adeb-7522cba9dc80 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.243870 Sep 07 10:02:47.015329 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1915/3805] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:46 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:47.022406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a5ff2d2f-5658-4438-884b-13e853e6e7ea req-a66a3ed1-0e61-433f-9180-e2d655b9be5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-deleted", "tag": "7db2bf51-8311-4cf4-ae79-919fe6ccada5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:47.048981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a5ff2d2f-5658-4438-884b-13e853e6e7ea req-a66a3ed1-0e61-433f-9180-e2d655b9be5c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.062648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a5ff2d2f-5658-4438-884b-13e853e6e7ea req-a66a3ed1-0e61-433f-9180-e2d655b9be5c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.064112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a5ff2d2f-5658-4438-884b-13e853e6e7ea req-a66a3ed1-0e61-433f-9180-e2d655b9be5c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.091074 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a5ff2d2f-5658-4438-884b-13e853e6e7ea req-a66a3ed1-0e61-433f-9180-e2d655b9be5c service nova] Creating event network-vif-deleted:7db2bf51-8311-4cf4-ae79-919fe6ccada5 for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:47.106531 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a5ff2d2f-5658-4438-884b-13e853e6e7ea req-a66a3ed1-0e61-433f-9180-e2d655b9be5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088460 Sep 07 10:02:47.107322 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1916/3806] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:47.130211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-769892449"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:47.133699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:47.157927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.159641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.160677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.162761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.165540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.165994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.596248 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93263496-0081-4e70-9ce8-0b1187650cff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5/action" status: 202 len: 0 microversion: 2.1 time: 0.482960 Sep 07 10:02:47.599728 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1917/3807] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:47 2022] POST /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 10:02:47.610651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:47.612465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:47.642809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.643490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.644052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.644884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.645903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.648846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.663096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:47.678923 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6aa8e3cc-d3c5-48da-9d26-e72cc8108ee2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.825208 Sep 07 10:02:47.679911 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1891/3808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:46 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:47.684577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f8c1cbe2-4976-48c9-937d-e837da4b5027 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b5d7fa60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:47.769150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f8c1cbe2-4976-48c9-937d-e837da4b5027 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.087937 Sep 07 10:02:47.769783 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1892/3809] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:47 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:47.784123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:47.784966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:47.792441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.793239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.793829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.794719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:47.795330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:47.795939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:47.848316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lazy-loading 'flavor' on Instance uuid a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:02:48.141748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.160767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.167233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.168867 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb45e2e9-9ea2-4141-bba7-8cf77bbe1963 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2227 microversion: 2.32 time: 0.567613 Sep 07 10:02:48.173160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-af2c201a-c5e1-4f9e-bd9e-5f1c1293f3b9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.392806 Sep 07 10:02:48.173600 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1918/3810] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:47 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2227 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:48.174557 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1893/3811] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:02:47 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:02:48.187422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:48.188334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:48.205334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:48.206186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:48.212486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:48.213503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:48.214366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:48.214865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:48.215563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:48.216240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:48.229518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:48.230020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:48.231641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:48.232670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:48.233678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:48.234386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:48.278488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:48.436803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.450789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.452531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.454014 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6caed6ea-f530-4837-80b1-d6fa50b9861f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.278413 Sep 07 10:02:48.454783 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1919/3812] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:48 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:48.669389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:48.681809 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd4afd9f-60f5-42d9-91a1-7a0757a7dae2 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.489955 Sep 07 10:02:48.682709 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1894/3813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:48 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:48.786483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0fe85eda-d5ce-47a4-ad96-e1568a785a3a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1295430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:48.843029 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0fe85eda-d5ce-47a4-ad96-e1568a785a3a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.059911 Sep 07 10:02:48.844479 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1920/3814] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:48 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:49.206722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:49.208011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:49.220349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.225847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.226485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.227382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.228365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.229116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.489133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:49.491612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:49.508166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.508853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.513087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.514117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.514726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.515317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.618492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:49.633878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:49.635365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:49.636630 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b99367fb-760e-48b6-b12e-fd33d70de228 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 2159 microversion: 2.32 time: 0.435661 Sep 07 10:02:49.645584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1895/3815] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:49 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 2159 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:49.706451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:49.709880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:49.722185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.722878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.723500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.724651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.725297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.725895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.785669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:49.819408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:49.828137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:49.828137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4912f49b-6ae3-492f-a811-d81db2f7412b tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.345678 Sep 07 10:02:49.852621 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1921/3816] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:49 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:49.869964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-557131ef-1131-43c3-95d3-1aad4c6c6766 req-e3f0652d-4690-45bd-90e0-41c56f42ab26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a94a73e-9d50-41fc-ad3b-410b631a51b6", "name": "network-vif-deleted", "tag": "34db865d-7ea1-4f47-b238-dd9dea03cc4f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:49.921405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-557131ef-1131-43c3-95d3-1aad4c6c6766 req-e3f0652d-4690-45bd-90e0-41c56f42ab26 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:49.922655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-557131ef-1131-43c3-95d3-1aad4c6c6766 req-e3f0652d-4690-45bd-90e0-41c56f42ab26 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:49.923299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-557131ef-1131-43c3-95d3-1aad4c6c6766 req-e3f0652d-4690-45bd-90e0-41c56f42ab26 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:49.941071 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-557131ef-1131-43c3-95d3-1aad4c6c6766 req-e3f0652d-4690-45bd-90e0-41c56f42ab26 service nova] Creating event network-vif-deleted:34db865d-7ea1-4f47-b238-dd9dea03cc4f for instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 on n-h2-836830-16 Sep 07 10:02:49.953902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-557131ef-1131-43c3-95d3-1aad4c6c6766 req-e3f0652d-4690-45bd-90e0-41c56f42ab26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099120 Sep 07 10:02:49.956233 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1922/3817] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:49.964770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44d11526-3da1-4886-9b29-8766aef55c8f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1dece50>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:50.048742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44d11526-3da1-4886-9b29-8766aef55c8f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.090050 Sep 07 10:02:50.051949 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1923/3818] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:49 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:50.269796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:50.283673 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ecf98d3-ced5-405a-8a8b-22d07a1d8b1d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.578810 Sep 07 10:02:50.284427 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1896/3819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:49 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:50.668970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:50.672666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:50.706858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:50.709696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:50.711012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:50.715364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:50.719147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:50.720281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:50.863406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:50.864054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:50.876955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:50.878243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:50.878718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:50.879794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:50.880309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:50.880759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:51.111325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.127236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.127677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.130230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.133926 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7aaa3765-a547-41ef-8f5d-85af4e1b8382 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.276838 Sep 07 10:02:51.149223 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1897/3820] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:50 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:51.149223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd05dd27-2fd6-43bb-b18b-378337608fc6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b235fb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:51.154364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.200047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.214212 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c35e3e8-51df-43ca-b8d3-5a24e6d0de6d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.545992 Sep 07 10:02:51.217254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1924/3821] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:50 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:51.229578 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd05dd27-2fd6-43bb-b18b-378337608fc6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.091720 Sep 07 10:02:51.238028 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1898/3822] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:51 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:51.309135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:51.310043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:51.320704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:51.322302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:51.323689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:51.326291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:51.326429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:51.328657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:51.546900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:51.558390 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1f0fd34-ffc1-415b-a34a-3c212934ba9f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.253844 Sep 07 10:02:51.560736 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1925/3823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:51 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:52.174907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:52.177136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:52.215547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:52.216324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:52.220046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:52.220963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:52.222272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:52.223719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:52.244371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:52.244996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:52.257773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:52.258505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:52.261044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:52.264682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:52.265528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:52.266139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:52.410224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.442761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.445030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.446341 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ac78e92-0fb9-4444-9ea5-9f2fbffb3426 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.287290 Sep 07 10:02:52.446924 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1899/3824] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:52 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:52.461630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.483244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65ea7c53-c54a-465d-89ec-273b43b39ecb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1f76280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:52.483573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.486355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.488222 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2d2849c-bafe-4a77-b398-7fc42e8931fb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.249897 Sep 07 10:02:52.504802 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1926/3825] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:52 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:52.574490 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65ea7c53-c54a-465d-89ec-273b43b39ecb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.126491 Sep 07 10:02:52.575425 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1900/3826] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:52 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:52.586443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:52.587353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:52.595869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:52.598838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:52.599534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:52.600534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:52.601636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:52.602246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:52.898423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:52.915505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9b6ce18-6ea6-4772-9ff7-0a7ee5a36b46 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.332671 Sep 07 10:02:52.919782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1927/3827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:52 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:53.480135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:53.481402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:53.496311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:53.501903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:53.502534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:53.503452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:53.504070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:53.504666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:53.519482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:53.520761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:53.538055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:53.543035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:53.543495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:53.544253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:53.544721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:53.545157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:53.710000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:53.725092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:53.737646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:53.743180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:53.748197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:53.751620 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be7c9106-7150-4b08-bd82-31e244aaf84c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.236076 Sep 07 10:02:53.754519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:53.755139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1928/3828] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:53 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:53.762618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3ae6ff4f-e1ee-44c5-8a00-4d945ac36112 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.288473 Sep 07 10:02:53.777063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cb2984a-82ec-448e-ad39-e9b368329a1f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b11a50d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:53.785148 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1901/3829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:53 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:53.854028 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cb2984a-82ec-448e-ad39-e9b368329a1f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.096060 Sep 07 10:02:53.862115 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1929/3830] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:53 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:53.941911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:53.942835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:53.957347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:53.957789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:53.958256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:53.961082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:53.961626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:53.964170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:54.350288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:54.362380 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6aa53059-daf8-4f55-abde-cb6c01c5f2c0 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.424937 Sep 07 10:02:54.381136 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1902/3831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:53 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:54.671195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-97760ba1-f558-4a49-9681-173b322ad1ce req-047786c7-f600-4e1a-b03e-1dd00036b809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14558c21-bf17-4cc2-9443-0280ee2e4db5", "name": "network-vif-plugged", "status": "completed", "tag": "f728cd6a-52de-45f2-87a6-c0004189aac0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:02:54.706195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-97760ba1-f558-4a49-9681-173b322ad1ce req-047786c7-f600-4e1a-b03e-1dd00036b809 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:54.706697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-97760ba1-f558-4a49-9681-173b322ad1ce req-047786c7-f600-4e1a-b03e-1dd00036b809 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:54.714016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-97760ba1-f558-4a49-9681-173b322ad1ce req-047786c7-f600-4e1a-b03e-1dd00036b809 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:54.748782 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-97760ba1-f558-4a49-9681-173b322ad1ce req-047786c7-f600-4e1a-b03e-1dd00036b809 service nova] Creating event network-vif-plugged:f728cd6a-52de-45f2-87a6-c0004189aac0 for instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 on n-h2-836830-16 Sep 07 10:02:54.769384 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-97760ba1-f558-4a49-9681-173b322ad1ce req-047786c7-f600-4e1a-b03e-1dd00036b809 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103030 Sep 07 10:02:54.773361 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1930/3832] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:02:54.783746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:54.784867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:54.803818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:54.812381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:54.815441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:54.818945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:54.823595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:54.827634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:54.832368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:54.833939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:54.856468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:54.857848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:54.860458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:54.864162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:54.871514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:54.874258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:55.322324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.359795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.365674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.367267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.368506 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a893f2e2-b836-4e37-a019-b5bb55bf6d6c tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.589968 Sep 07 10:02:55.369070 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1903/3833] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:54 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:55.386023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.388500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.390068 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1fb8f40d-7bb3-4ffd-a4b8-4ec0f2aaf4c8 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.595791 Sep 07 10:02:55.392815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1931/3834] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:54 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:02:55.406493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:55.408316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bdb5057c-131a-412f-9ee8-0be2a71fbf27 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1e91b80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:55.412421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:55.441777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:55.444828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:55.450493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:55.451484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:55.452159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:55.452785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:55.500691 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bdb5057c-131a-412f-9ee8-0be2a71fbf27 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.118598 Sep 07 10:02:55.501767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1904/3835] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:55 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:55.699315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:55.709328 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3407e335-3558-4057-9106-e7a2a0d58860 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.315023 Sep 07 10:02:55.731400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1932/3836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:55 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:56.417859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:56.419169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:56.431553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:56.432265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:56.436339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:56.438287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:56.438933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:56.440253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:56.440904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:56.443501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:56.464548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:56.467407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:56.469048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:56.472481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:56.473052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:56.473591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:56.544683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:56.557880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:56.560047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:56.561578 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab7ae81d-5a84-49dc-8f4e-33ed80f79bf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.166064 Sep 07 10:02:56.562731 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1905/3837] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:56 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:56.568821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c290487f-e89e-4480-bf41-3c97d22db954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b221a8b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:56.637526 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c290487f-e89e-4480-bf41-3c97d22db954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.073410 Sep 07 10:02:56.645241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1906/3838] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:56 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:56.646992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:56.657869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:56.659687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:56.661079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a569ce3a-82e1-4f42-8fc8-8ecf7ce1a093 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.234383 Sep 07 10:02:56.662789 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1933/3839] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:56 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:56.733602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:56.734537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:56.766924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:56.768578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:56.769085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:56.770176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:56.770662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:56.771679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:57.039110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.052947 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23aeda0d-b638-4603-abef-2b5ed1b7a5f8 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.322922 Sep 07 10:02:57.070629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1907/3840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:56 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:57.595311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:57.601719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:57.633717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:57.634996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:57.636091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:57.637418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:57.638571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:57.639526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:57.657443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0ba3b5e-6081-4d7f-bc98-f35e3db9ad14 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b221aca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:57.720485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:02:57.800048 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0ba3b5e-6081-4d7f-bc98-f35e3db9ad14 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.149439 Sep 07 10:02:57.808540 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1908/3841] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:57 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:57.830496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:57.831682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:57.856949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:57.857872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:57.858687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:57.859880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:57.860749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:57.865739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:57.869339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.886269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.888150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.892026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-187d2882-991b-4091-9bbc-6e318f135076 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.301930 Sep 07 10:02:57.893464 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1934/3842] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:57 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:57.971350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.982020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.983504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:57.984730 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c2737395-2125-4eea-bdb8-281a074f7774 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.174752 Sep 07 10:02:57.986947 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1909/3843] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:57 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:58.078106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:58.078744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:58.089735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:58.096811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:58.097384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:58.098149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:58.098633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:58.099231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:58.546373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:58.561422 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc4ea11b-ce5b-4a1c-987a-2e0b9f4bf15f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.487027 Sep 07 10:02:58.562255 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1935/3844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:58 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:02:58.816925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6730d3c6-413d-4d85-b1e2-a12b7d9952ec tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1ccdca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:58.928800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:58.929437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:58.950147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:58.954629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:58.955535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:58.960230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:58.961482 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6730d3c6-413d-4d85-b1e2-a12b7d9952ec tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.148737 Sep 07 10:02:58.962354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:58.962813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:58.973584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1910/3845] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:58 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:02:59.016924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:59.017983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:59.039274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:59.040790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:59.042850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:59.044064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:59.047712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:59.055116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:59.296603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.308629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.318287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.323650 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-769fc605-de0d-4a97-98ad-695de9492812 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.399276 Sep 07 10:02:59.328819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.341765 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1936/3846] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:58 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:59.356640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.364165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.366199 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c9658ef-c9a8-4f5d-b4ff-8483a0773cd0 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.355074 Sep 07 10:02:59.366782 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1911/3847] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:02:59 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:02:59.587306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:59.588207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:02:59.610614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:59.613591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:59.615530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:59.619717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:02:59.626787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:02:59.627459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:02:59.971525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:02:59.982508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa653562-04df-41e3-8dd5-d6ddf5419672 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1ccd040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:02:59.985515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7b2fc47d-fa0a-4bb8-a68c-03156fb60f15 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1531 microversion: 2.1 time: 0.402262 Sep 07 10:02:59.988637 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1937/3848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:02:59 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1531 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:00.070990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa653562-04df-41e3-8dd5-d6ddf5419672 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.094587 Sep 07 10:03:00.072210 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1912/3849] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:02:59 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:00.356562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:00.358244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:00.368149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:00.369790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:00.371435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:00.376129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:00.380727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:00.380727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:00.419675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:00.422809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:00.436793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:00.437329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:00.437869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:00.438595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:00.439055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:00.439673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:00.584659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:00.586730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:00.599980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:00.600719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:00.600934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:00.601982 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1564bd17-2cea-4e9f-8be0-4d867215c555 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.211049 Sep 07 10:03:00.610644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:00.616782 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1913/3850] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:00 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:00.619871 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-028b1aa4-3462-41a4-9356-c6df0ba5a4e8 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.267649 Sep 07 10:03:00.631556 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1938/3851] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:00 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:01.014358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:01.015002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:01.028511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:01.033270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:01.034324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:01.035331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:01.037696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:01.040358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:01.089577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60d07e02-acfe-40fc-a92c-a4cc114331e8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a5c670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:01.206220 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60d07e02-acfe-40fc-a92c-a4cc114331e8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1411 microversion: 2.1 time: 0.117674 Sep 07 10:03:01.212860 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1939/3852] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:03:01 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:01.648587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:01.652996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:01.653793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:01.664259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:01.665612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:01.668500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:01.671844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:01.672616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:01.673392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:01.674803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-42f12d53-f3b3-4c2a-97c4-0e612cc0c43c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1531 microversion: 2.1 time: 0.656893 Sep 07 10:03:01.678089 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1914/3853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:01 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1531 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:01.711098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:01.713963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:01.741600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:01.747754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:01.750609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:01.752365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:01.757308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:01.758971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:01.962105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:01.977846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:01.982039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:01.983867 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04d8e33b-1db3-49df-9cc9-1b2d3cdc3cc1 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.354117 Sep 07 10:03:02.010134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:02.021772 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1940/3854] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:01 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:03:02.026375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:02.029491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:02.031016 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99dc3b5d-f6d4-4cbc-9e47-09382c83611b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.335312 Sep 07 10:03:02.046095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1915/3855] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:01 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:02.232185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4806245e-0aee-49d0-b040-6a21dcaf8453 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0ada310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:02.706284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:02.707438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:02.724622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:02.730272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:02.730918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:02.731799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:02.735952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:02.736536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:03.226297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.238919 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b34133c0-410b-43d9-ac2e-c7d7d815b7e9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.536472 Sep 07 10:03:03.240459 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1916/3856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:02 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:03.250841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7453a8c9-4649-45cd-880b-0a9b60b86dbc req-82b9a1bb-5c97-4352-922a-ce7282b1957e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0", "name": "network-vif-plugged", "status": "completed", "tag": "73e192fa-c88f-4e9d-ad1e-d46bc07c2623"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:03.301643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7453a8c9-4649-45cd-880b-0a9b60b86dbc req-82b9a1bb-5c97-4352-922a-ce7282b1957e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:03.302613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7453a8c9-4649-45cd-880b-0a9b60b86dbc req-82b9a1bb-5c97-4352-922a-ce7282b1957e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:03.304169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7453a8c9-4649-45cd-880b-0a9b60b86dbc req-82b9a1bb-5c97-4352-922a-ce7282b1957e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:03.351613 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7453a8c9-4649-45cd-880b-0a9b60b86dbc req-82b9a1bb-5c97-4352-922a-ce7282b1957e service nova] Creating event network-vif-plugged:73e192fa-c88f-4e9d-ad1e-d46bc07c2623 for instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 on n-h2-836830-16 Sep 07 10:03:03.374399 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7453a8c9-4649-45cd-880b-0a9b60b86dbc req-82b9a1bb-5c97-4352-922a-ce7282b1957e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128875 Sep 07 10:03:03.377820 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1917/3857] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:03.396320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:03.399440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:03.412397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:03.413481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:03.414119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:03.416223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:03.416992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:03.417619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:03.524943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.528671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:03.546400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.548182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.554328 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9132c066-a28d-49c5-9aff-39771e05d721 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.175222 Sep 07 10:03:03.555102 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1918/3858] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:03 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:03.572177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:03.574224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:03.584810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=88 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:03.586568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:03.593941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:03.595412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:03.596341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:03.596958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:03.597569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:03.735002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.764497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.766004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:03.767222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f2a35c4-3a3c-4c01-ada2-9e900bf2e1ff tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.210501 Sep 07 10:03:03.781242 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1919/3859] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:03 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:04.269663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:04.271090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:04.293602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:04.296466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:04.297121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:04.298054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:04.299802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:04.301077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:04.717249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:04.748509 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82b02c86-35be-40dd-af99-b3b05f368789 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.484298 Sep 07 10:03:04.765221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1920/3860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:04 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:04.774078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:04.775000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:04.806679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:04.807117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:04.807575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:04.808471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:04.809039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:04.809521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:05.132376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:05.152939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:05.154781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:05.158319 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81c48029-bbee-4956-a36d-91a8f9ac9955 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.404126 Sep 07 10:03:05.165582 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1921/3861] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:04 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:05.179482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:05.180554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:05.209076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:05.214539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:05.217508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:05.220833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:05.223406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:05.226797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:05.537731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:05.564595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:05.573561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:05.576867 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-626f9428-ab1b-43fc-a17e-96cc77a5b09a tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.408022 Sep 07 10:03:05.583623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1922/3862] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:05 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:05.778328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:05.779188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:05.791078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:05.791761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:05.793899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:05.795518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:05.797115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:05.799457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.058590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.078383 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99e9727f-0400-422e-a369-72613ec1c790 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.303838 Sep 07 10:03:06.103050 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1923/3863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:05 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:06.117333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:06.123339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:06.140811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:06.141671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:06.142287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.143168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:06.148215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:06.150066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.241504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df5d58e0-f9fa-4c71-b67c-cf00a00c69bf tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/ips" status: 200 len: 145 microversion: 2.1 time: 0.135951 Sep 07 10:03:06.250208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1924/3864] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:03:06 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/ips => generated 145 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:06.257884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:06.258613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:06.266382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:06.266968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:06.267484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.268269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:06.268823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:06.269433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.360180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.373313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.374910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.376134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b5b774af-f867-473d-af4b-4d555c7165f9 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.124676 Sep 07 10:03:06.376898 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1925/3865] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:06 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:06.611185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:06.611850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:06.636418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:06.636418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:06.636418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.636418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:06.650295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:06.651510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:06.830284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.852204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.859527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:06.862239 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ec81f53-9507-4ca7-a9f8-65a66e7d90d4 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.256092 Sep 07 10:03:06.881521 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1926/3866] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:06 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:03:07.116719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:07.117455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:07.128560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:07.129218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:07.129614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:07.131749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:07.132050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:07.132489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:07.438745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:07.454429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb41fafe-93f3-4881-9148-29d2bd7ad65f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.347520 Sep 07 10:03:07.472187 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1927/3867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:07 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:07.483371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:07.486485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:07.499198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:07.501826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:07.508821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:07.510238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:07.510936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:07.511633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:07.654706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:07.666825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:07.671511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:07.674152 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e983693c-4fe2-40a8-bc1d-8c914e86361c tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1604 microversion: 2.42 time: 0.200683 Sep 07 10:03:07.680743 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1928/3868] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:07 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:07.901578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:07.902003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:07.916692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:07.919877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:07.920392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:07.921153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:07.929892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:07.930363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:08.128091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:08.179382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:08.188833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:08.199453 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-adda0316-746d-40b7-954b-bd2c951af9da tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.300621 Sep 07 10:03:08.204106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1929/3869] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:07 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:03:08.482353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:08.482977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:08.516614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:08.525886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:08.528875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:08.529699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:08.537819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:08.538329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:08.943118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-49a927de-6fb7-4b19-9504-6ea53697d221 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.479062 Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1930/3870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:08 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:09.006957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:10.517521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:10.531253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:10.537039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2384d558123f4c0c9a3948556ceb4145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997725e52ede40b592e0d19f35e5bc5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:10.541807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5a47bae-ca94-4fb9-a93e-2faa2a55fe45 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 200 len: 1366 microversion: 2.42 time: 1.579401 Sep 07 10:03:10.550444 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1931/3871] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:08 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 1366 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:10.569603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:10.572909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:10.598109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:10.601833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:10.604571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:10.606503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:10.607160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:10.611962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:10.907901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:10.933012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:10.936045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:10.950505 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-02dddb77-7a97-4625-9773-cfcb49122def tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.392563 Sep 07 10:03:10.958325 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1932/3872] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:10 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:10.970179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:10.981569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:11.001722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:11.002316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:11.002763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:11.003481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:11.003943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:11.004442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:11.659820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=51 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:11.948893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:11.968484 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1506638c-590e-4595-8f94-160c61c5d449 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 1.008599 Sep 07 10:03:11.971656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=33 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:11.975670 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1933/3873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:10 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:11.987814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:11.991068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:12.008228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:12.009063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:12.013709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:12.014696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:12.015390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:12.016216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:12.067659 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] HTTP exception thrown: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Request method failure captured: Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 HTTP/1.1 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGrEH1L6l0X9VZ96GUW5UwEZCpLldL5YFnfiL0CoyD3Io7syQ41KFXmua7kK2Y8UGEZEXqXTb30QXPzmkYBJ8Sc3LHHp18iAcSPtpFoFchJ_AjYmCOaypsGRfICUXRQjjmx698AY955otwP2Er8a9dnAL5gyIbd7YCi8oFJba7l2BpA Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.42 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 997725e52ede40b592e0d19f35e5bc5d Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997725e52ede40b592e0d19f35e5bc5d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 997725e52ede40b592e0d19f35e5bc5d Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TaggedBootDevicesTest_v242-346279185-project Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2384d558123f4c0c9a3948556ceb4145 Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TaggedBootDevicesTest_v242-346279185-project Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6689b9fa-2da1-481d-8792-e43f5cb49160'} Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:12.071085 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:12.076456 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:12.083614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Returning 404 to user: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:12.085975 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88163470-2b41-4fb1-a8a0-751090997f7f tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 404 len: 111 microversion: 2.42 time: 0.109047 Sep 07 10:03:12.091280 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1934/3874] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:11 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:03:12.112878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:12.113706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:12.132315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:12.135052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:12.139209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:12.140170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:12.140717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:12.141435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:12.568468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:12.601867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:12.616388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:12.625364 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5290254a-bf54-4572-94be-c7c32ddf97f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.523924 Sep 07 10:03:12.636568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1935/3875] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:12 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:12.643224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-73737c71-dfb4-40f8-9de0-644c93cb0785 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '.version_select at 0x7f14b1cabd30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:12.714664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-73737c71-dfb4-40f8-9de0-644c93cb0785 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998894080" status: 204 len: 0 microversion: 2.42 time: 0.076366 Sep 07 10:03:12.715266 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1936/3876] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 7 10:03:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998894080 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:03:13.025595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:13.026229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:13.055056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:13.062731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:13.065973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:13.072328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:13.075155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:13.075645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:13.202304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:13.685798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:13.699069 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-edb15829-1176-4e4f-ac96-187e5a07f50b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.697227 Sep 07 10:03:13.705688 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1937/3877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:13 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:13.722698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:13.722698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:13.759976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:13.782906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:13.783627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:13.784699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:13.787663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:13.788953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:14.137643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:14.179756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:14.187968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:14.194723 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b850b7f8-5a0a-457a-89b9-7caf8d451885 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.474712 Sep 07 10:03:14.217329 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1938/3878] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:13 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:14.243882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc46171-9964-45f3-80d2-b5d3d5c04751"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:14.251108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:14.296801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:14.303427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:14.308170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:14.309590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:14.318987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:14.319636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:15.026146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-962c940e-c44d-41f0-9586-dcac4b4f556b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823174 Sep 07 10:03:15.027959 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1939/3879] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:03:14 2022] POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:15.106586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:15.107390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:15.181141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:15.182872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:15.183340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:15.184094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:15.184557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:15.190234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:16.200177 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4806245e-0aee-49d0-b040-6a21dcaf8453 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1420 microversion: 2.1 time: 13.972160 Sep 07 10:03:16.206815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1941/3880] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:03:02 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1420 bytes in 13979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:16.241712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:16.247706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:16.274736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:16.278365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:16.279290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:16.281506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:16.283521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:16.284974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:17.173100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:17.190422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:17.191934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:17.200132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:17.223140 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-beeb4452-8975-4502-ac41-571891a875c6 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 2.191840 Sep 07 10:03:17.224350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c6753711-e6e6-4eec-b809-a65fc7438645 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 1.011781 Sep 07 10:03:17.238901 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1940/3881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:15 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:17.239646 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1942/3882] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:16 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:17.239735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c653b9a-220d-4cbe-8024-17ac94b5552e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1f76040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:17.323641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c653b9a-220d-4cbe-8024-17ac94b5552e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 200 len: 1420 microversion: 2.1 time: 0.096040 Sep 07 10:03:17.324549 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1941/3883] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:03:17 2022] GET /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:17.342855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9390c145-af69-431b-9683-b989522154f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b2405d30>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:18.248821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:18.250191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:18.281877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:18.283562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:18.284168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:18.287641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:18.289519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:18.290866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:19.054701 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9390c145-af69-431b-9683-b989522154f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 204 len: 0 microversion: 2.1 time: 1.715189 Sep 07 10:03:19.057219 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1943/3884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:17 2022] DELETE /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 0 bytes in 1719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:03:19.075184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:19.077403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:19.105927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:19.106844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:19.107661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:19.108608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:19.109337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:19.111462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:19.759159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:19.779362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:19.796317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:19.798577 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a63a4d94-50bb-425f-8be1-3423e7efb5a5 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.738945 Sep 07 10:03:19.827166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1944/3885] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:19 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:19.836783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:19.845880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:19.868769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:19.869352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:19.869802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:19.870524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:19.870982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:19.871409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:19.912357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:03:20.107413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fecd738b-f636-4751-98c4-beb60ee5866f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 204 len: 0 microversion: 2.1 time: 0.278518 Sep 07 10:03:20.109614 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1945/3886] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:03:19 2022] DELETE /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:03:20.462854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-705683711", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ac11c0d8-1462-4df6-b5ec-d6277d361200"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:20.593048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] validate_networks() for [('ac11c0d8-1462-4df6-b5ec-d6277d361200', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:03:21.136415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:21.159860 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6390e5d-afd4-4017-9a1e-50cd40786a2b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 2.913813 Sep 07 10:03:21.184016 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1942/3887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:18 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 2940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:21.200910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:21.201919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:21.218619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:21.219573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:21.222488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:21.223740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:21.224627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:21.225903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:21.966108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:22.000130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:22.001868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:22.003125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-64e39920-afff-4db4-b153-e6f4393359f6 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.816669 Sep 07 10:03:22.003687 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1943/3888] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:21 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:22.040683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6109d8b1-0ac0-4d72-998e-52f50c706a4c req-899e267f-23aa-4271-83bf-dcb021ca35d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14558c21-bf17-4cc2-9443-0280ee2e4db5", "name": "network-vif-unplugged", "status": "completed", "tag": "f728cd6a-52de-45f2-87a6-c0004189aac0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:22.085446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6109d8b1-0ac0-4d72-998e-52f50c706a4c req-899e267f-23aa-4271-83bf-dcb021ca35d1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:22.086573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6109d8b1-0ac0-4d72-998e-52f50c706a4c req-899e267f-23aa-4271-83bf-dcb021ca35d1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:22.089539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6109d8b1-0ac0-4d72-998e-52f50c706a4c req-899e267f-23aa-4271-83bf-dcb021ca35d1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:22.146447 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6109d8b1-0ac0-4d72-998e-52f50c706a4c req-899e267f-23aa-4271-83bf-dcb021ca35d1 service nova] Creating event network-vif-unplugged:f728cd6a-52de-45f2-87a6-c0004189aac0 for instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 on n-h2-836830-16 Sep 07 10:03:22.158555 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6109d8b1-0ac0-4d72-998e-52f50c706a4c req-899e267f-23aa-4271-83bf-dcb021ca35d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140095 Sep 07 10:03:22.160545 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1944/3889] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:22.194117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:22.195080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:22.207756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:22.211988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:22.214837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:22.215661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:22.217278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:22.217874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.011958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:23.027108 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bded6469-515d-4e35-95a2-58781979cd21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.839370 Sep 07 10:03:23.042358 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1945/3890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:22 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:23.053295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:23.053887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:23.061796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.062249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.062708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.063613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.064320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.065659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.088134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] HTTP exception thrown: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Request method failure captured: Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 HTTP/1.1 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGrEH1L6l0X9VZ96GUW5UwEZCpLldL5YFnfiL0CoyD3Io7syQ41KFXmua7kK2Y8UGEZEXqXTb30QXPzmkYBJ8Sc3LHHp18iAcSPtpFoFchJ_AjYmCOaypsGRfICUXRQjjmx698AY955otwP2Er8a9dnAL5gyIbd7YCi8oFJba7l2BpA Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.42 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 997725e52ede40b592e0d19f35e5bc5d Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997725e52ede40b592e0d19f35e5bc5d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 997725e52ede40b592e0d19f35e5bc5d Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TaggedBootDevicesTest_v242-346279185-project Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2384d558123f4c0c9a3948556ceb4145 Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TaggedBootDevicesTest_v242-346279185-project Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6689b9fa-2da1-481d-8792-e43f5cb49160'} Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:03:23.091172 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.095286 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.097398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Returning 404 to user: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:23.099123 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b43f7ae0-bbf4-4335-8db7-dc3e8f1f2253 tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 404 len: 111 microversion: 2.42 time: 0.054794 Sep 07 10:03:23.101091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1946/3891] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:03:23 2022] DELETE /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:03:23.105925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:23.107485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:23.114903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.115878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.117076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.118101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.118895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.120157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.344388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:23.366514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:23.374228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:23.382212 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e13ebc8-a206-4008-9629-fd2959a4e4f3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.274219 Sep 07 10:03:23.382884 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1947/3892] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:23 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:23.418019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:23.418803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] [instance: 6689b9fa-2da1-481d-8792-e43f5cb49160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:23.432798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.433228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.433688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.434407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.434865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.435297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.483662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] HTTP exception thrown: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Request method failure captured: Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 HTTP/1.1 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGrEH1L6l0X9VZ96GUW5UwEZCpLldL5YFnfiL0CoyD3Io7syQ41KFXmua7kK2Y8UGEZEXqXTb30QXPzmkYBJ8Sc3LHHp18iAcSPtpFoFchJ_AjYmCOaypsGRfICUXRQjjmx698AY955otwP2Er8a9dnAL5gyIbd7YCi8oFJba7l2BpA Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.42 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 997725e52ede40b592e0d19f35e5bc5d Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997725e52ede40b592e0d19f35e5bc5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997725e52ede40b592e0d19f35e5bc5d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 997725e52ede40b592e0d19f35e5bc5d Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-346279185 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TaggedBootDevicesTest_v242-346279185-project Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2384d558123f4c0c9a3948556ceb4145 Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TaggedBootDevicesTest_v242-346279185-project Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6689b9fa-2da1-481d-8792-e43f5cb49160'} Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.485303 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] Returning 404 to user: Instance 6689b9fa-2da1-481d-8792-e43f5cb49160 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ea1e6371-3bc6-4803-8dc1-3be6fb2fa3bd tempest-TaggedBootDevicesTest_v242-346279185 tempest-TaggedBootDevicesTest_v242-346279185-project] 10.222.0.60 "GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160" status: 404 len: 111 microversion: 2.42 time: 0.102424 Sep 07 10:03:23.490236 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1948/3893] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:23 2022] GET /compute/v2.1/servers/6689b9fa-2da1-481d-8792-e43f5cb49160 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:03:23.603702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:03:23.604208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:03:23.604595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:03:23.605203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:03:23.605790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:03:23.633849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.634587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.635179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.636092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.636703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.637324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:23.695415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:03:23.713474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for user 2e14f54af9f44dd28bab63c619816e67 and project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:03:23.755290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:03:23.760067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:03:23.861909 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4bccef6e-4623-47bf-9b4d-891146ed53a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.403706 Sep 07 10:03:23.870013 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1946/3894] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:03:23.874619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3bc3a8f7-a42a-4244-90b7-6a9a4c2e925b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:23.875253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3bc3a8f7-a42a-4244-90b7-6a9a4c2e925b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:23.926682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-80c5df59-bd27-4697-803b-b2968ead6cb0 req-0577686f-5ca1-45db-87ab-9f00f96198a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14558c21-bf17-4cc2-9443-0280ee2e4db5", "name": "network-vif-deleted", "tag": "f728cd6a-52de-45f2-87a6-c0004189aac0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:23.958380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-80c5df59-bd27-4697-803b-b2968ead6cb0 req-0577686f-5ca1-45db-87ab-9f00f96198a2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:23.959110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-80c5df59-bd27-4697-803b-b2968ead6cb0 req-0577686f-5ca1-45db-87ab-9f00f96198a2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:23.959834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-80c5df59-bd27-4697-803b-b2968ead6cb0 req-0577686f-5ca1-45db-87ab-9f00f96198a2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:24.014311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-80c5df59-bd27-4697-803b-b2968ead6cb0 req-0577686f-5ca1-45db-87ab-9f00f96198a2 service nova] Creating event network-vif-deleted:f728cd6a-52de-45f2-87a6-c0004189aac0 for instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 on n-h2-836830-16 Sep 07 10:03:24.023705 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-80c5df59-bd27-4697-803b-b2968ead6cb0 req-0577686f-5ca1-45db-87ab-9f00f96198a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104289 Sep 07 10:03:24.031127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1947/3895] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:03:24.056349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:24.057702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:24.085594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:24.088188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:24.088663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:24.089439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:24.089915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:24.090353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:24.349429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3bc3a8f7-a42a-4244-90b7-6a9a4c2e925b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:24.365002 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3bc3a8f7-a42a-4244-90b7-6a9a4c2e925b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1207 microversion: 2.1 time: 0.494079 Sep 07 10:03:24.367555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1949/3896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:23 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1207 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:24.413765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:24.415139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:24.446458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:24.447278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:24.448118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:24.467961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:24.468508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:24.468970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:24.769981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:24.789010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:24.793769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:24.795283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0b1957f-a89f-499c-b51b-d65fd3fd5326 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.386904 Sep 07 10:03:24.800064 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1950/3897] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:24 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:03:24.843343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:24.858268 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-922c1718-f2ad-4316-8fe9-09ef09feff08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.809799 Sep 07 10:03:24.861412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1948/3898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:24 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:25.390260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:25.390958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:25.414159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:25.414912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:25.415576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:25.422245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:25.430902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:25.431654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:25.775999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:25.789228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd2f50d6-098a-40d9-9ed4-5a0f96b32788 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1203 microversion: 2.1 time: 0.402593 Sep 07 10:03:25.792705 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1951/3899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:25 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1203 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:25.828774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:25.829653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:25.843784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:25.844923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:25.848909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:25.849958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:25.856083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:25.856565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:25.888463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:25.889430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:25.900211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:25.903431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:25.905676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:25.906812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:25.907910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:25.912027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:26.286786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:26.297292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:26.298946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:26.300292 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d301e438-69a7-4782-88e7-a604811ec9ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.476053 Sep 07 10:03:26.305343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1949/3900] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:25 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:26.628340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:26.654933 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98d3d98a-b673-4024-8169-0b53e5c626d4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.772269 Sep 07 10:03:26.673208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1952/3901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:25 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:26.818561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:26.819188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:26.831615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:26.832098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:26.835497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:26.837146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:26.837843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:26.838432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:27.018912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:27.028434 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2bcc23ca-edde-4523-94d6-02c12f6922bf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1265 microversion: 2.1 time: 0.214805 Sep 07 10:03:27.029038 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1950/3902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:26 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:27.350150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:27.351017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:27.366397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:27.367154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:27.367747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:27.368640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:27.372149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:27.372596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:27.688495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:27.691346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:27.712320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:27.714345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:27.723610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:27.724869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:27.725582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:27.726240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:27.737568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:27.761402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:27.765413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:27.776380 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26a7dbb2-7b77-488e-a38e-5910836b2e80 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.427564 Sep 07 10:03:27.777319 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1953/3903] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:27 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:28.065328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:28.066321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:28.088886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:28.094172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:28.096070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:28.098229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:28.098821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:28.099323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:28.842520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:28.856096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1edd9b69-9db5-44d9-a6be-6e67d724b874 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1265 microversion: 2.1 time: 0.798509 Sep 07 10:03:28.877327 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1954/3904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:28 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1265 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:28.882604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:28.887918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:28.899715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:28.900500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:28.901161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:28.902137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:28.908794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:28.909591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:29.034921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:29.045748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90a739c4-3ec8-413c-bfbe-55f4a04511fd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 1.361946 Sep 07 10:03:29.049694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1951/3905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:27 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:29.089277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:29.106958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:29.108720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:29.110697 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b329993b-a9dd-411b-9499-1274c6b9609d tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.232029 Sep 07 10:03:29.115493 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1955/3906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:28 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:29.887456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:29.888147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:29.908786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:29.909327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:29.909779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:29.913073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:29.913601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:29.916951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:30.079061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:30.079598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:30.092459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:30.097621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:30.098514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:30.099437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:30.100221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:30.102000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:30.105120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:30.123498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-64ec9387-124e-482c-92aa-78bf811bb683 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1265 microversion: 2.1 time: 0.242712 Sep 07 10:03:30.124112 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1952/3907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:29 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:30.173236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:30.173924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:30.187368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:30.192365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:30.194952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:30.199074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:30.203098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:30.203644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:30.494194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:30.514067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:30.515902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:30.517344 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.348785 Sep 07 10:03:30.528709 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1953/3908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:30 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:03:30.530320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:30.531541 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44436195-5845-4bcc-9946-cdf6d5337399 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001553 Sep 07 10:03:30.532351 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1954/3909] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 7 10:03:30 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 10:03:30.564761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:30.577744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:30.580272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78fb3f53-ab8e-4429-b601-f789ce216d2d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1526 microversion: 2.1 time: 0.505469 Sep 07 10:03:30.582517 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1956/3910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:30 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1526 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:31.154649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:31.156129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:31.186384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:31.191837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:31.193066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:31.194893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:31.233602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:31.236572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:31.563631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:31.565873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:31.589934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:31.590438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:31.590881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:31.591584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:31.592217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:31.597969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:31.918544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:31.934754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:31.936619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:31.940425 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5eeaf6f4-f4f9-4068-aab4-c56b698cdd21 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.381249 Sep 07 10:03:31.956439 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1957/3911] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:31 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:03:31.974707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:31.975711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:31.987756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:31.988713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:31.989574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:31.990855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:31.991533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:31.992258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:32.464771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:32.471429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:32.483234 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e47ee999-bb70-45ae-aae3-50adefd1a081 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1508 microversion: 2.1 time: 0.516255 Sep 07 10:03:32.484822 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1958/3912] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:31 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1508 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:32.485504 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-840f19b8-2be2-4126-a6db-cbf78920db8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 1.331201 Sep 07 10:03:32.493423 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1955/3913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:31 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:32.877664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d17f8f83-1126-436d-b26a-e93bd96c8370 req-b6f402c5-4963-4849-9787-e2bb395ddb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2729d92-a21b-4bbb-88f8-7737455f6974", "tag": "e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:32.941046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d17f8f83-1126-436d-b26a-e93bd96c8370 req-b6f402c5-4963-4849-9787-e2bb395ddb56 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:32.945664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d17f8f83-1126-436d-b26a-e93bd96c8370 req-b6f402c5-4963-4849-9787-e2bb395ddb56 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:32.946564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d17f8f83-1126-436d-b26a-e93bd96c8370 req-b6f402c5-4963-4849-9787-e2bb395ddb56 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:32.965673 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d17f8f83-1126-436d-b26a-e93bd96c8370 req-b6f402c5-4963-4849-9787-e2bb395ddb56 service nova] Creating event network-changed:e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10 for instance e2729d92-a21b-4bbb-88f8-7737455f6974 on n-h1-836830-16 Sep 07 10:03:32.984926 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d17f8f83-1126-436d-b26a-e93bd96c8370 req-b6f402c5-4963-4849-9787-e2bb395ddb56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118593 Sep 07 10:03:32.987760 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1959/3914] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:32.992881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:32.994923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:33.006417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:33.010344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:33.011121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:33.012042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:33.016832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:33.017544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:33.182381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:33.215186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:33.216690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:33.217999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d880b0a-e5d9-4520-9b4a-c77c86e4dbf3 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.234175 Sep 07 10:03:33.218559 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1956/3915] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:32 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:33.525429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:33.526152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:33.533572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:33.534191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:33.543392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:33.543904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:33.545793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:33.547128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:33.547262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:33.547703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:33.548011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:33.548156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:33.548725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:33.548868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:33.549372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:33.549806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:33.654430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:33.737172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:34.003569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:34.017143 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12945928-f43b-442b-8fdf-cc8896244b53 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 0.496948 Sep 07 10:03:34.018621 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1960/3916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:33 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:34.092688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:34.102524 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-81a78887-d0a6-49a9-b1b7-b4d3f9453901 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1508 microversion: 2.1 time: 0.572661 Sep 07 10:03:34.103128 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1957/3917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:33 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:34.246265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:34.247439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:34.249563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:34.259494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:34.265912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:34.266461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:34.271418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:34.271923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:34.272373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:34.358255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:34.450528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-aac99b6c-7dcd-4f3e-b279-fe302f0ae8f4 req-c2e8a224-b1b6-4ac9-864c-8f3520890fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0", "name": "network-vif-unplugged", "status": "completed", "tag": "73e192fa-c88f-4e9d-ad1e-d46bc07c2623"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:34.455196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:34.470880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:34.472028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-aac99b6c-7dcd-4f3e-b279-fe302f0ae8f4 req-c2e8a224-b1b6-4ac9-864c-8f3520890fde service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:34.472582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:34.474662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f526c8c-55cb-4328-b7f0-3ba6d2ced6d1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1604 microversion: 2.32 time: 0.232989 Sep 07 10:03:34.474878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-aac99b6c-7dcd-4f3e-b279-fe302f0ae8f4 req-c2e8a224-b1b6-4ac9-864c-8f3520890fde service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:34.475594 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1961/3918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:34 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:34.475908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-aac99b6c-7dcd-4f3e-b279-fe302f0ae8f4 req-c2e8a224-b1b6-4ac9-864c-8f3520890fde service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:34.509563 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-aac99b6c-7dcd-4f3e-b279-fe302f0ae8f4 req-c2e8a224-b1b6-4ac9-864c-8f3520890fde service nova] Creating event network-vif-unplugged:73e192fa-c88f-4e9d-ad1e-d46bc07c2623 for instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 on n-h2-836830-16 Sep 07 10:03:34.523042 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-aac99b6c-7dcd-4f3e-b279-fe302f0ae8f4 req-c2e8a224-b1b6-4ac9-864c-8f3520890fde service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073859 Sep 07 10:03:34.524186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1958/3919] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:35.049211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:35.049972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:35.063725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.064231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.068293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.070900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.071836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.074586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.142498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:35.150861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:35.169019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.172839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.173691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.174781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.175650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.176124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.662165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:35.672478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6056c9e5-a0f2-40bc-9216-29ef91614ecd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 0.632237 Sep 07 10:03:35.693130 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1962/3920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:35 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:35.702975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:35.705918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:35.718897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.721819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.723758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.732659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.733331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.733882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.799681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:35.803426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:35.804147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:35.804834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lazy-loading 'fault' on Instance uuid 5a94a73e-9d50-41fc-ad3b-410b631a51b6 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:03:36.363419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:36.373515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:36.378654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a94d8ef11b6a438a8812e7c0e8c1adde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c7a2ab850049869743783576449827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:36.380592 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-321f2f12-19b0-4771-8878-e466cf8b24e1 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 200 len: 1371 microversion: 2.32 time: 0.686242 Sep 07 10:03:36.389802 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1963/3921] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:35 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 1371 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:03:36.392299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:36.430821 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9598c52b-2aef-4140-9898-527f2aa56ae3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1511 microversion: 2.1 time: 1.302561 Sep 07 10:03:36.433477 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1959/3922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:35 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1511 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:36.460840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:36.461605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:36.475367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:36.476071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:36.476744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:36.477632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:36.479279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:36.480033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:36.699042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:36.699659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:36.717304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:36.717810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:36.718253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:36.718975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:36.719436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:36.719864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.091197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:37.103456 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fde3f448-f8c1-4001-9f9e-bc33869dc7b5 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1451 microversion: 2.1 time: 0.647521 Sep 07 10:03:37.104051 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1964/3923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:36 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1451 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:37.178068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:37.178790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:37.189515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.195520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.196181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.197341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.197954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.198823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.236256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:37.245372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:37.255789 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8148bebf-4cc7-40bc-9d4b-0f5132fad6d1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 0.559335 Sep 07 10:03:37.272268 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1960/3924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:36 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:37.275899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lazy-loading 'flavor' on Instance uuid a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:03:37.304899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'shelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state shelved_offloaded Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 14 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: {"shelve": {}} Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'shelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state shelved_offloaded Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'shelve': {}}} Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:03:37.307191 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state shelved_offloaded Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state shelved_offloaded Sep 07 10:03:37.311237 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.313633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'shelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state shelved_offloaded {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:37.330242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ecb17ff0-e8b3-4149-ac09-0bbb9fe114bb tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 155 microversion: 2.1 time: 0.158281 Sep 07 10:03:37.334542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1965/3925] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:03:37 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 155 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 10:03:37.343513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:37.344139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:37.356262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.356745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.357210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.361893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.362590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.365764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.422197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:37.422812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:37.430730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.431434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.432075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.432995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.433727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128833) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 10:03:37.434371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.435011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.453748 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] HTTP exception thrown: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Request method failure captured: Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 HTTP/1.1 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGqq3WGGJhJ_K5_WClEiTMM1QTXJZLThGMVBc32d_Ymdu1E027AGyV0yX794B84FtlkoOPACDHUyHm3h154y6xY9KH3kzlPDikt7Tcl5kbA5NzzrZf2nS1UwY0xnAFO15qrRVgkU9Y8wGPFmE8nVsLLWZBnToxqEzGSqy77ixJn5xjA Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.32 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e3c7a2ab850049869743783576449827 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e3c7a2ab850049869743783576449827"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e3c7a2ab850049869743783576449827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e3c7a2ab850049869743783576449827"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e3c7a2ab850049869743783576449827", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e3c7a2ab850049869743783576449827 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TaggedBootDevicesTest-1725183211-project Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a94d8ef11b6a438a8812e7c0e8c1adde Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TaggedBootDevicesTest-1725183211-project Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5a94a73e-9d50-41fc-ad3b-410b631a51b6'} Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.455665 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:37.461992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:37.463914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Returning 404 to user: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:37.465011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4a485d6-f2fd-447d-88b5-4093a5e1272b tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 404 len: 111 microversion: 2.32 time: 0.048660 Sep 07 10:03:37.466121 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1966/3926] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:37 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:03:37.474826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c43c631d-878c-433f-8230-a8fd020cc4ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '.version_select at 0x7f14b1c354c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:37.510764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c43c631d-878c-433f-8230-a8fd020cc4ba tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341427353" status: 204 len: 0 microversion: 2.32 time: 0.040330 Sep 07 10:03:37.511597 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1967/3927] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 7 10:03:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341427353 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:03:37.561212 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5d2cb7be-28cb-4df9-9f87-ade75a29498f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.221820 Sep 07 10:03:37.561912 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1961/3928] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:03:37 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:03:37.574763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:37.575595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:37.588221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.596453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.597079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:37.598289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:37.599258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:37.608001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:38.288890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:38.290323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:38.314261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:38.322031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:38.322694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:38.323951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:38.324639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:38.325442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:38.360696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:38.386903 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ced11941-77eb-4588-b6f5-f6b09b2aa76b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1459 microversion: 2.1 time: 0.820470 Sep 07 10:03:38.391010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1968/3929] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:37 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1459 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:39.425212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:39.425985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:39.448985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:39.449134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:39.449633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:39.450347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:39.450904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:39.465365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:39.710648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:39.739812 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7169a58f-1426-462b-a7e3-4ecdfca7ba32 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 1.450552 Sep 07 10:03:39.745771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1962/3930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:38 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:40.451835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:40.464197 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-397a1b8f-6222-436e-97bc-aebfb3dc986c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1459 microversion: 2.1 time: 1.043684 Sep 07 10:03:40.464808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1969/3931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:39 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1459 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:40.769219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:40.771102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:40.784996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:40.788678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:40.791247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:40.792338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:40.798477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:40.799880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:41.476490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:41.491629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:41.492033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:41.498464 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9d4b579-d81b-4070-b103-2c10a33298a3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 0.728715 Sep 07 10:03:41.501832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:41.510254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:41.510713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:41.511467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:41.511935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:41.512377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:41.522458 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1963/3932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:40 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:41.920676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fcd86dbf-1adf-485f-bafb-4631a51a539c req-9b0f730b-70c8-4599-8d4c-afd23de241ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2729d92-a21b-4bbb-88f8-7737455f6974", "name": "network-vif-plugged", "status": "completed", "tag": "e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:41.945662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:41.958577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fcd86dbf-1adf-485f-bafb-4631a51a539c req-9b0f730b-70c8-4599-8d4c-afd23de241ee service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:41.959311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fcd86dbf-1adf-485f-bafb-4631a51a539c req-9b0f730b-70c8-4599-8d4c-afd23de241ee service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:41.960934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fcd86dbf-1adf-485f-bafb-4631a51a539c req-9b0f730b-70c8-4599-8d4c-afd23de241ee service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:42.012699 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fcd86dbf-1adf-485f-bafb-4631a51a539c req-9b0f730b-70c8-4599-8d4c-afd23de241ee service nova] Creating event network-vif-plugged:e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10 for instance e2729d92-a21b-4bbb-88f8-7737455f6974 on n-h1-836830-16 Sep 07 10:03:42.021203 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fcd86dbf-1adf-485f-bafb-4631a51a539c req-9b0f730b-70c8-4599-8d4c-afd23de241ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107176 Sep 07 10:03:42.024318 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1964/3933] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:03:42.120325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:42.137587 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f5bbafa-ba04-4cb5-af8b-23411a2de08c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.643021 Sep 07 10:03:42.162465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1970/3934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:41 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:42.529801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:42.530526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:42.549892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:42.550370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:42.550810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:42.555411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:42.562109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:42.562787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:43.170024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:43.170669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:43.189272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:43.189835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:43.190569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:43.192114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:43.193072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:43.193747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:43.302144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:43.329894 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84db8f3a-9cf1-4fec-bd05-957d8dc9a5a2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1307 microversion: 2.1 time: 0.803816 Sep 07 10:03:43.331009 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1965/3935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:42 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1307 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:44.358966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b24c98c0-d9cd-4d64-8196-9d3f4d3fda2c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:44.370819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b24c98c0-d9cd-4d64-8196-9d3f4d3fda2c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:44.371557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b24c98c0-d9cd-4d64-8196-9d3f4d3fda2c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:44.372336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b24c98c0-d9cd-4d64-8196-9d3f4d3fda2c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:44.405158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b24c98c0-d9cd-4d64-8196-9d3f4d3fda2c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Going to try to stop instance {{(pid=128833) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:03:44.459769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:44.470198 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b24c98c0-d9cd-4d64-8196-9d3f4d3fda2c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action" status: 202 len: 0 microversion: 2.1 time: 0.115616 Sep 07 10:03:44.471990 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1966/3936] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:03:44 2022] POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:03:44.474831 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd5ca6e7-820f-4589-a8dc-ec91dc5ef9d3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 1.309210 Sep 07 10:03:44.485102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:44.489253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:44.492644 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1971/3937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:43 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:44.498030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:44.498854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:44.499441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:44.500481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:44.500980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:44.501434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:44.501613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:44.506182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:44.518416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:44.519163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:44.520960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:44.523922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:44.524585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:44.525345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:45.155772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:45.170593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60404e03-3483-4630-aabd-b52090c48433 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.676041 Sep 07 10:03:45.172316 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1972/3938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:44 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:45.406991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:45.425116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cfaf850c-cf72-4a7f-af67-c5129213653d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1487 microversion: 2.1 time: 0.951262 Sep 07 10:03:45.425756 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1967/3939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:44 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1487 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:45.451457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c1fe650-dc62-4f99-8e36-79b4e2b919d6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:03:45.469506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0c1fe650-dc62-4f99-8e36-79b4e2b919d6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:45.470184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0c1fe650-dc62-4f99-8e36-79b4e2b919d6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:45.470735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0c1fe650-dc62-4f99-8e36-79b4e2b919d6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:45.519110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:45.520332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:45.530603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:45.537018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:45.539262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:45.544039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:45.545451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:45.546840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0c1fe650-dc62-4f99-8e36-79b4e2b919d6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Going to try to stop instance {{(pid=128832) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:03:45.547430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:45.659344 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0c1fe650-dc62-4f99-8e36-79b4e2b919d6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974/action" status: 202 len: 0 microversion: 2.1 time: 0.213367 Sep 07 10:03:45.676584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1973/3940] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:03:45 2022] POST /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:03:45.689940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:45.692038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:45.700970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:45.701878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:45.702530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:45.703619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:45.704353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:45.705242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:45.734886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:46.911240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:46.925910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9a894de7-e73f-44a8-a391-10bd54327872 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 1.410930 Sep 07 10:03:46.927990 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1968/3941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:45 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:46.963812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:46.966097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:46.979305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:46.986446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:46.993497 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9742177d-21f3-462c-93bc-07e3d964077a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 1.311228 Sep 07 10:03:46.994692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:46.995178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:46.995928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:46.996173 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1974/3942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:45 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:46.996401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:46.996828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:47.529731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:47.542313 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-560d4d01-301a-46e3-928f-6188416f0475 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.596614 Sep 07 10:03:47.544445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1969/3943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:46 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:47.955283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:47.955501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:47.965750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:47.966245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:47.967862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:47.968753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:47.974622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:47.975283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:48.021482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:48.022629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:48.032885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:48.034550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:48.036537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:48.038539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:48.039728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:48.042869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:49.440967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:49.481362 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67fa3ef7-c239-4bb7-a9a3-415635ba2695 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 1.456776 Sep 07 10:03:49.485849 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1970/3944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:48 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:49.497742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:49.503132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:49.533907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:49.534331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:49.534770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:49.547318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:49.547808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:49.548284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:50.131192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:50.154921 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b950424-c4cb-4f23-9c2e-f3df074fdeb8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.667784 Sep 07 10:03:50.162635 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1971/3945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:49 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:50.195312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:50.207518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-795bdf26-44a0-418a-94e4-2b81158c28aa tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 2.256532 Sep 07 10:03:50.217438 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1975/3946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:47 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:50.515261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:50.516647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:50.533474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:50.536872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:50.537651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:50.539131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:50.541922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:50.542980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:50.885675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:50.895561 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8f8130d-a8c9-47c1-8cdb-6ee1bd25c824 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.383985 Sep 07 10:03:50.898050 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1972/3947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:50 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:51.188990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:51.191268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:51.218651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:51.227454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:51.231721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:51.232978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:51.241114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:51.243847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:51.258020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:51.272073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:51.272287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:51.272562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:51.273170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:51.278088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:51.279077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:51.291073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:52.359001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:52.368971 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b3a75c0-2878-407a-b0dd-83e13e6e3294 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 1.186847 Sep 07 10:03:52.383608 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1976/3948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:51 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:52.401410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:52.407678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:52.430171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:52.430668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:52.434362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:52.436818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:52.438890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:52.441686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:52.496797 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] HTTP exception thrown: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Request method failure captured: Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 HTTP/1.1 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGqq3WGGJhJ_K5_WClEiTMM1QTXJZLThGMVBc32d_Ymdu1E027AGyV0yX794B84FtlkoOPACDHUyHm3h154y6xY9KH3kzlPDikt7Tcl5kbA5NzzrZf2nS1UwY0xnAFO15qrRVgkU9Y8wGPFmE8nVsLLWZBnToxqEzGSqy77ixJn5xjA Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.32 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e3c7a2ab850049869743783576449827 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e3c7a2ab850049869743783576449827"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e3c7a2ab850049869743783576449827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e3c7a2ab850049869743783576449827"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e3c7a2ab850049869743783576449827", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e3c7a2ab850049869743783576449827 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TaggedBootDevicesTest-1725183211-project Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a94d8ef11b6a438a8812e7c0e8c1adde Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TaggedBootDevicesTest-1725183211-project Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5a94a73e-9d50-41fc-ad3b-410b631a51b6'} Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:03:52.508310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:52.512932 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:03:52.516567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Returning 404 to user: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:52.519200 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03bc456d-fead-4b4f-82c7-1000e131c640 tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 404 len: 111 microversion: 2.32 time: 0.134405 Sep 07 10:03:52.522095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1977/3949] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:03:52 2022] DELETE /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:03:52.534007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:52.537143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:52.549694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:52.553645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:52.557386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:52.558567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:52.559364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:52.560889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:52.967040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:53.014903 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-72d77a68-fc2a-49be-9833-e2105425d84a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 1.775215 Sep 07 10:03:53.021927 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1973/3950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:51 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:53.058003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:53.069690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] [instance: 5a94a73e-9d50-41fc-ad3b-410b631a51b6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:53.103452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:53.107877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:53.116902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:53.120175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:53.124379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:53.127798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:53.183236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] HTTP exception thrown: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Request method failure captured: Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 HTTP/1.1 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGqq3WGGJhJ_K5_WClEiTMM1QTXJZLThGMVBc32d_Ymdu1E027AGyV0yX794B84FtlkoOPACDHUyHm3h154y6xY9KH3kzlPDikt7Tcl5kbA5NzzrZf2nS1UwY0xnAFO15qrRVgkU9Y8wGPFmE8nVsLLWZBnToxqEzGSqy77ixJn5xjA Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.32 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e3c7a2ab850049869743783576449827 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e3c7a2ab850049869743783576449827"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e3c7a2ab850049869743783576449827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e3c7a2ab850049869743783576449827"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e3c7a2ab850049869743783576449827", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e3c7a2ab850049869743783576449827 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1725183211 Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TaggedBootDevicesTest-1725183211-project Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a94d8ef11b6a438a8812e7c0e8c1adde Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TaggedBootDevicesTest-1725183211-project Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5a94a73e-9d50-41fc-ad3b-410b631a51b6'} Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:03:53.187476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. Sep 07 10:03:53.191393 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:03:53.200593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] Returning 404 to user: Instance 5a94a73e-9d50-41fc-ad3b-410b631a51b6 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:03:53.202009 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6362d6ed-9f07-4529-833e-3670df57f4bb tempest-TaggedBootDevicesTest-1725183211 tempest-TaggedBootDevicesTest-1725183211-project] 10.222.0.60 "GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6" status: 404 len: 111 microversion: 2.32 time: 0.177129 Sep 07 10:03:53.211962 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1974/3951] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:03:53 2022] GET /compute/v2.1/servers/5a94a73e-9d50-41fc-ad3b-410b631a51b6 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:03:53.405518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:53.407085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:53.443204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:53.444378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:53.450148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:53.452874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:53.457767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:53.458734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:53.709268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:53.725030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88f4f870-6fb5-46b8-8de6-9679e73fbf80 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 1.199556 Sep 07 10:03:53.745729 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1978/3952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:52 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:54.040854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:54.047387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:54.071966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:54.072470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:54.072915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:54.079112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:54.079611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:54.080065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:54.238078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:54.266476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-baaf1420-14da-4387-913a-a5f38f2e8ec8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.865852 Sep 07 10:03:54.267149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1975/3953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:53 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:54.762987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:54.763761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:54.818366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:54.818983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:54.819499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:54.820258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:54.820719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:54.821148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:55.088700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:55.102733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d32d6b7-bac4-4f9a-97a9-9d6830fd237c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 1.065955 Sep 07 10:03:55.104108 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1979/3954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:54 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:55.299247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:55.300188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:55.318905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:55.322509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:55.325442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:55.327289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:55.331636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:55.333041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:55.589566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:55.608368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:03:55.620085 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-329b7647-15fd-41ff-a5db-037f548f7f84 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.856821 Sep 07 10:03:55.621943 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1976/3955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:54 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:56.107193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:56.124979 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2edf34e9-4915-4dc7-b5ee-60971d911a2b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.828523 Sep 07 10:03:56.150371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:56.150371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:56.159052 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1980/3956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:55 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:56.184111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:56.185892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:56.187922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:56.195343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:56.198254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:56.199795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:56.654883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:56.656083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:56.678665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:56.682300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:56.684983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:56.689790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:56.690842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:56.694374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:56.790247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:56.807004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d46a516-fb5b-4b3d-96ce-05ee426ddce1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.679092 Sep 07 10:03:56.828207 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1977/3957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:56 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:57.162752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:57.163543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:57.170133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:57.189622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:57.193655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:57.194646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:57.199760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:57.200476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:57.278148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:57.330010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ef5dc66-b289-4585-9165-f6c1753ce974 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.679661 Sep 07 10:03:57.338711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1981/3958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:56 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:57.784007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:57.801249 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed3e8ad5-b1f0-48a9-8db2-a724d6c2ffa5 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.640931 Sep 07 10:03:57.821149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1978/3959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:57 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:03:57.844871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:57.845824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:57.861856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:57.863673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:57.865896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:57.866836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:57.867472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:57.868059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:58.273107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:58.287573 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8e5f017-23b0-4da6-8f26-459cac2ba5cc tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.445164 Sep 07 10:03:58.341588 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1982/3960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:57 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:58.373168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:58.375181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:58.399942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:58.400577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:58.401138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:58.402047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:58.407714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:58.408456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:58.840641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:58.844057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:58.853153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:58.861742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aad47747-516f-4b9b-9da4-3ad904dfeebe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.499153 Sep 07 10:03:58.866692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:58.867505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:58.868098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:58.868982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:58.869611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:58.870182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:58.874009 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1979/3961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:58 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:59.277378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:59.291470 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b53cd532-0610-4ccd-998a-a9df875339ce tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1724 microversion: 2.1 time: 0.457629 Sep 07 10:03:59.308485 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1983/3962] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:58 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1724 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:59.370239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:59.371136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:59.386569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:59.387612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:59.388226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:59.389100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:59.389785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:59.416081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:59.838928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:03:59.850882 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e6d6843-6ad1-46c0-a48d-3c90d4da9a38 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.484580 Sep 07 10:03:59.865872 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1980/3963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:59 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:03:59.908582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:03:59.909148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:03:59.957145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:59.965796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:59.968409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:03:59.972988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:03:59.974420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:03:59.975947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:00.322425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:00.323665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:00.338173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:00.342689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:00.344493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:00.347977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:00.350049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:00.351133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:00.365270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:00.383154 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-befd94fa-3cb3-4a95-8e58-eb25d2eb1590 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.494962 Sep 07 10:04:00.399714 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1984/3964] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:03:59 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:00.882745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:00.883170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:00.900543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:00.921819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:00.925269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:00.934281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:00.935167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:00.937098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:01.475520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:01.499714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11001277-9b28-404b-b9bd-946c737cc064 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1701 microversion: 2.1 time: 1.183557 Sep 07 10:04:01.505957 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1981/3965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:00 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1701 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:01.516157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:01.528864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:01.580505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:01.586356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:01.587019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:01.590287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:01.593006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:01.594649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:01.906851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:01.921086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9eaafb77-3ca4-4eba-92dc-e1031afae055 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 1.044882 Sep 07 10:04:01.933333 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1985/3966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:00 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:01.945857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4638ce36-67c1-4652-8303-8873127e7636 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:01.966014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4638ce36-67c1-4652-8303-8873127e7636 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:01.967071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4638ce36-67c1-4652-8303-8873127e7636 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:01.967721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4638ce36-67c1-4652-8303-8873127e7636 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:02.020201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4638ce36-67c1-4652-8303-8873127e7636 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Going to try to start instance {{(pid=128832) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 10:04:02.128218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:02.146476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b519a477-3319-4dc8-8515-310374df41bb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.634664 Sep 07 10:04:02.151720 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1982/3967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:01 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:02.154957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4638ce36-67c1-4652-8303-8873127e7636 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action" status: 202 len: 0 microversion: 2.1 time: 0.220049 Sep 07 10:04:02.181558 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1986/3968] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:01 2022] POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:04:02.193121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:02.197044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:02.223035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:02.223554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:02.224019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:02.224747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:02.229121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:02.229979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:02.958358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:02.959181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:02.981365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:02.982132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:02.989748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:02.990661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:02.991676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:02.992206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:04.003201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:04.023831 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ccb1871-b86d-45a2-a7a6-ad6273b7814b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1710 microversion: 2.1 time: 1.838922 Sep 07 10:04:04.024441 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1983/3969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:02 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1710 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:04.068089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:04.069290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:04.088914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:04.090931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:04.095718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:04.097023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:04.100953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:04.107617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:04.713101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:04.727293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9107a986-9ea1-46fa-814d-095a8842069a tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 1.775193 Sep 07 10:04:04.732045 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1987/3970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:02 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:05.091201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:05.091914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:05.095213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:05.204640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:05.213754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:05.214797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:05.216539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:05.217041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:05.239419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:05.874469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:05.891891 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-894bd754-6e45-4527-bb00-7cc9a87ccad3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 1.841146 Sep 07 10:04:05.899610 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1984/3971] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:04 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:05.929318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:05.932475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:05.951562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:05.955353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:05.956079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:05.959059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:05.961659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:05.963956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:06.044807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:06.064416 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a94f6681-2b2b-4f05-8948-fa648b293d79 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1710 microversion: 2.1 time: 1.006022 Sep 07 10:04:06.079545 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1988/3972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:05 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1710 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:06.731084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:06.743114 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8606c77-cfc0-4ca8-ab7b-d252775d3f91 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.839575 Sep 07 10:04:06.744725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1985/3973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:05 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:06.930409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:06.932426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:06.944006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:06.945252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:06.946210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:06.947531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:06.948105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:06.949706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:07.105075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:07.107328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:07.122188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:07.125668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:07.128833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:07.130118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:07.132078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:07.134081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:07.640294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:07.688627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-164d5312-e815-4288-b3e6-1383c567f54e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1710 microversion: 2.1 time: 0.560680 Sep 07 10:04:07.691926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1986/3974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:07 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1710 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:07.755068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:07.767908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:07.770054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:07.782398 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-413c414d-8abc-4e35-906a-e97d08dc733c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.863379 Sep 07 10:04:07.786829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:07.789887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:07.792874 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1989/3975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:06 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:07.807540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:07.810661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:07.817497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:07.818097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:08.320842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:08.343272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-904e3183-3397-4708-b6df-aa7ec7226b42 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.579664 Sep 07 10:04:08.344730 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1987/3976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:07 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:08.719065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:08.720687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:08.737238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:08.738603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:08.741811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:08.747223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:08.747807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:08.748401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:08.818529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:08.819714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:08.829682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:08.830174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:08.830612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:08.844450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:08.845133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:08.845624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:09.421829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:09.432231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-055e480b-87a6-4399-bc6c-2b5f396b8bf6 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.620049 Sep 07 10:04:09.432867 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1988/3977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:08 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:09.443286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-24f8c566-8734-4eec-9fa3-d655342f565e req-8e7600e2-6d0b-424f-9a3d-f59afe2f67fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0", "name": "network-vif-plugged", "status": "completed", "tag": "73e192fa-c88f-4e9d-ad1e-d46bc07c2623"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:09.467578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-24f8c566-8734-4eec-9fa3-d655342f565e req-8e7600e2-6d0b-424f-9a3d-f59afe2f67fe service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:09.468146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-24f8c566-8734-4eec-9fa3-d655342f565e req-8e7600e2-6d0b-424f-9a3d-f59afe2f67fe service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:09.473838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-24f8c566-8734-4eec-9fa3-d655342f565e req-8e7600e2-6d0b-424f-9a3d-f59afe2f67fe service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:09.500358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-24f8c566-8734-4eec-9fa3-d655342f565e req-8e7600e2-6d0b-424f-9a3d-f59afe2f67fe service nova] Creating event network-vif-plugged:73e192fa-c88f-4e9d-ad1e-d46bc07c2623 for instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 on n-h2-836830-16 Sep 07 10:04:09.510770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-24f8c566-8734-4eec-9fa3-d655342f565e req-8e7600e2-6d0b-424f-9a3d-f59afe2f67fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071759 Sep 07 10:04:09.519727 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1989/3978] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:04:09.528891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:09.533995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:09.546934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:09.547616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:09.548211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:09.549318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:09.555750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:09.556421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:09.603251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:09.611035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:09.616898 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57f9c887-6de4-45e5-9b41-fbeb959f7d60 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1714 microversion: 2.1 time: 0.902440 Sep 07 10:04:09.631779 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1990/3979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:08 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1714 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:10.042288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:10.058983 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5d219de4-11b9-44c9-9887-06d38e599155 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.537583 Sep 07 10:04:10.059968 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1990/3980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:09 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:10.461764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:10.465368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:10.478659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:10.479773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:10.480405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:10.481388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:10.482236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:10.482846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:10.760511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:10.770899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cbe83e36-74d8-4d12-aef5-9df6d6ba85a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.317588 Sep 07 10:04:10.789485 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1991/3981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:10 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:11.088894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:11.090160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:11.110128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:11.110855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:11.111595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:11.120191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:11.121021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:11.123575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:11.735215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:11.752086 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20ddd79d-bd4c-42a2-8b03-19b50dcdaba9 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.666418 Sep 07 10:04:11.767068 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1991/3982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:11 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:11.794711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:11.796253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:11.828365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:11.828972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:11.829478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:11.830245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:11.830715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:11.832879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:12.590082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:12.604256 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f51363a6-3ec4-4dc5-936e-f9e6dd2417a0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.813358 Sep 07 10:04:12.605878 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1992/3983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:11 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:12.785087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:12.789932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:12.818883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=56 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:12.822145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:12.825235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:12.825235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:12.826944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:12.828701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:12.828969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:13.227307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:13.243260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4ff7b5ed-5388-4e48-af3b-eecff49f2135 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1517 microversion: 2.1 time: 0.465733 Sep 07 10:04:13.257789 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1992/3984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:12 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1517 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:13.632647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:13.634085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:13.652987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:13.654292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:13.659167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:13.660289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:13.664006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:13.664874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:14.277035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:14.277691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:14.289403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:14.290062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:14.299004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:14.301801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:14.307468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:14.308512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:14.382618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:14.395918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3b782fe-3dcd-4334-97b5-8466f82be814 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.768616 Sep 07 10:04:14.399824 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1993/3985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:13 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:15.427931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:15.428585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:15.445125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:15.445650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:15.446089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:15.446800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:15.447501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:15.448134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:15.602125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:15.615472 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f5e6aa2-8af6-4f08-90cc-72824b3f1b73 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.343473 Sep 07 10:04:15.630924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1993/3986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:14 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:15.654014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:15.661041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:15.682459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:15.684917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:15.685609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:15.686998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:15.687623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:15.688208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:15.727645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:15.975358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:15.985605 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-758a8620-6a55-43d9-97da-037d93d25d2f tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1497 microversion: 2.1 time: 0.561510 Sep 07 10:04:15.987195 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1994/3987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:15 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1497 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:16.107175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:16.121438 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37dd8918-eaec-427e-9b8a-8dc9cfcdb099 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.477422 Sep 07 10:04:16.134656 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1994/3988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:15 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:16.156756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:16.161591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:16.181159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:16.183594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:16.184474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:16.185984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:16.192560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:16.196217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:16.640334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:16.656860 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5934dea-3445-4e28-aa28-fd3884175e21 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.497469 Sep 07 10:04:16.667798 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1995/3989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:16 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:16.686923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d6d6ac9-3d8e-4e3b-bf2b-fc95f967a588 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:16.700162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4d6d6ac9-3d8e-4e3b-bf2b-fc95f967a588 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance ebd7524b-5666-4cb4-8722-2939f05d3d93 has no mapping to a cell. Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d6d6ac9-3d8e-4e3b-bf2b-fc95f967a588 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/ebd7524b-5666-4cb4-8722-2939f05d3d93/action HTTP/1.1 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 15 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: {"os-stop": {}} Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ebd7524b-5666-4cb4-8722-2939f05d3d93 has no mapping to a cell. Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ebd7524b-5666-4cb4-8722-2939f05d3d93', 'body': {'os-stop': {}}} Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance ebd7524b-5666-4cb4-8722-2939f05d3d93 has no mapping to a cell. Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:16.717197 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd7524b-5666-4cb4-8722-2939f05d3d93 has no mapping to a cell. Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd7524b-5666-4cb4-8722-2939f05d3d93 has no mapping to a cell. Sep 07 10:04:16.720873 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:16.723252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d6d6ac9-3d8e-4e3b-bf2b-fc95f967a588 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance ebd7524b-5666-4cb4-8722-2939f05d3d93 has no mapping to a cell. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:16.724332 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d6d6ac9-3d8e-4e3b-bf2b-fc95f967a588 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/ebd7524b-5666-4cb4-8722-2939f05d3d93/action" status: 404 len: 117 microversion: 2.1 time: 0.041447 Sep 07 10:04:16.725140 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1995/3990] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:16 2022] POST /compute/v2.1/servers/ebd7524b-5666-4cb4-8722-2939f05d3d93/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:04:16.734928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:16.735814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:16.748664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:16.749495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:16.750143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:16.751734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:16.755525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:16.756324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.018303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:17.019811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:17.035748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.036490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.042030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.043109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.043821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.044475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.182936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:17.203985 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60d69960-c370-4788-a470-f537d9b71c44 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.467765 Sep 07 10:04:17.204665 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1996/3991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:16 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:17.232665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:17.233733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:17.247334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.248188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.249719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.250682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.251733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.252442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.564519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:17.575949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ec04d95-b180-4fce-914b-8f3d4626c981 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.348816 Sep 07 10:04:17.576555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1997/3992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:17 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:17.603199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-547324f9-c136-492c-a466-42c201842f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:17.603759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-547324f9-c136-492c-a466-42c201842f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 872f94d5-472e-41df-afc6-dd49567a7f9d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:17.615585 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-547324f9-c136-492c-a466-42c201842f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 872f94d5-472e-41df-afc6-dd49567a7f9d could not be found. Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-547324f9-c136-492c-a466-42c201842f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/872f94d5-472e-41df-afc6-dd49567a7f9d/action HTTP/1.1 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 15 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: {"suspend": {}} Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 872f94d5-472e-41df-afc6-dd49567a7f9d could not be found. Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '872f94d5-472e-41df-afc6-dd49567a7f9d', 'body': {'suspend': {}}} Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872f94d5-472e-41df-afc6-dd49567a7f9d could not be found. Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872f94d5-472e-41df-afc6-dd49567a7f9d could not be found. Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:17.617419 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:17.622313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:17.622313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:17.622313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872f94d5-472e-41df-afc6-dd49567a7f9d could not be found. Sep 07 10:04:17.622313 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:17.622313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-547324f9-c136-492c-a466-42c201842f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 872f94d5-472e-41df-afc6-dd49567a7f9d could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:17.623329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-547324f9-c136-492c-a466-42c201842f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/872f94d5-472e-41df-afc6-dd49567a7f9d/action" status: 404 len: 111 microversion: 2.1 time: 0.027912 Sep 07 10:04:17.623329 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1998/3993] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:17 2022] POST /compute/v2.1/servers/872f94d5-472e-41df-afc6-dd49567a7f9d/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:04:17.632597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:17.633223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:17.650179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.650795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.651021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.657054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.657869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.658475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.703298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:17.720644 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05fc57b2-ebc5-4cce-ab61-a08b44efae72 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 200 len: 1474 microversion: 2.1 time: 0.700093 Sep 07 10:04:17.721851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1996/3994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:17 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 1474 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:17.746696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1609893746"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:17.749655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:17.761048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.762819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.763427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:17.764520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:17.768586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:17.769465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:18.355218 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62c76e1b-dc17-4fe1-b033-8dcca7df4d73 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974/action" status: 202 len: 0 microversion: 2.1 time: 0.611498 Sep 07 10:04:18.370968 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1997/3995] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:17 2022] POST /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 07 10:04:18.390775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8710ca4-cab3-44ae-98fc-88fc66d80412 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a38c10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:18.499024 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8710ca4-cab3-44ae-98fc-88fc66d80412 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.119359 Sep 07 10:04:18.500238 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1998/3996] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:18 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:18.528173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:18.542079 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc4cba61-4804-4492-b47b-4a9bbfde8a89 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.914207 Sep 07 10:04:18.560132 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 1999/3997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:17 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:18.570207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:18.571033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:18.580933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:18.582018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:18.582580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:18.583356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:18.583938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:18.584429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:19.516260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ce09ab4d-188f-43c4-800f-5696a90f7c0e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1c2da60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:19.654304 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ce09ab4d-188f-43c4-800f-5696a90f7c0e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.141956 Sep 07 10:04:19.667067 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2000/3998] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:19 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:19.793915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:19.802835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9195d6b-34a3-49e3-8c3e-0a4afdd8f177 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.239354 Sep 07 10:04:19.817518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 1999/3999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:18 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:19.836363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:19.837211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:19.845117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:19.845835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:19.846477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:19.847774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:19.848487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:19.849141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:19.890206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lazy-loading 'flavor' on Instance uuid a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:04:20.069030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81f751aa-432b-4c68-b6f1-6f79a1b1baec tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.239234 Sep 07 10:04:20.080211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:20.083111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:20.088997 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2001/4000] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:19 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:04:20.099844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:20.101485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:20.103362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:20.104180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:20.109456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:20.110086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:20.672512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d196c3f2-e68e-476a-adf7-ce6216c20ef1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1932b80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:20.797566 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d196c3f2-e68e-476a-adf7-ce6216c20ef1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.128925 Sep 07 10:04:20.799041 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2002/4001] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:20 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:21.316323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:21.331735 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ed6a381-aae0-4d1f-89b5-eba45fb65879 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1512 microversion: 2.1 time: 1.253871 Sep 07 10:04:21.335396 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2000/4002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:20 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1512 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:21.815068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-33ec5717-af1f-4fbb-83d7-cb74264cac6d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1171310>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:22.373970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:22.377480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:22.389285 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:04:22.390436 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:04:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 (ip 10.222.0.60) !!! Sep 07 10:04:22.435612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:22.442100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:22.443486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:22.446039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:22.452784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:22.454965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:22.736890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-33ec5717-af1f-4fbb-83d7-cb74264cac6d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.926561 Sep 07 10:04:22.741516 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2003/4003] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:21 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:23.350163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:23.360081 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a311b724-19d8-496f-b3cb-462e89378250 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1495 microversion: 2.1 time: 1.001712 Sep 07 10:04:23.360685 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2001/4004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:22 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1495 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:23.393288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:23.395744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:23.460612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:23.460918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:23.462780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:23.464249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:23.466130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:23.466736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:23.560029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lazy-loading 'flavor' on Instance uuid a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:04:23.598855 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'suspend' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state suspended Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 15 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: {"suspend": {}} Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: exception: Cannot 'suspend' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state suspended Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'suspend': {}}} Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 07 10:04:23.604257 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state suspended Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state suspended Sep 07 10:04:23.608437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:23.611447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'suspend' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state suspended {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:23.614192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d8f13c46-9df3-4c7a-96e4-be109302f68f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 148 microversion: 2.1 time: 0.229480 Sep 07 10:04:23.615294 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2004/4005] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:23 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 148 bytes in 233 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:04:23.623392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:23.623939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:23.641865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:23.644945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:23.645808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:23.647703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:23.649131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:23.649820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:23.761480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b11a1e4-545d-49f2-9875-d27ff130b82d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b12a61f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:23.770567 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8860aa05-2b60-4a80-8b76-c43006902a9b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.150799 Sep 07 10:04:23.774107 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2002/4006] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:23 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:04:23.797586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:23.798462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:23.831162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:23.836450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:23.838480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:23.841843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:23.842427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:23.849736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:23.964401 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b11a1e4-545d-49f2-9875-d27ff130b82d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.208751 Sep 07 10:04:23.969796 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2005/4007] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:23 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:24.815207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f359de21-afd4-4390-a180-91c9c54ae4ee req-5511bb41-4033-4d11-98e7-8f1cd640547e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2729d92-a21b-4bbb-88f8-7737455f6974", "name": "network-vif-plugged", "status": "completed", "tag": "e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:24.863847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f359de21-afd4-4390-a180-91c9c54ae4ee req-5511bb41-4033-4d11-98e7-8f1cd640547e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:24.874380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f359de21-afd4-4390-a180-91c9c54ae4ee req-5511bb41-4033-4d11-98e7-8f1cd640547e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:24.875074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f359de21-afd4-4390-a180-91c9c54ae4ee req-5511bb41-4033-4d11-98e7-8f1cd640547e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:24.923078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f359de21-afd4-4390-a180-91c9c54ae4ee req-5511bb41-4033-4d11-98e7-8f1cd640547e service nova] Creating event network-vif-plugged:e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10 for instance e2729d92-a21b-4bbb-88f8-7737455f6974 on n-h1-836830-16 Sep 07 10:04:24.983921 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f359de21-afd4-4390-a180-91c9c54ae4ee req-5511bb41-4033-4d11-98e7-8f1cd640547e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172784 Sep 07 10:04:24.986205 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2006/4008] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:04:24.994762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:25.007228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b458b8ff-ff23-4c1b-96b1-2452e9c395dd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1501 microversion: 2.1 time: 1.224682 Sep 07 10:04:25.008167 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2003/4009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:23 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1501 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:25.024205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1cc7fff-8818-421d-9264-a5afa2e74afa tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1c3ca60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:25.120360 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1cc7fff-8818-421d-9264-a5afa2e74afa tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.127894 Sep 07 10:04:25.129083 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2007/4010] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:24 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:26.033425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:26.035418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:26.050514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:26.051700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:26.055088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:26.056038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:26.056678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:26.058340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:26.137314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-026dbc81-9836-4af0-a64f-5d6631134f48 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1d34430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:26.215440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-026dbc81-9836-4af0-a64f-5d6631134f48 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.083361 Sep 07 10:04:26.216265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2008/4011] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:26 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:26.789111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:26.809912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52d8c69a-5c36-404c-a4cb-351be7bf10d1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1501 microversion: 2.1 time: 0.768219 Sep 07 10:04:26.811251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2004/4012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:26 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1501 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:27.246527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28ecbd38-de35-41e0-88cf-0b5ba97b1d9c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1c3c9d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:27.349448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28ecbd38-de35-41e0-88cf-0b5ba97b1d9c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.120375 Sep 07 10:04:27.353625 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2009/4013] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:27 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:27.839054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:27.840828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:27.857209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:27.857725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:27.858176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:27.859061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:27.859535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:27.860541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:28.368276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eabd7818-1532-4a2a-9423-6ba86ac47716 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1a15700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:28.483431 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eabd7818-1532-4a2a-9423-6ba86ac47716 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.119445 Sep 07 10:04:28.485426 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2010/4014] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:28 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:28.689461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:28.730842 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac90f7e7-6d2e-476f-a64a-c4408b7383f1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1501 microversion: 2.1 time: 0.896191 Sep 07 10:04:28.748979 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2005/4015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:27 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1501 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:29.502463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a45edfae-91c5-4274-92b8-37b3163dcb6c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1932f70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:29.597623 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a45edfae-91c5-4274-92b8-37b3163dcb6c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.100456 Sep 07 10:04:29.613123 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2011/4016] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:29 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:29.759467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:29.760815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:29.782908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:29.785846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:29.786599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:29.788952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:29.791292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:29.791986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:30.588628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:30.596528 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb3da218-7fe7-47bb-9ae6-d3ebd2130273 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.842011 Sep 07 10:04:30.597856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2006/4017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:29 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:30.614880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5de8355-4068-4bfd-a96b-de72e1b13fe1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b2678700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:30.630945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:30.651100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:30.680305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:30.681016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:30.681883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:30.683201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:30.684061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:30.684877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:30.718710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5de8355-4068-4bfd-a96b-de72e1b13fe1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.109397 Sep 07 10:04:30.719303 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2012/4018] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:30 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:31.735189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c0a55ad-0094-45df-a9d6-69639e956afe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1923790>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:31.837085 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c0a55ad-0094-45df-a9d6-69639e956afe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.097328 Sep 07 10:04:31.839779 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2013/4019] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:31 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:32.339089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:32.363639 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e331e4d-319f-4e09-82a5-1357990ac256 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.737156 Sep 07 10:04:32.364359 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2007/4020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:30 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:32.392592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c20cec78-f4e3-44dd-824b-5f6ce1f780ae tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:32.393363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c20cec78-f4e3-44dd-824b-5f6ce1f780ae tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: f5cd7943-0eb9-455b-91f1-de10815de489] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:32.412286 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-c20cec78-f4e3-44dd-824b-5f6ce1f780ae tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance f5cd7943-0eb9-455b-91f1-de10815de489 could not be found. Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c20cec78-f4e3-44dd-824b-5f6ce1f780ae tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/f5cd7943-0eb9-455b-91f1-de10815de489/action HTTP/1.1 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 15 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: {"unpause": {}} Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f5cd7943-0eb9-455b-91f1-de10815de489 could not be found. Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f5cd7943-0eb9-455b-91f1-de10815de489', 'body': {'unpause': {}}} Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cd7943-0eb9-455b-91f1-de10815de489 could not be found. Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cd7943-0eb9-455b-91f1-de10815de489 could not be found. Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:32.420224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:32.427114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:32.427114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:32.427114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cd7943-0eb9-455b-91f1-de10815de489 could not be found. Sep 07 10:04:32.427114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:32.427114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c20cec78-f4e3-44dd-824b-5f6ce1f780ae tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance f5cd7943-0eb9-455b-91f1-de10815de489 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:32.434548 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c20cec78-f4e3-44dd-824b-5f6ce1f780ae tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/f5cd7943-0eb9-455b-91f1-de10815de489/action" status: 404 len: 111 microversion: 2.1 time: 0.034244 Sep 07 10:04:32.437396 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2014/4021] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:32 2022] POST /compute/v2.1/servers/f5cd7943-0eb9-455b-91f1-de10815de489/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:04:32.446908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:32.447542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:32.469220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:32.469749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:32.470197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:32.470922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:32.471392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:32.471944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:32.855080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-20448628-efac-4878-93b3-9baa01d73a7e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1bd6790>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:32.948146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-20448628-efac-4878-93b3-9baa01d73a7e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.098088 Sep 07 10:04:32.950390 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2015/4022] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:32 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:33.019381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:33.039304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c03f1bc-7c8a-4178-82d4-8a8264886a3c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.596409 Sep 07 10:04:33.040359 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2008/4023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:32 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:33.066597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:33.067589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:33.081742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:33.085582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:33.086475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:33.088523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:33.091238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:33.091858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:33.433028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:33.445226 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5ce2404f-560e-4732-af1d-4f3f1bee3f97 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.382990 Sep 07 10:04:33.448337 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2016/4024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:33 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:33.496543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:33.498752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:33.514540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:33.517684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:33.518441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:33.519782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:33.520448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:33.525735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:33.565018 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'unpause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 15 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: {"unpause": {}} Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot 'unpause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'unpause': {}}} Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state active. Cannot unpause while the instance is in this state. Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:33.567760 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:33.572417 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:33.572417 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:33.572417 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:33.572417 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:33.572417 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:33.573860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'unpause' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:33.574899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd33e150-0580-4035-917d-b300929754c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 145 microversion: 2.1 time: 0.101141 Sep 07 10:04:33.579435 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2009/4025] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:33 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:04:33.588036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:33.588909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:33.651739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:33.657550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:33.661662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:33.672979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:33.674339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:33.675052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:33.969434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f256ed34-1c76-48b0-88db-474d2debc6ff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a38ca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:34.108550 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f256ed34-1c76-48b0-88db-474d2debc6ff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.144265 Sep 07 10:04:34.126310 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2010/4026] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:33 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:34.417962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:34.431233 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-293607da-888d-4bf2-ae54-e400ac0ae46f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.850730 Sep 07 10:04:34.432122 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2017/4027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:33 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:34.458075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:34.459214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:34.465799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:34.466541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:34.467137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:34.468018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:34.468702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:34.469785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:34.843612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:34.849738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:34.868002 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1913306a-ac90-49ba-9201-12b3cd302d1f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.409882 Sep 07 10:04:34.869082 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2011/4028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:34 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:34.897912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d867f409-c136-4296-8357-1ae328702a0d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:34.898844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d867f409-c136-4296-8357-1ae328702a0d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: f0ea73c6-569c-4b8b-8dee-7ffad06b2675] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:34.914107 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d867f409-c136-4296-8357-1ae328702a0d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance f0ea73c6-569c-4b8b-8dee-7ffad06b2675 could not be found. Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d867f409-c136-4296-8357-1ae328702a0d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/f0ea73c6-569c-4b8b-8dee-7ffad06b2675/action HTTP/1.1 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 18 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: {"unshelve": null} Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f0ea73c6-569c-4b8b-8dee-7ffad06b2675 could not be found. Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f0ea73c6-569c-4b8b-8dee-7ffad06b2675', 'body': {'unshelve': None}} Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ea73c6-569c-4b8b-8dee-7ffad06b2675 could not be found. Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ea73c6-569c-4b8b-8dee-7ffad06b2675 could not be found. Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:34.917537 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ea73c6-569c-4b8b-8dee-7ffad06b2675 could not be found. Sep 07 10:04:34.921591 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:34.925642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d867f409-c136-4296-8357-1ae328702a0d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance f0ea73c6-569c-4b8b-8dee-7ffad06b2675 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:34.929959 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d867f409-c136-4296-8357-1ae328702a0d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/f0ea73c6-569c-4b8b-8dee-7ffad06b2675/action" status: 404 len: 111 microversion: 2.1 time: 0.037777 Sep 07 10:04:34.940314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:34.941801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:34.947096 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2018/4029] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:34 2022] POST /compute/v2.1/servers/f0ea73c6-569c-4b8b-8dee-7ffad06b2675/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:04:34.952926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:34.954162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:34.954764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:34.956031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:34.956868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:34.957560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:35.125078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6bdc3f46-4de5-4f35-9a03-a0a1cbfcdb68 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b104b3a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:35.213990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6bdc3f46-4de5-4f35-9a03-a0a1cbfcdb68 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.092751 Sep 07 10:04:35.225344 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2019/4030] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:35 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:35.705633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:35.723621 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2fbb07a4-fec8-4445-b5fd-0dd258539f5b tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.785194 Sep 07 10:04:35.754794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:35.755421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:35.760337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=38 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:35.761042 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2012/4031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:34 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:35.786951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:35.790211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:35.790919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:35.795257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:35.795813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:35.797021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:36.232069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74f425d8-01d6-4ecf-a813-bbac6c8675ca tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a383a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:36.355474 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74f425d8-01d6-4ecf-a813-bbac6c8675ca tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.127498 Sep 07 10:04:36.357325 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2013/4032] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:36 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:37.058113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:37.088044 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8dd40a76-39eb-46c4-83fe-ebd207552a50 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.337750 Sep 07 10:04:37.102006 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2020/4033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:35 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:37.128399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:37.129253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:37.148437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:37.148953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:37.149437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:37.158839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:37.159386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:37.159832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:37.223623 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Cannot 'unshelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action HTTP/1.1 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 18 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: {"unshelve": null} Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: exception: Cannot 'unshelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'unshelve': None}} Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 in vm_state active. Cannot unshelve while the instance is in this state. Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 10:04:37.225563 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active Sep 07 10:04:37.230414 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:37.232903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 409 to user: Cannot 'unshelve' instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 while it is in vm_state active {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:37.234762 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d1357290-f533-49ed-8e09-8443336e0968 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action" status: 409 len: 146 microversion: 2.1 time: 0.111571 Sep 07 10:04:37.235926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2014/4034] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:37 2022] POST /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0/action => generated 146 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:04:37.246162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:37.247204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:37.257056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:37.257835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:37.258568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:37.259446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:37.260144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:37.260772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:37.373700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-24a949d2-7d0a-438d-84e3-0e0ecff3f58c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a03ca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:37.517251 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-24a949d2-7d0a-438d-84e3-0e0ecff3f58c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.149382 Sep 07 10:04:37.522782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2015/4035] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:37 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:38.075344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:38.098096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-29ecd044-54cd-4120-a560-25025ac7f949 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.856768 Sep 07 10:04:38.098742 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2021/4036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:37 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:38.129587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:38.130228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:38.145804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:38.146273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:38.146728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:38.147460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:38.147931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:38.148367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:38.542303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f57ee12b-b6fb-4232-ac1b-c2cfd079591c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b13673a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:38.617504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f57ee12b-b6fb-4232-ac1b-c2cfd079591c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.088481 Sep 07 10:04:38.619328 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2022/4037] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:38 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:39.213362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:39.221269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e46c6afc-1189-4c27-83f8-c5ea0bd06794 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.095948 Sep 07 10:04:39.227130 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2016/4038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:38 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:39.252313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c1fb015-0435-4708-9856-003f4457f7cd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1763270977_updated"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:39.256403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6c1fb015-0435-4708-9856-003f4457f7cd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: f7c47e02-1627-4609-819d-fdd93eb0547c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:39.282427 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6c1fb015-0435-4708-9856-003f4457f7cd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance f7c47e02-1627-4609-819d-fdd93eb0547c could not be found. Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c1fb015-0435-4708-9856-003f4457f7cd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/servers/f7c47e02-1627-4609-819d-fdd93eb0547c HTTP/1.1 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 81 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1763270977_updated"}} Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f7c47e02-1627-4609-819d-fdd93eb0547c could not be found. Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f7c47e02-1627-4609-819d-fdd93eb0547c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1763270977_updated'}}} Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c47e02-1627-4609-819d-fdd93eb0547c could not be found. Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 07 10:04:39.289752 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c47e02-1627-4609-819d-fdd93eb0547c could not be found. Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c47e02-1627-4609-819d-fdd93eb0547c could not be found. Sep 07 10:04:39.294522 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:39.306572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c1fb015-0435-4708-9856-003f4457f7cd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance f7c47e02-1627-4609-819d-fdd93eb0547c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:39.309764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c1fb015-0435-4708-9856-003f4457f7cd tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "PUT /compute/v2.1/servers/f7c47e02-1627-4609-819d-fdd93eb0547c" status: 404 len: 111 microversion: 2.1 time: 0.063389 Sep 07 10:04:39.317447 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2023/4039] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:04:39 2022] PUT /compute/v2.1/servers/f7c47e02-1627-4609-819d-fdd93eb0547c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:04:39.325553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:39.328706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:39.345738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:39.346034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:39.352577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:39.353539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:39.354038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:39.354485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:39.635289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-546a5c3f-7db0-4d3c-9333-a08fe250c31c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0f42280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:39.863978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:39.878611 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62fe2f2d-8478-454e-a74f-447764416850 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.556180 Sep 07 10:04:39.889649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2017/4040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:39 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:39.911082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:39.911837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:39.927295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:39.927712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:39.928156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:39.928871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:39.933485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:39.933993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:40.669830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:40.700991 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f89f79d4-d014-4121-b0cc-324fc6fb903f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.793964 Sep 07 10:04:40.702060 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2018/4041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:39 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:40.727654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5963dd1-9937-4548-912c-1ba08cacfea1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5963dd1-9937-4548-912c-1ba08cacfea1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: request: PUT /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 HTTP/1.1 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 280 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.737720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 10:04:40.740898 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:04:40.746286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5963dd1-9937-4548-912c-1ba08cacfea1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:40.747562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5963dd1-9937-4548-912c-1ba08cacfea1 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "PUT /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 400 len: 619 microversion: 2.1 time: 0.023973 Sep 07 10:04:40.748761 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2019/4042] 10.222.0.60 () {60 vars in 1257 bytes} [Wed Sep 7 10:04:40 2022] PUT /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:04:40.811742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:40.820152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:40.855066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:40.858674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:40.867250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:40.868807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:40.872370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:40.874832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:40.902371 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-546a5c3f-7db0-4d3c-9333-a08fe250c31c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 1.271307 Sep 07 10:04:40.906470 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2024/4043] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:39 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:41.919682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:41.921269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0dc80d6f-9820-4871-bb77-104575bdda60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b104b160>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:41.928276 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e2368cd-7265-4afb-b937-f5d2bed31f11 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 1.171019 Sep 07 10:04:41.957657 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2020/4044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:40 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:41.971142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:41.972232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:41.992237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:41.993473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:41.994085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:41.995449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:41.996079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:41.996677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:42.021884 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0dc80d6f-9820-4871-bb77-104575bdda60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.105431 Sep 07 10:04:42.023975 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2025/4045] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:41 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:42.492266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:42.529893 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9bfb4f6d-c376-4079-9a77-638115ab195c tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.554810 Sep 07 10:04:42.531247 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2021/4046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:41 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:42.563047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e75fbc2a-b0dd-4322-a930-7f8b909a50ab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e75fbc2a-b0dd-4322-a930-7f8b909a50ab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: request: PUT /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 HTTP/1.1 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 24 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": ""}} Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0', 'body': {'server': {'name': ''}}} Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi '' Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:04:42.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:04:42.575499 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:42.578586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e75fbc2a-b0dd-4322-a930-7f8b909a50ab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:42.579759 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e75fbc2a-b0dd-4322-a930-7f8b909a50ab tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "PUT /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 400 len: 108 microversion: 2.1 time: 0.030939 Sep 07 10:04:42.580589 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2026/4047] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:04:42 2022] PUT /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:04:42.589858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:42.590732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:42.602461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:42.604653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:42.607008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:42.607912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:42.609745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:42.613885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:43.008493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:43.009061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:43.029959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:43.030741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:43.033218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:43.035570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:43.036723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:43.040702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:43.051984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:43.091389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:43.101654 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-109fe0c0-8d7d-4939-b8c5-895e6479a51d tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1504 microversion: 2.1 time: 0.515904 Sep 07 10:04:43.106387 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2022/4048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:42 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:43.118109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ee778c0-238c-4edd-b688-7ce58488abb8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a2d040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:43.226325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ee778c0-238c-4edd-b688-7ce58488abb8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.117825 Sep 07 10:04:43.227049 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2023/4049] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:43 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:43.314026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lazy-loading 'services' on Instance uuid 74168d1b-4b40-480d-add9-d409e18a5490 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:04:43.569134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e7ac1973-4583-43ed-b822-c5645fea7918 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-volume_attachments/7dc46171-9964-45f3-80d2-b5d3d5c04751" status: 202 len: 0 microversion: 2.1 time: 0.557726 Sep 07 10:04:43.570735 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2027/4050] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:04:43 2022] DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-volume_attachments/7dc46171-9964-45f3-80d2-b5d3d5c04751 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:04:44.242464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1685bc70-3ca1-4308-9de5-f003ae1379ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a2b940>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:44.348870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1685bc70-3ca1-4308-9de5-f003ae1379ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.110271 Sep 07 10:04:44.353595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2024/4051] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:44 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:45.367771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7733cae8-7994-49b6-8f25-48285c11073d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b261b940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:45.476025 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7733cae8-7994-49b6-8f25-48285c11073d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.114041 Sep 07 10:04:45.476944 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2028/4052] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:45 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:46.493500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6e8af0d0-2fca-47d9-bbed-5f5eda386728 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1842430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:46.632131 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6e8af0d0-2fca-47d9-bbed-5f5eda386728 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.143499 Sep 07 10:04:46.632727 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2025/4053] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:46 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:47.649114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3cd9d779-29fa-4bf5-aab7-4257b93b9f44 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b12a6310>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:47.788046 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3cd9d779-29fa-4bf5-aab7-4257b93b9f44 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.143209 Sep 07 10:04:47.791249 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2029/4054] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:47 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:48.806523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de0551cb-5fa2-4ff3-bac6-59716795376e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a03b80>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:48.970318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de0551cb-5fa2-4ff3-bac6-59716795376e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.164618 Sep 07 10:04:48.980047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2026/4055] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:48 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:49.993416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-064b37ff-e589-4f55-ae28-46181bf80c5b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0f42670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:50.108903 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-064b37ff-e589-4f55-ae28-46181bf80c5b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.120695 Sep 07 10:04:50.109541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2030/4056] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:49 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:51.125002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ec5b468c-4410-47d1-8fbd-e2b6a5b30d52 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1842790>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:51.218533 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ec5b468c-4410-47d1-8fbd-e2b6a5b30d52 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.097280 Sep 07 10:04:51.219127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2027/4057] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:51 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:52.236599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-587f8617-9a86-469a-ac6d-fc8c00c2a26e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1932940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:52.344548 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-587f8617-9a86-469a-ac6d-fc8c00c2a26e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.113724 Sep 07 10:04:52.359735 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2031/4058] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:52 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:53.358193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=51 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:53.359146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=46 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:53.363822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-73e7d7d1-2bb9-4748-908e-51deee1233f4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09f8790>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:53.493918 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-73e7d7d1-2bb9-4748-908e-51deee1233f4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.132880 Sep 07 10:04:53.502090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2028/4059] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:53 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:54.513474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aeeffa9e-5169-4cab-871b-b1597bba4221 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b104bd30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:54.527209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:54.533652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:04:54.610650 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aeeffa9e-5169-4cab-871b-b1597bba4221 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1412 microversion: 2.1 time: 0.103356 Sep 07 10:04:54.621424 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2032/4060] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:54 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:55.628348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c99f3c6-2998-4586-bb70-514c0ab91204 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b100faf0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:55.730560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c99f3c6-2998-4586-bb70-514c0ab91204 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1421 microversion: 2.1 time: 0.107582 Sep 07 10:04:55.733359 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2033/4061] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:55 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:55.747957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3423c075-38f4-450a-a637-69f4183f7f6e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1c2dee0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:55.846727 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3423c075-38f4-450a-a637-69f4183f7f6e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 200 len: 1421 microversion: 2.1 time: 0.102042 Sep 07 10:04:55.852259 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2034/4062] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:04:55 2022] GET /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:04:55.876529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eea35288-79bc-4ed2-8e95-4295035346ad tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0f421f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:56.138796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ab35b37-471a-4862-8064-00c54a2966e1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'create', calling method: .version_select at 0x7f14b1295670>, body: {"keypair": {"name": "tempest-keypair-1520667217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfAm4MW1GEr9aS5waoB/iFXW208Afl7EumnA0VBmLyFPITyGiME5sSE1wd4p7OnD5JAH7tgd9h6FS1cQjqbAzWglgpIyEsiqDt29VKuWrDaMGlR86av1GSJGrvFrSIbQw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:56.171412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6ab35b37-471a-4862-8064-00c54a2966e1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for project e080e21e856141b7850ea79bafd5b8e9. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:04:56.192436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6ab35b37-471a-4862-8064-00c54a2966e1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for user 6a8b10f41570421a9292168d0326bae0 and project e080e21e856141b7850ea79bafd5b8e9. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:04:56.289398 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ab35b37-471a-4862-8064-00c54a2966e1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.758723 Sep 07 10:04:56.290120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2029/4063] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:04:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:04:57.340247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eea35288-79bc-4ed2-8e95-4295035346ad tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 204 len: 0 microversion: 2.1 time: 1.478573 Sep 07 10:04:57.340914 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2035/4064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:55 2022] DELETE /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 0 bytes in 1480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:04:57.349379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:57.350493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:57.373906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.374432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.374890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.375637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.376100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.385549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.461993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:04:57.482256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:57.483130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:57.494340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.496747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.504898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.505949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.506590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.507038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.534583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 HTTP/1.1 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3accfc03-7586-4d0b-becb-e1f3d1a0a078'} Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:04:57.536299 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.541225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:57.548632 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ec05a0e8-f1cd-4e4a-87f3-f8dfed5d4e3f tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 404 len: 111 microversion: 2.1 time: 0.070029 Sep 07 10:04:57.551818 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2036/4065] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:04:57 2022] DELETE /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:04:57.560144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:57.560898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: 3accfc03-7586-4d0b-becb-e1f3d1a0a078] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:57.569552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.570396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.571090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.572023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.572733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.574102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.603139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 HTTP/1.1 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3accfc03-7586-4d0b-becb-e1f3d1a0a078'} Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:04:57.607070 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. Sep 07 10:04:57.610930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:04:57.619384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance 3accfc03-7586-4d0b-becb-e1f3d1a0a078 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:04:57.622965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-61005f4e-fdc8-4879-b6cf-e5a73b9453e4 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078" status: 404 len: 111 microversion: 2.1 time: 0.067909 Sep 07 10:04:57.630271 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2037/4066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:57 2022] GET /compute/v2.1/servers/3accfc03-7586-4d0b-becb-e1f3d1a0a078 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:04:57.641231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:57.646941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:57.671426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.672440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.674219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.675690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.677575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.679821 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d92c05f-374a-4355-b58b-78410b8de91c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 204 len: 0 microversion: 2.1 time: 0.331662 Sep 07 10:04:57.681568 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2030/4067] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:04:57 2022] DELETE /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:04:57.686566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.755245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:04:57.948114 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e5969fc-1ea9-4003-912d-33dfdb34a646 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 204 len: 0 microversion: 2.1 time: 0.315955 Sep 07 10:04:57.948977 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2038/4068] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:04:57 2022] DELETE /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:04:57.957763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:57.958867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:57.969108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.971302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.972021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:57.973986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:57.977855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:57.978564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:58.029410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1391759403", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ac11c0d8-1462-4df6-b5ec-d6277d361200"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:58.103969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] validate_networks() for [('ac11c0d8-1462-4df6-b5ec-d6277d361200', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:04:59.482138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:04:59.491029 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-148b8483-a969-4ad3-9a0e-c03ac28f8c08 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 1.537696 Sep 07 10:04:59.493974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2031/4069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:57 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:04:59.503353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bda2616f-237d-4647-b0a1-220cd2155fcd tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:04:59.527767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda2616f-237d-4647-b0a1-220cd2155fcd tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:59.529037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda2616f-237d-4647-b0a1-220cd2155fcd tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:59.529753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bda2616f-237d-4647-b0a1-220cd2155fcd tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:59.568318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bda2616f-237d-4647-b0a1-220cd2155fcd tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Going to try to stop instance {{(pid=128833) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:04:59.649320 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bda2616f-237d-4647-b0a1-220cd2155fcd tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action" status: 202 len: 0 microversion: 2.1 time: 0.150155 Sep 07 10:04:59.650571 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2032/4070] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:04:59 2022] POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:04:59.664065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:04:59.665391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:04:59.685900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:59.687043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:59.687725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:04:59.689361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:04:59.690782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:04:59.691458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:00.984131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:05:00.984694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:05:00.985825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:05:00.986335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:05:00.986800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:05:01.001527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:01.002039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:01.003849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:01.004612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:01.005076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:01.005659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:01.029337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:05:01.035881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for user 2e14f54af9f44dd28bab63c619816e67 and project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:05:01.063355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:05:01.072408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:05:01.204845 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e38218b5-9922-473e-93ea-a83f1ec389be tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.179706 Sep 07 10:05:01.206121 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2039/4071] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:05:01.216155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3624b1d5-99ef-4919-b5ec-986fc04cf818 req-7bd3095e-31c5-4f07-a42e-b7b8b1f60b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2729d92-a21b-4bbb-88f8-7737455f6974", "name": "network-vif-unplugged", "status": "completed", "tag": "e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:01.248122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:01.257380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3624b1d5-99ef-4919-b5ec-986fc04cf818 req-7bd3095e-31c5-4f07-a42e-b7b8b1f60b29 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:01.263658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3624b1d5-99ef-4919-b5ec-986fc04cf818 req-7bd3095e-31c5-4f07-a42e-b7b8b1f60b29 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:01.264193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3624b1d5-99ef-4919-b5ec-986fc04cf818 req-7bd3095e-31c5-4f07-a42e-b7b8b1f60b29 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:01.266029 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d51429b8-a34d-42e3-a51a-23bd6981b2b4 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1678 microversion: 2.1 time: 1.607320 Sep 07 10:05:01.268630 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2033/4072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:04:59 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1678 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:01.283883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:01.286417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:01.302424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:01.304751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:01.307822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:01.308830 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3624b1d5-99ef-4919-b5ec-986fc04cf818 req-7bd3095e-31c5-4f07-a42e-b7b8b1f60b29 service nova] Creating event network-vif-unplugged:e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10 for instance e2729d92-a21b-4bbb-88f8-7737455f6974 on n-h1-836830-16 Sep 07 10:05:01.309616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:01.311811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:01.312590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:01.320711 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3624b1d5-99ef-4919-b5ec-986fc04cf818 req-7bd3095e-31c5-4f07-a42e-b7b8b1f60b29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111047 Sep 07 10:05:01.321445 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2040/4073] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:01.342705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df050ee2-b73d-4683-9030-aee2cbaf3296 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:01.343436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df050ee2-b73d-4683-9030-aee2cbaf3296 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:01.725286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df050ee2-b73d-4683-9030-aee2cbaf3296 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:01.736315 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df050ee2-b73d-4683-9030-aee2cbaf3296 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1208 microversion: 2.1 time: 0.408838 Sep 07 10:05:01.738013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2041/4074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:01 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1208 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:02.016233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:02.032002 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6a48d0b-8694-48c6-9449-515064ee2629 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.762033 Sep 07 10:05:02.045220 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2034/4075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:01 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:02.294536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:02.295351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:02.323136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:02.325896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:02.327170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:02.335265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:02.337215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:02.339114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:02.760407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:02.761056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:02.773312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:02.773733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:02.774183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:02.774911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:02.775377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:02.775814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:03.420580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:03.433659 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3da1e0bf-0a33-4d80-b253-99699d134f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1260 microversion: 2.1 time: 0.677180 Sep 07 10:05:03.438239 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2035/4076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:02 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1260 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:03.454378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:03.455023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:03.474290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:03.474800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:03.475255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:03.475980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:03.476446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:03.483114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:03.901127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:03.918242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e5917e23-db7e-4ff8-af07-81925558e886 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1678 microversion: 2.1 time: 1.626179 Sep 07 10:05:03.919783 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2042/4077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:02 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1678 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:04.224852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da075a784e1a40fd97c186fed2c3b2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717c98a794074ebcae407bb25e06fd41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:04.237833 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c08997ef-4312-433e-af2e-a1bcc88ac7c3 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 200 len: 1510 microversion: 2.1 time: 0.796271 Sep 07 10:05:04.238878 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2036/4078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:03 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 1510 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:04.389299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1624547166", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4"}], "security_groups": [{"name": "tempest-securitygroup--805329913"}], "key_name": "tempest-keypair-1520667217", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:04.724218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c9ad3ffc-b6a2-4cb7-844d-e794cbf2a3cd req-cf951d24-6bd7-45c9-92a4-50f610d17886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0", "name": "network-vif-deleted", "tag": "73e192fa-c88f-4e9d-ad1e-d46bc07c2623"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:04.753146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c9ad3ffc-b6a2-4cb7-844d-e794cbf2a3cd req-cf951d24-6bd7-45c9-92a4-50f610d17886 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:04.754437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c9ad3ffc-b6a2-4cb7-844d-e794cbf2a3cd req-cf951d24-6bd7-45c9-92a4-50f610d17886 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:04.756461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c9ad3ffc-b6a2-4cb7-844d-e794cbf2a3cd req-cf951d24-6bd7-45c9-92a4-50f610d17886 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:04.775170 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c9ad3ffc-b6a2-4cb7-844d-e794cbf2a3cd req-cf951d24-6bd7-45c9-92a4-50f610d17886 service nova] Creating event network-vif-deleted:73e192fa-c88f-4e9d-ad1e-d46bc07c2623 for instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 on n-h2-836830-16 Sep 07 10:05:04.781656 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c9ad3ffc-b6a2-4cb7-844d-e794cbf2a3cd req-cf951d24-6bd7-45c9-92a4-50f610d17886 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.483619 Sep 07 10:05:04.782895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2043/4079] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:04.810925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:04.812024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:04.832575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:04.833389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:04.834051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:04.834934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:04.835547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:04.836139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:05.010569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] validate_networks() for [('a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:05:05.016814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:05.031512 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e109757-aa9d-4ef5-b220-a25112c45c60 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1266 microversion: 2.1 time: 0.242893 Sep 07 10:05:05.032168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2044/4080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:04 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:05.071343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:05.071986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:05.105099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:05.105661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:05.119627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:05.120621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:05.121160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:05.121640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:05.784088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:05.797297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2f1c164-5ab7-480d-b3b6-a7cf4430aa73 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1678 microversion: 2.1 time: 0.763571 Sep 07 10:05:05.829816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2045/4081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:05 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1678 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:05.838663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:05.840281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] [instance: a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:05.848283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:05.849047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:05.850023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:05.850911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:05.851719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:05.852345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:05.868989 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] HTTP exception thrown: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 could not be found. Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Request method failure captured: Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 HTTP/1.1 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGvP7ZmXl7nd0iEZxkT9zrDUc9fvw_3VJAil2kbzJfi4aWTT171p5arlkvUspHO6PYIpOa4HbFheQDDutVnXn-3866Xk0wPewnRz2wdP0qxOA1IvZwJG8JpeTpwZ2QWVR-tVSTqOTPuHlJt4chf81a6bSxkwg0QU2ByjcD1FDdTDICI Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/717c98a794074ebcae407bb25e06fd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_717c98a794074ebcae407bb25e06fd41", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 717c98a794074ebcae407bb25e06fd41 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-47055487 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: da075a784e1a40fd97c186fed2c3b2a0 Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-47055487-project Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 could not be found. Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0'} Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 could not be found. Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 could not be found. Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:05:05.871930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 could not be found. Sep 07 10:05:05.878765 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:05:05.880926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] Returning 404 to user: Instance a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:05:05.882046 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4df1ed7-e86f-4287-aa40-4436caff6134 tempest-ServersNegativeTestJSON-47055487 tempest-ServersNegativeTestJSON-47055487-project] 10.222.0.60 "GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0" status: 404 len: 111 microversion: 2.1 time: 0.049950 Sep 07 10:05:05.886562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2046/4082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:05 2022] GET /compute/v2.1/servers/a9b3ff7c-a8a4-4b90-ba51-b02182ce2ba0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:05:06.067075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:06.068085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:06.086575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:06.087083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:06.087827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:06.088893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:06.089404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:06.090055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:06.224716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:06.293380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:06.304568 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84a58408-4695-45db-b5e1-17f1bdcea895 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1266 microversion: 2.1 time: 0.247932 Sep 07 10:05:06.305422 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2047/4083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:06 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:06.842466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:06.843158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:06.860049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:06.860556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:06.861007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:06.862343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:06.862811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:06.863240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:07.289564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:05:07.291188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:05:07.292010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:05:07.292605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:05:07.293494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:05:07.312813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:07.313711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:07.315540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:07.317172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:07.317922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:07.319145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:07.444857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:05:07.452113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for user 6a8b10f41570421a9292168d0326bae0 and project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:05:07.499478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:05:07.511505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:05:07.531255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:07.540334 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81b8730c-ff1f-44ad-b55c-2d999055b996 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1678 microversion: 2.1 time: 0.701750 Sep 07 10:05:07.545488 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2048/4084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:06 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1678 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:07.555332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a72f6f67-342b-47d6-97db-077219c4889c req-7a513d14-474a-45b7-8ffa-12a1af94e2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2729d92-a21b-4bbb-88f8-7737455f6974", "name": "network-vif-deleted", "tag": "e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:07.578186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a72f6f67-342b-47d6-97db-077219c4889c req-7a513d14-474a-45b7-8ffa-12a1af94e2df service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:07.579055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a72f6f67-342b-47d6-97db-077219c4889c req-7a513d14-474a-45b7-8ffa-12a1af94e2df service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:07.582058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a72f6f67-342b-47d6-97db-077219c4889c req-7a513d14-474a-45b7-8ffa-12a1af94e2df service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:07.617431 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a72f6f67-342b-47d6-97db-077219c4889c req-7a513d14-474a-45b7-8ffa-12a1af94e2df service nova] Creating event network-vif-deleted:e3f82b24-e9ae-4570-bff2-9bdcdf2bfd10 for instance e2729d92-a21b-4bbb-88f8-7737455f6974 on n-h1-836830-16 Sep 07 10:05:07.624589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a72f6f67-342b-47d6-97db-077219c4889c req-7a513d14-474a-45b7-8ffa-12a1af94e2df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077527 Sep 07 10:05:07.632378 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0f35d21-52bc-4a78-b5d7-e868db73c716 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.261435 Sep 07 10:05:07.632957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2049/4085] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:07.638228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2037/4086] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:05:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 3270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:05:07.644596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:07.652448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b854a820-4621-42a1-a2e2-004e1dce9c87 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:07.658713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:07.668697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b854a820-4621-42a1-a2e2-004e1dce9c87 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:07.684581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:07.707530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:07.709404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:07.710390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:07.714846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:07.715838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:08.040151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b854a820-4621-42a1-a2e2-004e1dce9c87 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:08.054642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b854a820-4621-42a1-a2e2-004e1dce9c87 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1239 microversion: 2.1 time: 0.407895 Sep 07 10:05:08.055539 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2038/4087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:07 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1239 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:08.410344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:08.419936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1c1fdd07-b394-4817-b9f6-b2e621e21ab8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1308 microversion: 2.1 time: 0.784934 Sep 07 10:05:08.421954 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2050/4088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:07 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:08.568572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:08.569327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:08.580066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:08.582151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:08.584551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:08.586034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:08.586640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:08.587220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:08.932578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:08.946661 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4109e764-5198-4dc1-a9fa-09bd4b09c0de tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1678 microversion: 2.1 time: 0.382784 Sep 07 10:05:08.948051 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2039/4089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:08 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1678 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:09.090654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:09.091722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:09.109162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:09.112766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:09.113453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:09.114496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:09.115812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:09.120226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:09.442884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:09.447111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:09.447815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:09.457593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72e83fb4-f198-4cdd-a96b-4ddd3cdebd9b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1291 microversion: 2.1 time: 0.373446 Sep 07 10:05:09.461423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:09.461597 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2051/4090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:09 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1291 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:09.462253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:09.462856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:09.463721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:09.464345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:09.464927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:09.888170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:09.899204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18c8dcc8-f14a-4e96-b351-68085993924e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1308 microversion: 2.1 time: 0.455981 Sep 07 10:05:09.901934 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2040/4091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:09 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:09.972019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:09.973058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:09.983512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:09.984300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:09.984871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:09.985771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:09.986491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:09.987097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:10.489594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:10.490553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:10.539540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:10.540482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:10.553087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:10.554972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:10.555765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:10.569315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:10.665306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:10.677802 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1a79fbd6-80eb-42d4-ab23-c9d880fa3ae3 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1678 microversion: 2.1 time: 0.710079 Sep 07 10:05:10.679588 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2052/4092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:09 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1678 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:10.712767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a30bfb29-8bca-4f11-b91a-1ffc5498d595 req-6ab0279e-26b5-403b-ae79-a1574592d87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562530a6-06f3-449a-8a52-2bb230d832e9", "tag": "f00be4f8-0dd4-41af-bac8-debcab8bcd8f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:10.725490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a30bfb29-8bca-4f11-b91a-1ffc5498d595 req-6ab0279e-26b5-403b-ae79-a1574592d87c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:10.726272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a30bfb29-8bca-4f11-b91a-1ffc5498d595 req-6ab0279e-26b5-403b-ae79-a1574592d87c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:10.727011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a30bfb29-8bca-4f11-b91a-1ffc5498d595 req-6ab0279e-26b5-403b-ae79-a1574592d87c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:10.742139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a30bfb29-8bca-4f11-b91a-1ffc5498d595 req-6ab0279e-26b5-403b-ae79-a1574592d87c service nova] Creating event network-changed:f00be4f8-0dd4-41af-bac8-debcab8bcd8f for instance 562530a6-06f3-449a-8a52-2bb230d832e9 on n-h2-836830-16 Sep 07 10:05:10.747724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a30bfb29-8bca-4f11-b91a-1ffc5498d595 req-6ab0279e-26b5-403b-ae79-a1574592d87c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039532 Sep 07 10:05:10.748929 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2053/4093] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:05:10.792482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:10.810454 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce69f890-4050-490d-96da-c54525ce3362 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1297 microversion: 2.1 time: 0.328377 Sep 07 10:05:10.836311 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2041/4094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:10 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1297 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:10.926853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:10.927571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:10.943819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:10.944456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:10.945000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:10.957053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:10.957053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:10.957053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:11.028481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:11.702459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:11.703093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:11.710712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:11.711211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:11.711839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:11.712741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:11.713220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:11.713833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:11.733851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:11.992377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:12.006053 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a0e04e55-79df-4ae1-8bf8-32063c73572e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1308 microversion: 2.1 time: 1.085564 Sep 07 10:05:12.010780 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2054/4095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:10 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:12.015955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:12.018220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:12.025693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:12.026191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:12.026639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:12.027515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:12.029074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:12.031172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:12.101406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:12.112142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8aa3309-d8bc-448b-a9bd-a83359886331 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1655 microversion: 2.1 time: 0.413111 Sep 07 10:05:12.113164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2042/4096] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:11 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1655 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:12.138234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c55b04ae-3461-42a8-8d1b-9b1e26217ac0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:12.145531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c55b04ae-3461-42a8-8d1b-9b1e26217ac0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:12.146266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c55b04ae-3461-42a8-8d1b-9b1e26217ac0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:12.146883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c55b04ae-3461-42a8-8d1b-9b1e26217ac0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:12.171577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c55b04ae-3461-42a8-8d1b-9b1e26217ac0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Going to try to start instance {{(pid=128833) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 10:05:12.209758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:12.223961 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb8210ad-3ab9-4d16-8a9f-11de000b5f6c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1297 microversion: 2.1 time: 0.211246 Sep 07 10:05:12.225029 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2055/4097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:12 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1297 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:12.249707 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c55b04ae-3461-42a8-8d1b-9b1e26217ac0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action" status: 202 len: 0 microversion: 2.1 time: 0.114857 Sep 07 10:05:12.251357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2043/4098] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:05:12 2022] POST /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:05:12.262314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:12.263158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:12.271747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:12.272370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:12.273148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:12.274131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:12.276256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:12.277160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:12.671927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:12.692530 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-093478fa-00f1-4814-96f1-6f44240efbb9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1664 microversion: 2.1 time: 0.435672 Sep 07 10:05:12.703532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2056/4099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:12 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1664 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:13.032509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:13.033997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:13.043859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:13.050108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:13.050897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:13.052118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:13.052832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:13.053547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:13.103755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:13.260915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:13.262262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:13.276377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:13.277380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:13.279473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:13.282014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:13.282642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:13.285028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:13.299574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:13.907166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:13.929032 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85faa604-1e10-43ca-b55f-e09b1538cdc1 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1308 microversion: 2.1 time: 0.900927 Sep 07 10:05:13.930437 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2044/4100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:13 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1308 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:13.936058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:13.942146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:13.953317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:13.954065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:13.954748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:13.956738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:13.957453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:13.961934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:14.269819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:14.288491 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e203287-b326-4b21-965f-c8f4f12bdf00 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 1.038165 Sep 07 10:05:14.298580 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2057/4101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:13 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:14.958589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:14.959553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:14.966817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:14.967661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:14.968316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:14.970159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:14.971039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:14.971809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:15.655577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:15.668619 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-35370b08-faeb-4004-bd64-0fb818b06713 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1664 microversion: 2.1 time: 1.736879 Sep 07 10:05:15.669726 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2045/4102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:13 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1664 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:15.680059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:15.683614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:15.702703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:15.703394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:15.703990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:15.705464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:15.710999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:15.712432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:15.961280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:15.973042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-643e7352-6246-484e-bb09-c009767d0c5e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1308 microversion: 2.1 time: 1.019583 Sep 07 10:05:15.974898 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2058/4103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:14 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1308 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:16.168180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:16.180307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0d981fa5-b449-4520-9a46-0770a7985dbb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 0.509320 Sep 07 10:05:16.183970 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2046/4104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:15 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:16.428063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1204773498", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0ae7a8c4-2979-440a-8ec9-87fc23d68876"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:16.543890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] validate_networks() for [('0ae7a8c4-2979-440a-8ec9-87fc23d68876', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:05:16.703048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:16.704763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:16.720973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:16.723764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:16.725849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:16.727187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:16.728860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:16.730297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:17.369462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:17.377101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:17.397848 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11ddb1f3-029e-4d1f-9863-161376d0438d tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1668 microversion: 2.1 time: 0.700357 Sep 07 10:05:17.401506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2047/4105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:16 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1668 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:17.408632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-03019f51-c94c-4daa-a333-c290c2c8f1d3 req-59edea70-2b4b-4749-b7c8-5eee46ff4d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562530a6-06f3-449a-8a52-2bb230d832e9", "name": "network-vif-plugged", "status": "completed", "tag": "f00be4f8-0dd4-41af-bac8-debcab8bcd8f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:17.433502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03019f51-c94c-4daa-a333-c290c2c8f1d3 req-59edea70-2b4b-4749-b7c8-5eee46ff4d42 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:17.434673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03019f51-c94c-4daa-a333-c290c2c8f1d3 req-59edea70-2b4b-4749-b7c8-5eee46ff4d42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:17.435340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03019f51-c94c-4daa-a333-c290c2c8f1d3 req-59edea70-2b4b-4749-b7c8-5eee46ff4d42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:17.457768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-03019f51-c94c-4daa-a333-c290c2c8f1d3 req-59edea70-2b4b-4749-b7c8-5eee46ff4d42 service nova] Creating event network-vif-plugged:f00be4f8-0dd4-41af-bac8-debcab8bcd8f for instance 562530a6-06f3-449a-8a52-2bb230d832e9 on n-h2-836830-16 Sep 07 10:05:17.465680 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-03019f51-c94c-4daa-a333-c290c2c8f1d3 req-59edea70-2b4b-4749-b7c8-5eee46ff4d42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062577 Sep 07 10:05:17.466804 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2048/4106] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:17.476738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:17.477976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:17.503119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:17.503613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:17.504059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:17.504763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:17.505233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:17.505663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:18.044666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:18.078908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:18.086865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c5231190-b30c-4cb9-aa4e-53aeb3cfce8d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1308 microversion: 2.1 time: 0.618475 Sep 07 10:05:18.090160 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2049/4107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:17 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1308 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:18.133850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:18.136619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:18.151260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:18.152429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:18.153200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:18.156121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:18.157355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:18.158608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:19.191009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:19.201351 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37993655-2067-48f4-b92c-cda21f0cf5db tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 1.099270 Sep 07 10:05:19.208782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2050/4108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:18 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:19.222375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8257de1d-318b-4a28-9e2a-199f0c61185b req-ba2b0ee6-2056-4d2b-b063-d5347c5b9ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:19.242827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8257de1d-318b-4a28-9e2a-199f0c61185b req-ba2b0ee6-2056-4d2b-b063-d5347c5b9ec8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:19.247107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8257de1d-318b-4a28-9e2a-199f0c61185b req-ba2b0ee6-2056-4d2b-b063-d5347c5b9ec8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:19.247773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8257de1d-318b-4a28-9e2a-199f0c61185b req-ba2b0ee6-2056-4d2b-b063-d5347c5b9ec8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:19.281421 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8257de1d-318b-4a28-9e2a-199f0c61185b req-ba2b0ee6-2056-4d2b-b063-d5347c5b9ec8 service nova] Creating event network-changed:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:05:19.297671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8257de1d-318b-4a28-9e2a-199f0c61185b req-ba2b0ee6-2056-4d2b-b063-d5347c5b9ec8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084976 Sep 07 10:05:19.301254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2051/4109] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:19.320513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:19.323044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:19.358752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:19.362340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:19.362908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:19.367229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:19.367876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:19.372535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:19.533935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:05:19.537486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:05:19.539224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:05:19.540753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:05:19.541443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:05:19.555749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:19.557727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:19.560994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:19.562217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:19.563014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:19.565370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:19.641094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Getting quotas for project 657b9590df5f4f2bbb688a3bf863ad8b. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:05:19.652695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Getting quotas for user 079702fbce6f4dcfaed9a35f35a6b086 and project 657b9590df5f4f2bbb688a3bf863ad8b. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:05:19.670255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Going to run 3 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:05:19.679367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:05:19.731042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=bf9a872b-7c5f-4b77-8dcc-28a8a00e1659,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:05:19.812998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:05:19.994767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9c2d3ea-f994-4457-8d3d-60266853e81d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.645945 Sep 07 10:05:19.999789 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2059/4110] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:05:20.022026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:20.037822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:20.040758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:05:20.114714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:20.115212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:20.115664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:20.116411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:20.116873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:20.127559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:20.181065 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c8ee19a-29e4-49ab-b7d0-0a886e8bab92 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.176306 Sep 07 10:05:20.186515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2060/4111] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:05:20 2022] GET /compute/v2.1/servers => generated 1018 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:20.200828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f23a7db-133b-4d6a-b589-fe189d1f8bed tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:20.202994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f23a7db-133b-4d6a-b589-fe189d1f8bed tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:20.378164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f23a7db-133b-4d6a-b589-fe189d1f8bed tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:20.386056 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f23a7db-133b-4d6a-b589-fe189d1f8bed tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1223 microversion: 2.1 time: 0.190630 Sep 07 10:05:20.389496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2061/4112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:20 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1223 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:20.395206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:20.409362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:20.412920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:20.431622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:20.432797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:20.433849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:20.434774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:20.438553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:20.439243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:20.772301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:20.780938 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f62f077f-d577-4659-a1ae-07da96f9cf82 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1487 microversion: 2.1 time: 1.477781 Sep 07 10:05:20.784835 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2052/4113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:19 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1487 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:20.806411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:20.806956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:20.825505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:20.838634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:20.839474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:20.840447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:20.841133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:20.841845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:20.889025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lazy-loading 'flavor' on Instance uuid 562530a6-06f3-449a-8a52-2bb230d832e9 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:05:21.067893 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6bb21aea-7a47-4972-b1ab-1ffedd61195a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9/action" status: 202 len: 0 microversion: 2.1 time: 0.265038 Sep 07 10:05:21.072890 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2053/4114] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:05:20 2022] POST /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:05:21.092785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:21.099788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:21.113418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:21.114358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:21.114950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:21.115662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:21.116214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:21.116731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:21.217990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:21.228901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd6ff4ed-e444-422e-9778-29e561e3493b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 0.837971 Sep 07 10:05:21.237943 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2062/4115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:20 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:21.421677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b4f31861-12cf-4694-b28f-192e7b1c44be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:21.422307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b4f31861-12cf-4694-b28f-192e7b1c44be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:21.838913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b4f31861-12cf-4694-b28f-192e7b1c44be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:21.869477 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b4f31861-12cf-4694-b28f-192e7b1c44be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1223 microversion: 2.1 time: 0.460758 Sep 07 10:05:21.871741 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2063/4116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:21 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1223 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:22.001603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:22.015545 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2647acfc-5dc0-4c48-a876-f0a6edd1846a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1495 microversion: 2.1 time: 0.941236 Sep 07 10:05:22.024675 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2054/4117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:21 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1495 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:22.264952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:22.266406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:22.299429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:22.301491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:22.302608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:22.303657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:22.305843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:22.308080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:22.788507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:22.797030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f7829962-7dab-40eb-8a81-d9c431a5dea9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 0.539774 Sep 07 10:05:22.805036 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2064/4118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:22 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:22.899994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:22.900767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:22.918032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:22.919788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:22.919788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:22.921940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:22.924604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:22.926615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:23.053934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:23.054944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:23.066881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:23.069978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:23.073639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:23.076704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:23.085249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:23.086916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:23.221784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:23.234736 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66350bf4-6805-4a9c-96bb-aad11d4a8ddb tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1219 microversion: 2.1 time: 0.337857 Sep 07 10:05:23.240393 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2055/4119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:22 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1219 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:23.699136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:23.708970 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2dfa4b54-395e-429d-a5e6-62e10265edef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 200 len: 1478 microversion: 2.1 time: 0.660794 Sep 07 10:05:23.728122 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2065/4120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:23 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 1478 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:23.736869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1623000656"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:23.739996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:23.743845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:23.758803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:23.759317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:23.759769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:23.763854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:23.764828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:23.765757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:23.832401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:23.834233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:23.843703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:23.844039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:23.844494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:23.849214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:23.849716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:23.850169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:24.240811 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c621be54-908c-4353-a601-17a3cf63c41d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9/action" status: 202 len: 0 microversion: 2.1 time: 0.508978 Sep 07 10:05:24.243014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2056/4121] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:05:23 2022] POST /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 10:05:24.293689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e3350bd6-3489-485c-bace-c126d02be37d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09f8ee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:24.435419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e3350bd6-3489-485c-bace-c126d02be37d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.149595 Sep 07 10:05:24.447785 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2057/4122] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:24 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:24.466827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:24.469062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:24.525868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:24.552582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:24.560954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:24.563533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:24.569936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:24.571009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:24.901968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:24.922193 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ef12fafc-336a-4410-a988-ed195d96b957 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1281 microversion: 2.1 time: 0.473217 Sep 07 10:05:24.922791 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2058/4123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:24 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:25.108135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:25.121852 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-292bfbb9-2f1f-40bf-9e83-502ed48ff4bf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 1.293907 Sep 07 10:05:25.123258 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2066/4124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:23 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:25.473352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5185090f-af33-4bdd-81d8-bbc9b419c178 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a0d670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:25.558457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5185090f-af33-4bdd-81d8-bbc9b419c178 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.098238 Sep 07 10:05:25.559330 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2059/4125] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:25 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:25.951095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:25.951835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:25.966594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:25.972197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:25.972838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:25.974085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:25.974872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:25.975495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:26.150676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:26.151540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:26.198475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:26.199675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:26.200339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:26.201098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:26.201603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:26.202033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:26.387001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:26.401825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8fef60fe-eeba-48dc-b4a8-7b0a8ac924be tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1281 microversion: 2.1 time: 0.451754 Sep 07 10:05:26.404981 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2067/4126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:25 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:26.575972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8fd2d7c-af3d-466e-a72b-6d3a12925884 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1932ee0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:26.627977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:26.647319 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95f80930-22db-41bf-b31f-9b1cb88e800a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 0.504426 Sep 07 10:05:26.655698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d8fd2d7c-af3d-466e-a72b-6d3a12925884 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.084527 Sep 07 10:05:26.671008 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2068/4127] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:26 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:26.671769 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2060/4128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:26 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:27.428170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:27.429403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:27.472365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:27.472902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:27.474940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:27.475658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:27.477580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:27.479991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:27.638939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:27.653114 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8dbb1512-46f0-4d6f-a8a9-0ca72d85f717 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1281 microversion: 2.1 time: 0.229802 Sep 07 10:05:27.655306 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2069/4129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:27 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:27.681731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-17d88a2d-0cea-4d83-84a2-5d94530da375 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b123bee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:27.685501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:27.686673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:27.703254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:27.705048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:27.705743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:27.706670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:27.707894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:27.708496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:27.769748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-17d88a2d-0cea-4d83-84a2-5d94530da375 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.094084 Sep 07 10:05:27.774276 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2061/4130] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:27 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:27.972554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:27.989981 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aedec9a1-7d65-4426-b309-e737eff857a2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 0.314510 Sep 07 10:05:27.995556 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2070/4131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:27 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:28.680689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:28.681771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:28.698087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:28.701496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:28.702172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:28.703120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:28.705719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:28.708765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:28.765175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:28.800195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-033b4b2f-6c92-4379-9c6f-a1a7f739a8a7 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0bdac10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:28.910997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:28.921230 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f88fdfc-2f10-4883-a083-1c37f14cfb83 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1281 microversion: 2.1 time: 0.245609 Sep 07 10:05:28.925281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2062/4132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:28 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:28.964097 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-033b4b2f-6c92-4379-9c6f-a1a7f739a8a7 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.178665 Sep 07 10:05:28.977815 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2071/4133] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:28 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:29.023434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:29.024070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:29.035549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:29.040695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:29.041540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:29.042510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:29.043208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:29.043898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:29.824637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:29.838672 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8d3e6ccf-c74f-4737-a623-3c0c44b15b6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 0.819844 Sep 07 10:05:29.839283 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2063/4134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:29 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:29.962397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:29.963085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:29.980617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6f02224-e5a3-4df8-a291-aa9ea8f41f94 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09ffc10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:29.986991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:29.990886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:29.991626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:29.994052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:29.996404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:30.000465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:30.074232 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6f02224-e5a3-4df8-a291-aa9ea8f41f94 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.097967 Sep 07 10:05:30.077502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2064/4135] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:29 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:30.144832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:30.776669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-38df8514-ce9a-4e99-ba5d-60bddca8ce66 req-379577d1-be6f-4a8c-9ac7-cabb570248b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-plugged", "status": "completed", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:30.795245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-38df8514-ce9a-4e99-ba5d-60bddca8ce66 req-379577d1-be6f-4a8c-9ac7-cabb570248b6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:30.796178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-38df8514-ce9a-4e99-ba5d-60bddca8ce66 req-379577d1-be6f-4a8c-9ac7-cabb570248b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:30.796831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-38df8514-ce9a-4e99-ba5d-60bddca8ce66 req-379577d1-be6f-4a8c-9ac7-cabb570248b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:30.819376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:30.834717 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-38df8514-ce9a-4e99-ba5d-60bddca8ce66 req-379577d1-be6f-4a8c-9ac7-cabb570248b6 service nova] Creating event network-vif-plugged:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:05:30.836719 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-581ce4ff-c1f3-4cb0-8602-643c8df7e244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 0.876220 Sep 07 10:05:30.851273 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-38df8514-ce9a-4e99-ba5d-60bddca8ce66 req-379577d1-be6f-4a8c-9ac7-cabb570248b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.548854 Sep 07 10:05:30.852919 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2072/4136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:29 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:30.856204 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2065/4137] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:30.879341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:30.879986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:30.913793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:30.914324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:30.914787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:30.918969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:30.920479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:30.922162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:31.096398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b63cd9e-1855-4dd8-9492-e65b2365b991 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09de4c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:31.208240 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b63cd9e-1855-4dd8-9492-e65b2365b991 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.117548 Sep 07 10:05:31.211684 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2066/4138] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:31 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:31.852791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:31.865444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:31.866384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:31.879803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:31.885604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:31.886160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:31.886998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:31.887515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:31.888889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:32.013870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:32.031498 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c057140d-194e-45b9-8011-a5cdd9a34258 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1364 microversion: 2.1 time: 1.166412 Sep 07 10:05:32.032684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2073/4139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:30 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1364 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:32.224349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4df2b17b-011b-476e-90e3-4ffc562afe46 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b126ef70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:32.330225 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4df2b17b-011b-476e-90e3-4ffc562afe46 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.109936 Sep 07 10:05:32.332079 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2074/4140] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:32 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:32.581609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:32.590683 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-998651a8-8d91-4240-8841-787f9a2353b4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 0.733841 Sep 07 10:05:32.595070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2067/4141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:31 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:33.059625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:33.060869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:33.077490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:33.078540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:33.078997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:33.079816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:33.081294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:33.086382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:33.099251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-37f316dc-a810-4d8f-bc5a-acd54a4017f6 req-a26c5206-4793-456f-a03a-fa319e8f253c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562530a6-06f3-449a-8a52-2bb230d832e9", "name": "network-vif-plugged", "status": "completed", "tag": "f00be4f8-0dd4-41af-bac8-debcab8bcd8f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:33.121554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-37f316dc-a810-4d8f-bc5a-acd54a4017f6 req-a26c5206-4793-456f-a03a-fa319e8f253c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:33.133560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-37f316dc-a810-4d8f-bc5a-acd54a4017f6 req-a26c5206-4793-456f-a03a-fa319e8f253c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:33.134307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-37f316dc-a810-4d8f-bc5a-acd54a4017f6 req-a26c5206-4793-456f-a03a-fa319e8f253c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:33.170968 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-37f316dc-a810-4d8f-bc5a-acd54a4017f6 req-a26c5206-4793-456f-a03a-fa319e8f253c service nova] Creating event network-vif-plugged:f00be4f8-0dd4-41af-bac8-debcab8bcd8f for instance 562530a6-06f3-449a-8a52-2bb230d832e9 on n-h2-836830-16 Sep 07 10:05:33.183055 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-37f316dc-a810-4d8f-bc5a-acd54a4017f6 req-a26c5206-4793-456f-a03a-fa319e8f253c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088389 Sep 07 10:05:33.190353 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2068/4142] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:05:33.349254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44d03356-da9b-4899-95d9-c986a46d4ec8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a9b0d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:33.469748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44d03356-da9b-4899-95d9-c986a46d4ec8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.125499 Sep 07 10:05:33.470984 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2069/4143] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:33 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:33.623082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:33.623841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:33.639999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:33.645783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:33.646792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:33.647152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:33.647634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:33.648069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:34.790058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:34.803376 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93960009-c7d3-4c3b-b174-be244dff6b65 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1550 microversion: 2.1 time: 1.748347 Sep 07 10:05:34.804316 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2075/4144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:33 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1550 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:34.815664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-672da362-9aad-4e25-b5db-de50c313cc36 req-71d0699c-720c-4712-9a3c-ce6428d4c972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9a872b-7c5f-4b77-8dcc-28a8a00e1659", "tag": "88938f89-c76b-47e3-ab3e-6ab6d506f4e3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:34.832929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-672da362-9aad-4e25-b5db-de50c313cc36 req-71d0699c-720c-4712-9a3c-ce6428d4c972 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:34.834054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-672da362-9aad-4e25-b5db-de50c313cc36 req-71d0699c-720c-4712-9a3c-ce6428d4c972 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:34.834684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-672da362-9aad-4e25-b5db-de50c313cc36 req-71d0699c-720c-4712-9a3c-ce6428d4c972 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:34.851096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-672da362-9aad-4e25-b5db-de50c313cc36 req-71d0699c-720c-4712-9a3c-ce6428d4c972 service nova] Creating event network-changed:88938f89-c76b-47e3-ab3e-6ab6d506f4e3 for instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 on n-h2-836830-16 Sep 07 10:05:34.881733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-672da362-9aad-4e25-b5db-de50c313cc36 req-71d0699c-720c-4712-9a3c-ce6428d4c972 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076046 Sep 07 10:05:34.886887 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2076/4145] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:34.901682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-139cf9c9-c060-462e-b271-08bd74bf2996 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0b6a280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:34.979628 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-139cf9c9-c060-462e-b271-08bd74bf2996 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.091380 Sep 07 10:05:34.985119 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2077/4146] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:34 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:34.995686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:34.996519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:35.014907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:35.015429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:35.015876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:35.016602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:35.017823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:35.018267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:35.262544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:35.274248 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a25446ac-7397-4b41-8725-bbd8744e4174 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 1.656203 Sep 07 10:05:35.299782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2070/4147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:33 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:35.594567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60aadbef-d9c0-48a3-901d-efa3299f85d2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.607735 Sep 07 10:05:35.595683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2078/4148] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:05:34 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/os-interface => generated 284 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:36.000110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85a4ed27-88ca-4513-9946-7847750035e4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b097b430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:36.058481 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85a4ed27-88ca-4513-9946-7847750035e4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.062263 Sep 07 10:05:36.075063 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2071/4149] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:35 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:36.311695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:36.316599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:36.328454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:36.329270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:36.330304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:36.331279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:36.331986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:36.332631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:37.081885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-954fb4ce-2b22-448e-9b33-034787807b90 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09ff1f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:37.159849 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-954fb4ce-2b22-448e-9b33-034787807b90 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.084651 Sep 07 10:05:37.168293 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2072/4150] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:37 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:37.653579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-74f89a81-d0a2-43dc-b248-ef41b4f475ee req-09d0a3f5-90d5-497b-8787-9d6ac5db5adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743be1f0-3e60-4f9e-875e-a6646fe44197", "tag": "117dd742-3a65-42c1-9c43-3d13418b5261"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:37.690915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74f89a81-d0a2-43dc-b248-ef41b4f475ee req-09d0a3f5-90d5-497b-8787-9d6ac5db5adf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:37.691679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74f89a81-d0a2-43dc-b248-ef41b4f475ee req-09d0a3f5-90d5-497b-8787-9d6ac5db5adf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:37.694843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74f89a81-d0a2-43dc-b248-ef41b4f475ee req-09d0a3f5-90d5-497b-8787-9d6ac5db5adf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:37.715747 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-74f89a81-d0a2-43dc-b248-ef41b4f475ee req-09d0a3f5-90d5-497b-8787-9d6ac5db5adf service nova] Creating event network-changed:117dd742-3a65-42c1-9c43-3d13418b5261 for instance 743be1f0-3e60-4f9e-875e-a6646fe44197 on n-h2-836830-16 Sep 07 10:05:37.726985 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-74f89a81-d0a2-43dc-b248-ef41b4f475ee req-09d0a3f5-90d5-497b-8787-9d6ac5db5adf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077459 Sep 07 10:05:37.730195 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2073/4151] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:05:37.792558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7b9b2482-b9f9-4547-a261-1961b1c0fc62 req-816175e5-0ae3-4f80-8530-7e8e9ac10b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a", "tag": "baad93c0-8311-4f25-9b2c-f62d94aab75d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:37.819026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7b9b2482-b9f9-4547-a261-1961b1c0fc62 req-816175e5-0ae3-4f80-8530-7e8e9ac10b0d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:37.819525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7b9b2482-b9f9-4547-a261-1961b1c0fc62 req-816175e5-0ae3-4f80-8530-7e8e9ac10b0d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:37.819964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7b9b2482-b9f9-4547-a261-1961b1c0fc62 req-816175e5-0ae3-4f80-8530-7e8e9ac10b0d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:37.852481 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7b9b2482-b9f9-4547-a261-1961b1c0fc62 req-816175e5-0ae3-4f80-8530-7e8e9ac10b0d service nova] Creating event network-changed:baad93c0-8311-4f25-9b2c-f62d94aab75d for instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a on n-h1-836830-16 Sep 07 10:05:37.863934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7b9b2482-b9f9-4547-a261-1961b1c0fc62 req-816175e5-0ae3-4f80-8530-7e8e9ac10b0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096519 Sep 07 10:05:37.867782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2074/4152] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:37.928673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:37.946459 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4dd1ca96-0d20-462c-aee3-0bf4c3511244 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 1.644354 Sep 07 10:05:37.947811 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2079/4153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:36 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:38.212264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f49a5bf-819a-4623-9a2f-cdc523d40daf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0970af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:38.319430 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f49a5bf-819a-4623-9a2f-cdc523d40daf tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.147049 Sep 07 10:05:38.334845 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2075/4154] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:38 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:38.979950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:38.980593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:38.993202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:38.993700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:38.994148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:38.994866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:38.995334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:38.995768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:39.337091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f4d1dbc-a703-40d4-bab6-f03c3632c16e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09ffc10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:39.400628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f4d1dbc-a703-40d4-bab6-f03c3632c16e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.066902 Sep 07 10:05:39.401580 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2076/4155] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:39 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:39.727786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:39.740303 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1aa2fd2e-1b14-40e9-a134-e5aeb2c9db8d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 0.769883 Sep 07 10:05:39.741222 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2080/4156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:38 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:40.002899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5d9c2e0a-f8e0-4548-8066-3bd9f34337bb req-6b4f904f-1d67-4385-907b-67006dd3ace1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:40.013234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5d9c2e0a-f8e0-4548-8066-3bd9f34337bb req-6b4f904f-1d67-4385-907b-67006dd3ace1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:40.013922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5d9c2e0a-f8e0-4548-8066-3bd9f34337bb req-6b4f904f-1d67-4385-907b-67006dd3ace1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:40.014523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5d9c2e0a-f8e0-4548-8066-3bd9f34337bb req-6b4f904f-1d67-4385-907b-67006dd3ace1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:40.031695 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5d9c2e0a-f8e0-4548-8066-3bd9f34337bb req-6b4f904f-1d67-4385-907b-67006dd3ace1 service nova] Creating event network-changed:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:05:40.045344 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5d9c2e0a-f8e0-4548-8066-3bd9f34337bb req-6b4f904f-1d67-4385-907b-67006dd3ace1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046328 Sep 07 10:05:40.050144 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2077/4157] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:40.417396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3572a23a-3921-42af-b639-b9b9828da7a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0b1f430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:40.508753 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3572a23a-3921-42af-b639-b9b9828da7a9 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.095091 Sep 07 10:05:40.518316 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2081/4158] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:40 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:40.769757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:40.770540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:40.807467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:40.812325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:40.813051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:40.817347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:40.817849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:40.818298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:41.529360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8b8415c0-634f-4735-b3ed-118f1c04aafb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b10813a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:41.642586 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8b8415c0-634f-4735-b3ed-118f1c04aafb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.119554 Sep 07 10:05:41.644001 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2082/4159] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:41 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:41.655415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:41.670814 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b4b441c5-c215-46b1-a333-0ce45eba7327 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 0.906008 Sep 07 10:05:41.672027 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2078/4160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:40 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:42.666171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21aba423-6eb7-4bd4-b8aa-566be672a865 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0bb6c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:42.693983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:42.694625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:42.725769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:42.732154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:42.733794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:42.739377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:42.740195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:42.740749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:42.752844 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21aba423-6eb7-4bd4-b8aa-566be672a865 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.097410 Sep 07 10:05:42.753486 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2083/4161] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:42 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:43.077605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0421b40e-9434-47aa-a0e3-20f49f13a196 req-fcec28bd-bfba-423c-b91d-381da8c91d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9a872b-7c5f-4b77-8dcc-28a8a00e1659", "name": "network-vif-plugged", "status": "completed", "tag": "88938f89-c76b-47e3-ab3e-6ab6d506f4e3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:43.102870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0421b40e-9434-47aa-a0e3-20f49f13a196 req-fcec28bd-bfba-423c-b91d-381da8c91d5c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:43.103512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0421b40e-9434-47aa-a0e3-20f49f13a196 req-fcec28bd-bfba-423c-b91d-381da8c91d5c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:43.104751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0421b40e-9434-47aa-a0e3-20f49f13a196 req-fcec28bd-bfba-423c-b91d-381da8c91d5c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:43.128872 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0421b40e-9434-47aa-a0e3-20f49f13a196 req-fcec28bd-bfba-423c-b91d-381da8c91d5c service nova] Creating event network-vif-plugged:88938f89-c76b-47e3-ab3e-6ab6d506f4e3 for instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 on n-h2-836830-16 Sep 07 10:05:43.151612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0421b40e-9434-47aa-a0e3-20f49f13a196 req-fcec28bd-bfba-423c-b91d-381da8c91d5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077043 Sep 07 10:05:43.154216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2084/4162] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:05:43.769565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a047d82-f88b-4d4d-a7c2-8cdd9cce911b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b116d940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:43.870411 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a047d82-f88b-4d4d-a7c2-8cdd9cce911b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.104797 Sep 07 10:05:43.882775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2085/4163] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:43 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:44.127868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:44.148110 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9e092f2-69a7-4b6f-a4b7-e7456a362d27 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 1.451937 Sep 07 10:05:44.150852 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2079/4164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:42 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:44.899578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-626c62f2-0907-4392-a7f5-981634fa819a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b126ed30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:44.986217 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-626c62f2-0907-4392-a7f5-981634fa819a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.093248 Sep 07 10:05:44.986947 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2086/4165] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:44 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:45.174599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:45.175782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:45.188711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:45.189571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:45.190386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:45.191635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:45.192496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:45.193345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:45.287088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-95b58778-3e0f-4051-acf4-9e209f1681a8 req-2fc39929-7e6b-427e-8a50-eb71c3ff488a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a", "name": "network-vif-plugged", "status": "completed", "tag": "baad93c0-8311-4f25-9b2c-f62d94aab75d"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:45.309128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-95b58778-3e0f-4051-acf4-9e209f1681a8 req-2fc39929-7e6b-427e-8a50-eb71c3ff488a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:45.312799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-95b58778-3e0f-4051-acf4-9e209f1681a8 req-2fc39929-7e6b-427e-8a50-eb71c3ff488a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:45.316087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-95b58778-3e0f-4051-acf4-9e209f1681a8 req-2fc39929-7e6b-427e-8a50-eb71c3ff488a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:45.341317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:45.343947 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-95b58778-3e0f-4051-acf4-9e209f1681a8 req-2fc39929-7e6b-427e-8a50-eb71c3ff488a service nova] Creating event network-vif-plugged:baad93c0-8311-4f25-9b2c-f62d94aab75d for instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a on n-h1-836830-16 Sep 07 10:05:45.362210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-95b58778-3e0f-4051-acf4-9e209f1681a8 req-2fc39929-7e6b-427e-8a50-eb71c3ff488a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076967 Sep 07 10:05:45.365237 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2087/4166] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:05:46.003674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab043671-d8d1-48c5-a85b-be2041a4a66d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b1a15700>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:46.146997 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab043671-d8d1-48c5-a85b-be2041a4a66d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.148807 Sep 07 10:05:46.158241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2088/4167] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:45 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:47.164978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe8c335b-cd91-4bed-a767-cefdce2a868c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b104bdc0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:47.242982 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe8c335b-cd91-4bed-a767-cefdce2a868c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.083096 Sep 07 10:05:47.245022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2089/4168] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:47 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:47.582577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:47.611983 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fb3a6a60-a626-4c2e-afae-31594238f69d tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 2.436251 Sep 07 10:05:47.626682 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2080/4169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:45 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:48.266148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9622218c-486a-466e-8d1e-22d6112dfdad tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b126eb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:48.374072 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9622218c-486a-466e-8d1e-22d6112dfdad tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.116538 Sep 07 10:05:48.385621 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2090/4170] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:48 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:48.640458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:48.642859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:48.701558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:48.702043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:48.703929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:48.706164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:48.710566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:48.713281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:49.232660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:49.246066 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd420f30-9e21-43c7-a576-b472e96ed05c tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 0.610641 Sep 07 10:05:49.248883 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2081/4171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:48 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:49.279291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b67910e2-4533-4b34-b426-4e8e12460950 req-989fe1d5-46c9-49e8-8af5-cd60e8ae4e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743be1f0-3e60-4f9e-875e-a6646fe44197", "name": "network-vif-plugged", "status": "completed", "tag": "117dd742-3a65-42c1-9c43-3d13418b5261"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:49.310156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b67910e2-4533-4b34-b426-4e8e12460950 req-989fe1d5-46c9-49e8-8af5-cd60e8ae4e12 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:49.311359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b67910e2-4533-4b34-b426-4e8e12460950 req-989fe1d5-46c9-49e8-8af5-cd60e8ae4e12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:49.312085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b67910e2-4533-4b34-b426-4e8e12460950 req-989fe1d5-46c9-49e8-8af5-cd60e8ae4e12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:49.346545 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b67910e2-4533-4b34-b426-4e8e12460950 req-989fe1d5-46c9-49e8-8af5-cd60e8ae4e12 service nova] Creating event network-vif-plugged:117dd742-3a65-42c1-9c43-3d13418b5261 for instance 743be1f0-3e60-4f9e-875e-a6646fe44197 on n-h2-836830-16 Sep 07 10:05:49.362583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b67910e2-4533-4b34-b426-4e8e12460950 req-989fe1d5-46c9-49e8-8af5-cd60e8ae4e12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085667 Sep 07 10:05:49.364713 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2091/4172] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:49.390813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f12e2eb-43e2-4f8e-a5d3-ef36705b9bb2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a07430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:49.477803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f12e2eb-43e2-4f8e-a5d3-ef36705b9bb2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.090622 Sep 07 10:05:49.478400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2082/4173] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:49 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:49.897458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1659748955", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7e4b5d7a-3e6d-4b4f-88b2-a6a0fb9632bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:50.024312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:05:50.277633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:50.278919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:50.312323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:50.323967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:50.333475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:50.334314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:50.334812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:50.335261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:50.943087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:50.956013 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9df622d-16da-4aab-ad52-931b3bfa09d1 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1323 microversion: 2.1 time: 0.683171 Sep 07 10:05:50.964101 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2083/4174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:50 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:50.989314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:51.011677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:51.023921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:51.031514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:51.032252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:51.038374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:51.041636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:51.042270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:51.172606 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-098b9ba5-23c8-4db8-ad00-f802f02f4fca tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.198613 Sep 07 10:05:51.176375 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2084/4175] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:05:50 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490/os-volume_attachments => generated 25 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:05:51.194100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c5fbf428-84fc-453a-bb07-e5f7ccea7609 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0a2d0d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:51.283714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c5fbf428-84fc-453a-bb07-e5f7ccea7609 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.105891 Sep 07 10:05:51.297607 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2085/4176] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:51 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:51.323794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:51.324932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:51.337506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:51.338248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:51.338874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:51.342506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:51.343308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:51.343905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:51.442141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:05:51.700473 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76a942e4-3c4e-4285-8301-1335116b4da0 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 204 len: 0 microversion: 2.1 time: 0.381037 Sep 07 10:05:51.701701 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2086/4177] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:05:51 2022] DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:05:51.712250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:51.714097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:51.727207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:51.727972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:51.728678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:51.731410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:51.732081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:51.732921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:52.452894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:52.463071 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-64e2bd32-5e2e-4705-96ab-fb484536aab9 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1674 microversion: 2.1 time: 0.754876 Sep 07 10:05:52.465215 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2087/4178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:51 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1674 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:05:52.491672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:52.492737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:52.500947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:52.502438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:52.503055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:52.503919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:52.504639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:52.505943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:52.909486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:05:52.909950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:05:52.910397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:05:52.910812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:05:52.911232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:05:52.913505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=39 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:52.939501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:52.953021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:52.953637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:52.961981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:52.964898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:52.965579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:53.020384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:05:53.027049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:05:53.121788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:05:53.125471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e4b5d7a-3e6d-4b4f-88b2-a6a0fb9632bf',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:05:53.279548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:53.297584 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94057316-72ee-470b-864d-30eee6edf1f0 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 200 len: 1516 microversion: 2.1 time: 0.831014 Sep 07 10:05:53.299431 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2088/4179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:52 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 1516 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:53.313211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9a6e69f-2881-4cc6-a4e4-318c0cd23fdb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09ce9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:53.386936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9a6e69f-2881-4cc6-a4e4-318c0cd23fdb tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1438 microversion: 2.1 time: 0.083803 Sep 07 10:05:53.398398 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2089/4180] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:53 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:53.556938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-32a55081-7965-4ee0-a9ee-684e8141bf45 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'create', calling method: .version_select at 0x7f14b09ae280>, body: {"keypair": {"name": "tempest-keypair-1907719540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA8YllmEX3NRhLhxUiQWA4qwrig6wSGPnoItz4oMSVRvmPp9HDwgWkzeNF5geNtTqHyZWSShthbpvjJl6S1x/dfOL4YpJAhsyz4iFxSwmRjRo/ewxUo4z3jLAd2vmqn7w=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:53.587046 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ece810c-bd02-420b-9ece-98c74268ae71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.693900 Sep 07 10:05:53.598430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2092/4181] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:05:53.636958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-32a55081-7965-4ee0-a9ee-684e8141bf45 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:05:53.648793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:53.649353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:53.651495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-32a55081-7965-4ee0-a9ee-684e8141bf45 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for user 6cb4a2e0094a4c90ae14626b946065e1 and project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:05:53.709068 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-32a55081-7965-4ee0-a9ee-684e8141bf45 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.308357 Sep 07 10:05:53.710132 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2090/4182] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 10:05:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 311 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 10:05:53.710773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:53.717552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:53.718033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:53.718972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:53.719260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:53.720240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:53.720756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:53.721719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:53.734909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:53.741712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:53.742426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:53.746057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:53.746734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:53.749432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:55.301709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:55.309621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:55.329781 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e50fe4f7-c97f-4b9a-ae3a-4ca6aaf2cd37 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1674 microversion: 2.1 time: 1.617270 Sep 07 10:05:55.352800 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2091/4183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:53 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1674 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:55.367432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:55.368125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:55.381464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:55.394340 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5acd15f-3ffb-42e7-a8a2-373ac85ad8d3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a" status: 200 len: 1517 microversion: 2.1 time: 1.794667 Sep 07 10:05:55.398307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:05:55.408652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:55.408967 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2093/4184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:53 2022] GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a => generated 1517 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:55.409614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:55.411252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:55.413455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:55.416516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:55.418825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:55.452447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1849e683-6844-4701-93f8-d2f1811e16df tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0aafaf0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:55.601009 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1849e683-6844-4701-93f8-d2f1811e16df tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1447 microversion: 2.1 time: 0.190396 Sep 07 10:05:55.604288 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2094/4185] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:55 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:55.620524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:55.623576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:55.631381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:55.639702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:55.640197 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-34d3d17a-4e82-416d-a3e0-3703dc9e8d36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1155 microversion: 2.1 time: 0.286171 Sep 07 10:05:55.642107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:55.642673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:55.645599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:55.646113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:55.650004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:55.650311 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2092/4186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:55 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1155 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:55.661224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93d35d71-3589-419b-bc02-aea8f4ee6f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b24ac8b0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:55.746884 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93d35d71-3589-419b-bc02-aea8f4ee6f4b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 200 len: 1447 microversion: 2.1 time: 0.095394 Sep 07 10:05:55.747472 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2093/4187] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:05:55 2022] GET /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:55.762905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-733c1507-531a-4d70-ac67-5595e0715abe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b097b160>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:56.420409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:56.431746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9735a41-35f9-4b42-8740-21b60b39add4 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 200 len: 1516 microversion: 2.1 time: 0.823451 Sep 07 10:05:56.432852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2095/4188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:55 2022] GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 1516 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:56.447611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:56.448873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:56.466404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:56.467611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:56.468081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:56.483964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:56.491595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:56.497923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:56.776568 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-733c1507-531a-4d70-ac67-5595e0715abe tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 204 len: 0 microversion: 2.1 time: 1.017717 Sep 07 10:05:56.777160 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2094/4189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:55 2022] DELETE /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:05:56.782247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:56.782754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:56.799599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:56.800295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:56.800926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:56.803118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:56.803751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:56.811986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:56.882133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:05:57.104164 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69d8bde2-4b0f-4fbf-a2e2-912bb9969f5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 204 len: 0 microversion: 2.1 time: 0.322640 Sep 07 10:05:57.105084 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2095/4190] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:05:56 2022] DELETE /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:05:57.123398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:57.124119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:57.132583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:57.135627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:57.136108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:57.136838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:57.137339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:57.139370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:57.662823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:57.680666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3d5c30a-2aa4-4712-8b2d-882aa8ecc708 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1173 microversion: 2.1 time: 0.574102 Sep 07 10:05:57.681401 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2096/4191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:57 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1173 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:57.686806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:57.687607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:57.705703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:57.706586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:57.707252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:57.708716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:57.709458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:57.711529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:57.748090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:05:57.890349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:57.903543 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b774fd7-c199-442e-b401-7fd64e0d37bb tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1674 microversion: 2.1 time: 1.468033 Sep 07 10:05:57.918013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2096/4192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:56 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1674 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:57.930062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33757a14-263e-42e4-8a50-627a6b08317a tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 204 len: 0 microversion: 2.1 time: 0.247146 Sep 07 10:05:57.931250 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2097/4193] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:05:57 2022] DELETE /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:05:57.936749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:57.943555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:57.960422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:57.960916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:57.973137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:57.974384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:57.975030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:57.975625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:58.195532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-379123946", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ac11c0d8-1462-4df6-b5ec-d6277d361200"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:58.327562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] validate_networks() for [('ac11c0d8-1462-4df6-b5ec-d6277d361200', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:05:59.361644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:05:59.385831 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7517f354-3fcc-452a-a2b8-ab8f8354561f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 200 len: 1522 microversion: 2.1 time: 1.466440 Sep 07 10:05:59.388475 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2097/4194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:57 2022] GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 1522 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:05:59.412242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4dc7fab8-4e8c-4dd7-9447-f5c623e297f4 req-3dde8d50-b6d5-495f-9fea-ca3096c1afcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74168d1b-4b40-480d-add9-d409e18a5490", "name": "network-vif-unplugged", "status": "completed", "tag": "03fbf564-e9a2-48e8-941f-9b647e2a9696"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:05:59.442293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4dc7fab8-4e8c-4dd7-9447-f5c623e297f4 req-3dde8d50-b6d5-495f-9fea-ca3096c1afcd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:59.443915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4dc7fab8-4e8c-4dd7-9447-f5c623e297f4 req-3dde8d50-b6d5-495f-9fea-ca3096c1afcd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:59.444555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4dc7fab8-4e8c-4dd7-9447-f5c623e297f4 req-3dde8d50-b6d5-495f-9fea-ca3096c1afcd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:59.484666 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4dc7fab8-4e8c-4dd7-9447-f5c623e297f4 req-3dde8d50-b6d5-495f-9fea-ca3096c1afcd service nova] Creating event network-vif-unplugged:03fbf564-e9a2-48e8-941f-9b647e2a9696 for instance 74168d1b-4b40-480d-add9-d409e18a5490 on n-h1-836830-16 Sep 07 10:05:59.509211 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4dc7fab8-4e8c-4dd7-9447-f5c623e297f4 req-3dde8d50-b6d5-495f-9fea-ca3096c1afcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105778 Sep 07 10:05:59.511256 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2098/4195] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:05:59.526909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:05:59.528273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:05:59.551098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:59.552570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:59.553307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:05:59.554306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:05:59.554959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:05:59.556252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:00.026429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:00.036773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27680ccc-cd93-44a6-8cb6-93058d19891e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1173 microversion: 2.1 time: 0.523010 Sep 07 10:06:00.037481 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2099/4196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:05:59 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1173 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:00.043122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:00.044021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:00.051812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:00.052590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:00.053499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:00.055206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:00.055978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:00.056648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:00.343140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:00.351883 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70a948e7-bf7a-4496-a43b-56c148fe84ae tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 200 len: 1606 microversion: 2.1 time: 0.312880 Sep 07 10:06:00.352787 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2100/4197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:00 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 1606 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:00.358006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-161000739", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c89eec50-bb9e-40af-bb53-f85977233779"}], "security_groups": [{"name": "tempest-securitygroup--696586167"}], "key_name": "tempest-keypair-1907719540", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:01.155232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:06:01.155723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:06:01.156138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:06:01.156678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:06:01.157350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:06:01.193169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.193807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.194816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:01.195579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.198072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.199795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:01.255149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:01.278625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Getting quotas for user 2e14f54af9f44dd28bab63c619816e67 and project 50af0650eb9e41d6ba3a56d33b959aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:01.326816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] validate_networks() for [('c89eec50-bb9e-40af-bb53-f85977233779', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:06:01.343912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:06:01.352466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:06:01.537609 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c91ae642-ba07-4027-9e90-be7064870c0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.347054 Sep 07 10:06:01.545642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2098/4198] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 10:06:01.553346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:01.555479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:01.575364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.575946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.576413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:01.580716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.582133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.584943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:01.778463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:01.789614 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-47a7b83f-9c2d-4430-8e6d-d40ad43bef5f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 200 len: 1480 microversion: 2.1 time: 0.247724 Sep 07 10:06:01.790236 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2099/4199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:01 2022] GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 1480 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:01.799309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-91b642f6-71fa-4b56-bcc3-47778740bc42 req-fceec78a-d43c-42e2-acd4-cca33fcc8c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74168d1b-4b40-480d-add9-d409e18a5490", "name": "network-vif-deleted", "tag": "03fbf564-e9a2-48e8-941f-9b647e2a9696"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:01.829905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-91b642f6-71fa-4b56-bcc3-47778740bc42 req-fceec78a-d43c-42e2-acd4-cca33fcc8c3a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.830345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-91b642f6-71fa-4b56-bcc3-47778740bc42 req-fceec78a-d43c-42e2-acd4-cca33fcc8c3a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.832275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-91b642f6-71fa-4b56-bcc3-47778740bc42 req-fceec78a-d43c-42e2-acd4-cca33fcc8c3a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:01.861697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-91b642f6-71fa-4b56-bcc3-47778740bc42 req-fceec78a-d43c-42e2-acd4-cca33fcc8c3a service nova] Creating event network-vif-deleted:03fbf564-e9a2-48e8-941f-9b647e2a9696 for instance 74168d1b-4b40-480d-add9-d409e18a5490 on n-h1-836830-16 Sep 07 10:06:01.874497 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-91b642f6-71fa-4b56-bcc3-47778740bc42 req-fceec78a-d43c-42e2-acd4-cca33fcc8c3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082976 Sep 07 10:06:01.881560 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2100/4200] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:01.891088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:01.892584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:01.920879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.921492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.921896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:01.928794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:01.929894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:01.930520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:02.993814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:03.048869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:03.775558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:03.785055 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-caa160fc-786b-4da2-bf23-04ae4af73b71 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1215 microversion: 2.1 time: 1.902138 Sep 07 10:06:03.801511 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2101/4201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:01 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1215 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:03.821246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:03.822065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:03.830839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:03.831531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:03.832087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:03.832995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:03.833749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:03.834450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:03.854610 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] HTTP exception thrown: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Request method failure captured: Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 HTTP/1.1 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwWOuK-lB13cpSCxrpdtK5zxqgUl4t7dsgca2ELCY9aY6vGt0mAtuLBX2E_s1OiBoJIP9CwJxceTQhFxE8qWktmp6_k6hmzYKy7CYYXtf6c1ga-XopG4wsD-stChvVsTMGePIiQktSWRG1Gel9LxBB543_KUopQ0uzWW4ci2do5o44 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_357930c7a1e64d09bac384b1c27d002c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 8ffce8dfc8c640328effeb5ae97acc66 Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '74168d1b-4b40-480d-add9-d409e18a5490'} Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:03.856995 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Returning 404 to user: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:03.861767 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-088e0845-993a-4f9a-9acc-68418eb90733 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 404 len: 111 microversion: 2.1 time: 0.055661 Sep 07 10:06:03.865928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2102/4202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:03 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:03.871534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9ca0f0f7-078d-4cb7-9a3e-83c464eb6971 req-de0e0c8a-df4d-4c63-bc94-f07eaf22f785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562530a6-06f3-449a-8a52-2bb230d832e9", "name": "network-vif-unplugged", "status": "completed", "tag": "f00be4f8-0dd4-41af-bac8-debcab8bcd8f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:03.897743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9ca0f0f7-078d-4cb7-9a3e-83c464eb6971 req-de0e0c8a-df4d-4c63-bc94-f07eaf22f785 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:03.899196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9ca0f0f7-078d-4cb7-9a3e-83c464eb6971 req-de0e0c8a-df4d-4c63-bc94-f07eaf22f785 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:03.901455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9ca0f0f7-078d-4cb7-9a3e-83c464eb6971 req-de0e0c8a-df4d-4c63-bc94-f07eaf22f785 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:03.934341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9ca0f0f7-078d-4cb7-9a3e-83c464eb6971 req-de0e0c8a-df4d-4c63-bc94-f07eaf22f785 service nova] Creating event network-vif-unplugged:f00be4f8-0dd4-41af-bac8-debcab8bcd8f for instance 562530a6-06f3-449a-8a52-2bb230d832e9 on n-h2-836830-16 Sep 07 10:06:03.943673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9ca0f0f7-078d-4cb7-9a3e-83c464eb6971 req-de0e0c8a-df4d-4c63-bc94-f07eaf22f785 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076117 Sep 07 10:06:03.945017 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2103/4203] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:03.955478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:03.964504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:03.975801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:03.976392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:03.976839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:03.977644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:03.978461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:03.978912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.205260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:06:04.205958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:06:04.210964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:06:04.211491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:06:04.212026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:06:04.218400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:04.225805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.226293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.226875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.227752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.228406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.229231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.231988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2210d92-a6a7-4442-83ad-4865291afce0 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1265 microversion: 2.1 time: 0.285353 Sep 07 10:06:04.233342 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2104/4204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:03 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:04.238966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-38157af1-7218-480f-8fcc-2aaa3cdf10e4 req-1d8bb87b-a5ad-4fe4-b5bd-e742c9e6caa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9a872b-7c5f-4b77-8dcc-28a8a00e1659", "name": "network-vif-deleted", "tag": "88938f89-c76b-47e3-ab3e-6ab6d506f4e3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:04.252788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-38157af1-7218-480f-8fcc-2aaa3cdf10e4 req-1d8bb87b-a5ad-4fe4-b5bd-e742c9e6caa6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.253028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:04.256686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-38157af1-7218-480f-8fcc-2aaa3cdf10e4 req-1d8bb87b-a5ad-4fe4-b5bd-e742c9e6caa6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.257540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-38157af1-7218-480f-8fcc-2aaa3cdf10e4 req-1d8bb87b-a5ad-4fe4-b5bd-e742c9e6caa6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.260162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for user 6cb4a2e0094a4c90ae14626b946065e1 and project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:04.275898 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-38157af1-7218-480f-8fcc-2aaa3cdf10e4 req-1d8bb87b-a5ad-4fe4-b5bd-e742c9e6caa6 service nova] Creating event network-vif-deleted:88938f89-c76b-47e3-ab3e-6ab6d506f4e3 for instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 on n-h2-836830-16 Sep 07 10:06:04.276717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:06:04.279448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:06:04.291088 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-38157af1-7218-480f-8fcc-2aaa3cdf10e4 req-1d8bb87b-a5ad-4fe4-b5bd-e742c9e6caa6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055061 Sep 07 10:06:04.293091 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2105/4205] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:04.301376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.302325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:04.315959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.317516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.319456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.323041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.325474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.327375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.373048 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] HTTP exception thrown: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 HTTP/1.1 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'bf9a872b-7c5f-4b77-8dcc-28a8a00e1659'} Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.379221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:04.383915 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.387877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 404 to user: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:04.388531 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5219f247-3df8-419c-bf21-3f81f65e3430 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 404 len: 111 microversion: 2.1 time: 0.093574 Sep 07 10:06:04.389386 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2106/4206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:04.403562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-937cd1da-9f06-4d7c-ab42-089857673d46 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '.version_select at 0x7f14b0970670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.410295 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ae3ca94-166f-4d11-b308-7c1b9adc03bf tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.048358 Sep 07 10:06:04.411481 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2101/4207] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 10:06:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 4058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 10:06:04.438843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.449682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:04.450688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:04.465269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-937cd1da-9f06-4d7c-ab42-089857673d46 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282856202" status: 202 len: 0 microversion: 2.1 time: 0.074487 Sep 07 10:06:04.469218 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2107/4208] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:06:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282856202 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:06:04.474098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.477866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.478583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.479807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.480505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.481530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c34a671-3c4f-42d0-8e52-71ad0e9b0b11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.482247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.482376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c34a671-3c4f-42d0-8e52-71ad0e9b0b11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:04.672293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9e29065d-1074-42cf-aeb0-35e8bbe0ef6e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.252646 Sep 07 10:06:04.673734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2102/4209] 10.222.0.60 () {58 vars in 1230 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:06:04.694595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-226ad512-d711-4197-854b-241c5641026b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-226ad512-d711-4197-854b-241c5641026b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 07 10:06:04.700090 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-226ad512-d711-4197-854b-241c5641026b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-226ad512-d711-4197-854b-241c5641026b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.019624 Sep 07 10:06:04.704981 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2103/4210] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:06:04.716865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.724951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:04.726227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:04.732506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.733003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.733520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.734404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.734779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.735349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.796653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:06:04.863283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d83ca7a7-397a-4f06-9ed3-8e26bdbcc75b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.149262 Sep 07 10:06:04.864767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2104/4211] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers => generated 683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:04.873667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8d28f4b8-ae6a-4fe3-a2d8-d297eb2f34f1 req-ae66cbfc-7849-459a-985d-3b1ee620aad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562530a6-06f3-449a-8a52-2bb230d832e9", "name": "network-vif-deleted", "tag": "f00be4f8-0dd4-41af-bac8-debcab8bcd8f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:04.882596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c34a671-3c4f-42d0-8e52-71ad0e9b0b11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:04.886819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8d28f4b8-ae6a-4fe3-a2d8-d297eb2f34f1 req-ae66cbfc-7849-459a-985d-3b1ee620aad6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.887301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8d28f4b8-ae6a-4fe3-a2d8-d297eb2f34f1 req-ae66cbfc-7849-459a-985d-3b1ee620aad6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.887968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8d28f4b8-ae6a-4fe3-a2d8-d297eb2f34f1 req-ae66cbfc-7849-459a-985d-3b1ee620aad6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.908050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c34a671-3c4f-42d0-8e52-71ad0e9b0b11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:04.912712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c34a671-3c4f-42d0-8e52-71ad0e9b0b11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:04.916156 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c34a671-3c4f-42d0-8e52-71ad0e9b0b11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1281 microversion: 2.20 time: 0.444881 Sep 07 10:06:04.933843 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2108/4212] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:04.941354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:04.942661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:04.957912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8d28f4b8-ae6a-4fe3-a2d8-d297eb2f34f1 req-ae66cbfc-7849-459a-985d-3b1ee620aad6 service nova] Creating event network-vif-deleted:f00be4f8-0dd4-41af-bac8-debcab8bcd8f for instance 562530a6-06f3-449a-8a52-2bb230d832e9 on n-h2-836830-16 Sep 07 10:06:04.960588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.960879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.961853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.964243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:04.969147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8d28f4b8-ae6a-4fe3-a2d8-d297eb2f34f1 req-ae66cbfc-7849-459a-985d-3b1ee620aad6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102828 Sep 07 10:06:04.970755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:04.971443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:04.972711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2105/4213] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:04.984368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.004388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.004657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.compute.servers [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Removing options 'limit' from query {{(pid=128832) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 10:06:05.007301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:05.019415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.020226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.020866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.021850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.024768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.025894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.068218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:06:05.119523 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ff417b9a-6b15-4d79-b19e-d00551b7486f tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.140266 Sep 07 10:06:05.133603 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2106/4214] 10.222.0.60 () {58 vars in 1144 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:05.148123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-508c81d2-1cf4-443f-babc-4f0dfe69c5b3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-508c81d2-1cf4-443f-babc-4f0dfe69c5b3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi '-1' Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 07 10:06:05.159109 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-508c81d2-1cf4-443f-babc-4f0dfe69c5b3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:05.163310 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-508c81d2-1cf4-443f-babc-4f0dfe69c5b3 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025923 Sep 07 10:06:05.174529 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2107/4215] 10.222.0.60 () {58 vars in 1142 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:06:05.182243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb723a0b-7025-4d21-a654-328b709d83a9 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb723a0b-7025-4d21-a654-328b709d83a9 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: action_args: {} Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'testing' Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 07 10:06:05.186138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:05.191880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb723a0b-7025-4d21-a654-328b709d83a9 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:05.194983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb723a0b-7025-4d21-a654-328b709d83a9 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.012233 Sep 07 10:06:05.198269 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2108/4216] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:06:05.208225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-77dfed62-7833-4748-913b-f940a530c3d7 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.216985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-77dfed62-7833-4748-913b-f940a530c3d7 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.217820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-77dfed62-7833-4748-913b-f940a530c3d7 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:05.230715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.compute.servers [None req-77dfed62-7833-4748-913b-f940a530c3d7 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Flavor 'non_existing_flavor' could not be found {{(pid=128832) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 07 10:06:05.232189 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-77dfed62-7833-4748-913b-f940a530c3d7 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.029361 Sep 07 10:06:05.233758 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2109/4217] 10.222.0.60 () {58 vars in 1178 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:06:05.257773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.268854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.283828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:05.291662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.293916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.294763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.295535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.299230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.300005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.428608 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30b0a4f4-950e-4d54-99dd-44d923a41e8e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.181702 Sep 07 10:06:05.429951 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2110/4218] 10.222.0.60 () {58 vars in 1174 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:06:05.435351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.436437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:05.447254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.448035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.449485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.450528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.451162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.451761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.593467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.618420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae893022-65e4-4397-b718-a291c0587978 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1265 microversion: 2.1 time: 0.185648 Sep 07 10:06:05.620513 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2111/4219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:05.627107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.632614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.633720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:05.654322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.655207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.656153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.657786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.663784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.664894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.791300 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7819e9fb-490f-466e-b447-f5c8249c4d9b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.169328 Sep 07 10:06:05.792504 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2112/4220] 10.222.0.60 () {58 vars in 1184 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:06:05.809077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.811319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.817501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.818539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:05.820805 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f89a8e4f-134b-4444-a760-6f0eabc3be48 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.898871 Sep 07 10:06:05.825994 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2109/4221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:04 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:05.836957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.846261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.847188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.848792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.849418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.850291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.890526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:06:05.944475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:05.952222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:05.952997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:05.970768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.972008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.975886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.976540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.979051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:05.979660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.983508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:05.988100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:05.988707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:06.480339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:06.508765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:06.510967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:06.512814 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6b6bf20-5ef9-4fae-ab04-f9cceee4eec6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1333 microversion: 2.20 time: 0.566222 Sep 07 10:06:06.513979 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2110/4222] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1333 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:06:06.648732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:06.650965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:06.662154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:06.662722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:06.663090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:06.667610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:06.668285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:06.669036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:06.764861 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-51c2c4f1-d525-4d36-9daa-42800d42cc9a tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.962369 Sep 07 10:06:06.766171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2113/4223] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:06:05 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:06.795811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0fb7db2-f1d7-4833-be2c-b5d8df849e16 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:06.804520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0fb7db2-f1d7-4833-be2c-b5d8df849e16 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:06.806033 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0fb7db2-f1d7-4833-be2c-b5d8df849e16 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014293 Sep 07 10:06:06.810468 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2114/4224] 10.222.0.60 () {58 vars in 1178 bytes} [Wed Sep 7 10:06:06 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 10:06:06.825511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:06.832637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:06.833939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Searching by: {'deleted': False, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:06:06.842081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:06.844826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:06.845685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:06.846695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:06.848541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:06.852854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:06.899798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:06:06.959678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d93cebf6-1873-4da4-b751-a4141e0b4a58 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.139432 Sep 07 10:06:06.960937 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2115/4225] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:06:06 2022] GET /compute/v2.1/servers => generated 683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:06.965990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:06.968167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:06.975661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:06.976420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:06.977340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:06.978242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:06.979028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:06.979705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.067023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:07.080348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-031a0ec7-9365-4a13-962b-8207552fe77d tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1265 microversion: 2.1 time: 0.435448 Sep 07 10:06:07.082421 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2111/4226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:06 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1265 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:07.100344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:07.102562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:07.113562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.114973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.116363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.117536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.118981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.119633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.138657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] HTTP exception thrown: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 HTTP/1.1 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'bf9a872b-7c5f-4b77-8dcc-28a8a00e1659'} Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:07.156097 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 404 to user: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9458e49-b8a4-473c-8cab-563444ca4abc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 404 len: 111 microversion: 2.1 time: 0.075786 Sep 07 10:06:07.161991 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2112/4227] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:07 2022] DELETE /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:07.171921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:07.172950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:07.187336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.189025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.191915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.192902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.193786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.194382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.234666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:06:07.242185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:07.356855 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b5a78de-297f-4956-ad5f-a29a331b8173 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "DELETE /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a" status: 204 len: 0 microversion: 2.1 time: 0.189456 Sep 07 10:06:07.360552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2113/4228] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:07 2022] DELETE /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:06:07.372591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:07.373683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:07.382977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.384517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.385132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.386441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.387690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.388289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.426938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:06:07.566933 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-186e6434-2b51-4125-a1c6-92678547cb2e tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "DELETE /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 204 len: 0 microversion: 2.1 time: 0.200703 Sep 07 10:06:07.570707 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2114/4229] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:07 2022] DELETE /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:06:07.573707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:07.574688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:07.587923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:07.602503 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12afbedd-418f-4c70-b360-e214ec25cfbc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.640218 Sep 07 10:06:07.605363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.606094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.606686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.606808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2116/4230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:06 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:07.621441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:07.622480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: bf9a872b-7c5f-4b77-8dcc-28a8a00e1659] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:07.627097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.629084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.629084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.639936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.643703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.644333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.645277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.648204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.648906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.661362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:07.699695 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] HTTP exception thrown: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 HTTP/1.1 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'bf9a872b-7c5f-4b77-8dcc-28a8a00e1659'} Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.708994 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. Sep 07 10:06:07.713432 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:07.714865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 404 to user: Instance bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:07.715893 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9c765e81-1fc9-4f7e-a29f-3c54c890f12b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659" status: 404 len: 111 microversion: 2.1 time: 0.108118 Sep 07 10:06:07.722725 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2117/4231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:07 2022] GET /compute/v2.1/servers/bf9a872b-7c5f-4b77-8dcc-28a8a00e1659 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:07.731119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:07.731737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:07.744544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.745301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.745928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.747385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.748005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.748580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.850429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:07.858581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:07.860495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:07.861795 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7bf540a9-6573-4446-8e34-703b0097ed7b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1339 microversion: 2.20 time: 0.293180 Sep 07 10:06:07.862779 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2115/4232] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:07 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1339 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:07.867738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0d19d372-3202-4f20-9d99-5187b8d03979 req-b1e0e937-0194-4f17-90fa-c5ed66f2ae44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6dc32a-d00c-493b-b9ac-383f2e03e3d0", "tag": "13d037e6-2037-4c8e-9875-946fd94ef329"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:07.878840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0d19d372-3202-4f20-9d99-5187b8d03979 req-b1e0e937-0194-4f17-90fa-c5ed66f2ae44 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:07.879422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0d19d372-3202-4f20-9d99-5187b8d03979 req-b1e0e937-0194-4f17-90fa-c5ed66f2ae44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:07.880397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0d19d372-3202-4f20-9d99-5187b8d03979 req-b1e0e937-0194-4f17-90fa-c5ed66f2ae44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:07.893024 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0d19d372-3202-4f20-9d99-5187b8d03979 req-b1e0e937-0194-4f17-90fa-c5ed66f2ae44 service nova] Creating event network-changed:13d037e6-2037-4c8e-9875-946fd94ef329 for instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 on n-h2-836830-16 Sep 07 10:06:07.898664 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0d19d372-3202-4f20-9d99-5187b8d03979 req-b1e0e937-0194-4f17-90fa-c5ed66f2ae44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Sep 07 10:06:07.899953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2116/4233] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:08.112912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:08.114824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:08.122776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:08.123578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:08.124379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:08.126929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:08.127517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:08.128054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:08.246963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:08.277688 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5fadc73a-1fc2-4bc5-9658-e856f5cb2ec6 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a" status: 200 len: 1523 microversion: 2.1 time: 0.550619 Sep 07 10:06:08.279599 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2118/4234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:07 2022] GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a => generated 1523 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:08.295532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4c885da-07d4-4b2e-9c49-96249d57bf95 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: .version_select at 0x7f14b0aa7a60>, body: {"keypair": {"name": "tempest-keypair-502452951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHPsTPNhl9pPedNpj88CBwidEvHgee2nU9eEohGJTw9u9c6VooaguMI6Pljr4dw6tS+7gY9zo55MF4v7G0/tgNw4DmyJXhfDShuBkhRrpBU67DXMq5gJBFRzsglKUxVzw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:08.318675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e4c885da-07d4-4b2e-9c49-96249d57bf95 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for project 357930c7a1e64d09bac384b1c27d002c. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:08.325634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e4c885da-07d4-4b2e-9c49-96249d57bf95 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for user 8ffce8dfc8c640328effeb5ae97acc66 and project 357930c7a1e64d09bac384b1c27d002c. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:08.362827 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4c885da-07d4-4b2e-9c49-96249d57bf95 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079247 Sep 07 10:06:08.364065 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2119/4235] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:08.379761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:08.391677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74f526fe-7821-4393-bba0-257609b4b886 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 0.290538 Sep 07 10:06:08.392383 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2117/4236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:08 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:08.640948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:08.647904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:08.658327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:08.659325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:08.659980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:08.660982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:08.661692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:08.662356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:08.896769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:08.897991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:08.911529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:08.912355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:08.912944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:08.913860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:08.914537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:08.915149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:09.094019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:09.118158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:09.128915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:09.133902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d371e55d-5e47-4e72-b245-10803b8bccc3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1339 microversion: 2.20 time: 0.243259 Sep 07 10:06:09.137683 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2118/4237] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:08 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:09.304542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:09.305079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:09.306872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:09.315530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:09.316034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:09.316176 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87e29ecb-bfd5-4fa8-a166-deb839a3b36c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.687965 Sep 07 10:06:09.316478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:09.321799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:09.322468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:09.323068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:09.329515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2120/4238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:08 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:09.418826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:09.419440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:09.425933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:09.426418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:09.426852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:09.427689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:09.428202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:09.428624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:10.221930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:10.244587 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0cb89e7f-51a2-4846-9b81-6c580b7a911b tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a" status: 200 len: 1523 microversion: 2.1 time: 0.944056 Sep 07 10:06:10.261392 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2119/4239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:09 2022] GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a => generated 1523 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:10.273068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:10.274134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:10.279608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:10.283685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:10.284287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:10.285634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:10.287054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:10.287629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:10.288165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:10.291716 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2bbf1ef-91db-4943-8351-7f3385ddb723 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 0.876955 Sep 07 10:06:10.292983 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2121/4240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:09 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:10.345818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:10.347144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:10.353773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:10.354349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:10.354867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:10.355657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:10.356189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:10.356835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:10.490436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:10.499226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:10.500994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:10.502379 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e64cdf5-6d84-4a70-bab1-ffc4bdd72187 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1339 microversion: 2.20 time: 0.235626 Sep 07 10:06:10.503464 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2120/4241] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:10 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:10.747030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cf8f5887-b665-457e-9c64-f317c09a21ae req-9da53b77-434a-4543-848b-52849fa78e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a", "name": "network-vif-deleted", "tag": "baad93c0-8311-4f25-9b2c-f62d94aab75d"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:10.760897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf8f5887-b665-457e-9c64-f317c09a21ae req-9da53b77-434a-4543-848b-52849fa78e31 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:10.761419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf8f5887-b665-457e-9c64-f317c09a21ae req-9da53b77-434a-4543-848b-52849fa78e31 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:10.761856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf8f5887-b665-457e-9c64-f317c09a21ae req-9da53b77-434a-4543-848b-52849fa78e31 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:10.799838 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cf8f5887-b665-457e-9c64-f317c09a21ae req-9da53b77-434a-4543-848b-52849fa78e31 service nova] Creating event network-vif-deleted:baad93c0-8311-4f25-9b2c-f62d94aab75d for instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a on n-h1-836830-16 Sep 07 10:06:10.814697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cf8f5887-b665-457e-9c64-f317c09a21ae req-9da53b77-434a-4543-848b-52849fa78e31 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071368 Sep 07 10:06:10.819807 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2121/4242] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:06:11.270302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:11.277835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:11.278958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:11.292472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.293058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.293610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.295427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.296710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.298155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.376435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:11.385017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.385698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.386391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.386654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lazy-loading 'fault' on Instance uuid 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:06:11.533749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:11.550942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4a930fc-d3d5-4f81-9407-ddf1f618ece3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 1.209725 Sep 07 10:06:11.551808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2122/4243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:10 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:11.554757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '079702fbce6f4dcfaed9a35f35a6b086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657b9590df5f4f2bbb688a3bf863ad8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:11.585494 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf9de747-a829-4222-86c3-fa7aafaaa907 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a" status: 200 len: 1313 microversion: 2.1 time: 0.313820 Sep 07 10:06:11.587285 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2122/4244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:11 2022] GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:11.590120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:11.592540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:11.607199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.608138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.609153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:11.609817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.611799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.612223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.612843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.616001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:11.628999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.631196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.634598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.635773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:11.636515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:11.637220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:11.913943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:11.923255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:11.924754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:11.926097 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-32b49728-4664-4656-9c65-229fb74c4b03 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1339 microversion: 2.20 time: 0.336821 Sep 07 10:06:11.926838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2123/4245] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:11 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1339 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:12.168872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cc59ca08-1889-4440-bdf0-bd540ab2a768 req-705b857d-e54f-4501-85f7-7ddbbb72a0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2436780-2c79-45ff-a3db-ddbca646ac20", "tag": "8659ac32-6784-4fab-989a-78a503004d0b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:12.180523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc59ca08-1889-4440-bdf0-bd540ab2a768 req-705b857d-e54f-4501-85f7-7ddbbb72a0ec service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.181765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc59ca08-1889-4440-bdf0-bd540ab2a768 req-705b857d-e54f-4501-85f7-7ddbbb72a0ec service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.182237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc59ca08-1889-4440-bdf0-bd540ab2a768 req-705b857d-e54f-4501-85f7-7ddbbb72a0ec service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.207977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cc59ca08-1889-4440-bdf0-bd540ab2a768 req-705b857d-e54f-4501-85f7-7ddbbb72a0ec service nova] Creating event network-changed:8659ac32-6784-4fab-989a-78a503004d0b for instance c2436780-2c79-45ff-a3db-ddbca646ac20 on n-h1-836830-16 Sep 07 10:06:12.217865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cc59ca08-1889-4440-bdf0-bd540ab2a768 req-705b857d-e54f-4501-85f7-7ddbbb72a0ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054370 Sep 07 10:06:12.219847 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2124/4246] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:12.579323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:12.580692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:12.589919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.590406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.590849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.591549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.592024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.592448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.711243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:12.722060 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9546089-03d1-42ba-9030-322c1e40ed05 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 1.168605 Sep 07 10:06:12.722722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2123/4247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:11 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:12.728558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:12.729511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:12.736490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.737268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.737955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.738723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.739387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.739890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.755949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] HTTP exception thrown: Instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a could not be found. Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a HTTP/1.1 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a could not be found. Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a'} Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a could not be found. Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a could not be found. Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.757884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a could not be found. Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 404 to user: Instance 11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:12.763034 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d59a33f5-f06a-41d4-9fce-81c03a7326cc tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a" status: 404 len: 111 microversion: 2.1 time: 0.035285 Sep 07 10:06:12.764271 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2124/4248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:12 2022] GET /compute/v2.1/servers/11190c73-2694-4ac0-a6c2-fb8bb3f5dd4a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:12.769580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:12.770414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] [instance: 743be1f0-3e60-4f9e-875e-a6646fe44197] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:12.776646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.777136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.777633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.778328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.778787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.779215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.795374 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] HTTP exception thrown: Instance 743be1f0-3e60-4f9e-875e-a6646fe44197 could not be found. Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Request method failure captured: Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 HTTP/1.1 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzcaInkQvBawU6CMaWjy4jBNBYUvAESqG_8ycOR_Y8D6E17--hUPw_S5p9vtPO5uOUhGAwP98-KQNi4L7Ma_YpK37pYBhBx-luNiR4UzvRl_-SSXC8Z78-gRH-2K_HvVDM_xEimOtMSDlqWZzMudN0XnaiH88CjCVlbsLk-N_CnUf8 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/657b9590df5f4f2bbb688a3bf863ad8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_657b9590df5f4f2bbb688a3bf863ad8b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 657b9590df5f4f2bbb688a3bf863ad8b Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-553959592 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 079702fbce6f4dcfaed9a35f35a6b086 Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ListServersNegativeTestJSON-553959592-project Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 743be1f0-3e60-4f9e-875e-a6646fe44197 could not be found. Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '743be1f0-3e60-4f9e-875e-a6646fe44197'} Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743be1f0-3e60-4f9e-875e-a6646fe44197 could not be found. Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743be1f0-3e60-4f9e-875e-a6646fe44197 could not be found. Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.797750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743be1f0-3e60-4f9e-875e-a6646fe44197 could not be found. Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] Returning 404 to user: Instance 743be1f0-3e60-4f9e-875e-a6646fe44197 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-587b70df-e5cd-462e-818d-854244452034 tempest-ListServersNegativeTestJSON-553959592 tempest-ListServersNegativeTestJSON-553959592-project] 10.222.0.60 "GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197" status: 404 len: 111 microversion: 2.1 time: 0.034426 Sep 07 10:06:12.802800 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2125/4249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:12 2022] GET /compute/v2.1/servers/743be1f0-3e60-4f9e-875e-a6646fe44197 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:12.866927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4eb7c5dd-79f2-4437-9fc6-e8f673824910 req-b162fe96-5485-4ab1-9d66-f533f6f780a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743be1f0-3e60-4f9e-875e-a6646fe44197", "name": "network-vif-deleted", "tag": "117dd742-3a65-42c1-9c43-3d13418b5261"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:12.883032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4eb7c5dd-79f2-4437-9fc6-e8f673824910 req-b162fe96-5485-4ab1-9d66-f533f6f780a7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.886844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4eb7c5dd-79f2-4437-9fc6-e8f673824910 req-b162fe96-5485-4ab1-9d66-f533f6f780a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.887293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4eb7c5dd-79f2-4437-9fc6-e8f673824910 req-b162fe96-5485-4ab1-9d66-f533f6f780a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.907876 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4eb7c5dd-79f2-4437-9fc6-e8f673824910 req-b162fe96-5485-4ab1-9d66-f533f6f780a7 service nova] Creating event network-vif-deleted:117dd742-3a65-42c1-9c43-3d13418b5261 for instance 743be1f0-3e60-4f9e-875e-a6646fe44197 on n-h2-836830-16 Sep 07 10:06:12.934366 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4eb7c5dd-79f2-4437-9fc6-e8f673824910 req-b162fe96-5485-4ab1-9d66-f533f6f780a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075688 Sep 07 10:06:12.935023 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2126/4250] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:06:12.953306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:12.954731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:12.956884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:12.974243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.974744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.975188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:12.975903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:12.976363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:12.976790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:13.400129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:13.424127 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a4d7391-b3c2-4e58-8e23-f250469339fc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.849937 Sep 07 10:06:13.425367 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2125/4251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:12 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:13.677299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:13.678606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:13.685824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:13.686319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:13.686754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:13.687459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:13.688003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:13.688603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:13.718671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:13.732059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:13.733707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:13.735622 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-24b99029-e2da-46a6-8fc6-cf147d997911 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 0.786913 Sep 07 10:06:13.736366 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2127/4252] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:12 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:13.747418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:13.748346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:13.757387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:13.758317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:13.758860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:13.759668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:13.761057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:13.761696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:14.545563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:14.556222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c64cdd4-4111-4ba0-a596-51d9a4419eb5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 0.815794 Sep 07 10:06:14.562287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:14.572160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2128/4253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:13 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:14.578169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5e4f7a58-da9a-4116-8ccc-961f3a4f7cdd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.904646 Sep 07 10:06:14.579789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:14.580857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:14.587314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:14.587941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:14.588481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:14.589517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:14.590079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:14.590613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:14.594561 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2126/4254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:13 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:14.611425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:14.612853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:14.621707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:14.622778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:14.623469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:14.624959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:14.626263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:14.626922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:14.901339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:15.535741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:15.545598 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-42ddebd6-f877-46a4-a52e-921b3fe0b13a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.972085 Sep 07 10:06:15.546347 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2129/4255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:14 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:15.552603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:15.553602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:15.560255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:15.561005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:15.561755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:15.563328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:15.564049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:15.564581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:15.652953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:15.662424 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74126775-c3d9-42f1-8bbc-d74553f2edf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.060999 Sep 07 10:06:15.663309 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2127/4256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:14 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:15.668831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:15.669714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:15.692086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:15.693702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:15.694257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:15.695266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:15.695849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:15.696488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:16.304212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:16.318014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:16.322778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:16.326122 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87f12f34-4bfd-4e2f-8035-d17b24fdd195 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 0.778262 Sep 07 10:06:16.326715 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2130/4257] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:15 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:16.338743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:16.341841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:16.355542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:16.358237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:16.360409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:16.363504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:16.365640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:16.367985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:16.633374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:16.639662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:16.651334 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd79e70f-c1b5-4cd1-b4ef-9cf4c2b02af5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 0.984069 Sep 07 10:06:16.663809 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2128/4258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:15 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:16.682117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:16.698271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:16.716968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:16.723251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:16.723761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:16.725171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:16.726530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:16.726966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:16.880049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:17.030724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:17.039853 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4521f5a2-ddfa-46dd-aabd-d65a82c6a7a3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.705733 Sep 07 10:06:17.040450 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2131/4259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:16 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:17.057309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1831685079", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e09fd04b-8409-45b6-802a-0ddc09260d65"}], "security_groups": [{"name": "tempest-securitygroup--1877127926"}], "key_name": "tempest-keypair-502452951", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:17.464729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] validate_networks() for [('e09fd04b-8409-45b6-802a-0ddc09260d65', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:06:17.556073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:17.567332 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ee7ac12-c0ee-49f4-86ca-64eac4b44eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.901905 Sep 07 10:06:17.571294 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2129/4260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:16 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:17.582390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-339514476"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:17.588287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:17.606785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:17.608175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:17.611114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:17.622568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:17.623487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:17.627633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:18.034715 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18c9b05a-d813-45f5-8818-6761a11eb607 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.461096 Sep 07 10:06:18.049542 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2130/4261] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:06:17 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 07 10:06:18.059434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:18.060653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:18.072327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:18.073275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:18.075062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:18.087759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:18.091615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:18.092418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:18.336212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:19.318175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:19.345975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:19.347902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:19.350441 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3110e270-85de-4056-a77c-151068390aae tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 1.299154 Sep 07 10:06:19.373580 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2131/4262] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:18 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:19.380877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:19.388203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:19.409447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:19.412280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:19.413462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:19.417820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:19.430839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:19.431301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:19.904192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:19.912771 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f430551-8b45-48b6-be4c-a5a262bea459 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 0.537910 Sep 07 10:06:19.913371 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2132/4263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:19 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:19.917988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fb624a44-d8c2-4ed3-85e3-b3972cde985d req-84ab198f-f026-48bd-8d25-ab52c8838c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:19.934859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fb624a44-d8c2-4ed3-85e3-b3972cde985d req-84ab198f-f026-48bd-8d25-ab52c8838c00 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:19.935486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fb624a44-d8c2-4ed3-85e3-b3972cde985d req-84ab198f-f026-48bd-8d25-ab52c8838c00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:19.936073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fb624a44-d8c2-4ed3-85e3-b3972cde985d req-84ab198f-f026-48bd-8d25-ab52c8838c00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:19.949785 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fb624a44-d8c2-4ed3-85e3-b3972cde985d req-84ab198f-f026-48bd-8d25-ab52c8838c00 service nova] Creating event network-changed:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h2-836830-16 Sep 07 10:06:19.957741 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fb624a44-d8c2-4ed3-85e3-b3972cde985d req-84ab198f-f026-48bd-8d25-ab52c8838c00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042607 Sep 07 10:06:19.958820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2133/4264] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:19.964850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:19.966287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:19.973774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:19.974670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:19.975338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:19.976637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:19.977523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:19.978213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.374781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:06:20.375920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:06:20.376075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:06:20.376471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:06:20.376798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:06:20.394402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.395088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.395857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.397325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.397977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.398917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.425039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for project 357930c7a1e64d09bac384b1c27d002c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:20.445058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Getting quotas for user 8ffce8dfc8c640328effeb5ae97acc66 and project 357930c7a1e64d09bac384b1c27d002c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:20.462656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:06:20.464983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:06:20.519778 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-588ebd27-d389-41c2-b77d-a384cacdc736 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.475564 Sep 07 10:06:20.520899 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2132/4265] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:06:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:06:20.612064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:20.626318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36726b2b-4e2b-483b-9e7c-8b470469fec9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.664711 Sep 07 10:06:20.629427 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2134/4266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:19 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:20.652083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-84a6e5a1-1e1d-4023-b007-8e5e3d54302a req-cc937fbc-ad93-43d1-bfb9-e44062834f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2436780-2c79-45ff-a3db-ddbca646ac20", "name": "network-vif-plugged", "status": "completed", "tag": "8659ac32-6784-4fab-989a-78a503004d0b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:20.665422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-84a6e5a1-1e1d-4023-b007-8e5e3d54302a req-cc937fbc-ad93-43d1-bfb9-e44062834f78 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.666143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-84a6e5a1-1e1d-4023-b007-8e5e3d54302a req-cc937fbc-ad93-43d1-bfb9-e44062834f78 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.666796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-84a6e5a1-1e1d-4023-b007-8e5e3d54302a req-cc937fbc-ad93-43d1-bfb9-e44062834f78 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.682017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-84a6e5a1-1e1d-4023-b007-8e5e3d54302a req-cc937fbc-ad93-43d1-bfb9-e44062834f78 service nova] Creating event network-vif-plugged:8659ac32-6784-4fab-989a-78a503004d0b for instance c2436780-2c79-45ff-a3db-ddbca646ac20 on n-h1-836830-16 Sep 07 10:06:20.687558 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-84a6e5a1-1e1d-4023-b007-8e5e3d54302a req-cc937fbc-ad93-43d1-bfb9-e44062834f78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039803 Sep 07 10:06:20.690062 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2135/4267] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:20.700389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:20.702147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:20.722062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.726839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.727525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.729945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.731546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.733329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.813859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-802004180", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:20.950915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:06:20.951532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:06:20.952026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:06:20.952442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:06:20.952858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:06:20.975518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.977128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.977831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:20.978808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:20.979491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:20.980326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:21.014733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Getting quotas for project 6cafbde6f8244130a239230c0627217b. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:21.022265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Getting quotas for user 03507369f02748818afad0434a2e3e14 and project 6cafbde6f8244130a239230c0627217b. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:21.039162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:06:21.042247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:06:21.100557 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8262d24c-7e44-4417-a6c4-5c67522407a5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.578134 Sep 07 10:06:21.101848 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2133/4268] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 10:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 10:06:21.115776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9386544a-f87b-4181-9f45-f12ac214fb1b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:21.117380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9386544a-f87b-4181-9f45-f12ac214fb1b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:21.237040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9386544a-f87b-4181-9f45-f12ac214fb1b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.262091 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9386544a-f87b-4181-9f45-f12ac214fb1b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1237 microversion: 2.1 time: 0.156664 Sep 07 10:06:21.266177 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2134/4269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:21 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1237 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:21.293214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:21.293214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:21.306039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:21.309501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:21.311221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:21.311998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:21.314750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:21.315225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:21.679360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.706468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.709321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.715499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f314284-89ab-42a8-b7e4-0edd61e5dfc7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 1.023509 Sep 07 10:06:21.718036 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2136/4270] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:20 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:21.728596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b316c8b1-91e0-4577-befd-11cb8884a693 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:21.729343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b316c8b1-91e0-4577-befd-11cb8884a693 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:21.913648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b316c8b1-91e0-4577-befd-11cb8884a693 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.927211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b316c8b1-91e0-4577-befd-11cb8884a693 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.930158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b316c8b1-91e0-4577-befd-11cb8884a693 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:21.935593 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b316c8b1-91e0-4577-befd-11cb8884a693 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1277 microversion: 2.57 time: 0.214805 Sep 07 10:06:21.947444 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2137/4271] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:21 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:21.966130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:21.967005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:21.975869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:21.976727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:21.977441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:21.978723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:21.979538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:21.980120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:22.269350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:22.279486 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b2b0e83-2a30-45bf-937d-8138092d6a0b tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1307 microversion: 2.1 time: 1.011873 Sep 07 10:06:22.280072 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2135/4272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:21 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1307 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:22.294827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:22.295290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:22.333342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:22.334681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:22.336628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:22.337721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:22.338551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:22.340628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:22.644336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:22.665171 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c95e7c3-c4e9-449a-abb0-3079c537c041 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1289 microversion: 2.1 time: 0.374566 Sep 07 10:06:22.667532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2136/4273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:22 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1289 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:22.750886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:22.751776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:22.771625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:22.772125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:22.772570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:22.778934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:22.780744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:22.782404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:23.025480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:23.036602 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e08df849-e04d-4280-9763-4d4ba032fb7e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 1.074690 Sep 07 10:06:23.037860 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2138/4274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:21 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:23.065550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:23.067142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:23.082046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:23.082966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:23.084049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:23.084990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:23.085987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:23.086853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:23.738098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:23.751888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:23.759419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:23.760899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-947ffcf7-35f1-499d-82e3-b6bf734f4e71 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1329 microversion: 2.57 time: 0.721781 Sep 07 10:06:23.765981 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2139/4275] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:23 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1329 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:23.791659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:23.806343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:23.835610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:23.838928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:23.839609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:23.843071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:23.845089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:23.847962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:24.587608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:24.610228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:24.611956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:24.613147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-047221f8-8833-47d5-9ae7-2bc7df8784d9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 1.869051 Sep 07 10:06:24.613727 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2137/4276] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:22 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:06:24.655183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:24.671622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:24.696813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:24.704012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:24.704805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:24.705746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:24.710016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:24.710714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:24.849096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:24.862896 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88f5f53c-32b8-4b1c-a9dd-6ac4fbd2affd tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1486 microversion: 2.1 time: 1.078115 Sep 07 10:06:24.870777 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2140/4277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:23 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1486 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:24.883397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:24.913661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:24.928753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:24.931841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:24.936552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:24.938189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:24.939133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:24.940363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:24.964841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:24.977354 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fa05ea4f-1c6b-4c69-a638-4e77df72c3e7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1295 microversion: 2.1 time: 0.325896 Sep 07 10:06:24.983555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2138/4278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:24 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1295 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:25.014329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:25.018327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:25.032426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:25.038713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:25.039497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:25.040375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:25.040859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:25.041326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:25.294185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:25.301244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:25.304205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:25.305769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:25.306958 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62e8eb2c-5175-42e1-8511-8d3cc65e7027 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1335 microversion: 2.57 time: 0.309442 Sep 07 10:06:25.307518 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2139/4279] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:24 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1335 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:25.317347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1099327645"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:25.324562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:25.349199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:25.350074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:25.350711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:25.351605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:25.352249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:25.352869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:25.781119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:25.818517 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b9df119-5a8e-4652-9bde-50a90380ceff tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "POST /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20/action" status: 202 len: 0 microversion: 2.1 time: 0.509348 Sep 07 10:06:25.819216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2140/4280] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:06:25 2022] POST /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 10:06:25.829434 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7d51457-936a-435d-b6e2-a493cf0fc13b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.954803 Sep 07 10:06:25.831319 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2141/4281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:24 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:25.847615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:25.851795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:25.859386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ef98687-cf2b-4ac8-8ff4-edf3a398c4db tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09289d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:25.869392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:25.872164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:25.872960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:25.880682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:25.881756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:25.884818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:26.000812 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ef98687-cf2b-4ac8-8ff4-edf3a398c4db tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97" status: 200 len: 1412 microversion: 2.1 time: 0.167118 Sep 07 10:06:26.001892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2142/4282] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:06:25 2022] GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:26.024632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:26.035192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:26.058551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:26.060363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:26.061807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:26.066315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:26.068769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:26.070503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:26.288587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:26.316182 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7dd1f360-ec23-424a-85fd-92f3974f9168 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1295 microversion: 2.1 time: 0.305147 Sep 07 10:06:26.322300 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2143/4283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:26 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1295 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:26.363400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4751958b-1d8b-4434-86db-b669f9abd5f4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09f8dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:26.435787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:26.452579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:26.455391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:26.456724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41576be8-d190-4ee0-8cc6-ccdb8ce638f4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 0.636090 Sep 07 10:06:26.459485 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2141/4284] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:25 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:26.483129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:26.504580 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4751958b-1d8b-4434-86db-b669f9abd5f4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97" status: 200 len: 1412 microversion: 2.1 time: 0.157820 Sep 07 10:06:26.506109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:26.507394 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2144/4285] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:06:26 2022] GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:26.525969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b859a23-727e-453d-9ffb-d75e9cef68e3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b091e5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:26.529676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:26.534010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:26.534729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:26.538404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:26.539091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:26.540864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:26.852214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b859a23-727e-453d-9ffb-d75e9cef68e3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97" status: 204 len: 0 microversion: 2.1 time: 0.334656 Sep 07 10:06:26.852675 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2145/4286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:26 2022] DELETE /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:06:26.858688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:26.859252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:26.870489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:26.871154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:26.871416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:26.872131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:26.872590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:26.873018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:27.018671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:27.027459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:27.028861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:27.037686 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57117a05-a3b1-4772-b542-953a1f029895 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1335 microversion: 2.57 time: 0.558205 Sep 07 10:06:27.038305 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2142/4287] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:26 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1335 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:27.070753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-271bf22e-1900-4fff-acc1-1d33fb848a09 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b0b1f550>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:27.128760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-271bf22e-1900-4fff-acc1-1d33fb848a09 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Image not found. Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-271bf22e-1900-4fff-acc1-1d33fb848a09 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 HTTP/1.1 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5311898c-e540-4777-a5dd-0ee042fb3f97'} Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5311898c-e540-4777-a5dd-0ee042fb3f97 Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 10:06:27.131401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5311898c-e540-4777-a5dd-0ee042fb3f97 could not be found. Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-271bf22e-1900-4fff-acc1-1d33fb848a09 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:27.136114 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-271bf22e-1900-4fff-acc1-1d33fb848a09 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97" status: 404 len: 62 microversion: 2.1 time: 0.078628 Sep 07 10:06:27.145811 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2143/4288] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 7 10:06:27 2022] GET /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:06:27.154486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:27.156136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:27.174429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:27.175624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:27.191801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:27.196895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:27.202481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:27.206665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:27.647034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:27.659027 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a070666-a9e1-4d71-a103-ee83ab15b910 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1504 microversion: 2.1 time: 0.519594 Sep 07 10:06:27.664401 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2144/4289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:27 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:27.672712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:27.677867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:27.693026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:27.700483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:27.704131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:27.707965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:27.708821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:27.711538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:27.994287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.006697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3552c0e9-7553-4fb4-8abd-4c8cb2c5abd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 1.152600 Sep 07 10:06:28.013119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.022926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2146/4290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:26 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:28.023718 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bac22d9c-1988-49b1-a3ed-124e43984815 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1295 microversion: 2.1 time: 0.356096 Sep 07 10:06:28.047633 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2145/4291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:27 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1295 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:28.056876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:28.059244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:28.066224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.067025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.067750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-cf0b2494-dd38-42a2-9c78-5c122cdc06f6 req-6fefc563-a7fc-485c-9a4d-9ea574083744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-plugged", "status": "completed", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:28.067890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.068822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.069749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.070444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.081239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf0b2494-dd38-42a2-9c78-5c122cdc06f6 req-6fefc563-a7fc-485c-9a4d-9ea574083744 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.090380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf0b2494-dd38-42a2-9c78-5c122cdc06f6 req-6fefc563-a7fc-485c-9a4d-9ea574083744 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.092961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf0b2494-dd38-42a2-9c78-5c122cdc06f6 req-6fefc563-a7fc-485c-9a4d-9ea574083744 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.125391 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-cf0b2494-dd38-42a2-9c78-5c122cdc06f6 req-6fefc563-a7fc-485c-9a4d-9ea574083744 service nova] Creating event network-vif-plugged:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:06:28.146187 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-cf0b2494-dd38-42a2-9c78-5c122cdc06f6 req-6fefc563-a7fc-485c-9a4d-9ea574083744 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094584 Sep 07 10:06:28.149878 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2146/4292] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:28.168631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:28.175581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:28.197426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.197868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.200478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.204005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.204803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.205466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.396677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.423722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.427129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.430784 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4120b932-bff8-4cab-a60d-936e57c8c78b tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1356 microversion: 2.57 time: 0.278313 Sep 07 10:06:28.432749 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2147/4293] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:28 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1356 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:28.476456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:28.483052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:28.499104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.500622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.501312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.506559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.512453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.517324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.640254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.669610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.671880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:28.673247 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-481526b2-cd89-4e7f-855a-cb19f2620ddb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 0.645678 Sep 07 10:06:28.680035 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2147/4294] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:28 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:28.707008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:28.709624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:28.720410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.721153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.721761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.722728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.723342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.724527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.741644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:06:28.742104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:06:28.742601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:06:28.743972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:06:28.744391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:06:28.872194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:28.880399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.880898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.881505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.882273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.882730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.883154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.915725 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f2d224b-5a45-4842-98e8-51f0cc908377 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "POST /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951/action" status: 202 len: 1137 microversion: 2.57 time: 0.456807 Sep 07 10:06:28.929224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2148/4295] 10.222.0.60 () {62 vars in 1320 bytes} [Wed Sep 7 10:06:28 2022] POST /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951/action => generated 1137 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 10:06:28.950130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:28.952906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:28.972617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.974865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.976573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:28.980657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:28.982475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:28.983168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:29.194715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:29.204660 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30fa3219-5268-4458-8b80-9547632ed5f8 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1499 microversion: 2.1 time: 0.516965 Sep 07 10:06:29.210334 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2148/4296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:28 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1499 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:29.215363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:29.220312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:29.245939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:29.247762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:29.248652 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-43bd80cc-8dd5-440e-8684-09ce815835b1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.313004 Sep 07 10:06:29.254149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:29.263262 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2149/4297] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:28 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:29.271030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:29.274699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:29.275177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:29.275911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:29.276688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:29.277131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:29.280205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:29.282978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:29.303439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:29.303941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:29.308966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:29.312265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:29.313072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:29.318359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:29.358688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:30.422653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:30.450794 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8a0b1d6-a50d-45b8-8c17-2bbf5ab00969 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 1.239071 Sep 07 10:06:30.486334 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2149/4298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:29 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:30.509678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:30.511397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:30.530625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:30.532101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:30.535407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:30.538802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:30.541634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:30.544251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:30.884592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:30.898612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d4e08e2-e679-4af8-91bf-d1032083de9c tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 1.631891 Sep 07 10:06:30.898612 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2150/4299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:29 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:30.927036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:30.927591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:30.940155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:30.947218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:30.947790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:30.948558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:30.949131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:30.949855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.013611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:31.259105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:31.325542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.336318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.350254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.351829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b83e0574-7b46-4b4d-83e2-467e05a275df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 0.864027 Sep 07 10:06:31.352636 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2150/4300] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:30 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:31.359866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:31.366082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:31.380163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.381273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.381995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.382956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.384260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.385321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.524571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.536197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.538437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.540050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f368569a-aa59-40a2-93b0-6b2d4b9ebdc5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.186129 Sep 07 10:06:31.541019 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2151/4301] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:31 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:31.548204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-baa6207a-5018-409d-92df-6492420efae5 req-8cb36734-a080-41b0-a2c0-f79fd4bcd34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "name": "network-vif-plugged", "status": "completed", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:31.560298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-baa6207a-5018-409d-92df-6492420efae5 req-8cb36734-a080-41b0-a2c0-f79fd4bcd34c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.561569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-baa6207a-5018-409d-92df-6492420efae5 req-8cb36734-a080-41b0-a2c0-f79fd4bcd34c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.562238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-baa6207a-5018-409d-92df-6492420efae5 req-8cb36734-a080-41b0-a2c0-f79fd4bcd34c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.595409 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-baa6207a-5018-409d-92df-6492420efae5 req-8cb36734-a080-41b0-a2c0-f79fd4bcd34c service nova] Creating event network-vif-plugged:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h2-836830-16 Sep 07 10:06:31.606713 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-baa6207a-5018-409d-92df-6492420efae5 req-8cb36734-a080-41b0-a2c0-f79fd4bcd34c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064073 Sep 07 10:06:31.610587 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2152/4302] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:31.621218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:31.626672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:31.633348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:31.642603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.645720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.646459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.647442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.648124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.648919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.655624 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-309ba2da-acd6-49c7-85b6-09fd7ce56ff2 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1486 microversion: 2.1 time: 0.727410 Sep 07 10:06:31.656468 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2151/4303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:30 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1486 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:31.683075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:31.683806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:31.694061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.696623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.697127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.700692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.701619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.702239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.755980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:06:31.921382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:31.952644 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c56797ef-070f-4124-94f7-1b2499e9468c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 204 len: 0 microversion: 2.1 time: 0.272102 Sep 07 10:06:31.956228 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2152/4304] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:31 2022] DELETE /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:06:31.973793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:31.974986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:31.988622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.989113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.989601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:31.990314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:31.990770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:31.991193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:32.007972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:32.590704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:32.604918 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03ed146d-fcb4-4e74-9417-e4279624853f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.991910 Sep 07 10:06:32.605559 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2153/4305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:31 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:32.621357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e381a4db-19e0-4c88-bd72-c13301738954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b08dd0d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:32.665096 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e381a4db-19e0-4c88-bd72-c13301738954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Image not found. Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e381a4db-19e0-4c88-bd72-c13301738954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 HTTP/1.1 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5311898c-e540-4777-a5dd-0ee042fb3f97'} Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5311898c-e540-4777-a5dd-0ee042fb3f97 to delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5311898c-e540-4777-a5dd-0ee042fb3f97 could not be found. Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.667452 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e381a4db-19e0-4c88-bd72-c13301738954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e381a4db-19e0-4c88-bd72-c13301738954 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97" status: 404 len: 62 microversion: 2.1 time: 0.060502 Sep 07 10:06:32.673418 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2154/4306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:32 2022] DELETE /compute/v2.1/images/5311898c-e540-4777-a5dd-0ee042fb3f97 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:06:32.676531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:32.683389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:32.705245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:32.722916 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-215c521a-e0cc-4ea0-a74e-6a5094ce8500 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 0.763243 Sep 07 10:06:32.723513 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2153/4307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:31 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:32.728219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:32.728822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:32.740001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:32.740703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:32.741167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:32.741309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:32.741693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:32.741937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:32.742126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:32.742403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:32.742819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:32.742937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:32.743272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:32.743694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:33.007883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:33.022904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:33.027112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:33.032421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd31ae9c-3592-4cd8-b449-23b3195bad3d tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.305218 Sep 07 10:06:33.033555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2154/4308] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:32 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:33.040585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:33.047478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:33.062461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:33.063137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:33.063599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:33.064532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:33.065264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:33.069070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:33.149856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:06:33.260442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Instance is already in deleting state, ignoring this request Sep 07 10:06:33.266761 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4af7e6f8-c268-4596-aa20-d5472750018e tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 204 len: 0 microversion: 2.1 time: 0.224494 Sep 07 10:06:33.270496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2155/4309] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:33 2022] DELETE /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:06:33.281048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:33.281865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:33.296756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:33.297342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:33.299983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:33.300748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:33.301248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:33.303091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:33.464681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:33.477790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:33.479597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:33.485075 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60fe9ff4-424a-4a02-b0aa-00fc05bd6d9e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1406 microversion: 2.20 time: 0.808898 Sep 07 10:06:33.500070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2155/4310] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:32 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1406 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:33.631332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:33.631967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:33.641551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:33.642058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:33.642501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:33.643219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:33.653976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:33.654526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:34.553767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:34.589848 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8c68e81a-d01a-4ea4-9c29-e6139b582ca3 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1492 microversion: 2.1 time: 1.306123 Sep 07 10:06:34.596876 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2156/4311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:33 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1492 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:34.620388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc32a-d00c-493b-b9ac-383f2e03e3d0", "name": "network-vif-plugged", "status": "completed", "tag": "13d037e6-2037-4c8e-9875-946fd94ef329"}, {"server_uuid": "c2436780-2c79-45ff-a3db-ddbca646ac20", "name": "network-vif-plugged", "status": "completed", "tag": "8659ac32-6784-4fab-989a-78a503004d0b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:34.654140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:34.682486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:34.690201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:34.690660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:34.732511 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] Creating event network-vif-plugged:13d037e6-2037-4c8e-9875-946fd94ef329 for instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 on n-h2-836830-16 Sep 07 10:06:34.733275 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] Creating event network-vif-plugged:8659ac32-6784-4fab-989a-78a503004d0b for instance c2436780-2c79-45ff-a3db-ddbca646ac20 on n-h1-836830-16 Sep 07 10:06:34.754483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-eed9bca4-f663-443f-b145-5837e850b14b req-065bfbae-b30a-442b-89b3-6958d5567710 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.155661 Sep 07 10:06:34.760993 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2157/4312] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:34.779171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:34.779904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:34.819720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:34.819720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:34.819720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:34.827035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:34.830484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:34.835543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:35.077799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:35.090112 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ff04605-42a0-4ff5-a55b-e03a9705afc1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 1.462805 Sep 07 10:06:35.094856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2156/4313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:33 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:35.136083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-22d4f03e-150d-47aa-81e1-3e18df208962 req-eb39d8a0-2dc6-4dbf-b285-fe836ca26c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e7b78b-a56a-448b-bb06-e4fb7e5ff993", "tag": "b99f2135-88d6-4c0e-a7cb-9bea2960104e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:35.152642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22d4f03e-150d-47aa-81e1-3e18df208962 req-eb39d8a0-2dc6-4dbf-b285-fe836ca26c62 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:35.155771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22d4f03e-150d-47aa-81e1-3e18df208962 req-eb39d8a0-2dc6-4dbf-b285-fe836ca26c62 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:35.157641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22d4f03e-150d-47aa-81e1-3e18df208962 req-eb39d8a0-2dc6-4dbf-b285-fe836ca26c62 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:35.185531 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-22d4f03e-150d-47aa-81e1-3e18df208962 req-eb39d8a0-2dc6-4dbf-b285-fe836ca26c62 service nova] Creating event network-changed:b99f2135-88d6-4c0e-a7cb-9bea2960104e for instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 on n-h2-836830-16 Sep 07 10:06:35.197277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-22d4f03e-150d-47aa-81e1-3e18df208962 req-eb39d8a0-2dc6-4dbf-b285-fe836ca26c62 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069772 Sep 07 10:06:35.204826 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2157/4314] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:35.215092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:35.217993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:35.234363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:35.238012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:35.240474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:35.244301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:35.245007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:35.245636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:35.545569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:35.560940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:35.562865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:35.566290 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ece74480-419c-4f84-8e80-a5a9113d829c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.358938 Sep 07 10:06:35.570643 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2158/4315] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:35 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:35.582414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:35.583329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:35.602444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:35.603307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:35.604109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:35.605006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:35.626631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:35.627204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:36.253315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:36.267880 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87b03a83-bc7b-4221-8153-0a4fb813bcb1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 1.503508 Sep 07 10:06:36.268742 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2158/4316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:34 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:36.286020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:36.287026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:36.296204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:36.297967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:36.298740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:36.300357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:36.301435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:36.302163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:36.519056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e14f54af9f44dd28bab63c619816e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50af0650eb9e41d6ba3a56d33b959aa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:36.536573 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d17805e-d14a-4205-91c2-00ba63a60e95 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 200 len: 1450 microversion: 2.1 time: 0.261858 Sep 07 10:06:36.537228 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2159/4317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:36 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 1450 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:36.553525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:36.554623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:36.565786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:36.573471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:36.574185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:36.575444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:36.576264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:36.576865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:36.719677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:36.748260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:36.757838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:36.762216 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25cc1a82-3762-4edc-9cea-368d782061b8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1599 microversion: 2.20 time: 1.186082 Sep 07 10:06:36.765191 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2159/4318] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:35 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1599 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:36.778252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:36.784299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:36.794901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:36.795532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:36.796191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:36.800613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:36.804697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:36.806110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.141844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:37.154601 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8e2ccc6-25d6-413a-97e1-1d2f3b3896d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1203 microversion: 2.1 time: 0.611908 Sep 07 10:06:37.158650 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2160/4319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:36 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1203 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:37.169956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.173405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.186288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.189616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.190235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.191226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.193109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.193767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.245843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:37.270215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:37.272332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:37.282457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b7b3154-b1ae-49ce-bbf7-37366ccc0a81 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.514408 Sep 07 10:06:37.286661 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2160/4320] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:36 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:37.294311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0cb23fdb-3f64-4c44-a333-d2fbc0b6c46e req-3877c90c-6f60-429a-861a-fd583ce7ef17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2436780-2c79-45ff-a3db-ddbca646ac20", "name": "network-vif-deleted", "tag": "8659ac32-6784-4fab-989a-78a503004d0b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:37.305509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0cb23fdb-3f64-4c44-a333-d2fbc0b6c46e req-3877c90c-6f60-429a-861a-fd583ce7ef17 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.306282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0cb23fdb-3f64-4c44-a333-d2fbc0b6c46e req-3877c90c-6f60-429a-861a-fd583ce7ef17 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.307087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0cb23fdb-3f64-4c44-a333-d2fbc0b6c46e req-3877c90c-6f60-429a-861a-fd583ce7ef17 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.322967 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0cb23fdb-3f64-4c44-a333-d2fbc0b6c46e req-3877c90c-6f60-429a-861a-fd583ce7ef17 service nova] Creating event network-vif-deleted:8659ac32-6784-4fab-989a-78a503004d0b for instance c2436780-2c79-45ff-a3db-ddbca646ac20 on n-h1-836830-16 Sep 07 10:06:37.333520 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0cb23fdb-3f64-4c44-a333-d2fbc0b6c46e req-3877c90c-6f60-429a-861a-fd583ce7ef17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044909 Sep 07 10:06:37.335594 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2161/4321] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:37.340517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.341208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.364660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.369502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.370923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.372917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.378447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.379106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.478495 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78d82f23-bde8-4503-ba31-f0aad2abaff1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.317927 Sep 07 10:06:37.487498 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2161/4322] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 10:06:37 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-interface => generated 285 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:06:37.564556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.565213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: c2436780-2c79-45ff-a3db-ddbca646ac20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.572840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.577467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.578323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.579258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.581753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.582380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.626193 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance c2436780-2c79-45ff-a3db-ddbca646ac20 could not be found. Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 HTTP/1.1 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance c2436780-2c79-45ff-a3db-ddbca646ac20 could not be found. Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'c2436780-2c79-45ff-a3db-ddbca646ac20'} Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2436780-2c79-45ff-a3db-ddbca646ac20 could not be found. Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2436780-2c79-45ff-a3db-ddbca646ac20 could not be found. Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.632193 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.636948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.636948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.636948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:37.636948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:37.636948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2436780-2c79-45ff-a3db-ddbca646ac20 could not be found. Sep 07 10:06:37.636948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.639431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance c2436780-2c79-45ff-a3db-ddbca646ac20 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:37.643823 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1e4639a-388e-426a-8a4c-44a239fe0f0c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20" status: 404 len: 111 microversion: 2.1 time: 0.084871 Sep 07 10:06:37.645251 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2162/4323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:37 2022] GET /compute/v2.1/servers/c2436780-2c79-45ff-a3db-ddbca646ac20 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:37.658083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-731c7ba8-cca8-4235-80fb-ad9651d827ac tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09c0c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.694361 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-731c7ba8-cca8-4235-80fb-ad9651d827ac tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Image not found. Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-731c7ba8-cca8-4235-80fb-ad9651d827ac tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b HTTP/1.1 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ef8536f0-af8e-4460-a36c-df9c5e18670b'} Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef8536f0-af8e-4460-a36c-df9c5e18670b to delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef8536f0-af8e-4460-a36c-df9c5e18670b could not be found. Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.699917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 10:06:37.704678 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.707858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-731c7ba8-cca8-4235-80fb-ad9651d827ac tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:37.708901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-731c7ba8-cca8-4235-80fb-ad9651d827ac tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b" status: 404 len: 62 microversion: 2.1 time: 0.060053 Sep 07 10:06:37.712630 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2163/4324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:37 2022] DELETE /compute/v2.1/images/ef8536f0-af8e-4460-a36c-df9c5e18670b => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:06:37.726476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.727426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.743501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.743898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.744351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.745067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.745554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.745991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.753522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:37.761899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e7b8c9e8-c904-426a-94d4-29610fd80e04 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 0.425688 Sep 07 10:06:37.762483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2162/4325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:37 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:37.792040 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 HTTP/1.1 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '562530a6-06f3-449a-8a52-2bb230d832e9'} Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:37.793657 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-512bcb0a-f894-475e-8cf6-92b5fcbb9001 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 404 len: 111 microversion: 2.1 time: 0.077784 Sep 07 10:06:37.801451 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2164/4326] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:37 2022] DELETE /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:37.804641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.805257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 562530a6-06f3-449a-8a52-2bb230d832e9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.817453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.817963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.818412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.819433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.819905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.820342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.835252 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 HTTP/1.1 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '562530a6-06f3-449a-8a52-2bb230d832e9'} Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.836938 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance 562530a6-06f3-449a-8a52-2bb230d832e9 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0ba1511-bc2b-40d2-aca4-9fb43707f301 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9" status: 404 len: 111 microversion: 2.1 time: 0.037848 Sep 07 10:06:37.842268 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2163/4327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:37 2022] GET /compute/v2.1/servers/562530a6-06f3-449a-8a52-2bb230d832e9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:37.847889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb5dc436-7d62-44c7-a320-ae7eab4da1c4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b261b790>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.873345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-eb5dc436-7d62-44c7-a320-ae7eab4da1c4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Image not found. Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb5dc436-7d62-44c7-a320-ae7eab4da1c4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 HTTP/1.1 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: exception: Image not found. Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4112e438-9aad-4be4-90e5-38e9c0ffd249'} Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4112e438-9aad-4be4-90e5-38e9c0ffd249 to delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4112e438-9aad-4be4-90e5-38e9c0ffd249 could not be found. Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.875655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 10:06:37.879820 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.882802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb5dc436-7d62-44c7-a320-ae7eab4da1c4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Image not found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:37.883887 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb5dc436-7d62-44c7-a320-ae7eab4da1c4 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249" status: 404 len: 62 microversion: 2.1 time: 0.040597 Sep 07 10:06:37.888293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2165/4328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:37 2022] DELETE /compute/v2.1/images/4112e438-9aad-4be4-90e5-38e9c0ffd249 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:06:37.901077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.901931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.913956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.917552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.918409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.919268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.919930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.920368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.970982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 HTTP/1.1 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e2729d92-a21b-4bbb-88f8-7737455f6974'} Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:37.972626 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:37.977346 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-55957a66-122c-4bbc-a462-0b192cf4153c tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 404 len: 111 microversion: 2.1 time: 0.085050 Sep 07 10:06:37.980214 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2164/4329] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:37 2022] DELETE /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:37.983201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:37.983823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: e2729d92-a21b-4bbb-88f8-7737455f6974] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:37.992713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.993242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.993662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:37.994372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:37.994969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:37.995594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.020186 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 HTTP/1.1 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e2729d92-a21b-4bbb-88f8-7737455f6974'} Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.022281 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance e2729d92-a21b-4bbb-88f8-7737455f6974 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:38.029791 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4e499dc-add9-48c9-85ea-5e1f7fdc39ef tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974" status: 404 len: 111 microversion: 2.1 time: 0.048123 Sep 07 10:06:38.034260 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2166/4330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:37 2022] GET /compute/v2.1/servers/e2729d92-a21b-4bbb-88f8-7737455f6974 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:38.040073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82c067ce-ca0f-4920-8d0b-2150e6e1e6f5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '.version_select at 0x7f14b09399d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:38.070774 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-82c067ce-ca0f-4920-8d0b-2150e6e1e6f5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Image not found. Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82c067ce-ca0f-4920-8d0b-2150e6e1e6f5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b HTTP/1.1 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: exception: Image not found. Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '8db266aa-2510-46a3-8739-740c8c68e27b'} Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8db266aa-2510-46a3-8739-740c8c68e27b to delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8db266aa-2510-46a3-8739-740c8c68e27b could not be found. Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.076284 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82c067ce-ca0f-4920-8d0b-2150e6e1e6f5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Image not found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82c067ce-ca0f-4920-8d0b-2150e6e1e6f5 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b" status: 404 len: 62 microversion: 2.1 time: 0.041366 Sep 07 10:06:38.082523 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2165/4331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:38 2022] DELETE /compute/v2.1/images/8db266aa-2510-46a3-8739-740c8c68e27b => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 10:06:38.088049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:38.088643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:38.101822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.102401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.102860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.103585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.104051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.104495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.140267 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 HTTP/1.1 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '14558c21-bf17-4cc2-9443-0280ee2e4db5'} Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:38.142846 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.147242 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.149316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:38.150535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df037159-b50a-4657-8de1-ed54342c5e85 tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 404 len: 111 microversion: 2.1 time: 0.066932 Sep 07 10:06:38.156297 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2167/4332] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:38 2022] DELETE /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:06:38.162146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:38.164057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] [instance: 14558c21-bf17-4cc2-9443-0280ee2e4db5] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:38.184305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.185159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:38.186009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:38.190915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.194675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.198194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.200631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.202218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.204578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.205214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.205916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.207010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.207708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.208387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.247319 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] HTTP exception thrown: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Request method failure captured: Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 HTTP/1.1 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwzISDebs1w_Z_WglLS9Xy5R6NIGd1ayxoarJDgAw-U3iF4t77IDI1MOyAOsgRdQ78QKX-6SV9iT0uKWv0SXFp4JYZj50wbfoxZjEHajzalzqfSRegI93zADG_vBBWMFA6cCI-2MBfZjOPlJcm9HOU43i6bO9p7R4YXTLiWtlXq5ic Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50af0650eb9e41d6ba3a56d33b959aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50af0650eb9e41d6ba3a56d33b959aa3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 50af0650eb9e41d6ba3a56d33b959aa3 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ImagesTestJSON-963428542 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2e14f54af9f44dd28bab63c619816e67 Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ImagesTestJSON-963428542-project Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '14558c21-bf17-4cc2-9443-0280ee2e4db5'} Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.249371 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:38.254517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:38.254517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:38.254517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:38.254517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:38.254517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. Sep 07 10:06:38.254517 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:38.258886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] Returning 404 to user: Instance 14558c21-bf17-4cc2-9443-0280ee2e4db5 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:38.260024 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-def06c3d-15c4-449b-b2bc-897c34a551ce tempest-ImagesTestJSON-963428542 tempest-ImagesTestJSON-963428542-project] 10.222.0.60 "GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5" status: 404 len: 111 microversion: 2.1 time: 0.104151 Sep 07 10:06:38.261818 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2166/4333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:38 2022] GET /compute/v2.1/servers/14558c21-bf17-4cc2-9443-0280ee2e4db5 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:38.315996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:38.316710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:38.329986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.330569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.331242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.332120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.333815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.335752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.640141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:38.659456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:38.662138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:38.669313 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c51bb73-77d4-42d9-aa01-f9c1df34d56e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.356146 Sep 07 10:06:38.670949 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2167/4334] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:38 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:06:38.793295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:38.793903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:38.808630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.809219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.809887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:38.811837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:38.813700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:38.814658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:39.430119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:39.440752 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e8af399-6514-41cb-8d25-6ea56a9334c0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1389 microversion: 2.1 time: 1.259511 Sep 07 10:06:39.461457 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2168/4335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:38 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1389 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:39.467615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:39.468563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:39.475306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:39.476127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:39.476806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:39.477792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:39.478470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:39.479138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:39.649980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:39.664412 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19a7f053-31e1-4a7c-a1b1-6c6e82fe2232 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 0.874999 Sep 07 10:06:39.679875 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2168/4336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:38 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:39.705839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:39.706521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:39.722738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:39.723237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:39.723683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:39.724450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:39.724894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:39.725355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:40.011712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:40.023864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:40.034215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:40.035493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d769269f-c14c-4309-bf03-44ee05ba9f59 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.335426 Sep 07 10:06:40.045682 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2169/4337] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:39 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:40.231624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:40.246840 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-137f5f90-979c-4117-b351-c6e43ef45b74 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1389 microversion: 2.1 time: 0.781300 Sep 07 10:06:40.247614 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2169/4338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:39 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1389 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:40.275181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:40.276072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:40.295406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:40.295919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:40.296364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:40.297135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:40.297645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:40.298061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:40.694717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:40.696030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:40.707761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:40.711601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:40.712330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:40.714416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:40.715092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:40.715697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.186380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:41.196424 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b956e1e-d9a3-406e-b8c5-f3e099ce5fd1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1389 microversion: 2.1 time: 0.925781 Sep 07 10:06:41.200343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2170/4339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:40 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1389 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:41.210709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:41.212117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:41.224933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.226935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.229720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.231016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.235774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.236341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.309759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:41.322008 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-498c7308-f6af-41f9-9cec-4bf87cbd290f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 0.629009 Sep 07 10:06:41.322897 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2170/4340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:40 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:41.330723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:41.331515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:41.350549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.351286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.353418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.354318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.356103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.356783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.428903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:06:41.435959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:41.452240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:41.460543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:41.470031 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-674412c4-2d32-45ed-9ad6-d0a2782c297e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.268093 Sep 07 10:06:41.474166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2171/4341] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:41 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:41.649705 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-80b652eb-7ccb-4ac0-96ff-94f1a56b95e7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 204 len: 0 microversion: 2.1 time: 0.324575 Sep 07 10:06:41.652061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2171/4342] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:06:41 2022] DELETE /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:06:41.662361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5310d890-0d9c-4bb9-83d9-9cbfe1855137 req-30603944-1bac-41fc-b87c-5482a96bbe47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:41.666590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:41.668841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=92 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:41.670226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:41.687414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.687914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.688350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.691556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5310d890-0d9c-4bb9-83d9-9cbfe1855137 req-30603944-1bac-41fc-b87c-5482a96bbe47 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.693019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:41.693556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.693999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.698221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5310d890-0d9c-4bb9-83d9-9cbfe1855137 req-30603944-1bac-41fc-b87c-5482a96bbe47 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:41.701760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5310d890-0d9c-4bb9-83d9-9cbfe1855137 req-30603944-1bac-41fc-b87c-5482a96bbe47 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:41.715663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:41.743179 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5310d890-0d9c-4bb9-83d9-9cbfe1855137 req-30603944-1bac-41fc-b87c-5482a96bbe47 service nova] Creating event network-changed:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h2-836830-16 Sep 07 10:06:41.744195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:41.773794 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5310d890-0d9c-4bb9-83d9-9cbfe1855137 req-30603944-1bac-41fc-b87c-5482a96bbe47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281667 Sep 07 10:06:41.775002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2172/4343] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:42.034264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:42.054389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b61cb92-95fc-4cdd-a3ad-47c69afd5ba2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1395 microversion: 2.1 time: 0.396122 Sep 07 10:06:42.055377 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2172/4344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:41 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1395 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:42.360305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:42.362152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:42.379175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:42.380943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:42.381653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:42.382841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:42.388318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:42.390044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:42.511922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:42.513537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:42.539462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:42.542978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:42.543441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:42.544197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:42.544675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:42.545094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:42.731841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:42.757974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:42.760404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:42.761843 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-862fd9b3-bf04-4e27-9952-1b411da0e368 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.255403 Sep 07 10:06:42.773846 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2173/4345] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:42 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:42.823446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:42.834414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1dbd9f51-153d-49bc-848f-9645ec3486ea tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 0.485959 Sep 07 10:06:42.839189 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2173/4346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:42 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:43.057470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f596ade8-ccf5-4e2c-b607-c8b04fc4ef82 req-d1f992a2-b00b-4d63-9285-557cd3f0ee22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e7b78b-a56a-448b-bb06-e4fb7e5ff993", "name": "network-vif-plugged", "status": "completed", "tag": "b99f2135-88d6-4c0e-a7cb-9bea2960104e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:43.078118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f596ade8-ccf5-4e2c-b607-c8b04fc4ef82 req-d1f992a2-b00b-4d63-9285-557cd3f0ee22 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.078915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f596ade8-ccf5-4e2c-b607-c8b04fc4ef82 req-d1f992a2-b00b-4d63-9285-557cd3f0ee22 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.086312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:43.087231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:43.092810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f596ade8-ccf5-4e2c-b607-c8b04fc4ef82 req-d1f992a2-b00b-4d63-9285-557cd3f0ee22 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:43.098729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.101203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.102127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:43.104129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.107122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.108979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:43.121880 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f596ade8-ccf5-4e2c-b607-c8b04fc4ef82 req-d1f992a2-b00b-4d63-9285-557cd3f0ee22 service nova] Creating event network-vif-plugged:b99f2135-88d6-4c0e-a7cb-9bea2960104e for instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 on n-h2-836830-16 Sep 07 10:06:43.134510 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f596ade8-ccf5-4e2c-b607-c8b04fc4ef82 req-d1f992a2-b00b-4d63-9285-557cd3f0ee22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082081 Sep 07 10:06:43.137637 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2174/4347] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:43.652173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:43.664414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-864335c6-2268-486c-847a-262ed73d7c04 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1395 microversion: 2.1 time: 0.579984 Sep 07 10:06:43.665036 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2174/4348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:43 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1395 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:43.794124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:43.795429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:43.810516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.814714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.815445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:43.816394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.819965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.820746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:43.862599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:43.863530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:43.873739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.874480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.878899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:43.880386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:43.881085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:43.884225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:44.321200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:44.347417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:44.354193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:44.356080 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a01c688d-1cf8-4a1f-bd10-a1df6e33a187 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.566855 Sep 07 10:06:44.390899 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2175/4349] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:43 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:44.543371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:44.557307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa7b77bf-f57f-4a9b-af7e-fba25b32d8c7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1363 microversion: 2.1 time: 0.699594 Sep 07 10:06:44.567363 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2175/4350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:43 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1363 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:44.692119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:44.692839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:44.699209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:44.700064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:44.700571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:44.701883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:44.708901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:44.709530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:45.390468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:45.391904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:45.402777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:45.405511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:45.407076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:45.410444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:45.413138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:45.413618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:46.076285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:46.097036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:46.111918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:46.125387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82c0a3dc-74ed-416b-a625-6d2a98f8e120 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.736413 Sep 07 10:06:46.128368 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2176/4351] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:45 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:46.143965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:46.146268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:46.178253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:46.178820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:46.179269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:46.185803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:46.186306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:46.191608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:46.200469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:46.209570 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f772fdc-b41e-4135-863b-143dcd2b74a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1395 microversion: 2.1 time: 1.521260 Sep 07 10:06:46.217532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2176/4352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:44 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1395 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:46.463553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9c7cdd9a-3204-4e4b-9409-a614d97d1703 req-fb63be6b-026c-4a9f-b5c6-4b885cb55f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6dc32a-d00c-493b-b9ac-383f2e03e3d0", "name": "network-vif-deleted", "tag": "13d037e6-2037-4c8e-9875-946fd94ef329"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:46.510787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9c7cdd9a-3204-4e4b-9409-a614d97d1703 req-fb63be6b-026c-4a9f-b5c6-4b885cb55f95 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:46.511277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9c7cdd9a-3204-4e4b-9409-a614d97d1703 req-fb63be6b-026c-4a9f-b5c6-4b885cb55f95 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:46.538993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9c7cdd9a-3204-4e4b-9409-a614d97d1703 req-fb63be6b-026c-4a9f-b5c6-4b885cb55f95 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:46.603673 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9c7cdd9a-3204-4e4b-9409-a614d97d1703 req-fb63be6b-026c-4a9f-b5c6-4b885cb55f95 service nova] Creating event network-vif-deleted:13d037e6-2037-4c8e-9875-946fd94ef329 for instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 on n-h2-836830-16 Sep 07 10:06:46.616468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9c7cdd9a-3204-4e4b-9409-a614d97d1703 req-fb63be6b-026c-4a9f-b5c6-4b885cb55f95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155974 Sep 07 10:06:46.623264 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2177/4353] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:46.836204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:46.851646 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60f55835-776e-45a1-922f-ddbb0a1f30a8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1549 microversion: 2.1 time: 0.721577 Sep 07 10:06:46.866652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2177/4354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:46 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1549 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:46.889713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:46.890610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:46.922246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:46.928683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:46.929320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:46.930295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:46.933543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:46.938484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:47.158008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:47.159558 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3dbfae7-1553-4a23-84b4-4a00c2b90a6a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285856 Sep 07 10:06:47.160661 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2178/4355] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:06:46 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:47.168240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:47.185646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:47.186296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:47.194271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:47.196534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:47.197622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:47.199956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:47.233751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:47.234519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:47.245651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:47.247369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:47.249093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:47.250095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:47.252174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:47.252907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:47.503242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:47.508296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:47.518538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:47.522566 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1bd5518-149d-48d3-84fd-10ea1c555c54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.294412 Sep 07 10:06:47.524459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:47.525332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2179/4356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:47 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:47.585606 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd7e7a5f-cf45-4f77-9da4-7e5e0f2cb2b6 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.374544 Sep 07 10:06:47.590629 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2178/4357] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:47 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:48.555060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:48.556336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:48.575618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:48.578687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:48.581344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:48.584378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:48.585153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:48.589630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:48.619259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:48.619877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:48.651114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:48.651640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:48.652089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:48.652826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:48.653314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:48.663504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:48.877587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:48.889527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79d10748-4419-48ab-a419-2f3cbeec4feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.335669 Sep 07 10:06:48.892930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2180/4358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:48 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:49.056253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:49.069215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:49.074036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:49.078974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be0f6b32-c25f-45e6-afdb-ca653c1fcea3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.463638 Sep 07 10:06:49.093422 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2179/4359] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:48 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:49.917204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:49.919142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:49.945607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:49.946527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:49.949217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:49.971946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:49.972623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:49.977906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:50.106609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:50.107231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:50.119357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:50.119855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:50.120300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:50.121011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:50.121495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:50.121922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:50.308315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:50.319181 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9ec7d861-577c-42ee-9327-11acdb898682 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.404232 Sep 07 10:06:50.332879 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2181/4360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:49 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:50.523338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:50.548707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:50.550489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:50.553645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3a314c5-25d1-49f5-bf1d-8f89c42d4fcb tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.451619 Sep 07 10:06:50.573519 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2180/4361] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:50 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:06:50.771278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:50.772223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:50.784557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:50.785768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:50.787070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:50.789007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:50.795347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:50.795921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:51.008169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f55e4370-df90-45cc-adfd-4964a9939ba9 req-05cb9efd-53bf-411a-9aab-660d1ada6e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e7b78b-a56a-448b-bb06-e4fb7e5ff993", "tag": "b99f2135-88d6-4c0e-a7cb-9bea2960104e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:51.023252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f55e4370-df90-45cc-adfd-4964a9939ba9 req-05cb9efd-53bf-411a-9aab-660d1ada6e81 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:51.029958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f55e4370-df90-45cc-adfd-4964a9939ba9 req-05cb9efd-53bf-411a-9aab-660d1ada6e81 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:51.030487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f55e4370-df90-45cc-adfd-4964a9939ba9 req-05cb9efd-53bf-411a-9aab-660d1ada6e81 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:51.081291 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f55e4370-df90-45cc-adfd-4964a9939ba9 req-05cb9efd-53bf-411a-9aab-660d1ada6e81 service nova] Creating event network-changed:b99f2135-88d6-4c0e-a7cb-9bea2960104e for instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 on n-h2-836830-16 Sep 07 10:06:51.093036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f55e4370-df90-45cc-adfd-4964a9939ba9 req-05cb9efd-53bf-411a-9aab-660d1ada6e81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088299 Sep 07 10:06:51.094059 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2181/4362] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:51.351559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:51.353037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:51.367698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:51.368199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:51.380520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:51.383195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:51.385549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:51.385956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:51.546248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:51.562931 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa64d05d-293d-4745-8157-3564ea8ea258 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.219416 Sep 07 10:06:51.563514 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2182/4363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:51 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:06:51.580389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:51.589638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:51.590264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:51.599502 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62ea4ae8-9ad0-4fd9-8988-9a7872b77edf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.832660 Sep 07 10:06:51.601136 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2182/4364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:50 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:51.607115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:51.607628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:51.608079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:51.609654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:51.610056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:51.610810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:51.818885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:51.842651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:51.845246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:51.846646 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c36a678a-056e-4f6d-ab33-a550650842e5 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.260929 Sep 07 10:06:51.857635 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2183/4365] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:51 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:06:52.594785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:52.595605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:52.612767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:52.616202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:52.637633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:52.638425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:52.657828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:52.658632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:52.659122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:52.659560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:52.678880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:52.679377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:52.679816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:52.680533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:52.681078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:52.688603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:53.085816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:53.100716 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b5c507f-fa3e-411d-8918-931977be815c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.511122 Sep 07 10:06:53.103261 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2183/4366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:52 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:53.137959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:53.138639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:53.178210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:53.181090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:53.181938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:53.182884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:53.186043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:53.186681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:53.414304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:53.418457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:53.428318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:53.432625 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbdadd27-d069-4430-9e23-64c6fc833f8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.812082 Sep 07 10:06:53.433215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:53.435539 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2184/4367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:52 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:53.438028 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00e60006-55a9-463d-a813-8155308982f8 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.331999 Sep 07 10:06:53.446003 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2184/4368] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:53 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:53.477326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1228162990"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:53.485409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:53.502637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:53.503471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:53.505473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:53.506337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:53.506811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:53.510110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:53.969547 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c40577aa-5824-4303-9c5c-8733838ae76f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.507301 Sep 07 10:06:53.971535 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2185/4369] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:06:53 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 07 10:06:54.129057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:54.129715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:54.149326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:54.149820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:54.150277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:54.150976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:54.159143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:54.159875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:54.395362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:54.408041 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1aac138-6c9c-4b42-a2ab-f671c19b314e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.283121 Sep 07 10:06:54.422861 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2185/4370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:54 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:54.479203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:54.480189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:54.492601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:54.497956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:54.498425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:54.499180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:54.502210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:54.502701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:54.611979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:54.621940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:54.627627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:54.630907 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-564449c5-c6e4-4898-a1d6-5b50cfaeccea tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.157509 Sep 07 10:06:54.635650 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2186/4371] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:54 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:55.362654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ca8814f3-6692-40c9-80cf-712b61a448b6 req-5228bfab-7552-4b3d-b1a2-0ffdb003ced1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-unplugged", "status": "completed", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:55.383994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ca8814f3-6692-40c9-80cf-712b61a448b6 req-5228bfab-7552-4b3d-b1a2-0ffdb003ced1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:55.386205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ca8814f3-6692-40c9-80cf-712b61a448b6 req-5228bfab-7552-4b3d-b1a2-0ffdb003ced1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:55.388487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ca8814f3-6692-40c9-80cf-712b61a448b6 req-5228bfab-7552-4b3d-b1a2-0ffdb003ced1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:55.437731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:55.439437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:55.454176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:55.454957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:55.457800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:55.458981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:55.459628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:55.462374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:55.463396 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ca8814f3-6692-40c9-80cf-712b61a448b6 req-5228bfab-7552-4b3d-b1a2-0ffdb003ced1 service nova] Creating event network-vif-unplugged:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:06:55.482486 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ca8814f3-6692-40c9-80cf-712b61a448b6 req-5228bfab-7552-4b3d-b1a2-0ffdb003ced1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125646 Sep 07 10:06:55.485095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2186/4372] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:55.633715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:55.646923 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-238de821-5fad-4f28-b50a-dfdc3b9237e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1188 microversion: 2.1 time: 0.215149 Sep 07 10:06:55.649652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2187/4373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:55 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1188 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:55.664780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:55.666115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:55.676503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:55.676999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:55.681213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:55.682020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:55.682503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:55.682938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:55.864076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:55.877616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:55.882283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:55.887144 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19c8a541-7028-44c2-ada7-6b372e403e33 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1365 microversion: 2.57 time: 0.224892 Sep 07 10:06:55.893811 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2187/4374] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:55 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:56.040629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb78179b-be20-4f4f-b04a-96262f21df73 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Action: 'create', calling method: .version_select at 0x7f14b091ea60>, body: {"keypair": {"name": "tempest-keypair-652064048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2692rmvtt3kw1UG6kbSJvUpyW5SSPEtCkt3klxFdYIPJIyuMBU29MUdsjDpB1/q4WN+PG8PXiv7JAC3hJzH8M3lpfemoe8EsXhzt6ztZNEj2jAruP/+Pv5TEH7M02epQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:56.059968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-bb78179b-be20-4f4f-b04a-96262f21df73 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:56.069288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-bb78179b-be20-4f4f-b04a-96262f21df73 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for user 3142029354534ce0b619aeafbf6517a1 and project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:56.105772 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb78179b-be20-4f4f-b04a-96262f21df73 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325303 Sep 07 10:06:56.107150 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2188/4375] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:06:56.117932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e6219111-fcd7-46d4-b850-8bae92c10fdb tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b0972e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.133035 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e6219111-fcd7-46d4-b850-8bae92c10fdb tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-652064048" status: 200 len: 497 microversion: 2.1 time: 0.019078 Sep 07 10:06:56.137051 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2188/4376] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 7 10:06:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-652064048 => generated 497 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:56.150615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76c7b179-9835-42aa-8a86-2ed6aa9c11e4 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b09395e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.196767 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76c7b179-9835-42aa-8a86-2ed6aa9c11e4 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-652064048" status: 202 len: 0 microversion: 2.1 time: 0.051110 Sep 07 10:06:56.198237 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2189/4377] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-652064048 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:06:56.212458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0217631-8ab5-4768-ac3a-ab0d9160a8e6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Action: 'create', calling method: .version_select at 0x7f14b0aa8a60>, body: {"keypair": {"name": "tempest-keypair-237776879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZmAQtx0rjro88ROjhj1tjSOPR3XC8P0j5Y92pZmoPBIVHReASGqcnxFalTexf+nE72J2HdKNLZtg7QAl7HearFvdpebjcT5NNNseERaGonwY5ZvDZX7Tn+lqeCMQigww=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:56.251657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c0217631-8ab5-4768-ac3a-ab0d9160a8e6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:56.266976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c0217631-8ab5-4768-ac3a-ab0d9160a8e6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for user 3142029354534ce0b619aeafbf6517a1 and project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:56.330105 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0217631-8ab5-4768-ac3a-ab0d9160a8e6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123194 Sep 07 10:06:56.337825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2189/4378] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:56.341558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7bcd3d3-7dba-48fd-a085-611c6201cc25 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b08ddca0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.388444 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7bcd3d3-7dba-48fd-a085-611c6201cc25 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237776879" status: 202 len: 0 microversion: 2.1 time: 0.050826 Sep 07 10:06:56.389778 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2190/4379] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237776879 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:06:56.400109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1a2534c-35d6-4d2f-9e28-dd83f55507d6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Action: 'create', calling method: .version_select at 0x7f14b09c0ca0>, body: {"keypair": {"name": "tempest-keypair-369525023", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:56.426286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c1a2534c-35d6-4d2f-9e28-dd83f55507d6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:56.432134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c1a2534c-35d6-4d2f-9e28-dd83f55507d6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for user 3142029354534ce0b619aeafbf6517a1 and project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:56.482756 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1a2534c-35d6-4d2f-9e28-dd83f55507d6 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.088021 Sep 07 10:06:56.487841 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2190/4380] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:56 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:56.511871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-10d8d760-15f1-49ca-9b25-9c07234a05eb tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b08ea310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.543023 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-10d8d760-15f1-49ca-9b25-9c07234a05eb tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369525023" status: 202 len: 0 microversion: 2.1 time: 0.046447 Sep 07 10:06:56.544057 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2191/4381] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369525023 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:06:56.559752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0692a898-5a80-4d4b-97b4-0e498209d609 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Action: 'create', calling method: .version_select at 0x7f14b093a3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1241619649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGD2jqQlZN+JwTDjaMgydky0DdRbSVzIasnLqq/pNhsRtTKfIzRG8KWzCbAd3HuvuCTXMhV7jz5aVRWPFhE/IDu5lt866O72biD5qSTKWK/u9UAQtawYq0gMmFVA+u7fcA=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:56.589954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0692a898-5a80-4d4b-97b4-0e498209d609 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:56.597996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0692a898-5a80-4d4b-97b4-0e498209d609 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for user 3142029354534ce0b619aeafbf6517a1 and project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:56.618796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:56.642352 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0692a898-5a80-4d4b-97b4-0e498209d609 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.088848 Sep 07 10:06:56.658268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5abed1ab-8dd7-4c71-93f4-ac4ac2153ad2 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Action: 'create', calling method: .version_select at 0x7f14b09394c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1793495501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPK2c6vl6DR5uM9ddj6gbZDe2wInloJvIe6PZ2FyaHWdob+1P/XuY3XWz3zSGJh44FhzWFLSssH+OEhPIYUmpbK/8EnOYEMH9emQwCS07RevWBj72vJ8AMpoVyRlKA8Eg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:56.661850 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2191/4382] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:56.693121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.694047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:56.698101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5abed1ab-8dd7-4c71-93f4-ac4ac2153ad2 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:56.710912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5abed1ab-8dd7-4c71-93f4-ac4ac2153ad2 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for user 3142029354534ce0b619aeafbf6517a1 and project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:56.712135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:56.712645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:56.713739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:56.714477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:56.717753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:56.719177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:56.772162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5abed1ab-8dd7-4c71-93f4-ac4ac2153ad2 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.119261 Sep 07 10:06:56.781556 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2192/4383] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:56.789166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:56.792137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-822a4b72-991b-44d3-b657-e10db3fc5a5f tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Action: 'create', calling method: .version_select at 0x7f14b0959940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-417073421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk1ivrCyqJ8HAHpzDHqr1hB11LiFDGNefwGw5h+eCfuy0pjmCI1wdIlYxRC0/7PdypWwpdDz3d5TJG1tgeNNaoxpE71R5VdPkeONLpaW3UjTOYJPNB3tU+ORwV8b2fnoQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:56.793668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:56.794166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:56.794718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lazy-loading 'fault' on Instance uuid fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:06:56.841494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-822a4b72-991b-44d3-b657-e10db3fc5a5f tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:06:56.856176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-822a4b72-991b-44d3-b657-e10db3fc5a5f tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Getting quotas for user 3142029354534ce0b619aeafbf6517a1 and project a549df47b55f4ac6a0391ee06084bf62. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:06:56.901576 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-822a4b72-991b-44d3-b657-e10db3fc5a5f tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.118320 Sep 07 10:06:56.917028 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2193/4384] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:06:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:56.925095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1759b232-3c50-4cd7-9ae1-3c3223d29af1 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b08dd430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.931162 n-d-836830-16 devstack@n-api.service[128833]: WARNING oslo_db.sqlalchemy.utils [None req-1759b232-3c50-4cd7-9ae1-3c3223d29af1 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 10:06:56.950404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1759b232-3c50-4cd7-9ae1-3c3223d29af1 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.032069 Sep 07 10:06:56.953567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:56.959228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2194/4385] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 10:06:56 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:56.969689 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a29a165b-a2c0-4f33-a710-abc2931af552 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1193 microversion: 2.1 time: 0.297934 Sep 07 10:06:56.970313 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2192/4386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:56 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1193 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:56.973924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:56.974542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:56.981666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:56.982514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:56.983117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:56.984393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:56.985134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:56.985934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:56.991844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41a1150d-d824-40c9-a5a9-ffe058195c82 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b093eca0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:57.020302 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41a1150d-d824-40c9-a5a9-ffe058195c82 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-417073421" status: 202 len: 0 microversion: 2.1 time: 0.032806 Sep 07 10:06:57.028461 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2193/4387] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-417073421 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:06:57.038947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a78c52ce-06f5-4355-b532-fcfc33d3d0a9 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b09d7e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:57.085322 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a78c52ce-06f5-4355-b532-fcfc33d3d0a9 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1793495501" status: 202 len: 0 microversion: 2.1 time: 0.051290 Sep 07 10:06:57.088904 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2194/4388] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 7 10:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1793495501 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:06:57.096754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ed822fc1-8401-4989-9937-e05bac38f437 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] Calling method '.version_select at 0x7f14b0982a60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:57.136473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:57.142694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:57.146715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ed822fc1-8401-4989-9937-e05bac38f437 tempest-KeyPairsV2TestJSON-2031984243 tempest-KeyPairsV2TestJSON-2031984243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1241619649" status: 202 len: 0 microversion: 2.1 time: 0.056287 Sep 07 10:06:57.151657 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2195/4389] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 7 10:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1241619649 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:06:57.151829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:57.174634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:57.179270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2aa3b4f-a57b-4163-b895-b004e77585cc tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1371 microversion: 2.57 time: 0.211867 Sep 07 10:06:57.189572 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2195/4390] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:56 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:58.002268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:58.009292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:58.023567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:58.024161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:58.025689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:58.026763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:58.027455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:58.028121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:58.068991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:58.069602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:58.070233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:58.070758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lazy-loading 'fault' on Instance uuid fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:06:58.160199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:58.173116 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-47d249ab-65e5-4a75-9cc9-d5a6ec490cf2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 200 len: 1193 microversion: 2.1 time: 0.181138 Sep 07 10:06:58.174824 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2196/4391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:57 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 1193 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:06:58.214149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:58.214794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:58.233582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:58.235592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:58.237573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:58.238525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:58.240039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:58.241479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:58.391776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:58.410646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:58.414824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:58.416036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f80d7012-53df-4105-9aab-852804f0c4f3 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1371 microversion: 2.57 time: 0.208920 Sep 07 10:06:58.416605 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2196/4392] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:58 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:06:58.758051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f3d09f4c-9da7-4a32-9279-90e56cdc1151 req-8651ec37-7732-48d2-ad2d-37ed6be6b36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-plugged", "status": "completed", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:06:58.781515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f3d09f4c-9da7-4a32-9279-90e56cdc1151 req-8651ec37-7732-48d2-ad2d-37ed6be6b36e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:58.784107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f3d09f4c-9da7-4a32-9279-90e56cdc1151 req-8651ec37-7732-48d2-ad2d-37ed6be6b36e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:58.784778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f3d09f4c-9da7-4a32-9279-90e56cdc1151 req-8651ec37-7732-48d2-ad2d-37ed6be6b36e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:58.815018 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f3d09f4c-9da7-4a32-9279-90e56cdc1151 req-8651ec37-7732-48d2-ad2d-37ed6be6b36e service nova] Creating event network-vif-plugged:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:06:58.828034 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f3d09f4c-9da7-4a32-9279-90e56cdc1151 req-8651ec37-7732-48d2-ad2d-37ed6be6b36e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075038 Sep 07 10:06:58.828659 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2197/4393] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:06:59.204140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:59.205547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: fa6dc32a-d00c-493b-b9ac-383f2e03e3d0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:59.246002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:59.253722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:59.254439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:59.258900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:59.267840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:59.271981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:59.320341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 could not be found. Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 HTTP/1.1 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 could not be found. Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'fa6dc32a-d00c-493b-b9ac-383f2e03e3d0'} Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 could not be found. Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 could not be found. Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:06:59.339935 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 could not be found. Sep 07 10:06:59.345267 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:06:59.347068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:06:59.351437 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3072c4af-7273-4253-8b62-74e528c92878 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0" status: 404 len: 111 microversion: 2.1 time: 0.151116 Sep 07 10:06:59.355275 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2197/4394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:06:59 2022] GET /compute/v2.1/servers/fa6dc32a-d00c-493b-b9ac-383f2e03e3d0 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:06:59.444952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:59.445714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:59.461069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:59.480575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:59.481593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:59.490671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:59.495268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:59.495947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:59.554228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:06:59.635027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:59.644512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:59.658423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:06:59.660144 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2a886e9-7c53-4de4-9408-6981bce09f43 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1356 microversion: 2.57 time: 0.220511 Sep 07 10:06:59.660892 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2198/4395] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:59 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:06:59.693323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:06:59.694224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:06:59.710310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:59.711074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:59.712789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:59.716518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:06:59.717518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:06:59.719296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:06:59.792014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:06:59.993307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bbcc0792-cf5c-471b-a8a7-1ebe1203a7e1 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "DELETE /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 204 len: 0 microversion: 2.57 time: 0.303575 Sep 07 10:06:59.997057 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2198/4396] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:06:59 2022] DELETE /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:07:00.003926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:00.004989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:00.017952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:00.018640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:00.019196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:00.020225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:00.022984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:00.023685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:00.228906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:00.244184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:00.246201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:00.252887 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4616df3-dacd-4048-abe6-4810cd8aac67 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1362 microversion: 2.57 time: 0.254052 Sep 07 10:07:00.260239 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2199/4397] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:06:59 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:01.272676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-213fdfdf-2aa3-49a2-bf28-2bd13675a7e0 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b0959a60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy3QWQzCT1D9syEzOzmrVXNu3te7St35zwP2u2Rj0vwMISjo8qqxjLz3HpUfZCNN6avg1oZWNxISznQzUjF/eMHGf41OVq39h0jRUz2Md6yr7JApl2HeeW+/2+9hBwgkA=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:01.294239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:01.294855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-213fdfdf-2aa3-49a2-bf28-2bd13675a7e0 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 257 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy3QWQzCT1D9syEzOzmrVXNu3te7St35zwP2u2Rj0vwMISjo8qqxjLz3HpUfZCNN6avg1oZWNxISznQzUjF/eMHGf41OVq39h0jRUz2Md6yr7JApl2HeeW+/2+9hBwgkA=="}} Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy3QWQzCT1D9syEzOzmrVXNu3te7St35zwP2u2Rj0vwMISjo8qqxjLz3HpUfZCNN6avg1oZWNxISznQzUjF/eMHGf41OVq39h0jRUz2Md6yr7JApl2HeeW+/2+9hBwgkA=='}}} Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 07 10:07:01.318215 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 10:07:01.322410 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.332012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-213fdfdf-2aa3-49a2-bf28-2bd13675a7e0 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:01.337069 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-213fdfdf-2aa3-49a2-bf28-2bd13675a7e0 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.364016 Sep 07 10:07:01.347425 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2199/4398] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:00 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 379 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:07:01.349845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:01.350940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:01.354993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:01.355992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:01.356606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:01.357434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:01.363986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b09391f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-727462545", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:01.417030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:01.434145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:01.449339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for user d8afd608c3594d16a8c839fd28ee1ec7 and project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:01.537145 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:01.540002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:01.551126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:01.552826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:01.554400 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35a62017-627e-4139-8a33-7759e5ba3c2c tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1362 microversion: 2.57 time: 0.265129 Sep 07 10:07:01.555514 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2200/4399] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:01 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 2166 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-727462545", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:01.570360 n-d-836830-16 devstack@n-api.service[128833]: exception: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-727462545', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:01.572801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:01.575638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e31152ed-922e-40f9-a41a-8d08c2422baf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.223256 Sep 07 10:07:01.584263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2200/4400] 10.222.0.60 () {60 vars in 1160 bytes} [Wed Sep 7 10:07:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:07:01.592034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-482e2300-d781-4b6b-9675-0355df54c955 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b09c0ca0>, body: {"keypair": {"name": "tempest-keypair-177134095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUCL9M439ngOt9x490TC5l6ZcVJrbWg8M4ik7Z8gZvCELLq1LjhdrLno71mfBohz6HzZ4kAKrBn7O3ChhclMW4ew5JjKr5gr6moziHCmVqbxrezMknOnl4UAsVPsgJ/og=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:01.615684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-482e2300-d781-4b6b-9675-0355df54c955 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:01.622749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-482e2300-d781-4b6b-9675-0355df54c955 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for user d8afd608c3594d16a8c839fd28ee1ec7 and project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:01.679408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-482e2300-d781-4b6b-9675-0355df54c955 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094017 Sep 07 10:07:01.682051 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2201/4401] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:01.695889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b0908af0>, body: {"keypair": {"name": "tempest-keypair-177134095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSoYBCKneDaFGBcGOkzXL5GVJlgOgRrLBYmsUwt1l9Do2YYN+APILB2LzcqHfoSRWYSFiGhL0ymCdQIqhjDimHEiiZJdliO9n25lQ533AA0lHMwKQc956aphHZVJOJlbw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:01.759219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:01.771430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for user d8afd608c3594d16a8c839fd28ee1ec7 and project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:01.846199 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] HTTP exception thrown: Key pair 'tempest-keypair-177134095' already exists. Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 272 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: {"keypair": {"name": "tempest-keypair-177134095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSoYBCKneDaFGBcGOkzXL5GVJlgOgRrLBYmsUwt1l9Do2YYN+APILB2LzcqHfoSRWYSFiGhL0ymCdQIqhjDimHEiiZJdliO9n25lQ533AA0lHMwKQc956aphHZVJOJlbw=="}} Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: exception: Key pair 'tempest-keypair-177134095' already exists. Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-177134095', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSoYBCKneDaFGBcGOkzXL5GVJlgOgRrLBYmsUwt1l9Do2YYN+APILB2LzcqHfoSRWYSFiGhL0ymCdQIqhjDimHEiiZJdliO9n25lQ533AA0lHMwKQc956aphHZVJOJlbw=='}}} Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result.read() Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd8afd608c3594d16a8c839fd28ee1ec7-tempest-keypair-177134095' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 07 10:07:01.945652 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi session.flush() Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result.read() Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 10:07:01.949823 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd8afd608c3594d16a8c839fd28ee1ec7-tempest-keypair-177134095' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 7, 10, 7, 1, 831256), 'updated_at': None, 'name': 'tempest-keypair-177134095', 'user_id': 'd8afd608c3594d16a8c839fd28ee1ec7', 'fingerprint': '75:80:42:c6:6d:a6:b2:a8:18:10:6a:61:84:b4:2d:66', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSoYBCKneDaFGBcGOkzXL5GVJlgOgRrLBYmsUwt1l9Do2YYN+APILB2LzcqHfoSRWYSFiGhL0ymCdQIqhjDimHEiiZJdliO9n25lQ533AA0lHMwKQc956aphHZVJOJlbw==', 'type': 'ssh'}] Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi keypair.create() Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._create() Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-177134095' already exists. Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 07 10:07:01.953844 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-177134095' already exists. Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-177134095' already exists. Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 409 to user: Key pair 'tempest-keypair-177134095' already exists. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b30c157b-3200-4888-873d-b6486136ccaf tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.268439 Sep 07 10:07:01.961471 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2201/4402] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:01 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 270 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:07:01.970289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-857880b2-0cb4-4756-a4b4-885cc86dcc49 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Calling method '.version_select at 0x7f14b098ca60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:02.030216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-857880b2-0cb4-4756-a4b4-885cc86dcc49 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177134095" status: 202 len: 0 microversion: 2.1 time: 0.064657 Sep 07 10:07:02.049634 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2202/4403] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:07:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177134095 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:02.055457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbb6c9f8-5a5e-4ffe-984a-85e5f9d5ebfc tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b074e040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9o+6gQzmvlbRfC5gfzpsg3n4f0kAm8e3O8EORDhI5JMoXJZZB9mXZcjtjshOxgrbLsia3aelVKsRmCyZVlkbO+LtXa/wm+M8aY0sYtRyCRlqCL4nyW4UjVOGDwQ4sXWw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbb6c9f8-5a5e-4ffe-984a-85e5f9d5ebfc tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 247 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9o+6gQzmvlbRfC5gfzpsg3n4f0kAm8e3O8EORDhI5JMoXJZZB9mXZcjtjshOxgrbLsia3aelVKsRmCyZVlkbO+LtXa/wm+M8aY0sYtRyCRlqCL4nyW4UjVOGDwQ4sXWw=="}} Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9o+6gQzmvlbRfC5gfzpsg3n4f0kAm8e3O8EORDhI5JMoXJZZB9mXZcjtjshOxgrbLsia3aelVKsRmCyZVlkbO+LtXa/wm+M8aY0sYtRyCRlqCL4nyW4UjVOGDwQ4sXWw=='}}} Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi '' Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:07:02.071295 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbb6c9f8-5a5e-4ffe-984a-85e5f9d5ebfc tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:02.076920 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bbb6c9f8-5a5e-4ffe-984a-85e5f9d5ebfc tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.025973 Sep 07 10:07:02.080330 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2202/4404] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:02 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:07:02.090303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b08ea550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1145120728", "public_key": " "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:02.127915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:02.135012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for user d8afd608c3594d16a8c839fd28ee1ec7 and project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:02.160445 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 95 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1145120728", "public_key": " "}} Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: exception: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1145120728', 'public_key': ' '}}} Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.163777 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.167971 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.173116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:02.174332 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-603a3135-c1f5-4501-ae6b-571b282f30d3 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.088013 Sep 07 10:07:02.175204 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2203/4405] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Sep 7 10:07:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:07:02.190381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d4d0aa1-954a-4bca-a272-264b136c8930 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b0740ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr9gf1X3HsnMP4fzUKNjTSbXsiGRfPSQ2wS66uJ2lekODCHBYrVyxiR3YhTfY1SiBNd2Ry3/nqTxecq3OucigiYLJq7zFrNtr0tk/Yg3apCtLDVhg5TsqsIGvF3nEVELQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d4d0aa1-954a-4bca-a272-264b136c8930 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 507 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr9gf1X3HsnMP4fzUKNjTSbXsiGRfPSQ2wS66uJ2lekODCHBYrVyxiR3YhTfY1SiBNd2Ry3/nqTxecq3OucigiYLJq7zFrNtr0tk/Yg3apCtLDVhg5TsqsIGvF3nEVELQ=="}} Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr9gf1X3HsnMP4fzUKNjTSbXsiGRfPSQ2wS66uJ2lekODCHBYrVyxiR3YhTfY1SiBNd2Ry3/nqTxecq3OucigiYLJq7zFrNtr0tk/Yg3apCtLDVhg5TsqsIGvF3nEVELQ=='}}} Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 07 10:07:02.198328 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 10:07:02.201694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.203952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d4d0aa1-954a-4bca-a272-264b136c8930 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:02.204047 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3d4d0aa1-954a-4bca-a272-264b136c8930 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.019172 Sep 07 10:07:02.207798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2203/4406] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:02 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:07:02.222619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Action: 'create', calling method: .version_select at 0x7f14b098c550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-873487010", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:02.273509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:02.282659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Getting quotas for user d8afd608c3594d16a8c839fd28ee1ec7 and project d15398490f4446d2a91d8d3a08df1961. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:02.318783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 117 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-873487010", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: exception: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-873487010', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 07 10:07:02.320677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2640a0b8-c90d-4dbc-95d9-145ffe1c134b tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103606 Sep 07 10:07:02.329930 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2204/4407] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:07:02.332430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbb2fc1d-561f-40c1-8d2b-2a22b45793c9 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Calling method '.version_select at 0x7f14b074e9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:02.363166 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-dbb2fc1d-561f-40c1-8d2b-2a22b45793c9 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2033504144 not found for user d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbb2fc1d-561f-40c1-8d2b-2a22b45793c9 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Request method failure captured: Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2033504144 HTTP/1.1 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1EMJKfLQ2oZyHRt2mag0zuZcFwMuBey6bUV7bxhK0-O4SMSQ800pySxl52xQcG9J5pq3Fptu10tNgFEagVt6kwLwsFN0FL-v3J_dwe5MxknJIH04qoFGp-h50uyxKmuAhN7m_eBRgqUuAiSxJT5xKDAPLH8B1x1Esu_jsayuWpQs0 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d15398490f4446d2a91d8d3a08df1961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d15398490f4446d2a91d8d3a08df1961", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d15398490f4446d2a91d8d3a08df1961 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2067184692 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2067184692-project Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: exception: Keypair tempest-keypair-non-existent-2033504144 not found for user d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'tempest-keypair-non-existent-2033504144'} Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2033504144 not found for user d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.364957 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2033504144 not found for user d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2033504144 not found for user d8afd608c3594d16a8c839fd28ee1ec7 Sep 07 10:07:02.371333 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:02.378835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbb2fc1d-561f-40c1-8d2b-2a22b45793c9 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2033504144 not found for user d8afd608c3594d16a8c839fd28ee1ec7 {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:02.378835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbb2fc1d-561f-40c1-8d2b-2a22b45793c9 tempest-KeyPairsNegativeTestJSON-2067184692 tempest-KeyPairsNegativeTestJSON-2067184692-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2033504144" status: 404 len: 145 microversion: 2.1 time: 0.045557 Sep 07 10:07:02.381348 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2204/4408] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 10:07:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2033504144 => generated 145 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:07:02.594593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:02.596436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:02.613020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:02.632972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:02.634159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:02.638103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:02.653872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:02.658923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:03.004763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:03.031972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:03.044075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03507369f02748818afad0434a2e3e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cafbde6f8244130a239230c0627217b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:03.045741 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 200 len: 1362 microversion: 2.57 time: 0.464709 Sep 07 10:07:03.049286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2205/4409] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:02 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:04.079118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:04.080748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] [instance: 319abf9f-f607-422d-9d00-b312e1559951] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:04.100882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:04.104607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:04.110254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:04.111296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:04.114751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:04.117085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:04.212277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] HTTP exception thrown: Instance 319abf9f-f607-422d-9d00-b312e1559951 could not be found. Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Request method failure captured: Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 HTTP/1.1 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG0bXmvf5OY0CiUOp3Op5fQ-iSFXo_ugJIWSuXU4WzIpc0j60HNyB8Y5W6BCBYDHrex1OIUy1IFXsIdZZSnxdh7T8MoT4yKZniVcSXs0on5nb5KS3YjV2yRETocM2G3mtnz2XPz2QZd7kibmz8STCpmLdkehv6M0CNl-JU3wg9NoqWQ Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.57 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 6cafbde6f8244130a239230c0627217b Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerShowV257Test-1454873745 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6cafbde6f8244130a239230c0627217b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6cafbde6f8244130a239230c0627217b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6cafbde6f8244130a239230c0627217b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6cafbde6f8244130a239230c0627217b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerShowV257Test-1454873745 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 6cafbde6f8244130a239230c0627217b Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerShowV257Test-1454873745 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerShowV257Test-1454873745-project Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 03507369f02748818afad0434a2e3e14 Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerShowV257Test-1454873745-project Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 319abf9f-f607-422d-9d00-b312e1559951 could not be found. Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '319abf9f-f607-422d-9d00-b312e1559951'} Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319abf9f-f607-422d-9d00-b312e1559951 could not be found. Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319abf9f-f607-422d-9d00-b312e1559951 could not be found. Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:04.214875 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319abf9f-f607-422d-9d00-b312e1559951 could not be found. Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Returning 404 to user: Instance 319abf9f-f607-422d-9d00-b312e1559951 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:04.223139 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d1838f8-77c2-4be7-8f3d-2b47a72c02e2 tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951" status: 404 len: 111 microversion: 2.57 time: 0.151214 Sep 07 10:07:04.228231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2205/4410] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:04 2022] GET /compute/v2.1/servers/319abf9f-f607-422d-9d00-b312e1559951 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:07:08.261317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:08.262828 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001971 Sep 07 10:07:08.263318 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2206/4411] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 7 10:07:08 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 10:07:10.648793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-451235144", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "60effda8-65c6-4761-8eb9-2c6f9dcd6afe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:10.812219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:07:11.807553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=20 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:13.406890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:13.408450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003532 Sep 07 10:07:13.409015 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2207/4412] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 7 10:07:13 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 10:07:13.419017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:13.420446 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001972 Sep 07 10:07:13.421655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2208/4413] 10.222.0.60 () {54 vars in 1035 bytes} [Wed Sep 7 10:07:13 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 07 10:07:13.430768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:13.432017 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001686 Sep 07 10:07:13.432646 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2209/4414] 10.222.0.60 () {54 vars in 1041 bytes} [Wed Sep 7 10:07:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:13.450404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:13.451781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138f74b2-e130-473a-b643-cbb8280cc09e tempest-ServerShowV257Test-1454873745 tempest-ServerShowV257Test-1454873745-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001933 Sep 07 10:07:13.452476 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2210/4415] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 7 10:07:13 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 10:07:14.144159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:14.154821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:07:14.155361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:07:14.155850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:07:14.156264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:07:14.156679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:07:14.174167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:14.174665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:14.175109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:14.179450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:14.181974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:14.184011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:14.235533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:14.252930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:14.358719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:07:14.360779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60effda8-65c6-4761-8eb9-2c6f9dcd6afe',volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:07:14.541854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:14.542706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:14.554277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=24 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:14.556198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=61,nova_api:DELETE=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:14.558198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=21 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:14.560901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:14.562869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:14.564395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:14.568520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:14.570323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:14.575045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:14.611373 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6cb6e1b7-cc8b-4956-8356-0772b7b8b570 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.965360 Sep 07 10:07:14.613391 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2206/4416] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:07:14.625124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cfd3e1d3-be47-4a86-8b7c-b8013f715991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:14.629755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cfd3e1d3-be47-4a86-8b7c-b8013f715991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:14.658636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40b9f9d4-f05c-4cff-98ec-e70453b0c60d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/ips" status: 200 len: 151 microversion: 2.20 time: 0.119847 Sep 07 10:07:14.661266 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2211/4417] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 7 10:07:14 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/ips => generated 151 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:07:14.796296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cfd3e1d3-be47-4a86-8b7c-b8013f715991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:14.807271 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cfd3e1d3-be47-4a86-8b7c-b8013f715991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1056 microversion: 2.1 time: 0.186987 Sep 07 10:07:14.813297 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2207/4418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:14 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1056 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:15.836737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:15.837647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:15.855921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:15.856721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:15.857413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:15.861497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:15.862489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:15.865620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:16.218188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:16.231268 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1330c23-ea44-48a1-851a-6f5b35a1f456 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1106 microversion: 2.1 time: 0.398885 Sep 07 10:07:16.233140 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2212/4419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:15 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1106 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:17.256840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:17.257652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:17.274911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:17.275918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:17.278263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:17.279448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:17.282478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:17.285723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:17.640357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:17.648336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-291de0c0-5358-4d18-8b22-ab3a1f89a675 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1154 microversion: 2.1 time: 0.397221 Sep 07 10:07:17.657621 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2208/4420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:17 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1154 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:18.326825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:18.328070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:18.342302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:18.349386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:18.350591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:18.354812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:18.355582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:18.359680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:18.430910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lazy-loading 'flavor' on Instance uuid 216dfce6-78f0-4ed7-ab4b-eec1dde35dff {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:07:18.674907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:18.675640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:18.690980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:18.696942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:18.699317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:18.705661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:18.709764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:18.711801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:18.894202 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-acbddf4b-6d0e-4541-92d8-24f04e27d7fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/action" status: 202 len: 0 microversion: 2.20 time: 0.572977 Sep 07 10:07:18.894806 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2213/4421] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:07:18 2022] POST /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:07:18.914686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:18.915764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:18.933914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:18.934792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:18.935428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:18.936907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:18.942198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:18.942942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:19.017394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:19.025772 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1020264d-3be7-47f9-a82f-59b9aebc80e9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1172 microversion: 2.1 time: 0.354685 Sep 07 10:07:19.032149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2209/4422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:18 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1172 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:19.507380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:19.523934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:19.525364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:19.526566 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c2fc95c0-aa46-4f9f-8f77-94db6d192575 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 0.627445 Sep 07 10:07:19.527493 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2214/4423] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:18 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:20.054311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:20.055766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:20.066843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:20.070452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:20.071119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:20.076449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:20.077293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:20.077904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:20.561958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:20.563342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:20.575342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:20.588068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:20.589081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:20.593844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:20.593844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:20.593844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:20.965676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:20.984885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d675dca0-40ce-433f-87d8-677e22729815 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1214 microversion: 2.1 time: 0.934295 Sep 07 10:07:20.985883 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2210/4424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:20 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1214 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:07:21.383091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:21.396395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:21.410880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:21.412124 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-782d1b88-ad76-43cf-aed3-ea50159006c9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 0.854787 Sep 07 10:07:21.419435 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2215/4425] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:20 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:22.007937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:22.008563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:22.024705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:22.025306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:22.025680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:22.026397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:22.026862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:22.027293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:22.442520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:22.443137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:22.452154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:22.457969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:22.458683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:22.461355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:22.462009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:22.467168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:22.556151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:22.565685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7a90684-35e5-4e11-85cc-c144b3f6338b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1214 microversion: 2.1 time: 0.561491 Sep 07 10:07:22.574345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2211/4426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:22 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1214 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:22.964779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:22.973541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:22.981507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:22.983004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-284220ef-a419-472b-bc6c-d831491fa480 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 0.544359 Sep 07 10:07:22.984972 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2216/4427] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:22 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:07:23.598982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:23.599696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:23.619658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:23.620203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:23.622475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:23.626265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:23.626840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:23.629704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:24.021308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:24.021308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:24.032255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:24.035843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:24.037643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:24.056398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:24.057256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:24.058347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:24.214230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:24.379118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:24.393219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-016e596f-8214-493b-b688-4602fa610f29 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1214 microversion: 2.1 time: 0.799041 Sep 07 10:07:24.393851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2212/4428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:23 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1214 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:25.003990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:25.021809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:25.026724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:25.027952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f4c5c947-edbb-42e8-8be4-02ac3c0d6b94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 1.016908 Sep 07 10:07:25.035902 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2217/4429] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:24 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:07:25.421650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:25.422521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:25.425079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:25.445917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:25.454089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:25.463393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:25.465950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:25.467975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:25.468762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:25.804789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-524ec55f-5321-4fd3-98ee-5fd6b6538646 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b0910ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-743625299", "description": "tempest-description-2022523741"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:26.904062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:26.916572 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a38302af-7d4e-4497-b1ad-036ead3359a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1214 microversion: 2.1 time: 1.500799 Sep 07 10:07:26.928647 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2213/4430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:25 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1214 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:26.948430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-911a6550-e189-4d64-90cb-a58569c619d3 req-ae91afc7-ef04-453f-8116-01c8b8c08fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0cb929d-0bf8-4e43-863b-5a9b09598f51", "tag": "a9dca1d4-3bdf-408b-8c66-c865160d62d1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:26.997634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-911a6550-e189-4d64-90cb-a58569c619d3 req-ae91afc7-ef04-453f-8116-01c8b8c08fa0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:27.002745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-911a6550-e189-4d64-90cb-a58569c619d3 req-ae91afc7-ef04-453f-8116-01c8b8c08fa0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:27.005557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-911a6550-e189-4d64-90cb-a58569c619d3 req-ae91afc7-ef04-453f-8116-01c8b8c08fa0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:27.063860 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-911a6550-e189-4d64-90cb-a58569c619d3 req-ae91afc7-ef04-453f-8116-01c8b8c08fa0 service nova] Creating event network-changed:a9dca1d4-3bdf-408b-8c66-c865160d62d1 for instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 on n-h1-836830-16 Sep 07 10:07:27.089832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-911a6550-e189-4d64-90cb-a58569c619d3 req-ae91afc7-ef04-453f-8116-01c8b8c08fa0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159481 Sep 07 10:07:27.091125 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2214/4431] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:27.318018 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-524ec55f-5321-4fd3-98ee-5fd6b6538646 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.859117 Sep 07 10:07:27.319276 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2218/4432] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 10:07:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:27.324152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:27.326349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:27.356158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:27.356901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:27.357605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:27.360242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:27.376535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:27.378833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:27.528267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:27.529008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:27.552015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:27.553227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:27.554841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:27.559033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:27.560622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:27.565827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:27.630524 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-40cc082c-4116-4674-8324-4a21e3bb9ba7 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/ips" status: 200 len: 146 microversion: 2.1 time: 0.533778 Sep 07 10:07:27.632757 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2215/4433] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:07:27 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/ips => generated 146 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:27.644067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a508fd1-012e-4421-b18a-61812dc90d79 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b0758ca0>, body: {"security_group_rule": {"parent_group_id": "6bd3bdd4-a705-4d65-abf8-7969c39505c8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:28.123073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:28.143135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:28.144652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:28.160370 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8dde5b83-df05-4c4b-95e3-866555e4cf84 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 0.834375 Sep 07 10:07:28.163816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2219/4434] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:27 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:28.188528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:28.193853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:28.229390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:28.235866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:28.236510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:28.240318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:28.243891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:28.244456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:29.371588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:29.387621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc804f37-b200-4df4-b573-d2c994ac1e4a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1214 microversion: 2.1 time: 1.221055 Sep 07 10:07:29.401480 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2220/4435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:28 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1214 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:29.409739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:29.420327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:29.456012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:29.462668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:29.465055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:29.466039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:29.476508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:29.477835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:30.516722 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a508fd1-012e-4421-b18a-61812dc90d79 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.882440 Sep 07 10:07:30.517894 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2216/4436] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:30.523720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:30.525311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:30.573142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:30.577222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:30.577863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:30.585832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:30.588910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:30.591021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:30.592640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:30.613427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:30.621560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:30.622993 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e6da601-6aaa-446b-9153-778bc61aa0ca tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 1.226376 Sep 07 10:07:30.623799 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2221/4437] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:29 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:30.650040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:30.650885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:30.659233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:30.659957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:30.660555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:30.662088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:30.662983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:30.663601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:31.281139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:31.300304 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-563a6457-afbe-4d90-8014-a735867b68d0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.658287 Sep 07 10:07:31.304060 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2222/4438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:30 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:31.314853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70dc3468-90fb-4039-8215-dd336e37e5e9 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b098c8b0>, body: {"security_group_rule": {"parent_group_id": "6bd3bdd4-a705-4d65-abf8-7969c39505c8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:31.324304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:31.342632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ced94a2-487b-4d03-b7dd-e3377251f1b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.820276 Sep 07 10:07:31.343256 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2217/4439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:30 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:31.365667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e65054b8-5641-4236-880a-2d54d4215264"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:31.370420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:31.393619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:31.394438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:31.395072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:31.399030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:31.402925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:31.403626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:31.431499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-70dc3468-90fb-4039-8215-dd336e37e5e9 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: This rule already exists in group 6bd3bdd4-a705-4d65-abf8-7969c39505c8 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70dc3468-90fb-4039-8215-dd336e37e5e9 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 138 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: {"security_group_rule": {"parent_group_id": "6bd3bdd4-a705-4d65-abf8-7969c39505c8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: exception: This rule already exists in group 6bd3bdd4-a705-4d65-abf8-7969c39505c8 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6bd3bdd4-a705-4d65-abf8-7969c39505c8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6bd3bdd4-a705-4d65-abf8-7969c39505c8 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6bd3bdd4-a705-4d65-abf8-7969c39505c8 Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:31.433415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:31.440460 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:31.440460 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:31.440460 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6bd3bdd4-a705-4d65-abf8-7969c39505c8 Sep 07 10:07:31.440460 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:31.440460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70dc3468-90fb-4039-8215-dd336e37e5e9 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 400 to user: This rule already exists in group 6bd3bdd4-a705-4d65-abf8-7969c39505c8 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:31.440460 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70dc3468-90fb-4039-8215-dd336e37e5e9 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.129769 Sep 07 10:07:31.441443 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2223/4440] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:31 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:07:31.452572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-463424462"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:31.461595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:31.480851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:31.482077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:31.483846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:31.485316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:31.488563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:31.489253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:31.999483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4826fcb-47bf-4af5-9d77-d6b11dfd2616 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.555267 Sep 07 10:07:32.001405 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2224/4441] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:07:31 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 07 10:07:32.009027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4db63f0c-b185-4613-b753-db06f7c7f288 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b093e5e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:32.051186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b0bd8e0-165a-424f-b403-abb4b1faef8b tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700835 Sep 07 10:07:32.058013 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2218/4442] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:07:31 2022] POST /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:32.071187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:32.072254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:32.090470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:32.098548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:32.101541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:32.104333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:32.105385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:32.106052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:32.108138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:33.110945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:33.136875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:33.152266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:33.153893 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66c3aa75-c10c-4b23-b9e3-ce2580f5c092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 1.094342 Sep 07 10:07:33.156150 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2219/4443] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:32 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:33.164922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:33.172562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:33.221455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:33.221965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:33.227684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:33.228689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:33.230573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:33.232373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:33.314419 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4db63f0c-b185-4613-b753-db06f7c7f288 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/da1750de-aaad-4c36-a9bc-b72522e44556" status: 202 len: 0 microversion: 2.1 time: 1.311349 Sep 07 10:07:33.315003 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2225/4444] 10.222.0.60 () {58 vars in 1287 bytes} [Wed Sep 7 10:07:32 2022] DELETE /compute/v2.1/os-security-group-rules/da1750de-aaad-4c36-a9bc-b72522e44556 => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:33.320414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:33.321159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:33.352185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:33.352576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:33.356638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:33.360859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:33.361616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:33.362850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:33.958145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:33.962499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:33.973207 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-13d73d16-a9b1-4495-92ff-97bc038b8a38 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.814351 Sep 07 10:07:33.973805 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2220/4445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:33 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:33.987515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e91dbdde-8861-4b7c-9113-40d920cd5b4e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.671422 Sep 07 10:07:33.997237 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2226/4446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:33 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:34.010197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66a54346-8b81-4cff-9d5e-e7ca45542da8 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b0903ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1834540636", "description": "tempest-description-515278196"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:34.186280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:34.186990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:34.224256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:34.224774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:34.225252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:34.225991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:34.226462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:34.226897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:34.305709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:34.764411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66a54346-8b81-4cff-9d5e-e7ca45542da8 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.762479 Sep 07 10:07:34.765090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2221/4447] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 10:07:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:34.780513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-09c5ef31-61a4-44b8-9161-edd93b51cf75 req-09e76b0b-dbdd-48f6-9db7-670a948a9ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "name": "network-vif-plugged", "status": "completed", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:34.835704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-09c5ef31-61a4-44b8-9161-edd93b51cf75 req-09e76b0b-dbdd-48f6-9db7-670a948a9ff8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:34.836474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-09c5ef31-61a4-44b8-9161-edd93b51cf75 req-09e76b0b-dbdd-48f6-9db7-670a948a9ff8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:34.837660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-09c5ef31-61a4-44b8-9161-edd93b51cf75 req-09e76b0b-dbdd-48f6-9db7-670a948a9ff8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:34.862306 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-09c5ef31-61a4-44b8-9161-edd93b51cf75 req-09e76b0b-dbdd-48f6-9db7-670a948a9ff8 service nova] Creating event network-vif-plugged:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h2-836830-16 Sep 07 10:07:34.883509 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-09c5ef31-61a4-44b8-9161-edd93b51cf75 req-09e76b0b-dbdd-48f6-9db7-670a948a9ff8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109029 Sep 07 10:07:34.886492 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2222/4448] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:34.907838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85363763-a1ce-4ea6-92c8-f2bea63bff9c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b08a25e0>, body: {"security_group_rule": {"parent_group_id": "2c6da46b-7cce-49db-9992-216ce7302850", "ip_protocol": "tcp", "from_port": 1287603177, "to_port": 22}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:34.987654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:35.006250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:35.015741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:35.019476 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03880768-363d-417a-9cec-770aba794337 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.838394 Sep 07 10:07:35.023150 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2227/4449] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:34 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:07:35.050677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-85363763-a1ce-4ea6-92c8-f2bea63bff9c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Invalid port range 1287603177:22. Former value cannot be greater than the later Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85363763-a1ce-4ea6-92c8-f2bea63bff9c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 146 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: {"security_group_rule": {"parent_group_id": "2c6da46b-7cce-49db-9992-216ce7302850", "ip_protocol": "tcp", "from_port": 1287603177, "to_port": 22}} Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid port range 1287603177:22. Former value cannot be greater than the later Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2c6da46b-7cce-49db-9992-216ce7302850', 'ip_protocol': 'tcp', 'from_port': 1287603177, 'to_port': 22}}} Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1287603177:22. Former value cannot be greater than the later Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1287603177:22. Former value cannot be greater than the later Sep 07 10:07:35.052920 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1287603177:22. Former value cannot be greater than the later Sep 07 10:07:35.056801 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.063656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85363763-a1ce-4ea6-92c8-f2bea63bff9c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 400 to user: Invalid port range 1287603177:22. Former value cannot be greater than the later {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:35.064994 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85363763-a1ce-4ea6-92c8-f2bea63bff9c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.176964 Sep 07 10:07:35.065879 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2223/4450] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:34 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:07:35.075197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:35.079247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:35.103373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:35.116248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:35.117442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:35.119366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:35.122999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:35.124920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:35.174456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f8d3d3d1-5d4e-40b5-9da5-62c739fd98cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: .version_select at 0x7f14b08ea4c0>, body: {"keypair": {"name": "tempest-keypair-1479952548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyzATRUHYQodB3P/QYmzCJFwz8K+tnsKg9bO7DCPMHMhFhNV1FWUuxwB4Vq/MgV/d/5AkNf3NOseRLiznUlro6Y3m1kwRrK0U6+L6Yx8eVUvIZNaQ5XuZPttIK4sLvdgw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:35.214088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f8d3d3d1-5d4e-40b5-9da5-62c739fd98cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:35.229227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f8d3d3d1-5d4e-40b5-9da5-62c739fd98cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:35.277530 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f8d3d3d1-5d4e-40b5-9da5-62c739fd98cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.252983 Sep 07 10:07:35.278163 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2228/4451] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:07:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:35.288223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:35.289914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:35.298080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:35.299102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:35.299865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:35.300820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:35.301532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:35.302201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:35.533535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:35.543103 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb8caaf8-ce20-4cab-a00f-b6e5f647d9c6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1686 microversion: 2.1 time: 0.475669 Sep 07 10:07:35.549920 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2224/4452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:35 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1686 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:35.558177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ec9930f-b422-409b-8aa6-5c5a82ec17dd tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b08a2820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2099060059", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:35.560451 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6ec9930f-b422-409b-8aa6-5c5a82ec17dd tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Security group id should be uuid Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ec9930f-b422-409b-8aa6-5c5a82ec17dd tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 131 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2099060059", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: exception: Security group id should be uuid Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2099060059', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:35.565927 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:35.569951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 07 10:07:35.569951 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:07:35.574131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ec9930f-b422-409b-8aa6-5c5a82ec17dd tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 400 to user: Security group id should be uuid {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:35.576047 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ec9930f-b422-409b-8aa6-5c5a82ec17dd tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.024725 Sep 07 10:07:35.582099 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2225/4453] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:35 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:07:35.606168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba21e7ba-745e-4711-861d-0affdcb8c3be tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b0758820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1902072210", "description": "tempest-description-1655511624"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:36.089010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:36.105714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e5834cf9-9cfb-48f3-a733-270164ccb00b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.821924 Sep 07 10:07:36.108745 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2229/4454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:35 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:36.120399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:36.121563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:36.140457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:36.141508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:36.143347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:36.145891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:36.146546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:36.148974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:36.635158 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ba21e7ba-745e-4711-861d-0affdcb8c3be tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.040853 Sep 07 10:07:36.635922 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2226/4455] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 10:07:35 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:36.642304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:36.643296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:36.662666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:36.664942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:36.665968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:36.668224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:36.670257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:36.671091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:36.836550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:36.852543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:36.858780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:36.862501 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-adba68ff-c90f-4c64-9b14-7b1ca1a1c484 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.751060 Sep 07 10:07:36.864079 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2230/4456] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:36 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:36.883421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb168177-247e-45b2-b439-ebee5b504b2a tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b08aa940>, body: {"security_group_rule": {"parent_group_id": "a88352b0-0dd9-4ae5-b855-591f6ee1ec08", "ip_protocol": "tempest-999-695942065", "from_port": 22, "to_port": 22}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:37.054668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-cb168177-247e-45b2-b439-ebee5b504b2a tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Invalid IP protocol tempest-999-695942065. Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb168177-247e-45b2-b439-ebee5b504b2a tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 156 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: {"security_group_rule": {"parent_group_id": "a88352b0-0dd9-4ae5-b855-591f6ee1ec08", "ip_protocol": "tempest-999-695942065", "from_port": 22, "to_port": 22}} Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid IP protocol tempest-999-695942065. Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a88352b0-0dd9-4ae5-b855-591f6ee1ec08', 'ip_protocol': 'tempest-999-695942065', 'from_port': 22, 'to_port': 22}}} Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-695942065. Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-695942065. Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:37.056832 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-695942065. Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb168177-247e-45b2-b439-ebee5b504b2a tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 400 to user: Invalid IP protocol tempest-999-695942065. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:37.061781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb168177-247e-45b2-b439-ebee5b504b2a tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.194338 Sep 07 10:07:37.065511 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2231/4457] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:36 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:07:37.074205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b9c66cc-6876-4138-ac0d-fd98f57582a7 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b0910dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-187635093", "description": "tempest-description-335672993"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:37.196997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:37.214498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d208bdbb-8050-440a-bbd8-5bdba5e92ca2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.576129 Sep 07 10:07:37.238756 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2227/4458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:36 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:37.261588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:37.262521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:37.277286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:37.290837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:37.291328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:37.292097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:37.295406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:37.296209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:37.995607 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b9c66cc-6876-4138-ac0d-fd98f57582a7 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.928787 Sep 07 10:07:38.007017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:38.012543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2232/4459] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 10:07:37 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:38.019634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-11bc18a2-25bd-4bda-9f52-d54377f70b0b req-bc86e4ea-325a-433e-8f6b-aee490ef7f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-plugged", "status": "completed", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:38.043834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-11bc18a2-25bd-4bda-9f52-d54377f70b0b req-bc86e4ea-325a-433e-8f6b-aee490ef7f10 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:38.044758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-11bc18a2-25bd-4bda-9f52-d54377f70b0b req-bc86e4ea-325a-433e-8f6b-aee490ef7f10 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:38.047157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-11bc18a2-25bd-4bda-9f52-d54377f70b0b req-bc86e4ea-325a-433e-8f6b-aee490ef7f10 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:38.053836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26b304dc-a40c-4145-a5b8-b3ed867aff36 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.813223 Sep 07 10:07:38.063535 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2228/4460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:37 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:38.079445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:38.081461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:38.102377 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-11bc18a2-25bd-4bda-9f52-d54377f70b0b req-bc86e4ea-325a-433e-8f6b-aee490ef7f10 service nova] Creating event network-vif-plugged:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:07:38.127483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-11bc18a2-25bd-4bda-9f52-d54377f70b0b req-bc86e4ea-325a-433e-8f6b-aee490ef7f10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110823 Sep 07 10:07:38.128924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:38.129716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:38.132667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:38.133713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:38.134565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:38.135474 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2233/4461] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:38.136134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:38.164367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa488754-e40f-4de1-b878-abfd3255df12 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b09c0dc0>, body: {"security_group_rule": {"parent_group_id": "9522b72c-344f-493d-bfe0-6440c765e3cb", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:38.205974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:38.603410 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-aa488754-e40f-4de1-b878-abfd3255df12 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa488754-e40f-4de1-b878-abfd3255df12 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 138 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: {"security_group_rule": {"parent_group_id": "9522b72c-344f-493d-bfe0-6440c765e3cb", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9522b72c-344f-493d-bfe0-6440c765e3cb', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 10:07:38.605644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 10:07:38.613022 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:38.616317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa488754-e40f-4de1-b878-abfd3255df12 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:38.618230 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa488754-e40f-4de1-b878-abfd3255df12 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.480145 Sep 07 10:07:38.619069 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2234/4462] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:38 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 483 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:07:38.635224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:38.638059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:38.641396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:38.652287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:38.660472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:38.666915 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-81bc5765-d165-4a7b-9a8a-f3e4dfd139ac tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.601874 Sep 07 10:07:38.671033 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2229/4463] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:38 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:38.674395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:38.676578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:38.680068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:38.685661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:38.686720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:38.690264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:38.692362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5e7fbc5f-6125-4202-9758-955f2017016d tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b074e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-425263430", "description": "tempest-description-85529330"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:39.575240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:39.591336 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62399553-f21b-464b-ae70-271c6128df3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.964277 Sep 07 10:07:39.596340 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2235/4464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:38 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:39.606103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:39.607671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:39.615971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:39.616760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:39.617581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:39.619135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:39.619809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:39.620479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:39.695296 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5e7fbc5f-6125-4202-9758-955f2017016d tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.017247 Sep 07 10:07:39.696533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2230/4465] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 7 10:07:38 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:39.703945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-785798365", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1850076c-60ca-4b3b-8a8e-057cac39480d"}], "security_groups": [{"name": "tempest-securitygroup--307451574"}], "key_name": "tempest-keypair-1479952548", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:40.093803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:40.121791 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f842099c-d4f6-435d-be1f-563b11363e51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.522898 Sep 07 10:07:40.122812 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2236/4466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:39 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:40.134878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:40.135908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:40.155666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:40.158556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:40.159241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:40.166239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:40.170136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:40.171444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:40.598096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:40.612434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:40.625068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:40.626385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d209a87a-066d-493f-852d-f545ddad6277 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.500989 Sep 07 10:07:40.633279 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2237/4467] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:40 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:40.638371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7b0406c-54eb-49e9-8255-ef7c9c03c754 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b090f430>, body: {"security_group_rule": {"parent_group_id": "baa1547b-c141-4450-819e-1132986aa4f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 241590043}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:40.820990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b7b0406c-54eb-49e9-8255-ef7c9c03c754 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Invalid port range 22:241590043. Valid TCP ports should be between 1-65535 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7b0406c-54eb-49e9-8255-ef7c9c03c754 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 145 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: {"security_group_rule": {"parent_group_id": "baa1547b-c141-4450-819e-1132986aa4f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 241590043}} Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid port range 22:241590043. Valid TCP ports should be between 1-65535 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'baa1547b-c141-4450-819e-1132986aa4f0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 241590043}}} Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:241590043. Valid TCP ports should be between 1-65535 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:241590043. Valid TCP ports should be between 1-65535 Sep 07 10:07:40.823136 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:241590043. Valid TCP ports should be between 1-65535 Sep 07 10:07:40.828244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:40.830344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7b0406c-54eb-49e9-8255-ef7c9c03c754 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 400 to user: Invalid port range 22:241590043. Valid TCP ports should be between 1-65535 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:40.831450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b7b0406c-54eb-49e9-8255-ef7c9c03c754 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.196879 Sep 07 10:07:40.832545 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2238/4468] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:40 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:07:40.837435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:40.842993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:40.856296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:40.858066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:40.860759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:40.861868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:40.862565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:40.864240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:41.347643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:41.359409 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e399a0a-0ea2-46c0-9a49-68fec5cd1006 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.525506 Sep 07 10:07:41.361721 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2239/4469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:40 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:41.368084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Action: 'create', calling method: .version_select at 0x7f14b090f040>, body: {"security_group_rule": {"parent_group_id": "fab3139a-0f93-45fb-a96f-b04ab0524886", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:41.400649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 10:07:41.401820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Neutron security group fab3139a-0f93-45fb-a96f-b04ab0524886 not found {{(pid=128832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 10:07:41.402756 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.402756 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 138 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: {"security_group_rule": {"parent_group_id": "fab3139a-0f93-45fb-a96f-b04ab0524886", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: exception: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fab3139a-0f93-45fb-a96f-b04ab0524886', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 10:07:41.405368 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] Sep 07 10:07:41.409340 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:41.421170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 404 to user: Security group fab3139a-0f93-45fb-a96f-b04ab0524886 does not exist Sep 07 10:07:41.421170 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-86e454ed-fa66-4f31-bbba-bd4f8cec8bdb'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:41.422590 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7175857e-4f8d-4072-90c1-0e053779bc1c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.059569 Sep 07 10:07:41.428380 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2240/4470] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 7 10:07:41 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:07:41.447382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:41.450143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:41.465305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:41.466218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:41.466912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:41.468671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:41.469733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:41.470406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:41.930472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:41.946074 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b7745823-bd9a-4530-bd34-af736f0295e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.509369 Sep 07 10:07:41.946682 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2241/4471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:41 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:41.980833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b09d71f0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:42.060547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG neutronclient.v2_0.client [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist", "detail": ""}} {{(pid=128832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 10:07:42.061451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.security_group_api [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Neutron security group rule 60d84769-8269-4a81-ad84-a98660a333d1 not found {{(pid=128832) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 07 10:07:42.062258 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] HTTP exception thrown: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.062258 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Request method failure captured: Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-security-group-rules/60d84769-8269-4a81-ad84-a98660a333d1 HTTP/1.1 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1dU9l8pL7TfPVc4aMsmkvKDPHW_zZI8aT8-00htp-7LzHIxU1Z9DHu5L_ZJCCqW2CSuwC0bkP-rluglLRqpbGyp5wgTpARkYmE1AiIrY5XVDbSL5xyQCs7DSAfV_eRd15Qb_SqVCcH6cox2iTkniXfvFjOUHCw1hlETk8h4l-q7kg Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258f36b2e5c64f37a1bd26f30620a818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258f36b2e5c64f37a1bd26f30620a818", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 258f36b2e5c64f37a1bd26f30620a818 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f100a3190f204aa18432f7e008f6bf56 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-51705050-project Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: exception: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '60d84769-8269-4a81-ad84-a98660a333d1'} Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 10:07:42.067656 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] Sep 07 10:07:42.072271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:07:42.078013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Returning 404 to user: Security group rule 60d84769-8269-4a81-ad84-a98660a333d1 does not exist Sep 07 10:07:42.078013 n-d-836830-16 devstack@n-api.service[128832]: Neutron server returns request_ids: ['req-a75ee68d-f27c-47bf-9418-318d8710984e'] {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:07:42.079193 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d244bb1e-2b30-4a15-9d6a-449cce5c32cf tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/60d84769-8269-4a81-ad84-a98660a333d1" status: 404 len: 199 microversion: 2.1 time: 0.119254 Sep 07 10:07:42.091213 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2242/4472] 10.222.0.60 () {58 vars in 1287 bytes} [Wed Sep 7 10:07:41 2022] DELETE /compute/v2.1/os-security-group-rules/60d84769-8269-4a81-ad84-a98660a333d1 => generated 199 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:07:42.113452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:42.114082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:42.156067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:42.159278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:42.160261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:42.165497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:42.168981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:42.173931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:42.692903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:42.708158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:42.712020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:42.723600 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae125c2a-9f80-4e01-ad7e-8818a30d0b46 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.630654 Sep 07 10:07:42.730281 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2243/4473] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:42 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:42.743870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3eedb30c-af94-44cb-88ef-07d4eb4c4659 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b090fe50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:43.529026 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3eedb30c-af94-44cb-88ef-07d4eb4c4659 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/baa1547b-c141-4450-819e-1132986aa4f0" status: 202 len: 0 microversion: 2.1 time: 0.791191 Sep 07 10:07:43.531620 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2244/4474] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 10:07:42 2022] DELETE /compute/v2.1/os-security-groups/baa1547b-c141-4450-819e-1132986aa4f0 => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:43.538530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:43.539470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:43.559955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:43.565801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:43.572594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:43.575189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:43.578279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:43.578989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:44.043164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:44.053788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-64983585-afc7-493e-9995-6d26487a8bb9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.520463 Sep 07 10:07:44.077871 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2245/4475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:43 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:44.088256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:44.093117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:44.112902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:44.114501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:44.115668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:44.117379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:44.118953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:44.127156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:44.982253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:44.996397 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94f9a4d1-412f-455a-a62f-89fb27fa5cfa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1202 microversion: 2.1 time: 0.917088 Sep 07 10:07:45.019755 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2246/4476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:44 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1202 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:45.033604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-df9c4a0a-72ff-4d91-819b-487c6d418701 req-e1efb14b-ac98-4ad8-bcb2-e8df7cda1014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0cb929d-0bf8-4e43-863b-5a9b09598f51", "name": "network-vif-plugged", "status": "completed", "tag": "a9dca1d4-3bdf-408b-8c66-c865160d62d1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:45.053218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:45.084364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-df9c4a0a-72ff-4d91-819b-487c6d418701 req-e1efb14b-ac98-4ad8-bcb2-e8df7cda1014 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:45.084874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-df9c4a0a-72ff-4d91-819b-487c6d418701 req-e1efb14b-ac98-4ad8-bcb2-e8df7cda1014 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:45.085342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-df9c4a0a-72ff-4d91-819b-487c6d418701 req-e1efb14b-ac98-4ad8-bcb2-e8df7cda1014 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:45.121696 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-df9c4a0a-72ff-4d91-819b-487c6d418701 req-e1efb14b-ac98-4ad8-bcb2-e8df7cda1014 service nova] Creating event network-vif-plugged:a9dca1d4-3bdf-408b-8c66-c865160d62d1 for instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 on n-h1-836830-16 Sep 07 10:07:45.134547 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-df9c4a0a-72ff-4d91-819b-487c6d418701 req-e1efb14b-ac98-4ad8-bcb2-e8df7cda1014 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113601 Sep 07 10:07:45.145527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2247/4477] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:45.156421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c9bb5a16-2b31-41ee-8d84-c1198c9be54d tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b092f820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:45.241850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:45.827147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c9bb5a16-2b31-41ee-8d84-c1198c9be54d tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/9522b72c-344f-493d-bfe0-6440c765e3cb" status: 202 len: 0 microversion: 2.1 time: 0.679386 Sep 07 10:07:45.827936 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2248/4478] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 10:07:45 2022] DELETE /compute/v2.1/os-security-groups/9522b72c-344f-493d-bfe0-6440c765e3cb => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:45.835066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:45.836086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:45.907764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:45.912563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:45.938307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:45.944452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:45.945774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:45.947306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:46.430721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:46.441617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:46.444046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:46.445803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67cf7cbe-cb9a-453a-a0e2-3a3e080c6f75 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.616473 Sep 07 10:07:46.447840 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2249/4479] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:45 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:46.454421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:46.455311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:46.464659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:46.465574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:46.466225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:46.468384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:46.469035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:46.469656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:46.748817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:46.761746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41760868-9277-49db-b09f-afb49a3d9440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.312227 Sep 07 10:07:46.780433 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2250/4480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:46 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:46.787112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e3cdf8f2-1355-44eb-9639-f1867f6b989c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b08ca550>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:47.162010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e3cdf8f2-1355-44eb-9639-f1867f6b989c tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a88352b0-0dd9-4ae5-b855-591f6ee1ec08" status: 202 len: 0 microversion: 2.1 time: 0.378646 Sep 07 10:07:47.166480 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2251/4481] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 10:07:46 2022] DELETE /compute/v2.1/os-security-groups/a88352b0-0dd9-4ae5-b855-591f6ee1ec08 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:47.175779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:47.183882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:47.198468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:47.200769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:47.201510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:47.203060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:47.203816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:47.205167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:47.728840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:47.745941 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a4a9733-784d-43bb-bf05-ed8f31462b8e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1389 microversion: 2.1 time: 0.577684 Sep 07 10:07:47.746535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2252/4482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:47 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1389 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:47.786465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58c290e7-7e87-4e5b-95e4-035efe296d92 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b08ca8b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:48.312696 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58c290e7-7e87-4e5b-95e4-035efe296d92 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/2c6da46b-7cce-49db-9992-216ce7302850" status: 202 len: 0 microversion: 2.1 time: 0.528150 Sep 07 10:07:48.313909 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2253/4483] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 10:07:47 2022] DELETE /compute/v2.1/os-security-groups/2c6da46b-7cce-49db-9992-216ce7302850 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:48.330742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:48.332555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:48.372679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:48.372679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:48.372679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:48.372679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:48.372679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:48.372679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:48.640166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:48.740710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:48.767851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:48.769617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:48.770852 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b5877ab6-6a1e-4543-b1f6-7e620e1638f7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.451571 Sep 07 10:07:48.771424 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2254/4484] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:48 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:48.784988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:48.786098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:48.800495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:48.811393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:48.812172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:48.812950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:48.813455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:48.821081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:49.175937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:49.184661 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-793e407c-eacd-4ade-823a-b2a4fbc052bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1389 microversion: 2.1 time: 0.412181 Sep 07 10:07:49.185813 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2255/4485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:48 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1389 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:49.190745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:49.191363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:49.197455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:49.197947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:49.198384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:49.199084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:49.199932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:49.200368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:49.245219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:49.552395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:49.563198 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9e4a55cd-60b3-4d16-83a0-a7d2c3c257c4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.375917 Sep 07 10:07:49.563803 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2256/4486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:49 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:49.579725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c6983fc-2a9f-46ee-8ce7-067d5601e866 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] Calling method '.version_select at 0x7f14b08caa60>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:49.753668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=15 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:50.133698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c6983fc-2a9f-46ee-8ce7-067d5601e866 tempest-SecurityGroupRulesNegativeTestJSON-51705050 tempest-SecurityGroupRulesNegativeTestJSON-51705050-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6bd3bdd4-a705-4d65-abf8-7969c39505c8" status: 202 len: 0 microversion: 2.1 time: 0.568774 Sep 07 10:07:50.137738 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2257/4487] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 7 10:07:49 2022] DELETE /compute/v2.1/os-security-groups/6bd3bdd4-a705-4d65-abf8-7969c39505c8 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:07:50.144259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:50.144895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:50.196993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:50.204999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:50.206065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:50.207061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:50.207541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:50.214494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:51.249145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:51.258139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0be87c2f-3c29-4737-a698-624e7831ce7f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1389 microversion: 2.1 time: 1.122826 Sep 07 10:07:51.271975 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2258/4488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:50 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1389 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:51.277215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:51.277991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:51.305337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:51.308079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:51.308717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:51.311138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:51.318023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:51.319559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:51.951068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:51.972965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:51.984700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:51.986180 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28a59625-a976-4255-a392-ad124287d4a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.712907 Sep 07 10:07:52.012774 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2259/4489] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:51 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:52.032309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:52.032958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:52.042542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:52.043629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:52.046014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:52.047394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:52.048439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:52.049044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:52.930729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:52.940584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aee7bc92-ef96-4047-b9fc-5ec5602855e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 0.926163 Sep 07 10:07:52.941527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2260/4490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:52 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:52.957202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:52.984714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:53.010353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.010853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.011293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.012003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.012453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.012872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.110780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2957d638-9ba4-477c-9a3c-a5fb1cc755a1 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158250 Sep 07 10:07:53.111400 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2261/4491] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:07:52 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:53.136439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:53.137384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:53.166018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.166521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.167430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.169605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.170902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.172620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.232031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:07:53.450294 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-efd0e6af-30ba-49cf-8dea-2d1233253288 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 204 len: 0 microversion: 2.1 time: 0.337360 Sep 07 10:07:53.464759 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2262/4492] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:07:53 2022] DELETE /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:07:53.470627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:53.478150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:53.495893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.497941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.500594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.506307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.507004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.509853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.852831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:53.866806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:53.868401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:53.871222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c19572b0-9852-4319-9360-5ccaec76f57c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.405103 Sep 07 10:07:53.877060 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2263/4493] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:53 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:53.891286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:53.893365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:53.917832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.918714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.922323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:53.927173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:53.928005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:53.928660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:54.031312 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75c28b78-0b11-46a4-9612-f324cfa25679 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/e65054b8-5641-4236-880a-2d54d4215264" status: 200 len: 194 microversion: 2.1 time: 0.144445 Sep 07 10:07:54.032366 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2264/4494] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 7 10:07:53 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/e65054b8-5641-4236-880a-2d54d4215264 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:54.037036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:54.037778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:54.050401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:54.052981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:54.053483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:54.054235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:54.054694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:54.055131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:54.991833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:55.008510 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e564b9c-d3a0-4fe0-abe1-7e7c47b541f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1395 microversion: 2.1 time: 0.968114 Sep 07 10:07:55.023153 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2265/4495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:54 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1395 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:55.042433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:55.048162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:55.068385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:55.073844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:55.074561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:55.075677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:55.080728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:55.081345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:56.315731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:56.329589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bbc2f07c-5fe3-4e71-91c6-e1f4934e52eb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1681 microversion: 2.1 time: 1.304965 Sep 07 10:07:56.337945 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2266/4496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:55 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1681 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:56.362041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:56.364306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:56.389567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:56.390610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:56.391390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:56.392311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:56.392932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:56.393570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:57.247734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:57.259091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:57.260555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:57.266526 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c321e272-db10-422a-a8df-0d516a849e0e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1738 microversion: 2.20 time: 0.926124 Sep 07 10:07:57.279456 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2267/4497] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:56 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1738 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:07:57.289254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:57.290158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:57.299441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:57.303093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:57.304901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:57.307138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:57.308308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:57.308899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:57.376283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] validate_networks() for [('1850076c-60ca-4b3b-8a8e-057cac39480d', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:07:58.035005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:58.073827 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa932c60-20f7-46e0-a11c-b3f91f7836e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1353 microversion: 2.1 time: 0.786927 Sep 07 10:07:58.078132 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2268/4498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:57 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1353 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:58.084445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:58.087540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:58.102892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:58.104046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:58.104787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:58.106257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:58.106970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:58.107775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:58.989875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:07:59.000206 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60370d44-0120-4f5e-8756-2bbe8c2dcb3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.920329 Sep 07 10:07:59.001965 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2269/4499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:58 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:07:59.018560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "682bf339-82cc-4e5c-ba60-39dd91f0b872"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:59.027038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:59.055599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.056268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.063246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.064465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.067008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.071593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.539645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:07:59.540296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:07:59.541286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:07:59.541707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:07:59.542690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:07:59.579331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.581534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.582601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.584184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.584675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.585096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.643951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:07:59.653688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:07:59.671140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:07:59.673801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:07:59.702279 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2d75ba6-1d49-4719-9bd3-db6c9914e70f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "POST /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695699 Sep 07 10:07:59.713450 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2270/4500] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:07:59 2022] POST /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:59.752551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7f488768-5643-487d-822e-2b370e491a4b req-ad6c48c0-806a-455b-a4b0-f6da22289c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0cb929d-0bf8-4e43-863b-5a9b09598f51", "name": "network-vif-deleted", "tag": "a9dca1d4-3bdf-408b-8c66-c865160d62d1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:07:59.796118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7f488768-5643-487d-822e-2b370e491a4b req-ad6c48c0-806a-455b-a4b0-f6da22289c44 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.796593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7f488768-5643-487d-822e-2b370e491a4b req-ad6c48c0-806a-455b-a4b0-f6da22289c44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.797077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7f488768-5643-487d-822e-2b370e491a4b req-ad6c48c0-806a-455b-a4b0-f6da22289c44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.821449 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3cc32880-5fe4-4451-9b9c-aa099cb1c3aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 20.122917 Sep 07 10:07:59.828477 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2231/4501] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:07:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 20131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:07:59.833635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:59.834244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:59.837944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:07:59.847619 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7f488768-5643-487d-822e-2b370e491a4b req-ad6c48c0-806a-455b-a4b0-f6da22289c44 service nova] Creating event network-vif-deleted:a9dca1d4-3bdf-408b-8c66-c865160d62d1 for instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 on n-h1-836830-16 Sep 07 10:07:59.865947 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7f488768-5643-487d-822e-2b370e491a4b req-ad6c48c0-806a-455b-a4b0-f6da22289c44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141090 Sep 07 10:07:59.869004 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2271/4502] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:07:59.873889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.874574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.875167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.877662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.878285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.879856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:07:59.880472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.887475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:07:59.917834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.927187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.929125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:07:59.937579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:07:59.939035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:07:59.940280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:00.471266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:00.487678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f630d863-9f17-4aa5-9961-f2bcfa8a73df tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1187 microversion: 2.1 time: 0.615759 Sep 07 10:08:00.488921 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2272/4503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:07:59 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1187 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:00.501720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31299f34-2d7f-48dc-90f9-73f04dfc8681 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:00.505362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-31299f34-2d7f-48dc-90f9-73f04dfc8681 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:00.956868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-31299f34-2d7f-48dc-90f9-73f04dfc8681 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:00.972484 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31299f34-2d7f-48dc-90f9-73f04dfc8681 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1241 microversion: 2.1 time: 0.480593 Sep 07 10:08:00.973106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2273/4504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:00 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1241 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:00.993110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:00.994533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:00.995654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:01.024602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:01.027831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:01.028756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:01.033417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:01.035060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:01.037121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:01.038644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:01.038952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:01.042729 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bfa9b321-ab30-4a6a-a9c7-fa6c491a3173 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1720 microversion: 2.20 time: 1.212835 Sep 07 10:08:01.063786 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2232/4505] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:07:59 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1720 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:01.473851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:01.485421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8f999a8-f60c-40a3-a4e0-4bd9da4dbead tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.507087 Sep 07 10:08:01.485421 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2274/4506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:00 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:01.516932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:01.518085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:01.535006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:01.535664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:01.536207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:01.537120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:01.537801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:01.538449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:01.661990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:01.680618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d577ef34-764e-4054-8160-3dafdd0a9610 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1187 microversion: 2.1 time: 0.164491 Sep 07 10:08:01.682104 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2233/4507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:01 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:02.000656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:02.001309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:02.023115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:02.026949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:02.027521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:02.028302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:02.028794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:02.029807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:02.081944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:02.082573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:02.094720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:02.095222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:02.095668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:02.104171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:02.104729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:02.105276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:02.359030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:02.370356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-400735e8-5f7a-49d9-99c5-6f1c0e7e4d3c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1245 microversion: 2.1 time: 0.372813 Sep 07 10:08:02.374235 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2275/4508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:01 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1245 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:02.706730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:02.707520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:02.722927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:02.724432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:02.724829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:02.731623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:02.734448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:02.734960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:02.990299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:03.005278 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa34cb15-c5da-42a3-9f83-11e183194874 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1187 microversion: 2.1 time: 0.305259 Sep 07 10:08:03.006502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2276/4509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:02 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1187 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:03.012268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:03.017719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1fc0244d-c2f3-4b71-8abf-bb77913b6194 req-4f39e322-2139-42ac-8c01-82b6988af0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "name": "network-vif-unplugged", "status": "completed", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:03.024825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:03.037329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:03.043268 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb1bcc39-d843-4b22-8a49-6317486eade8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1720 microversion: 2.20 time: 0.965283 Sep 07 10:08:03.049082 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2234/4510] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:02 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1720 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:03.076899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1fc0244d-c2f3-4b71-8abf-bb77913b6194 req-4f39e322-2139-42ac-8c01-82b6988af0a6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:03.079751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1fc0244d-c2f3-4b71-8abf-bb77913b6194 req-4f39e322-2139-42ac-8c01-82b6988af0a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:03.080602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1fc0244d-c2f3-4b71-8abf-bb77913b6194 req-4f39e322-2139-42ac-8c01-82b6988af0a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:03.107759 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1fc0244d-c2f3-4b71-8abf-bb77913b6194 req-4f39e322-2139-42ac-8c01-82b6988af0a6 service nova] Creating event network-vif-unplugged:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h2-836830-16 Sep 07 10:08:03.164937 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1fc0244d-c2f3-4b71-8abf-bb77913b6194 req-4f39e322-2139-42ac-8c01-82b6988af0a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154443 Sep 07 10:08:03.168595 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2277/4511] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:03.414880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:03.416334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:03.442966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:03.443675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:03.447774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:03.448559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:03.449037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:03.452513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:03.738245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:03.754389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7dcb5b2-c69c-405e-9975-e4b10907301c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1293 microversion: 2.1 time: 0.356502 Sep 07 10:08:03.757637 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2235/4512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:03 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:03.979135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:03.980581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:03.995703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:03.996441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:03.997218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:03.998391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:03.999122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:03.999765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.033504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:04.034293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:04.041478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.041972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.042773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.043651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.044278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.045542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.170095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:04.207976 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eeeada27-7560-4d4c-831a-3dfd7319e355 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1187 microversion: 2.1 time: 0.177322 Sep 07 10:08:04.213231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2236/4513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:04 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1187 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:04.226536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:04.227156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:04.257505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.258011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.258451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.259161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.259616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.266204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.416272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:04.427529 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40e26a3d-06a4-440f-811f-49461fc01ab4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.452450 Sep 07 10:08:04.452359 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2278/4514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:03 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:04.459283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:04.460297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:04.471276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.471972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.472475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.474007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.474695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.475368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.664207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:04.682394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:04.688189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:04.690454 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68a329d1-0c77-4007-8439-ffb11a060a0a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1723 microversion: 2.20 time: 0.476686 Sep 07 10:08:04.709390 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2237/4515] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:04 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:04.724258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b983b0f1-6a65-4432-93fd-eb0867f4ea9d"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:04.750268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:04.763056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.764199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.764833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.765797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.766455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.767176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.870453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:04.882556 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e49fd108-0e45-4e64-bca2-935b68d0b588 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.427073 Sep 07 10:08:04.884071 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2279/4516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:04 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:04.893324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:04.896525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:04.921013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.923658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.924308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:04.926114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:04.929824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:04.930618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:05.084425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:05.103716 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41e852a4-d1cc-4d90-923c-a0db2119ac98 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1299 microversion: 2.1 time: 0.218219 Sep 07 10:08:05.104314 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2280/4517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:04 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:05.117340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:05.118228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:05.129594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:05.130393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:05.130996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:05.131927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:05.136026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:05.136787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.228368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:06.243442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9190ef72-5a0c-41e7-b3e0-6357f9f25819 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.137710 Sep 07 10:08:06.245873 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2281/4518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:05 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:06.252667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:06.253634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:06.261301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.261988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.262589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.264297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.264963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.265900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.372394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:06.383696 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b40fb5a9-e0bc-4630-ad2a-a82cc7e496da tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 200 len: 1187 microversion: 2.1 time: 0.135839 Sep 07 10:08:06.384056 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2282/4519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:06 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 1187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:06.392314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3fa98142-831f-4677-8128-534e7f0f8c8e req-1e2ab239-effe-4a36-a6e8-8f7c869f3bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-unplugged", "status": "completed", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:06.405775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3fa98142-831f-4677-8128-534e7f0f8c8e req-1e2ab239-effe-4a36-a6e8-8f7c869f3bfe service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.406528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3fa98142-831f-4677-8128-534e7f0f8c8e req-1e2ab239-effe-4a36-a6e8-8f7c869f3bfe service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.406968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3fa98142-831f-4677-8128-534e7f0f8c8e req-1e2ab239-effe-4a36-a6e8-8f7c869f3bfe service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.428808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3fa98142-831f-4677-8128-534e7f0f8c8e req-1e2ab239-effe-4a36-a6e8-8f7c869f3bfe service nova] Creating event network-vif-unplugged:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:08:06.445776 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3fa98142-831f-4677-8128-534e7f0f8c8e req-1e2ab239-effe-4a36-a6e8-8f7c869f3bfe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060226 Sep 07 10:08:06.446399 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2283/4520] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:06.472720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:06.473771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:06.480679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.481433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.483320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.484395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.485153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.485770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.658023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:06.672601 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62cbb9f4-cfe8-4739-9c63-83cdf517470f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1299 microversion: 2.1 time: 0.216439 Sep 07 10:08:06.674021 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2284/4521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:06 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:06.704350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:06.713416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:06.736678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.737374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.742511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.745776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.746595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.751001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.930736 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc1c834f-e560-4d13-87e5-3c32ce68da4a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.252149 Sep 07 10:08:06.934495 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2285/4522] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:08:06 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:08:06.956500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:06.957893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:06.977426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.980770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.981449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:06.985325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:06.986011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:06.986611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:07.450268 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cae0ad65-715b-47a0-8e20-704dd954893e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.733743 Sep 07 10:08:07.454928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2238/4523] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 7 10:08:04 2022] POST /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 188 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:08:07.486676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:07.490955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0cb929d-0bf8-4e43-863b-5a9b09598f51] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:07.518499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:07.519382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:07.521540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:07.527196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:07.530134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:07.532287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:07.572866 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 could not be found. Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 HTTP/1.1 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 could not be found. Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'd0cb929d-0bf8-4e43-863b-5a9b09598f51'} Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 could not be found. Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 could not be found. Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:08:07.575181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 could not be found. Sep 07 10:08:07.586762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:07.590656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance d0cb929d-0bf8-4e43-863b-5a9b09598f51 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:08:07.592214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66c5bad7-1f62-43f0-9be0-fea413e1d78c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51" status: 404 len: 111 microversion: 2.1 time: 0.135677 Sep 07 10:08:07.593546 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2239/4524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:07 2022] GET /compute/v2.1/servers/d0cb929d-0bf8-4e43-863b-5a9b09598f51 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:08:07.594038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:07.602193 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5de0fc98-777d-41db-9c5f-6eab019252cf tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1670 microversion: 2.1 time: 0.659556 Sep 07 10:08:07.613508 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2286/4525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:06 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:07.698027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:07.699254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:07.710876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:07.714328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:07.714901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:07.717907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:07.718486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:07.719177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:07.907188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:07.908188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:07.923039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:07.931749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:07.934289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:07.938565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:07.947468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:07.948301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:08.183006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128832) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 10:08:08.386983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-22b51b46-3513-4483-a4a0-1ff68b4d95fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/action" status: 202 len: 0 microversion: 2.20 time: 0.487916 Sep 07 10:08:08.389027 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2287/4526] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:08:07 2022] POST /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:08:08.424156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:08.424802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:08.451585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:08.452470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:08.452974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:08.453739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:08.454208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:08.454641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:08.634331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:08.650817 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b440dcd5-fbc6-4edd-9d2b-873d8e034c18 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 0.957428 Sep 07 10:08:08.661638 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2240/4527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:07 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:08.672082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:08.672082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:08.689158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:08.689158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:08.689511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:08.689999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:08.690569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:08.690990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:09.583202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:09.590572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:09.591805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:09.603778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:09.605292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:09.605727 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18d1197d-ea84-4f09-b8a0-af25cb0098b1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1670 microversion: 2.1 time: 0.947427 Sep 07 10:08:09.606764 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2241/4528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:08 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1670 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:09.627236 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2498dcd4-3266-4855-bbc4-f96aca3b5d0f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1749 microversion: 2.20 time: 1.214602 Sep 07 10:08:09.634007 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2288/4529] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:08 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1749 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:09.679819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:09.680441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:09.690254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:09.691892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:09.695258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:09.697964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:09.704563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:09.705903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:09.706864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:09.707548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:10.634125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:10.634744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:10.654746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:10.655324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:10.655893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:10.659949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:10.662492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:10.663225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:10.961644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:11.290163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:11.309009 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd9eacf1-3295-4010-976a-581978516a63 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 1.632689 Sep 07 10:08:11.322032 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2242/4530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:09 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:11.327527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:11.328343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:11.340097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:11.342030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:11.347378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:11.348380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:11.349241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:11.349927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:11.717212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:11.728660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5054f846-9be9-4215-83e0-1b5a4984ed57 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1670 microversion: 2.1 time: 1.098370 Sep 07 10:08:11.748227 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2289/4531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:10 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1670 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:12.112966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:12.162039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:12.165473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:12.172227 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b726190-0a61-43c3-8baa-67b0c2e5672e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 0.848702 Sep 07 10:08:12.174374 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2243/4532] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:11 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:12.324479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3cac68ab-ee90-437d-be91-89aac2d9abe7 req-a4c1bd25-d0f8-468a-8568-6a5e77abb0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65605bef-4101-4f64-ad05-fe9dbe2c3f65", "tag": "19e17a81-1b2c-4cda-a71f-5519113ea77f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:12.336863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3cac68ab-ee90-437d-be91-89aac2d9abe7 req-a4c1bd25-d0f8-468a-8568-6a5e77abb0a7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:12.338764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3cac68ab-ee90-437d-be91-89aac2d9abe7 req-a4c1bd25-d0f8-468a-8568-6a5e77abb0a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:12.344410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3cac68ab-ee90-437d-be91-89aac2d9abe7 req-a4c1bd25-d0f8-468a-8568-6a5e77abb0a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:12.360101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:12.360646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:12.364559 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3cac68ab-ee90-437d-be91-89aac2d9abe7 req-a4c1bd25-d0f8-468a-8568-6a5e77abb0a7 service nova] Creating event network-changed:19e17a81-1b2c-4cda-a71f-5519113ea77f for instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 on n-h2-836830-16 Sep 07 10:08:12.374304 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3cac68ab-ee90-437d-be91-89aac2d9abe7 req-a4c1bd25-d0f8-468a-8568-6a5e77abb0a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062230 Sep 07 10:08:12.375834 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2290/4533] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:12.386723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:12.387472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:12.388610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:12.389503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:12.390046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:12.390488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:12.757888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:12.758610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:12.766861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:12.768035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:12.769397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:12.770865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:12.771629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:12.772287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:12.856155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:12.866051 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7010a92-6e8a-4e0d-91a6-43d5f4051f8f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 0.515772 Sep 07 10:08:12.869085 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2244/4534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:12 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:13.099908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:13.116379 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5f43f8d-cc4f-4333-9623-e52375cf6396 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.364073 Sep 07 10:08:13.130536 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2291/4535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:12 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:13.143833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:13.146347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:13.165460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:13.165959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:13.166401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:13.167110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:13.167569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:13.167994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:13.203555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:13.204099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:13.212528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:13.213022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:13.222191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:13.223034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:13.223522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:13.223968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:13.306349 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d613c472-c542-4739-9ba4-d94b3d89cc3e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 200 len: 322 microversion: 2.1 time: 0.164551 Sep 07 10:08:13.307944 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2245/4536] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:08:13 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:08:13.320717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:13.321698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:13.332521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:13.333216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:13.333831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:13.334715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:13.335333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:13.335920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:13.403473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:13.964652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:13.967129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:13.980727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:13.981938 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-abd36a0e-47c8-40dc-a972-8e04ed46ad8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.664688 Sep 07 10:08:13.986278 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2246/4537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:13 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:13.987177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:13.992881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b411989-8226-47c8-83c7-1c00e7b4e68c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 0.794023 Sep 07 10:08:13.993085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:13.993756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:14.004755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:14.005735 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2292/4538] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:13 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:14.006397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:14.010222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:14.012735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:14.020640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:14.024524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:14.035800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:14.036985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:14.048030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:14.049341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:14.050765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:14.052726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:14.054360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:14.054830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:14.458426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:14.472121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9fafa980-be73-4d3e-9384-f99f9968bfc2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 0.484457 Sep 07 10:08:14.473161 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2247/4539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:13 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:14.548218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:14.558499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e52fc6ae-096e-44e4-af89-ea7295629ed9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.541556 Sep 07 10:08:14.580076 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2293/4540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:14 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:14.593285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:14.593908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:14.611012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:14.615000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:14.615702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:14.617283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:14.620769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:14.623362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:15.024684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:15.026011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:15.035164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:15.045516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:15.058754 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91e0ec92-0fd1-4cf5-949c-4a4cadaece69 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.470783 Sep 07 10:08:15.061370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:15.062367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:15.063059 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2248/4541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:14 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:15.080083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:15.082268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:15.086138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:15.091045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:15.093574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:15.094206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:15.127382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:15.127382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:15.127382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:15.127382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:15.127382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:15.127382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:16.077626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:16.090499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:16.103632 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f85beacb-3558-49f8-ac08-6cda4ddf84f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.014666 Sep 07 10:08:16.109062 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2249/4542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:15 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:16.116723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:16.118902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:16.140912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:16.141476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:16.141945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:16.143840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:16.144528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:16.147203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:16.147360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:16.148999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:16.155691 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb2f363a-9f00-43bf-baf7-874aed6eef36 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 1.135906 Sep 07 10:08:16.160831 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2294/4543] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:15 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:16.316854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2145254110", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:16.461781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] validate_networks() for [('a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:08:16.893862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:16.901678 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f332115-587a-41d9-918e-f376b04d1c0c tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 0.791327 Sep 07 10:08:16.905905 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2250/4544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:16 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:17.189685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:17.190432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:17.208182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:17.209085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:17.212359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:17.213501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:17.217651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:17.218275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:17.875163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:17.886738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:17.888769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:17.898996 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0d65ce7-15c8-4f67-9a47-344ce73bb8ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 0.713090 Sep 07 10:08:17.907687 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2251/4545] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:17 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:17.931213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:17.932108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:17.942858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:17.943683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:17.946367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:17.947335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:17.947981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:17.951272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:18.020494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:08:18.021535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:08:18.022176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:08:18.022786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:08:18.023367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:08:18.043885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:18.044670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:18.045548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:18.050861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:18.051584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:18.052181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:18.092807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:08:18.104672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for user 6a8b10f41570421a9292168d0326bae0 and project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:08:18.160802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:08:18.171880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:08:18.302108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:18.307281 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b864987-ef7f-4152-8be6-0995e5dc3811 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.993831 Sep 07 10:08:18.308215 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2295/4546] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:08:18.318824 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-834ca012-d783-424b-af9d-84135adeeefe tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 0.391362 Sep 07 10:08:18.320722 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2252/4547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:17 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:18.328837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf8cad63-b08c-49c9-ae10-9490813051b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:18.342181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf8cad63-b08c-49c9-ae10-9490813051b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:18.502615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cf8cad63-b08c-49c9-ae10-9490813051b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:18.511536 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf8cad63-b08c-49c9-ae10-9490813051b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1215 microversion: 2.1 time: 0.189359 Sep 07 10:08:18.520202 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2253/4548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:18 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:18.656456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe64df23-9586-4dc1-a62a-329239c4b96f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Action: 'create', calling method: .version_select at 0x7f14b082a700>, body: {"keypair": {"name": "tempest-keypair-1058019951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZs0+iXezKSer/dXzjZec+qv6rPtU+b6ycu+RyviE3PoQQDVxZxushrFBISwzCgQE1MP8ZCWEcctX73GxCPf5Sfot50r5deY1uT28e/WMBsj57FPuEqpcjXhaR5B59MyA=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:18.708855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fe64df23-9586-4dc1-a62a-329239c4b96f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Getting quotas for project a99d3f866a9f4d8ea033d85f3ec53016. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:08:18.719874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-fe64df23-9586-4dc1-a62a-329239c4b96f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Getting quotas for user b1530e0cafad4cf6b10e9da58d2ffaa9 and project a99d3f866a9f4d8ea033d85f3ec53016. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:08:18.830055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ab6e23a2-a54d-4e64-a2e9-681719c82625 req-7c5ab53f-cbdf-4347-a98d-5d9239d52b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65605bef-4101-4f64-ad05-fe9dbe2c3f65", "name": "network-vif-plugged", "status": "completed", "tag": "19e17a81-1b2c-4cda-a71f-5519113ea77f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:18.851661 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe64df23-9586-4dc1-a62a-329239c4b96f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.540426 Sep 07 10:08:18.852854 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2296/4549] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:08:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:18.875817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ab6e23a2-a54d-4e64-a2e9-681719c82625 req-7c5ab53f-cbdf-4347-a98d-5d9239d52b87 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:18.876397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ab6e23a2-a54d-4e64-a2e9-681719c82625 req-7c5ab53f-cbdf-4347-a98d-5d9239d52b87 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:18.876846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ab6e23a2-a54d-4e64-a2e9-681719c82625 req-7c5ab53f-cbdf-4347-a98d-5d9239d52b87 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:18.932939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:18.934388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:18.950102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:18.952087 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ab6e23a2-a54d-4e64-a2e9-681719c82625 req-7c5ab53f-cbdf-4347-a98d-5d9239d52b87 service nova] Creating event network-vif-plugged:19e17a81-1b2c-4cda-a71f-5519113ea77f for instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 on n-h2-836830-16 Sep 07 10:08:18.957464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:18.958749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:18.959727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:18.960410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:18.964660 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ab6e23a2-a54d-4e64-a2e9-681719c82625 req-7c5ab53f-cbdf-4347-a98d-5d9239d52b87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139333 Sep 07 10:08:18.967229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:18.970959 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2254/4550] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:19.351538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:19.352935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:19.379231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:19.380919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:19.383596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:19.386123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:19.390119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:19.395655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:19.491251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:19.513908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:19.516122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:19.518107 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-987ed60d-ff01-4b78-8e52-7e1f6787e681 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 0.590036 Sep 07 10:08:19.519131 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2297/4551] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:18 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:19.538357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2272276-ec9d-438f-bbd0-500683d4b49d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:19.539331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2272276-ec9d-438f-bbd0-500683d4b49d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:19.704960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2272276-ec9d-438f-bbd0-500683d4b49d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:19.712984 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2272276-ec9d-438f-bbd0-500683d4b49d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1215 microversion: 2.1 time: 0.178887 Sep 07 10:08:19.716865 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2298/4552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:19 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:19.842203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:19.859870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d472dcee-3fbc-43bf-ad83-7afc40e6a8d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1366 microversion: 2.1 time: 0.513237 Sep 07 10:08:19.864372 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2255/4553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:19 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:20.557263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:20.558160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:20.566687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:20.571705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:20.576264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:20.577457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:20.583817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:20.585274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:20.740062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:20.741416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:20.763698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:20.769242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:20.769242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:20.769242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:20.774221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:20.775006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:20.777790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:21.211687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:21.227646 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88a1615a-54a9-4713-94a5-0b5c69431b99 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1275 microversion: 2.1 time: 0.491563 Sep 07 10:08:21.228254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2256/4554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:20 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1275 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:21.241979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:21.243254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:21.293004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:21.300283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:21.301312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:21.302297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:21.302988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:21.303659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:22.040885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:22.059417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:22.062152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:22.063575 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4fa5837c-1c1f-4b42-913d-d771ed533b39 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 1.514122 Sep 07 10:08:22.086948 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2299/4555] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:20 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:22.263709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:22.264350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:22.287266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:22.289915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:22.291348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:22.292130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:22.298397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:22.299118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:22.556667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:22.587162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c65cb124-213f-48b0-994a-cd4b8c9a2b4a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1555 microversion: 2.1 time: 1.347365 Sep 07 10:08:22.588384 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2257/4556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:21 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1555 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:22.614042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:22.615221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:22.647347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:22.652414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:22.655448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:22.656815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:22.658756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:22.659469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:22.875871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:22.886658 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-694fc35b-7fbd-4071-965c-b005b894dd6f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1273 microversion: 2.1 time: 0.628695 Sep 07 10:08:22.887243 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2300/4557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:22 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1273 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:23.100772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:23.101454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:23.102901 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9953a97-a513-4950-a5c5-bb25f8d4c152 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.494414 Sep 07 10:08:23.108137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2258/4558] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:08:22 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-interface => generated 284 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:08:23.147603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.148292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.154848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.162319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.170377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.171245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.413016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:23.415815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:23.439688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.448937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.449676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.452197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.453675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.455170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.530820 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-637cd415-be21-4b6b-9f56-f62a840602c2 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.124466 Sep 07 10:08:23.532170 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2259/4559] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:08:23 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:08:23.708657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:23.709326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:23.723153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.723661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.724132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.724832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.730306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.730891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.861073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8b60b41-99f3-4b00-b30a-80069d8c9b66 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/e65054b8-5641-4236-880a-2d54d4215264" status: 200 len: 194 microversion: 2.1 time: 0.152311 Sep 07 10:08:23.866986 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2260/4560] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 7 10:08:23 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/e65054b8-5641-4236-880a-2d54d4215264 => generated 194 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:23.873195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:23.873765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:23.886154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.886671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.887114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:23.888387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:23.889039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:23.889777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:24.096043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lazy-loading 'services' on Instance uuid 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:08:24.352377 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76fc0dde-2e47-4fe5-85af-b4895721b0e6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/e65054b8-5641-4236-880a-2d54d4215264" status: 202 len: 0 microversion: 2.1 time: 0.483434 Sep 07 10:08:24.360961 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2261/4561] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:08:23 2022] DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/e65054b8-5641-4236-880a-2d54d4215264 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:08:24.380471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:24.381444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:24.421112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:24.421941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:24.427169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:24.430102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:24.430802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:24.431471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:24.845410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:24.855728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:24.863181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:24.864742 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-753edfa1-b8e8-42cd-83a9-6a3e40410a5b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 1.768755 Sep 07 10:08:24.869851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2301/4562] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:23 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:25.071238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:25.085477 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1691683b-3a3e-4cd9-b44c-4056f1aa8949 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1273 microversion: 2.1 time: 0.722883 Sep 07 10:08:25.086076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2262/4563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:24 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1273 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:25.420739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f05ef552-9ff7-4173-9672-c89413078efd req-fd1f8321-618b-4e31-8bed-ff9d6bf7b5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65605bef-4101-4f64-ad05-fe9dbe2c3f65", "tag": "19e17a81-1b2c-4cda-a71f-5519113ea77f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:25.441372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f05ef552-9ff7-4173-9672-c89413078efd req-fd1f8321-618b-4e31-8bed-ff9d6bf7b5e6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:25.441958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f05ef552-9ff7-4173-9672-c89413078efd req-fd1f8321-618b-4e31-8bed-ff9d6bf7b5e6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:25.442416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f05ef552-9ff7-4173-9672-c89413078efd req-fd1f8321-618b-4e31-8bed-ff9d6bf7b5e6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:25.475363 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f05ef552-9ff7-4173-9672-c89413078efd req-fd1f8321-618b-4e31-8bed-ff9d6bf7b5e6 service nova] Creating event network-changed:19e17a81-1b2c-4cda-a71f-5519113ea77f for instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 on n-h2-836830-16 Sep 07 10:08:25.492811 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f05ef552-9ff7-4173-9672-c89413078efd req-fd1f8321-618b-4e31-8bed-ff9d6bf7b5e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085080 Sep 07 10:08:25.507215 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2302/4564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:25.902786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:25.903725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:25.912451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:25.914017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:25.914791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:25.917008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:25.918100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:25.920104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:26.111424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:26.112280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:26.132558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:26.136628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:26.137730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:26.139984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:26.144914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:26.146209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:26.768986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:26.792545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:26.797138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:26.798670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c932537f-646a-4c9b-8c3a-67f9e04d2d85 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1751 microversion: 2.20 time: 0.905226 Sep 07 10:08:26.818062 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2263/4565] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:25 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1751 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:27.209387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:27.220996 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a7f97d4d-9650-4c84-86fb-7dbc050986f3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 1.116538 Sep 07 10:08:27.225853 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2303/4566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:26 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:27.832935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:27.833768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:27.869363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:27.869889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:27.885263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:27.887108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:27.889589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:27.890056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:27.968539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:28.252642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:28.253271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:28.255295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:28.275188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:28.275704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:28.276148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:28.276871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:28.277361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:28.277882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:28.486501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:28.496850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:28.512328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:28.516172 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5caf2d17-d0dd-486f-943f-887e9af54054 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.688740 Sep 07 10:08:28.525145 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2264/4567] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:27 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:28.687546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:28.696564 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-04b07b46-d851-4a8d-8d6b-b680beb826e9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 0.448099 Sep 07 10:08:28.703407 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2304/4568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:28 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:28.879280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ed8c0bf0-6ef7-4d78-8ff9-f951b817b372 req-2efa6313-b5e3-46dd-be02-7c143d4fd925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0496fd-94ae-433f-b2dc-fb7834094202", "tag": "4276e99b-903b-4b21-b5c1-849f5aed900e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:28.888903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:28.893522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed8c0bf0-6ef7-4d78-8ff9-f951b817b372 req-2efa6313-b5e3-46dd-be02-7c143d4fd925 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:28.894512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed8c0bf0-6ef7-4d78-8ff9-f951b817b372 req-2efa6313-b5e3-46dd-be02-7c143d4fd925 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:28.895150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed8c0bf0-6ef7-4d78-8ff9-f951b817b372 req-2efa6313-b5e3-46dd-be02-7c143d4fd925 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:28.957458 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ed8c0bf0-6ef7-4d78-8ff9-f951b817b372 req-2efa6313-b5e3-46dd-be02-7c143d4fd925 service nova] Creating event network-changed:4276e99b-903b-4b21-b5c1-849f5aed900e for instance 1c0496fd-94ae-433f-b2dc-fb7834094202 on n-h1-836830-16 Sep 07 10:08:28.978537 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ed8c0bf0-6ef7-4d78-8ff9-f951b817b372 req-2efa6313-b5e3-46dd-be02-7c143d4fd925 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094333 Sep 07 10:08:28.979486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2265/4569] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:29.485834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2441dcfe-718a-486c-99a2-06a9e87189cb req-efbe0f81-75fe-4a28-b8eb-75351a59303e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:29.523158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2441dcfe-718a-486c-99a2-06a9e87189cb req-efbe0f81-75fe-4a28-b8eb-75351a59303e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:29.523697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2441dcfe-718a-486c-99a2-06a9e87189cb req-efbe0f81-75fe-4a28-b8eb-75351a59303e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:29.524151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2441dcfe-718a-486c-99a2-06a9e87189cb req-efbe0f81-75fe-4a28-b8eb-75351a59303e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:29.552957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:29.554679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:29.570152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:29.570483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2441dcfe-718a-486c-99a2-06a9e87189cb req-efbe0f81-75fe-4a28-b8eb-75351a59303e service nova] Creating event network-changed:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h1-836830-16 Sep 07 10:08:29.578359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:29.579158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:29.582251 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2441dcfe-718a-486c-99a2-06a9e87189cb req-efbe0f81-75fe-4a28-b8eb-75351a59303e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101706 Sep 07 10:08:29.583506 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2305/4570] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:29.603449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:29.604098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:29.608892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:29.732046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:29.733291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:29.749270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:29.752989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:29.754567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:29.759067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:29.760252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:29.763853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:29.764742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:30.192056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:30.203941 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a70ce19-9f09-4dfe-9321-081d553256e3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 0.476641 Sep 07 10:08:30.207720 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2306/4571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:29 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:30.455349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:30.466666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:30.469065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:30.471766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c971abb-b4db-429b-b3c0-1abf50b9d8e1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.923657 Sep 07 10:08:30.472948 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2266/4572] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:29 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:31.246138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:31.249735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:31.259778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:31.263361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:31.265155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:31.271168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:31.272128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:31.276661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:31.500873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:31.501773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:31.518967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:31.521150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:31.522131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:31.539463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:31.542011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:31.542775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:31.969333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:31.983151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:31.988940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:31.992489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77357404-1fcc-4ac1-a144-c93830b7d9c6 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.497423 Sep 07 10:08:31.995365 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2267/4573] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:31 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:32.093952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:32.117679 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3edd4373-6462-4f47-b1e6-09c6716de4bc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 0.879802 Sep 07 10:08:32.120479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2307/4574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:31 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:33.049079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:33.050100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:33.099476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:33.100764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:33.104025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:33.110314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:33.114203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:33.118585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:33.147931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:33.155437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:33.185783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:33.186243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:33.186793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:33.188091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:33.190662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:33.191384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:33.742659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:33.757894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:33.759795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:33.761111 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53e2d220-ec3f-456c-9d58-29947ca6eba1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.738577 Sep 07 10:08:33.763589 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2268/4575] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:33 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:33.844377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:33.867859 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c04200f9-c166-44ff-bb8a-d0fb619b3e15 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 0.714828 Sep 07 10:08:33.868554 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2308/4576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:33 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:34.797289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:34.798651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:34.808569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:34.811466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:34.813229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:34.816612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:34.821809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:34.827945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:34.893385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:34.894251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:34.909010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:34.909938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:34.910508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:34.911316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:34.920035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:34.920274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:35.363906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:35.373653 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56455d1f-1e21-491e-9c2d-1ccc6745f69f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 0.483964 Sep 07 10:08:35.374255 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2309/4577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:34 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:35.410873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:35.411761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:35.430510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:35.432560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:35.433427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:35.434591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:35.435385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:35.436052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:35.488648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:35.499643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:35.504856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:35.506380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:35.521964 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-891e0a9f-f002-4d5e-83ef-5207faffd110 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/682bf339-82cc-4e5c-ba60-39dd91f0b872" status: 200 len: 194 microversion: 2.1 time: 0.125152 Sep 07 10:08:35.523282 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2310/4578] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 7 10:08:35 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/682bf339-82cc-4e5c-ba60-39dd91f0b872 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:35.525025 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f535908-ec62-4401-9a38-1d776db20b33 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.731495 Sep 07 10:08:35.526735 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2269/4579] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:34 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:35.528574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-46f98666-6578-485c-8f2b-862812345a07 req-896b2c4f-0dc4-417a-9115-1763e3bb7bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0496fd-94ae-433f-b2dc-fb7834094202", "name": "network-vif-plugged", "status": "completed", "tag": "4276e99b-903b-4b21-b5c1-849f5aed900e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:35.547167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-46f98666-6578-485c-8f2b-862812345a07 req-896b2c4f-0dc4-417a-9115-1763e3bb7bec service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:35.547983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-46f98666-6578-485c-8f2b-862812345a07 req-896b2c4f-0dc4-417a-9115-1763e3bb7bec service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:35.548624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-46f98666-6578-485c-8f2b-862812345a07 req-896b2c4f-0dc4-417a-9115-1763e3bb7bec service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:35.554851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:35.559837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:35.562867 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-46f98666-6578-485c-8f2b-862812345a07 req-896b2c4f-0dc4-417a-9115-1763e3bb7bec service nova] Creating event network-vif-plugged:4276e99b-903b-4b21-b5c1-849f5aed900e for instance 1c0496fd-94ae-433f-b2dc-fb7834094202 on n-h1-836830-16 Sep 07 10:08:35.568421 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-46f98666-6578-485c-8f2b-862812345a07 req-896b2c4f-0dc4-417a-9115-1763e3bb7bec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043639 Sep 07 10:08:35.569407 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2311/4580] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:35.597427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:35.599066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:35.599545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:35.600490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:35.601134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:35.602060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:35.772452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lazy-loading 'services' on Instance uuid 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:08:35.929520 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4973cc5b-6084-492e-9466-078d42cf8461 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/682bf339-82cc-4e5c-ba60-39dd91f0b872" status: 202 len: 0 microversion: 2.1 time: 0.391835 Sep 07 10:08:35.931865 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2270/4581] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:08:35 2022] DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments/682bf339-82cc-4e5c-ba60-39dd91f0b872 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:08:36.404770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:36.405445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:36.428779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:36.429625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:36.430242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:36.430995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:36.431466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:36.431900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:36.562157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:36.563457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:36.577642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:36.578582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:36.579074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:36.580914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:36.581590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:36.582441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:36.662440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:36.679346 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39f00518-283a-4b40-b4c4-518a13226041 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1315 microversion: 2.1 time: 0.273594 Sep 07 10:08:36.680366 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2312/4582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:36 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:36.837550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:36.855398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:36.857162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:36.886816 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2ce979e-f914-4622-8ad3-d07ad7230283 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.334468 Sep 07 10:08:36.888287 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2271/4583] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:36 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:37.709484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:37.712899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:37.734312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:37.735131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:37.735938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:37.736874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:37.737770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:37.738659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:37.921740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:37.922446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:37.938173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:37.943618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:37.948114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:37.949452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:37.952151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:37.952896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:37.992533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:38.002790 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f2fb91e1-0fc1-4c70-8c80-248a083be517 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1501 microversion: 2.1 time: 0.300218 Sep 07 10:08:38.003398 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2313/4584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:37 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1501 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:38.033835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-979c4308-2d1e-4d8f-9539-0fac76551f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:38.049696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-979c4308-2d1e-4d8f-9539-0fac76551f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:38.050200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-979c4308-2d1e-4d8f-9539-0fac76551f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:38.050646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-979c4308-2d1e-4d8f-9539-0fac76551f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:38.115943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-979c4308-2d1e-4d8f-9539-0fac76551f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Going to try to stop instance {{(pid=128832) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:08:38.228398 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-979c4308-2d1e-4d8f-9539-0fac76551f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202/action" status: 202 len: 0 microversion: 2.1 time: 0.198216 Sep 07 10:08:38.237553 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2314/4585] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:08:38 2022] POST /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:08:38.246346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:38.247794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:38.261922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:38.263910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:38.264877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:38.266196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:38.266830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:38.267895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:38.306953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:38.331837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:38.333402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:38.348241 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8dcace83-d1de-4fc6-b870-59cf23cedaa2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.433170 Sep 07 10:08:38.370335 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2272/4586] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:37 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:38.627560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:38.640047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-933748c3-0636-40c0-a637-7c6c26950ed5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.399809 Sep 07 10:08:38.643764 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2315/4587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:38 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:39.412685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:39.426786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:39.466745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:39.467252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:39.467771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:39.468495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:39.469637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:39.472276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:39.668089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:39.670011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:39.680960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:39.682600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:39.683722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:39.687118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:39.687947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:39.689194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:39.704187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:39.719766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:39.721751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:39.728870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e3f310e-1da6-4af0-8103-f12887fd190f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.319760 Sep 07 10:08:39.755420 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2273/4588] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:39 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:39.934576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:39.948750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f75006ce-6a3a-4104-a636-ce47b6ec9f45 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.282942 Sep 07 10:08:39.950710 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2316/4589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:39 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:40.765282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:40.766530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:40.777799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:40.781939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:40.783033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:40.784208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:40.785257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:40.785853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:40.972760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:40.973422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:40.990665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:40.991377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:40.991996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:40.993241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:40.994458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:40.998165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:41.139805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:41.152131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:41.158269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:41.159894 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e30aec1-3f07-4145-87e4-9df1cbecc434 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.399712 Sep 07 10:08:41.162502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2274/4590] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:40 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:41.659269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:41.672103 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d336056-0aec-4699-9de5-be9a99740768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.703251 Sep 07 10:08:41.688271 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2317/4591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:40 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:42.193700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:42.196062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:42.205850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:42.206726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:42.207328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:42.208230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:42.208892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:42.209733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:42.531312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:42.542768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:42.545115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:42.546524 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b47666b-7c9d-49f3-8678-ca7acfd2d6ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.358126 Sep 07 10:08:42.567938 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2275/4592] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:42 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:42.698729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:42.699294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:42.718110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:42.719023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:42.723318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:42.727843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:42.728410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:42.730439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.111802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:43.114357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:43.127302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.127852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.128567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.129087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.129579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.130000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.186607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:43.197546 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2cfe760d-2626-4b0f-93de-56e0ed4f2ce5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.503990 Sep 07 10:08:43.217651 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2318/4593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:42 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:43.220423 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7fa5e4c1-7333-4b58-a0e8-0a1ddeb1cad8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105549 Sep 07 10:08:43.222477 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2276/4594] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:08:43 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 10:08:43.389213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:43.391617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:43.399996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.401019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.401770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.402707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.403457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.404175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.460651 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c00dd85c-ca6d-45fe-bf7b-33fff8df0fa6 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077531 Sep 07 10:08:43.461971 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2319/4595] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:08:43 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:08:43.565764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:43.566277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:43.576717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.576881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:43.577734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:43.578090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.578586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.579304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.579765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.580221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.585123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.585707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.586278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.587058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.587624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.588235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.630085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:08:43.758080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:43.769575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:43.771722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:43.773088 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2e7b5eb-72ad-4dc8-85bd-90ff0cac4d24 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.201754 Sep 07 10:08:43.808515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2320/4596] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:43 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:43.842407 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79c48658-31d2-4155-8c00-6f7b9e84040e tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 204 len: 0 microversion: 2.1 time: 0.279074 Sep 07 10:08:43.843862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2277/4597] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:08:43 2022] DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:08:43.852688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:43.853572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:43.866425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.867849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.867849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:43.868073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:43.868544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:43.868977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:44.085582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:44.099029 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1e9f537-9a35-482c-8a75-cc05417bd78a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1674 microversion: 2.1 time: 0.248149 Sep 07 10:08:44.113221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2321/4598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:43 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:44.229940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:44.230792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:44.245389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:44.246236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:44.247471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:44.248252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:44.248787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:44.249307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:44.425016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:44.435321 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ccbf8719-67d8-47ac-90f2-db178b33cdda tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.216803 Sep 07 10:08:44.449815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2278/4599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:44 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:44.816981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:44.818018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:44.826013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:44.826615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:44.827184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:44.827996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:44.828566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:44.829101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:45.008591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:45.019684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:45.021138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:45.022429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57f27ae4-4eec-4411-a8ab-ddb42e4d9f05 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.218492 Sep 07 10:08:45.023316 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2322/4600] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:44 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:45.124401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:45.125050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:45.133442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:45.133835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:45.134373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:45.135104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:45.135644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:45.136283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:45.165941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:45.328967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:45.337981 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26bd9dfa-ae45-4f16-be43-fc46931e4928 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1674 microversion: 2.1 time: 0.218269 Sep 07 10:08:45.339191 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2279/4601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:45 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:45.463807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:45.465121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:45.470858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:45.479902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:45.480508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:45.481998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:45.482832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:45.483825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:45.484264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:45.701787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:45.714609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a1e15d4-c014-423a-978c-a0ab3b4c3e10 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.257956 Sep 07 10:08:45.716081 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2323/4602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:45 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:46.049975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:46.050605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:46.062694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:46.063201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:46.063648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:46.065984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:46.066461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:46.066898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:46.363421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:46.364632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:46.374160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:46.384813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:46.385953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:46.386429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:46.387762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:46.388246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:46.388690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:46.420604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:46.425947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:46.427419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab7a0fc6-421a-4cf6-882d-4cfa1080bc51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.382144 Sep 07 10:08:46.430184 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2280/4603] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:46 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:46.640762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:46.654764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-758348dc-1862-4e65-accd-54bf2b45eade tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1674 microversion: 2.1 time: 0.293151 Sep 07 10:08:46.655601 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2324/4604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:46 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1674 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:46.740595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:46.744031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:46.756159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:46.756669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:46.757113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:46.757884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:46.758341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:46.758766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.162214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:47.174587 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b29c3483-d2b1-4b14-b239-852664db6d67 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.438357 Sep 07 10:08:47.176994 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2281/4605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:46 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:47.432851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2b3b779e-7989-4f93-99af-59c3ee892940 req-f0df3bd1-2f06-42cd-a3e9-64c3ae52275b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e7b78b-a56a-448b-bb06-e4fb7e5ff993", "name": "network-vif-deleted", "tag": "b99f2135-88d6-4c0e-a7cb-9bea2960104e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:08:47.455147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2b3b779e-7989-4f93-99af-59c3ee892940 req-f0df3bd1-2f06-42cd-a3e9-64c3ae52275b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:47.458389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2b3b779e-7989-4f93-99af-59c3ee892940 req-f0df3bd1-2f06-42cd-a3e9-64c3ae52275b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:47.460173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:47.460777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:47.463519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2b3b779e-7989-4f93-99af-59c3ee892940 req-f0df3bd1-2f06-42cd-a3e9-64c3ae52275b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.472514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:47.473014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:47.480222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.481507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:47.482080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:47.482554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.489646 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2b3b779e-7989-4f93-99af-59c3ee892940 req-f0df3bd1-2f06-42cd-a3e9-64c3ae52275b service nova] Creating event network-vif-deleted:b99f2135-88d6-4c0e-a7cb-9bea2960104e for instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 on n-h2-836830-16 Sep 07 10:08:47.502743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2b3b779e-7989-4f93-99af-59c3ee892940 req-f0df3bd1-2f06-42cd-a3e9-64c3ae52275b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074416 Sep 07 10:08:47.505092 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2325/4606] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:08:47.683523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:47.684636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:47.706019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:47.706294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:47.707025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:47.708176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.711159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:47.711845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:47.712967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.736737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:47.740157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:47.741448 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e046b354-4697-4e04-b990-bf27bf347b9a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.285428 Sep 07 10:08:47.746281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2282/4607] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:47 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:08:47.808839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:47.809555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:47.810005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:47.814119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lazy-loading 'fault' on Instance uuid 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:08:48.019394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffce8dfc8c640328effeb5ae97acc66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357930c7a1e64d09bac384b1c27d002c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:48.024044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:48.044463 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-901eb3dd-4147-4d85-9940-58ccc2d92e43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 200 len: 1327 microversion: 2.1 time: 0.365321 Sep 07 10:08:48.045764 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2326/4608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:47 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 1327 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:48.201454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:48.202412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:48.210190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:48.211606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:48.213657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:48.214627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:48.216689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:48.217463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:48.474534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:48.486816 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f152fb0-30d4-4c7b-8a24-dc53a3d6d55a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.290849 Sep 07 10:08:48.490205 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2283/4609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:48 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:48.768761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:48.769599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:48.783801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:48.785390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:48.786118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:48.787253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:48.787998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:48.790528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:49.072282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:49.080247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:49.100227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:49.102707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:49.104135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:49.111788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:49.113427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:49.115773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] HTTP exception thrown: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Request method failure captured: Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 HTTP/1.1 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGwWOuK-lB13cpSCxrpdtK5zxqgUl4t7dsgca2ELCY9aY6vGt0mAtuLBX2E_s1OiBoJIP9CwJxceTQhFxE8qWktmp6_k6hmzYKy7CYYXtf6c1ga-XopG4wsD-stChvVsTMGePIiQktSWRG1Gel9LxBB543_KUopQ0uzWW4ci2do5o44 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_357930c7a1e64d09bac384b1c27d002c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 8ffce8dfc8c640328effeb5ae97acc66 Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '60e7b78b-a56a-448b-bb06-e4fb7e5ff993'} Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:08:49.228458 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:08:49.235294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Returning 404 to user: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:08:49.251086 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ac391581-a47b-4099-999a-f3394153727a tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 404 len: 111 microversion: 2.1 time: 0.182781 Sep 07 10:08:49.256258 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2284/4610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:49 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:08:49.279441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-160a821c-19aa-47b0-8577-03e8c97e0f43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '.version_select at 0x7f14b0a07af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:49.392536 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-160a821c-19aa-47b0-8577-03e8c97e0f43 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502452951" status: 202 len: 0 microversion: 2.1 time: 0.129426 Sep 07 10:08:49.397411 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2285/4611] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502452951 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:08:49.514368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:49.515175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:49.530139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:49.545840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:49.546309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:49.549157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:49.551050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:49.551687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:50.675223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:50.688727 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2d56ea7-759f-4530-9bf2-eca98f6e2b1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 1.180148 Sep 07 10:08:50.692867 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2286/4612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:49 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:50.786158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:50.801949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:50.813022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:50.814850 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e70bac2e-eb62-4ffc-b983-2ff3073a57a4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 2.049877 Sep 07 10:08:50.815672 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2327/4613] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:48 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:51.722723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:51.723487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:51.758717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:08:51.770993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:51.772053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:51.774035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:51.774941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:51.780897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:51.781602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:51.861816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:51.866433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:51.901514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:51.902835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:51.903916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:51.905631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:51.908067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:51.908947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:52.504094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:52.523947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:52.525659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:52.530308 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35781453-719c-4752-8c05-f99be3ff6005 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.685641 Sep 07 10:08:52.538818 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2328/4614] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:51 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:52.667414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:52.679079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-25192ed1-6703-4526-a7b8-ed957f659d6e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.963670 Sep 07 10:08:52.693893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2287/4615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:51 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:53.560059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:53.560597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:53.577876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:53.578379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:53.578823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:53.582465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:53.582945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:53.583386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:53.705347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:53.706727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:53.719352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:53.724634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:53.725571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:53.726509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:53.727145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:53.728184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:54.113272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:54.129926 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c1bc47f8-902b-4713-aaa5-cbb239d7651b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.429269 Sep 07 10:08:54.131132 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2288/4616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:53 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:54.136003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:54.146862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:54.149630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:54.151024 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cefdee04-1595-4bcc-bd3f-755d01a584d8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.595937 Sep 07 10:08:54.152086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2329/4617] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:53 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:55.159592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:55.160372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:55.189252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:55.190093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:55.201995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:55.204698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:55.207071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:55.208342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:55.212208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:55.214011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:55.214625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:55.215897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:55.217482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:55.223196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:55.223980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:55.225542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:55.716038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:55.725984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:55.734677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:55.737019 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a90c8a47-4206-4b54-af60-af5233431b99 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.552066 Sep 07 10:08:55.758379 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2330/4618] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:55 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:55.835957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:55.847416 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a73d44d-d24a-41ea-af17-1aa577a722fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.692216 Sep 07 10:08:55.860221 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2289/4619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:55 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:08:56.769865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:56.771151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:56.784535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:56.789930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:56.791466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:56.798126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:56.799691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:56.800419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:56.877893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:56.880931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:56.907593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:56.908533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:56.913804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:56.915641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:56.917641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:56.918923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:57.494040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:57.504892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:57.513958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:57.515513 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c496cc3-c244-4fec-b700-e8ee4a3e8438 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.751189 Sep 07 10:08:57.518745 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2331/4620] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:56 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:57.536053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:57.549281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fe3a7466-1568-4b0b-9d94-5d953aa9f317 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.680976 Sep 07 10:08:57.550875 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2290/4621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:56 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:08:58.550498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:58.551185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:58.575735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:08:58.576373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:08:58.594104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:58.594620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:58.595072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:58.596067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:58.596627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:58.597083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:58.597856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:58.598324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:58.598756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:58.604962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:08:58.613443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:08:58.616443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:08:59.195763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:59.214129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:59.217566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:59.223046 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19416a2c-d3dd-45bf-a829-3eac2ab9691e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.677145 Sep 07 10:08:59.223926 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2332/4622] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:08:58 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:08:59.255290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:08:59.265689 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54f8e14d-d722-4886-9d68-40195d25efee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.694536 Sep 07 10:08:59.283463 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2291/4623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:08:58 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:00.253532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:00.254991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:00.270084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:00.271081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:00.272511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:00.274370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:00.275099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:00.275776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:00.295127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:00.298202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:00.322769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:00.324133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:00.330160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:00.337052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:00.340532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:00.341277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:00.984297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:01.014369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:01.027190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:01.041344 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac872300-48c4-46d2-a0ee-d36e50d23c09 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.795242 Sep 07 10:09:01.065871 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2333/4624] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:00 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:01.081409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:01.089084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:01.104156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:01.109057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:01.109976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:01.111173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:01.113075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:01.114964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:01.143333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:01.152862 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49336706-24d4-4d08-a3cd-e32fbb35d3ca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.861405 Sep 07 10:09:01.161465 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2292/4625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:00 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:01.188586 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2bbd8b9e-2976-450d-b007-e2c4b452c09f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/ips" status: 200 len: 148 microversion: 2.1 time: 0.120871 Sep 07 10:09:01.189731 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2334/4626] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:09:01 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/ips => generated 148 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:02.081582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:02.083810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:02.117589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:02.118195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:02.118653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:02.119405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:02.119874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:02.120304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:02.191205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:02.193606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:02.218831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:02.228231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:02.232333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:02.234408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:02.236855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:02.238731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:02.888742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:02.922603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:02.926581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:02.937909 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b0dcc90-8d7e-4eb3-a867-a47fd3ec359b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.860913 Sep 07 10:09:02.940652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2293/4627] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:02 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:03.113378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:03.142687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03067d89-125d-4346-a497-09cc21d42cee tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1511 microversion: 2.1 time: 0.956823 Sep 07 10:09:03.144739 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2335/4628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:02 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1511 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:03.971388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:03.973391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:03.996661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.002756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.005313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.008101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.012563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.032388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.180035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:04.182516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:04.202723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.216629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.217418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.219551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.220239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.223278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.549415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:04.560251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:04.563606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:04.572323 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2fd4fa83-c7cd-40fc-86e6-4304d10bd871 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.608024 Sep 07 10:09:04.573172 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2294/4629] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:03 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:04.642220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:04.660198 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45138516-6d61-43ae-b931-207396078957 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1488 microversion: 2.1 time: 0.491320 Sep 07 10:09:04.663788 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2336/4630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:04 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1488 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:04.690093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:04.693788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:04.705330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.706029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.706654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.709316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.712614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.713313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.771793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f6e5766-dbef-4216-b0e4-e332bdbdd20c"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:04.778377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:04.788357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.789103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.789836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.807318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.809454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.818550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.902556 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45205522-f4f7-4421-adc7-447565697a2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 200 len: 170 microversion: 2.1 time: 0.216686 Sep 07 10:09:04.910462 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2295/4631] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:04 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 170 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:04.920247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:04.921452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:04.932753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.937795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.939181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:04.940127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:04.940773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:04.941416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.285699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:05.295670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96488a65-0eb8-46af-9565-8a23f5b86b3d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.382679 Sep 07 10:09:05.298808 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2296/4632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:04 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:05.333579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:05.334076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:05.347220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:05.349113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:05.349594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.351916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:05.353290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:05.354533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.379781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4098a1e3-29c5-47f9-b2c2-e3b9ecfcc54d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624329 Sep 07 10:09:05.384503 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2337/4633] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:09:04 2022] POST /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:05.606240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:05.606240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:05.620473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:05.631949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:05.632815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.634960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:05.635623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:05.638535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.698531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:05.711552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0be532a-c57b-455b-bc3e-a809a7e95555 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.381927 Sep 07 10:09:05.714045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2297/4634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:05 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:05.740575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:05.741458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:05.749966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:05.752784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:05.754259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.755032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:05.755513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:05.755954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:05.767529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:06.107066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:06.121714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:06.123274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:06.130490 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b150887-4b29-4db0-ac85-765ba12bd21d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.533696 Sep 07 10:09:06.141522 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2338/4635] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:05 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:06.268668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:06.279499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62d09df8-9ca8-4966-aba4-b37db9373a4c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.542754 Sep 07 10:09:06.281812 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2298/4636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:05 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:06.307770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:06.309213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:06.317389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:06.318151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:06.318774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:06.319779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:06.320524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:06.321118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:06.605387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:06.615725 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f2e1b32-d19e-4b34-9d48-a065dedb5a55 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.311795 Sep 07 10:09:06.624640 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2339/4637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:06 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:06.900163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-52265068", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:06.974600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] validate_networks() for [('a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:09:07.172686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:07.174483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:07.208348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:07.209351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:07.212852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:07.222236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:07.231609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:07.232292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:07.828567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:07.842520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:07.846753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:07.851275 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58c5fe70-bdcc-4fd8-9301-8f82a670b890 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.681674 Sep 07 10:09:07.852866 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2340/4638] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:07 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:09:08.233139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:09:08.236438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:09:08.237282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:09:08.237899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:09:08.238498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:09:08.263986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:08.265085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:08.265879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:08.269169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:08.271780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:08.272831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:08.349218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:09:08.370465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for user 6a8b10f41570421a9292168d0326bae0 and project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:09:08.390905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:09:08.394298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:09:08.585610 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7071a874-a9a0-466f-ad99-e66da81a96c3 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698509 Sep 07 10:09:08.595221 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2299/4639] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:09:08.600119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3171cb51-6fff-496d-ba83-19c9298573ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:08.600944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3171cb51-6fff-496d-ba83-19c9298573ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:08.776692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3171cb51-6fff-496d-ba83-19c9298573ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:08.790798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3171cb51-6fff-496d-ba83-19c9298573ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1213 microversion: 2.1 time: 0.193695 Sep 07 10:09:08.795530 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2341/4640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:08 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:08.882054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:08.883368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:08.906900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:08.907648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:08.909059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:08.910878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:08.911633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:08.912320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.064208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:09.065071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:09.095205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.095205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.095205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.095205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.095205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.095205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.135376 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] HTTP exception thrown: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Request method failure captured: Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 HTTP/1.1 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwWOuK-lB13cpSCxrpdtK5zxqgUl4t7dsgca2ELCY9aY6vGt0mAtuLBX2E_s1OiBoJIP9CwJxceTQhFxE8qWktmp6_k6hmzYKy7CYYXtf6c1ga-XopG4wsD-stChvVsTMGePIiQktSWRG1Gel9LxBB543_KUopQ0uzWW4ci2do5o44 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_357930c7a1e64d09bac384b1c27d002c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8ffce8dfc8c640328effeb5ae97acc66 Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '60e7b78b-a56a-448b-bb06-e4fb7e5ff993'} Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:09:09.170677 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.175826 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.179536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Returning 404 to user: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:09.184943 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46019c08-7589-4c5c-a29b-76fdbfc68d22 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 404 len: 111 microversion: 2.1 time: 0.123200 Sep 07 10:09:09.187367 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2342/4641] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:09:09 2022] DELETE /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:09:09.228981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:09.231016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:09.235573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 60e7b78b-a56a-448b-bb06-e4fb7e5ff993] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:09.243537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:09.248449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:09.253526 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a94361e0-d79f-4898-ae81-3d3668500928 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.373989 Sep 07 10:09:09.254211 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2300/4642] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:08 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:09.288389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.289103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.302833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.307802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.314701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.325575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.386351 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] HTTP exception thrown: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Request method failure captured: Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 HTTP/1.1 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwWOuK-lB13cpSCxrpdtK5zxqgUl4t7dsgca2ELCY9aY6vGt0mAtuLBX2E_s1OiBoJIP9CwJxceTQhFxE8qWktmp6_k6hmzYKy7CYYXtf6c1ga-XopG4wsD-stChvVsTMGePIiQktSWRG1Gel9LxBB543_KUopQ0uzWW4ci2do5o44 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_357930c7a1e64d09bac384b1c27d002c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8ffce8dfc8c640328effeb5ae97acc66 Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '60e7b78b-a56a-448b-bb06-e4fb7e5ff993'} Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:09.388638 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Returning 404 to user: Instance 60e7b78b-a56a-448b-bb06-e4fb7e5ff993 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:09.396235 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99a44ce1-140f-4966-a9cf-4112149d54d8 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993" status: 404 len: 111 microversion: 2.1 time: 0.198531 Sep 07 10:09:09.399974 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2343/4643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:09 2022] GET /compute/v2.1/servers/60e7b78b-a56a-448b-bb06-e4fb7e5ff993 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:09:09.817142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:09.818386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:09.838756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.842508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.843491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.846297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.849005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.852492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.873705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e187a8ff-1ccb-42f0-8d62-cba51b1fd754 req-23c5292e-95cd-49e8-9e48-ee9ae998e93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "name": "network-vif-plugged", "status": "completed", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:09.910106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e187a8ff-1ccb-42f0-8d62-cba51b1fd754 req-23c5292e-95cd-49e8-9e48-ee9ae998e93d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:09.911054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e187a8ff-1ccb-42f0-8d62-cba51b1fd754 req-23c5292e-95cd-49e8-9e48-ee9ae998e93d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:09.911935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e187a8ff-1ccb-42f0-8d62-cba51b1fd754 req-23c5292e-95cd-49e8-9e48-ee9ae998e93d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:09.937385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e187a8ff-1ccb-42f0-8d62-cba51b1fd754 req-23c5292e-95cd-49e8-9e48-ee9ae998e93d service nova] Creating event network-vif-plugged:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h1-836830-16 Sep 07 10:09:09.944661 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e187a8ff-1ccb-42f0-8d62-cba51b1fd754 req-23c5292e-95cd-49e8-9e48-ee9ae998e93d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077527 Sep 07 10:09:09.988668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2344/4644] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:10.035121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:10.056482 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3be5123a-ddc1-4831-8330-bb9a0ad425e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1217 microversion: 2.1 time: 0.243123 Sep 07 10:09:10.057536 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2301/4645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:09 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:10.303953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:10.306103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:10.327862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:10.334673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:10.335414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:10.342949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:10.355247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:10.356627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:10.402031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:10.639140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:10.667682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:10.674127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:10.676305 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d8c2a915-2c21-4b7e-9165-4ef74d4bae98 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.391335 Sep 07 10:09:10.684616 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2345/4646] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:10 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:11.082362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:11.083790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:11.101409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:11.109865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:11.110680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:11.111703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:11.112829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:11.113668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:11.344281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:11.352649 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19e66006-e1aa-4537-912e-764b209eadfb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1273 microversion: 2.1 time: 0.274663 Sep 07 10:09:11.354065 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2302/4647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:11 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:11.715581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:11.716164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:11.723315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:11.724080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:11.724687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:11.725582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:11.726198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:11.727101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:12.160443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:12.186066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:12.190754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:12.196626 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4dd95542-8b71-4f17-b61d-4d2f77bef95e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.487627 Sep 07 10:09:12.199784 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2346/4648] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:11 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:12.382958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:12.383591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:12.406034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:12.406940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:12.408348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:12.410966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:12.411770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:12.413447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:12.901727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:12.919032 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-13da5a6a-ac65-4c40-9609-e3ea2f8cac82 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1313 microversion: 2.1 time: 0.541357 Sep 07 10:09:12.920755 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2303/4649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:12 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:13.227319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:13.228019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:13.243823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:13.244327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:13.244789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:13.245525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:13.246594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:13.247142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:13.586090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:13.598863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:13.602781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:13.607391 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-665c9aad-6f3e-4d40-a7aa-a8760bd886fd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1807 microversion: 2.20 time: 0.384025 Sep 07 10:09:13.610393 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2347/4650] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:13 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1807 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:13.959483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:13.960098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:13.971307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:13.976291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:13.976803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:13.977562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:13.978028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:13.982053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:14.343720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1762677233", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1d852168-1032-4968-90ea-cae5d02ef843"}], "security_groups": [{"name": "tempest-securitygroup--15493060"}], "key_name": "tempest-keypair-1058019951", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "78e2320d-60d3-4be1-84dc-5e51390de7c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:14.860829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] validate_networks() for [('1d852168-1032-4968-90ea-cae5d02ef843', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:09:14.892988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:14.903528 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f54a970c-3acb-4ca7-b26b-640fd11fb0b8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1313 microversion: 2.1 time: 0.948484 Sep 07 10:09:14.906215 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2304/4651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:13 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1313 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:14.912343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:14.913204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:14.931811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:14.938120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:14.939171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:14.944586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:14.945778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:14.948339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:15.713455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:15.731471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:15.739644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:15.745549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82357390-5ef7-498e-b822-ff7b1b6abbfd tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1794 microversion: 2.20 time: 0.835544 Sep 07 10:09:15.768011 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2305/4652] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:09:14 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1794 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:09:15.780440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e1f6eb9d-6a74-45d2-8d39-1012563e3d13 req-d2394a26-d4d8-469d-9120-88cfbfe61055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6317208c-813d-44f8-8011-875e3c181122", "tag": "a3b89a6c-c489-416d-acde-c94605259523"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:15.811417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e1f6eb9d-6a74-45d2-8d39-1012563e3d13 req-d2394a26-d4d8-469d-9120-88cfbfe61055 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:15.813714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e1f6eb9d-6a74-45d2-8d39-1012563e3d13 req-d2394a26-d4d8-469d-9120-88cfbfe61055 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:15.814552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e1f6eb9d-6a74-45d2-8d39-1012563e3d13 req-d2394a26-d4d8-469d-9120-88cfbfe61055 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:15.847040 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e1f6eb9d-6a74-45d2-8d39-1012563e3d13 req-d2394a26-d4d8-469d-9120-88cfbfe61055 service nova] Creating event network-changed:a3b89a6c-c489-416d-acde-c94605259523 for instance 6317208c-813d-44f8-8011-875e3c181122 on n-h2-836830-16 Sep 07 10:09:15.860521 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e1f6eb9d-6a74-45d2-8d39-1012563e3d13 req-d2394a26-d4d8-469d-9120-88cfbfe61055 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091144 Sep 07 10:09:15.863986 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2306/4653] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:15.938077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:15.939106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:15.952606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:15.953369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:15.954018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:15.954973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:15.955429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:15.966043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:16.254336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=58 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:16.264108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Getting quotas for project a99d3f866a9f4d8ea033d85f3ec53016. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:09:16.280457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Getting quotas for user b1530e0cafad4cf6b10e9da58d2ffaa9 and project a99d3f866a9f4d8ea033d85f3ec53016. Resources: dict_keys(['metadata_items']) {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:09:16.316068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:09:16.316626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:09:16.317257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:09:16.319257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:09:16.319799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:09:16.343694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:16.347517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:16.348337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:16.349540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:16.352623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:16.353364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:16.406236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Getting quotas for project a99d3f866a9f4d8ea033d85f3ec53016. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:09:16.421482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Getting quotas for user b1530e0cafad4cf6b10e9da58d2ffaa9 and project a99d3f866a9f4d8ea033d85f3ec53016. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:09:16.450631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:16.465644 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a65bdc00-f6f0-47d2-b918-2e7c92d36472 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1313 microversion: 2.1 time: 0.531986 Sep 07 10:09:16.466570 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2307/4654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:15 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:16.474607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1563763194", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f5d06e73-b124-4c33-a68b-c0c8f45a9aac", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:16.546244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:09:16.548649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78e2320d-60d3-4be1-84dc-5e51390de7c0',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:09:16.637824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:09:16.893432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca24211e-2476-4769-b442-45ab720ead32 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.554098 Sep 07 10:09:16.901418 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2348/4655] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:09:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 2563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:09:16.908674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55dd2fb5-275d-4535-915e-3ca2061ff398 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:16.909517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-55dd2fb5-275d-4535-915e-3ca2061ff398 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:16.986655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-55dd2fb5-275d-4535-915e-3ca2061ff398 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:16.996612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55dd2fb5-275d-4535-915e-3ca2061ff398 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1122 microversion: 2.1 time: 0.092093 Sep 07 10:09:16.999415 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2349/4656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:16 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1122 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:17.021327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:17.021962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:17.040082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.040924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.041434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.042275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.046433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.047040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.065876 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] HTTP exception thrown: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Request method failure captured: Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 HTTP/1.1 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwWOuK-lB13cpSCxrpdtK5zxqgUl4t7dsgca2ELCY9aY6vGt0mAtuLBX2E_s1OiBoJIP9CwJxceTQhFxE8qWktmp6_k6hmzYKy7CYYXtf6c1ga-XopG4wsD-stChvVsTMGePIiQktSWRG1Gel9LxBB543_KUopQ0uzWW4ci2do5o44 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_357930c7a1e64d09bac384b1c27d002c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8ffce8dfc8c640328effeb5ae97acc66 Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '74168d1b-4b40-480d-add9-d409e18a5490'} Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:09:17.067998 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.073494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Returning 404 to user: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:17.075919 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c71d904b-c80e-416c-ae86-26ebf0a7c078 tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 404 len: 111 microversion: 2.1 time: 0.063178 Sep 07 10:09:17.076055 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2350/4657] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:09:17 2022] DELETE /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:09:17.087228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:17.090761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] [instance: 74168d1b-4b40-480d-add9-d409e18a5490] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:17.105840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.107462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.109948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.112125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.113640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.115483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.156502 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] HTTP exception thrown: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Request method failure captured: Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 HTTP/1.1 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGwWOuK-lB13cpSCxrpdtK5zxqgUl4t7dsgca2ELCY9aY6vGt0mAtuLBX2E_s1OiBoJIP9CwJxceTQhFxE8qWktmp6_k6hmzYKy7CYYXtf6c1ga-XopG4wsD-stChvVsTMGePIiQktSWRG1Gel9LxBB543_KUopQ0uzWW4ci2do5o44 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/357930c7a1e64d09bac384b1c27d002c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_357930c7a1e64d09bac384b1c27d002c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 357930c7a1e64d09bac384b1c27d002c Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668607254 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8ffce8dfc8c640328effeb5ae97acc66 Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeTestJSON-668607254-project Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '74168d1b-4b40-480d-add9-d409e18a5490'} Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:17.159038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] Returning 404 to user: Instance 74168d1b-4b40-480d-add9-d409e18a5490 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:17.164484 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8735c21e-af4c-4aa2-97ba-bce68ad2294f tempest-AttachVolumeTestJSON-668607254 tempest-AttachVolumeTestJSON-668607254-project] 10.222.0.60 "GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490" status: 404 len: 111 microversion: 2.1 time: 0.079435 Sep 07 10:09:17.165589 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2351/4658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:17 2022] GET /compute/v2.1/servers/74168d1b-4b40-480d-add9-d409e18a5490 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:09:17.489878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:17.490819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:17.503578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.512155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.512811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.517392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:09:17.517803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:09:17.518464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:09:17.518955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:09:17.519441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:09:17.531310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.532233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.532915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.540744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.548387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.552476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.554347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:17.558869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:17.560417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:17.641111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:09:17.660979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:09:17.707232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:09:17.712310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f5d06e73-b124-4c33-a68b-c0c8f45a9aac',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:09:17.940789 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07a622dc-1d03-4a5e-9721-1013da2e1828 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466266 Sep 07 10:09:17.941929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2308/4659] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:09:17.980958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de50d411-2b1b-4734-9afe-5592206b945c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:17.984488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-de50d411-2b1b-4734-9afe-5592206b945c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:18.243061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:18.266825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1d52be8-7370-42d7-8e6e-cb57103e12a9 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1313 microversion: 2.1 time: 0.776572 Sep 07 10:09:18.268416 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2352/4660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:17 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:18.289695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:18.294732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:18.330211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:18.332715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:18.333834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:18.336846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:18.337795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:18.340504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:18.572235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:18.595434 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6350f08f-0b02-4729-bb27-1138d584cdb1 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1164 microversion: 2.1 time: 0.324310 Sep 07 10:09:18.604637 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2353/4661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:18 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1164 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:18.620058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-de50d411-2b1b-4734-9afe-5592206b945c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:18.634493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de50d411-2b1b-4734-9afe-5592206b945c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1057 microversion: 2.1 time: 0.681825 Sep 07 10:09:18.636930 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2309/4662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:17 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1057 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:19.297642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:19.298267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:19.327221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:19.327728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:19.328175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:19.329081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:19.329485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:19.330014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:19.632125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:19.632604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:19.649112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:19.649879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:19.650518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:19.651602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:19.652474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:19.653333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:19.868548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:19.889942 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58aaa93b-7b12-49aa-82b1-7391e5235b04 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1238 microversion: 2.1 time: 0.262583 Sep 07 10:09:19.891612 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2310/4663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:19 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1238 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:19.926574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:19.927541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:19.955062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:19.957312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:19.959879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:19.960889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:19.963545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:19.965850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:19.990772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:20.001248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2619716d-d64c-4109-91a5-acd645e522dd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1313 microversion: 2.1 time: 0.709149 Sep 07 10:09:20.001845 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2354/4664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:19 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:20.407973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:20.429562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c6763346-78d1-499a-a946-4efd75577d9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1109 microversion: 2.1 time: 0.528372 Sep 07 10:09:20.446196 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2311/4665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:19 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1109 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:20.921400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:20.922042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:20.943598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:20.944297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:20.944768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:20.945617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:20.946090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:20.946525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:21.025342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:21.027874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:21.049359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:21.052507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:21.054771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:21.060912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:21.064016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:21.071905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:21.310070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:21.335249 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40f1256b-0b0c-4ba9-86c3-ad9bb3c0eef8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1238 microversion: 2.1 time: 0.411312 Sep 07 10:09:21.346251 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2355/4666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:20 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1238 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:21.359270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4c717222-22e7-480b-afff-72de02d0a6dc req-3d5d5d0d-a653-46cc-a673-ffb139ee3328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6317208c-813d-44f8-8011-875e3c181122", "name": "network-vif-plugged", "status": "completed", "tag": "a3b89a6c-c489-416d-acde-c94605259523"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:21.404374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c717222-22e7-480b-afff-72de02d0a6dc req-3d5d5d0d-a653-46cc-a673-ffb139ee3328 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:21.405554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c717222-22e7-480b-afff-72de02d0a6dc req-3d5d5d0d-a653-46cc-a673-ffb139ee3328 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:21.406281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c717222-22e7-480b-afff-72de02d0a6dc req-3d5d5d0d-a653-46cc-a673-ffb139ee3328 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:21.460287 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4c717222-22e7-480b-afff-72de02d0a6dc req-3d5d5d0d-a653-46cc-a673-ffb139ee3328 service nova] Creating event network-vif-plugged:a3b89a6c-c489-416d-acde-c94605259523 for instance 6317208c-813d-44f8-8011-875e3c181122 on n-h2-836830-16 Sep 07 10:09:21.468998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4c717222-22e7-480b-afff-72de02d0a6dc req-3d5d5d0d-a653-46cc-a673-ffb139ee3328 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120976 Sep 07 10:09:21.469659 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2356/4667] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:21.484897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:21.487376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:21.510331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:21.514081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:21.515624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:21.518633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:21.519716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:21.521772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:21.760097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:21.769759 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46b3ef2f-2dbd-48bd-856b-51d8908e9e42 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1127 microversion: 2.1 time: 0.296338 Sep 07 10:09:21.772880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2357/4668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:21 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1127 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:21.910680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:21.960710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-24c52223-8407-40cf-ab71-e2801bc34a25 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1313 microversion: 2.1 time: 0.939377 Sep 07 10:09:21.988378 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2312/4669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:21 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:22.371312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:22.373025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:22.416479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:22.423276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:22.423741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:22.426108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:22.426614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:22.427123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:22.800419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:22.801650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:22.804949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:22.830211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:22.831034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:22.832294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:22.834213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:22.838873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:22.840355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:23.724688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:23.738819 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21fe3804-618f-4954-b00d-81362119315e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.938343 Sep 07 10:09:23.740893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2313/4670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:22 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:23.754213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:23.755176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:23.772393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:23.773106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:23.773741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:23.774636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:23.775443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:23.776145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:24.533477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:24.556503 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e8605dc-b73b-4439-a093-a14392a9f26b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1304 microversion: 2.1 time: 2.187487 Sep 07 10:09:24.557933 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2358/4671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:22 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1304 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:24.778332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:24.779479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:24.802750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:24.803486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:24.804169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:24.805111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:24.806066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:24.807105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:24.831588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:24.841480 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0743cd3c-4e7d-4128-a903-86302b56d854 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1499 microversion: 2.1 time: 1.099009 Sep 07 10:09:24.843889 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2314/4672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:23 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1499 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:24.870484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:24.873381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:24.885483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:24.888085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:24.888983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:24.889983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:24.892544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:24.893285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:25.001793 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d60db4c8-3080-4f49-a6c9-20263abe10b2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.135632 Sep 07 10:09:25.003114 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2315/4673] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:24 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 10:09:25.582180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:25.583024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:25.615875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:25.616550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:25.617127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:25.617990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:25.618559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:25.619098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:25.789001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:25.810445 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb3f08e4-80be-40f5-87c7-1a510530263e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 1.050980 Sep 07 10:09:25.811047 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2359/4674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:24 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:26.014195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:26.017381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:26.035798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:26.052295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:26.061460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:26.062415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:26.062909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:26.067414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:26.208044 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b227b0ce-464b-4856-b183-dc5839884b72 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.198405 Sep 07 10:09:26.209553 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2360/4675] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:26 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:09:26.285852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:26.304436 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8a275320-5403-41d0-91b7-04b41f193c54 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1304 microversion: 2.1 time: 0.726506 Sep 07 10:09:26.305042 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2316/4676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:25 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1304 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:26.591707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4d099a85-43dd-47b3-be1c-4362d5aa858d req-7163dd0b-e161-4e74-935d-7f3b6a55fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de3e34b-ada0-4c49-bf59-155a4094daec", "tag": "80d5f69b-d0f8-4053-b7df-6aad05bb59e6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:26.623232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:26.626421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d099a85-43dd-47b3-be1c-4362d5aa858d req-7163dd0b-e161-4e74-935d-7f3b6a55fa06 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:26.626980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d099a85-43dd-47b3-be1c-4362d5aa858d req-7163dd0b-e161-4e74-935d-7f3b6a55fa06 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:26.627585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d099a85-43dd-47b3-be1c-4362d5aa858d req-7163dd0b-e161-4e74-935d-7f3b6a55fa06 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:26.682194 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d099a85-43dd-47b3-be1c-4362d5aa858d req-7163dd0b-e161-4e74-935d-7f3b6a55fa06 service nova] Creating event network-changed:80d5f69b-d0f8-4053-b7df-6aad05bb59e6 for instance 6de3e34b-ada0-4c49-bf59-155a4094daec on n-h2-836830-16 Sep 07 10:09:26.694710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4d099a85-43dd-47b3-be1c-4362d5aa858d req-7163dd0b-e161-4e74-935d-7f3b6a55fa06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107958 Sep 07 10:09:26.695627 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2361/4677] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:26.839887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:26.840981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:26.857045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:26.860408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:26.861106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:26.862861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:26.867092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:26.867807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:27.220094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:27.224437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:27.227156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:27.267252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:27.268118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:27.268794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:27.270016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:27.270718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:27.277750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:27.380662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4210a579-bd39-4799-ad40-a4340fd120f8 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.163620 Sep 07 10:09:27.382206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2362/4678] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:27 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:09:27.389766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:27.394948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:27.412229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:27.413074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:27.413804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:27.416839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:27.417633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:27.418328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:27.613973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:27.975216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:27.987637 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f822e59-fbfb-4906-aa98-cc768f997582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 1.151906 Sep 07 10:09:28.016461 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2317/4679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:26 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:28.129218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:28.139170 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-227b8ccc-b0bf-483d-9936-c17e2ea3456f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1304 microversion: 2.1 time: 0.755400 Sep 07 10:09:28.154037 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2363/4680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:27 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1304 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:28.290777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5e890d1-9278-4e17-8ecc-d52c38885549 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Action: 'create', calling method: .version_select at 0x7f14b09ce8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-148461315", "metadata": {"Type": "work"}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5e890d1-9278-4e17-8ecc-d52c38885549 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Request method failure captured: Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 121 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG3Xt3XOY9ReY8Qi_XITJh7FdH34anXchyNnDCgG041Z9VNZn0HPiXP07ZGdSqtduHQAK6jEGSuU-Qk8o_Nn4F0-vYbUFF-bRfSJwuityZAO6tQixQqWxg6gtCgTRv985r8yl3_gwpbhcA1RYWBr5jZvb1o02s6QEamX5MwtRZK7Lwo Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c20f64810be84afe93c33ac83cd1566d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: bf08a48def6d40c190d04bbe07d1e62b Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-148461315", "metadata": {"Type": "work"}}} Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-148461315', 'metadata': {'Type': 'work'}}}} Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:09:28.301780 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5e890d1-9278-4e17-8ecc-d52c38885549 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:28.307198 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5e890d1-9278-4e17-8ecc-d52c38885549 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.285725 Sep 07 10:09:28.310590 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2318/4681] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 7 10:09:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:09:28.315381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85967b3c-8707-4a23-81b2-11e61907e67e tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Action: 'create', calling method: .version_select at 0x7f14b090faf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-760524908", "metadata": {"Type": "work"}}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85967b3c-8707-4a23-81b2-11e61907e67e tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Request method failure captured: Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 119 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG3Xt3XOY9ReY8Qi_XITJh7FdH34anXchyNnDCgG041Z9VNZn0HPiXP07ZGdSqtduHQAK6jEGSuU-Qk8o_Nn4F0-vYbUFF-bRfSJwuityZAO6tQixQqWxg6gtCgTRv985r8yl3_gwpbhcA1RYWBr5jZvb1o02s6QEamX5MwtRZK7Lwo Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c20f64810be84afe93c33ac83cd1566d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: bf08a48def6d40c190d04bbe07d1e62b Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-760524908", "metadata": {"Type": "work"}}} Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-760524908', 'metadata': {'Type': 'work'}}}} Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi '0' Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:09:28.319930 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.326265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85967b3c-8707-4a23-81b2-11e61907e67e tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:28.327228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85967b3c-8707-4a23-81b2-11e61907e67e tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016063 Sep 07 10:09:28.331055 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2364/4682] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 7 10:09:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:09:28.336702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4021069d-d1e1-42a2-91c1-8d3c3b477b8d tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Action: 'create', calling method: .version_select at 0x7f14b1295ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-904109319", "metadata": {"Type": "work"}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4021069d-d1e1-42a2-91c1-8d3c3b477b8d tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Request method failure captured: Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 118 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG3Xt3XOY9ReY8Qi_XITJh7FdH34anXchyNnDCgG041Z9VNZn0HPiXP07ZGdSqtduHQAK6jEGSuU-Qk8o_Nn4F0-vYbUFF-bRfSJwuityZAO6tQixQqWxg6gtCgTRv985r8yl3_gwpbhcA1RYWBr5jZvb1o02s6QEamX5MwtRZK7Lwo Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c20f64810be84afe93c33ac83cd1566d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: bf08a48def6d40c190d04bbe07d1e62b Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-904109319", "metadata": {"Type": "work"}}} Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-904109319', 'metadata': {'Type': 'work'}}}} Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi '' Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:09:28.342135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4021069d-d1e1-42a2-91c1-8d3c3b477b8d tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:28.347498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4021069d-d1e1-42a2-91c1-8d3c3b477b8d tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010742 Sep 07 10:09:28.354262 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2319/4683] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 7 10:09:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:09:28.354918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662de15c-2666-4cbf-8976-13405d3e4193 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Calling method '.version_select at 0x7f14b09ae040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:28.415180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:28.418141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:28.446651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:28.447494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:28.448168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:28.449338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:28.450100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:28.451519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:28.458267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:28.488480 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-662de15c-2666-4cbf-8976-13405d3e4193 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] HTTP exception thrown: Volume tempest-invalid-278138459 could not be found. Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662de15c-2666-4cbf-8976-13405d3e4193 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Request method failure captured: Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-278138459 HTTP/1.1 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG3Xt3XOY9ReY8Qi_XITJh7FdH34anXchyNnDCgG041Z9VNZn0HPiXP07ZGdSqtduHQAK6jEGSuU-Qk8o_Nn4F0-vYbUFF-bRfSJwuityZAO6tQixQqWxg6gtCgTRv985r8yl3_gwpbhcA1RYWBr5jZvb1o02s6QEamX5MwtRZK7Lwo Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c20f64810be84afe93c33ac83cd1566d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: bf08a48def6d40c190d04bbe07d1e62b Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: exception: Volume tempest-invalid-278138459 could not be found. Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'tempest-invalid-278138459'} Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-278138459 could not be found. (HTTP 404) (Request-ID: req-17ec89ee-e636-44a1-af9b-748b4c9cb91f) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:09:28.506080 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-278138459 could not be found. Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-278138459 could not be found. Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-278138459 could not be found. Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662de15c-2666-4cbf-8976-13405d3e4193 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Returning 404 to user: Volume tempest-invalid-278138459 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:28.512373 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-662de15c-2666-4cbf-8976-13405d3e4193 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-278138459" status: 404 len: 98 microversion: 2.1 time: 0.159817 Sep 07 10:09:28.519096 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2365/4684] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 7 10:09:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-278138459 => generated 98 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 10:09:28.527146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-387159cc-e3fd-4507-a0e7-dbd846a7bda3 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006504 Sep 07 10:09:28.528915 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2366/4685] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 7 10:09:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 10:09:28.545963 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e6cffb3-f909-460f-879f-3f6e7d834041 tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007553 Sep 07 10:09:28.552397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2367/4686] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 10:09:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 10:09:28.557765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b45a5b35-85cf-48fc-b468-7f0f7c4efdde tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Calling method '.version_select at 0x7f14b104b5e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:28.605610 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b45a5b35-85cf-48fc-b468-7f0f7c4efdde tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] HTTP exception thrown: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b45a5b35-85cf-48fc-b468-7f0f7c4efdde tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Request method failure captured: Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/os-volumes/ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 HTTP/1.1 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG3Xt3XOY9ReY8Qi_XITJh7FdH34anXchyNnDCgG041Z9VNZn0HPiXP07ZGdSqtduHQAK6jEGSuU-Qk8o_Nn4F0-vYbUFF-bRfSJwuityZAO6tQixQqWxg6gtCgTRv985r8yl3_gwpbhcA1RYWBr5jZvb1o02s6QEamX5MwtRZK7Lwo Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c20f64810be84afe93c33ac83cd1566d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: bf08a48def6d40c190d04bbe07d1e62b Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: exception: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34'} Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. (HTTP 404) (Request-ID: req-b12c1cf1-5dd6-49e9-895a-9acb2eb1e57c) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:09:28.607597 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. Sep 07 10:09:28.615310 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.622010 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9811b167-7463-4b3e-8e17-171b3c729a06 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.225871 Sep 07 10:09:28.625363 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2320/4687] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:28 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 10:09:28.626699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b45a5b35-85cf-48fc-b468-7f0f7c4efdde tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Returning 404 to user: Volume ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:28.628772 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b45a5b35-85cf-48fc-b468-7f0f7c4efdde tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34" status: 404 len: 109 microversion: 2.1 time: 0.075282 Sep 07 10:09:28.634454 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2368/4688] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:09:28 2022] DELETE /compute/v2.1/os-volumes/ab7f71ad-a1e2-4fe6-bbee-87fb992c8e34 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:09:28.640891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-844293fb-8184-4920-af90-ce408ab832ec tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Calling method '.version_select at 0x7f14b123b9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:28.657295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:28.698373 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-844293fb-8184-4920-af90-ce408ab832ec tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] HTTP exception thrown: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-844293fb-8184-4920-af90-ce408ab832ec tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Request method failure captured: Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-volumes/96203e1f-1611-466a-b280-1a2a0d43aae4 HTTP/1.1 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG3Xt3XOY9ReY8Qi_XITJh7FdH34anXchyNnDCgG041Z9VNZn0HPiXP07ZGdSqtduHQAK6jEGSuU-Qk8o_Nn4F0-vYbUFF-bRfSJwuityZAO6tQixQqWxg6gtCgTRv985r8yl3_gwpbhcA1RYWBr5jZvb1o02s6QEamX5MwtRZK7Lwo Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c20f64810be84afe93c33ac83cd1566d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c20f64810be84afe93c33ac83cd1566d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c20f64810be84afe93c33ac83cd1566d Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesNegativeTest-846354102 Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: bf08a48def6d40c190d04bbe07d1e62b Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesNegativeTest-846354102-project Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: exception: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '96203e1f-1611-466a-b280-1a2a0d43aae4'} Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. (HTTP 404) (Request-ID: req-754a20f2-c431-4507-a210-b2a03e27736d) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:09:28.701750 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-844293fb-8184-4920-af90-ce408ab832ec tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] Returning 404 to user: Volume 96203e1f-1611-466a-b280-1a2a0d43aae4 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-844293fb-8184-4920-af90-ce408ab832ec tempest-VolumesNegativeTest-846354102 tempest-VolumesNegativeTest-846354102-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/96203e1f-1611-466a-b280-1a2a0d43aae4" status: 404 len: 109 microversion: 2.1 time: 0.066876 Sep 07 10:09:28.706483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2321/4689] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:09:28 2022] GET /compute/v2.1/os-volumes/96203e1f-1611-466a-b280-1a2a0d43aae4 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:09:28.770253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f5c5c3a8-5496-40a2-ba8b-569eb318bdb0 req-d8fb71d1-983a-4512-b05e-bd23209648df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d66249-b73b-4d59-afc7-516d1bb9cdb7", "tag": "867d1158-27f7-4342-90c1-bd0a9c3e225e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:28.803707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f5c5c3a8-5496-40a2-ba8b-569eb318bdb0 req-d8fb71d1-983a-4512-b05e-bd23209648df service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:28.817313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f5c5c3a8-5496-40a2-ba8b-569eb318bdb0 req-d8fb71d1-983a-4512-b05e-bd23209648df service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:28.820089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f5c5c3a8-5496-40a2-ba8b-569eb318bdb0 req-d8fb71d1-983a-4512-b05e-bd23209648df service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:28.856846 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f5c5c3a8-5496-40a2-ba8b-569eb318bdb0 req-d8fb71d1-983a-4512-b05e-bd23209648df service nova] Creating event network-changed:867d1158-27f7-4342-90c1-bd0a9c3e225e for instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 on n-h2-836830-16 Sep 07 10:09:28.880045 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f5c5c3a8-5496-40a2-ba8b-569eb318bdb0 req-d8fb71d1-983a-4512-b05e-bd23209648df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114978 Sep 07 10:09:28.882862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2369/4690] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:29.016623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:29.017341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:29.032867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:29.036230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:29.036740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:29.038477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:29.038975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:29.040744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:29.166604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:29.167333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:29.186237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:29.186740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:29.187212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:29.187938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:29.188417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:29.188849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:29.654665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:29.663779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a361e2ce-8c64-4e7b-bfa4-67c6a93b151d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.652338 Sep 07 10:09:29.670412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2322/4691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:29 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:29.681489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:29.687757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:29.701624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:29.702302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:29.703140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:29.704846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:29.707526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:29.708055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:29.846539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:29.875468 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4307c18-6157-403a-b343-cef6ec1d2b8b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.203562 Sep 07 10:09:29.876431 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2323/4692] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:29 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:09:29.882570 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06d980d1-1083-44d2-a250-6f6dea049d85 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1304 microversion: 2.1 time: 0.722089 Sep 07 10:09:29.883035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2370/4693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:29 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1304 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:30.692781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:30.693518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:30.712707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:30.713228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:30.713660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:30.717367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:30.718687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:30.719327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:30.833544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68c3e8ff-01b0-4f96-a8ca-b3eb4f642408 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: .version_select at 0x7f14b10813a0>, body: {"keypair": {"name": "tempest-keypair-1901777919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKqJsZQURQW/IntBmnVBFR0eS418dSKJe4jSjXSEBcDfhwQ7nMof2eQVYQ1nWLsNLdq2EuzVflF4+GtEjailDkRF7KgKdz4sQD0w3IrHUzuA3zwKJQ3VasU1NF33Kl8Uw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:30.856642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-68c3e8ff-01b0-4f96-a8ca-b3eb4f642408 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:09:30.868464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-68c3e8ff-01b0-4f96-a8ca-b3eb4f642408 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:09:30.906456 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68c3e8ff-01b0-4f96-a8ca-b3eb4f642408 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075866 Sep 07 10:09:30.926458 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2371/4694] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:09:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:30.931863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:30.943962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:30.961198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:30.963377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:30.964101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:30.966194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:30.969049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:30.969778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:31.054560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c409028a-2b6f-453a-a6c7-88ed6a278f9d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.126329 Sep 07 10:09:31.055548 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2372/4695] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:30 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:09:31.115018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:31.116012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:31.156014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:31.161726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:31.162345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:31.163797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:31.166585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:31.167783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:32.050706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:32.068311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03b4504d-aecc-4318-b21d-4a6e5a80fb21 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 1.371441 Sep 07 10:09:32.069613 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2324/4696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:30 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:32.075522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:32.087364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:32.098350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:32.103266 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3449063a-e196-4f92-aea6-a9de44cdce51 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1304 microversion: 2.1 time: 1.034915 Sep 07 10:09:32.104159 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2373/4697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:31 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1304 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:32.112515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:32.113378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:32.118569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:32.119554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:32.124153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:32.124831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:32.218030 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d0d0a65-fa6f-448c-85e2-22541b388e66 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.146706 Sep 07 10:09:32.223502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2325/4698] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:32 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:09:33.106347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:33.107222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:33.130469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:33.131238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:33.141801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:33.142585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:33.143187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:33.148340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:33.150649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:33.153560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:33.157390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:33.158007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:33.158687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:33.159285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:33.162565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:33.164253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:33.328634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:33.770409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:33.787224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-344dbde1-6b82-495a-a46c-58080c4f33e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.694359 Sep 07 10:09:33.787412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:33.797515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8335e775-1fe1-4bb8-82ed-2dc21104fa64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1304 microversion: 2.1 time: 0.669148 Sep 07 10:09:33.799552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2326/4699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:33 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1304 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:33.800044 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2374/4700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:33 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:33.825892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:33.829434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:33.852105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:33.853033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:33.853781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:33.855865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:33.860530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:33.861169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:33.959886 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94621608-b55d-4e69-8007-97f8fba2303c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 14 microversion: 2.1 time: 0.158535 Sep 07 10:09:33.962089 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2327/4701] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:33 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:09:34.577308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2031005046", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1850076c-60ca-4b3b-8a8e-057cac39480d"}], "security_groups": [{"name": "tempest-securitygroup--937441012"}], "key_name": "tempest-keypair-1901777919", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:34.827390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:34.828176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:34.866147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:34.869942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:34.870339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:34.871393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:34.871953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:34.872435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:34.937109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] validate_networks() for [('1850076c-60ca-4b3b-8a8e-057cac39480d', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:09:35.690539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:35.701240 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fba47678-f35f-4a39-a83a-5358679ab977 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.879507 Sep 07 10:09:35.725311 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2328/4702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:34 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:35.737029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:35.737756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:35.757923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:35.758449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:35.762365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:35.763410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:35.766063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:35.767528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.478996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:36.507846 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a64cf06-292e-4d8d-88bc-f996d924df7e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.780445 Sep 07 10:09:36.533995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2329/4703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:35 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:36.542693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:36.546418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:36.575808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:36.576544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:36.578741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.579588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:36.580083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:36.580529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.700005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:09:36.701978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:09:36.702459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:09:36.702895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:09:36.703319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:09:36.735312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:36.736051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:36.736703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.737204 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea8c93e1-85c8-437c-afc4-985abd90e843 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action" status: 200 len: 16401 microversion: 2.1 time: 0.201734 Sep 07 10:09:36.737983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:36.738906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:36.738906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.744571 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2330/4704] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:36 2022] POST /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122/action => generated 16401 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:36.761822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:36.764119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:36.778435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:36.783962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:36.786265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.787721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:36.789943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:36.790841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:36.806960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:09:36.816952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:09:36.863269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:09:36.870224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:09:36.992751 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b13e0a9-f7bf-4a09-89ec-80dce41f1e54 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.451585 Sep 07 10:09:36.995005 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2375/4705] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:09:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:09:37.008132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:37.009103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:37.018893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:37.019981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:37.020674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:37.040352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:37.042240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:37.043794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:37.398820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:37.473574 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4959297-16d6-427b-a0ab-6c0b1dc12688 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.726195 Sep 07 10:09:37.474843 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2331/4706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:36 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:37.488483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74d25d3e-9853-4134-9843-2e615eadccf5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:37.491341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-74d25d3e-9853-4134-9843-2e615eadccf5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:37.594070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-74d25d3e-9853-4134-9843-2e615eadccf5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:37.601341 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74d25d3e-9853-4134-9843-2e615eadccf5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1242 microversion: 2.1 time: 0.124692 Sep 07 10:09:37.601911 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2332/4707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:37 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:37.617101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:37.618159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:37.636174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:37.637168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:37.638807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:37.641931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:37.642418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:37.642860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:37.735807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:37.744772 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8c6cf0f-1afd-4879-9a54-c9205b4af3a7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.747770 Sep 07 10:09:37.749569 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2376/4708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:36 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:37.794500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:37.795403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:37.819411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:37.820921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:37.822229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:37.824886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:37.826878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:37.828496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:38.155729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:38.172237 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5baa20a2-5296-4cfc-8a80-c7fca2bdc432 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.569248 Sep 07 10:09:38.174570 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2333/4709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:37 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:38.286274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:38.298663 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eacdcfcb-9358-4c9f-925b-e472753e7327 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.514879 Sep 07 10:09:38.299465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2377/4710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:37 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:38.326285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:38.326920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:38.335077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:38.335583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:38.336039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:38.336761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:38.337280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:38.337714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:38.502802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:38.504158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:38.523148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:38.541774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:38.542425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:38.543460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:38.553410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:38.554599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:38.900642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:38.910119 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d685cc0f-2554-42c5-b3e2-6cb61954cf4d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.588829 Sep 07 10:09:38.915473 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2334/4711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:38 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:38.954225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:38.954768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:38.966341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:38.967028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:38.971366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:38.973539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:38.974398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:38.975331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.102239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:39.127374 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-17f91a03-20d5-451a-94e9-645c3d3077b3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1294 microversion: 2.1 time: 0.204109 Sep 07 10:09:39.128785 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2335/4712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:38 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:39.145262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:39.149141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:39.175771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:39.200697 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e84a71e9-017f-4d97-a0d4-d55d3725ed9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.697870 Sep 07 10:09:39.213308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:39.220839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:39.224026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.227315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:39.227852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2378/4713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:38 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:39.230113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:39.231181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.249690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:39.250310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:39.255960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:39.271888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:39.274920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:39.275673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.277552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:39.280178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:39.280800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.734774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:39.748215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:39.754213 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0a3590c-ef8b-4bfa-ab05-4b0da7127280 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.525148 Sep 07 10:09:39.759022 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f8dd3a88-ff89-435c-af82-cb1b2ab96478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.628328 Sep 07 10:09:39.759746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2379/4714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:39 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:39.761633 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2336/4715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:39 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:39.784870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:39.785931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:39.799867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:39.800811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:39.804100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.805762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:39.807116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:39.808892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:39.909438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Locking {{(pid=128832) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 07 10:09:40.028853 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7364b2f2-176b-46c3-8215-2b52921ad9f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.249633 Sep 07 10:09:40.029734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2380/4716] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:39 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:09:40.039311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:40.040360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:40.058696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.059810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.061730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.064031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.065067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.067084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.174469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:40.175289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:40.195471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.196675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.197122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.197867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.199012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.209930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.478598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:40.492740 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c73dec7d-9fb1-463e-8c15-7c3807d9f553 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1300 microversion: 2.1 time: 0.322514 Sep 07 10:09:40.501538 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2381/4717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:40 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1300 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:40.507146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:40.508504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:40.568896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.570236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.587852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.598218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.601039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.603904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.657073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:40.668281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8a918cf1-f526-4770-bcc4-f4465ace1d85 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.630602 Sep 07 10:09:40.669622 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2337/4718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:40 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:40.696491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:40.710906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.714866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.719086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.781577 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] HTTP exception thrown: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 is locked Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Request method failure captured: Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action HTTP/1.1 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 15 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzHI4_Gs1AYCsuN-nstt6RfgCFlbQJx2Y7t1xTba8onie0D-p3dYmj4ETDluGw23VZ-TI88rSdpp2PKXSvonJ_41bjSbUVIF6F_z1PYTp7NtwRlUHYOB7Rv76Aw67_NCxbTeua_jq2FFTf93vJmiFWgHyHPh0TUMHb2J9KhW_fTKRU Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e080e21e856141b7850ea79bafd5b8e9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a8b10f41570421a9292168d0326bae0 Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: {"os-stop": {}} Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 is locked Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '269aa25f-08f2-4a84-bf93-2a9a614ed126', 'body': {'os-stop': {}}} Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 is locked Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 is locked Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 is locked Sep 07 10:09:40.783383 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:09:40.790219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Returning 409 to user: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 is locked {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:09:40.793875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4fedb5ca-d419-459d-bfbc-4751184f8e6a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 409 len: 107 microversion: 2.1 time: 0.098173 Sep 07 10:09:40.794765 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2338/4719] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:40 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 107 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 10:09:40.804644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:40.806527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:40.818938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.822016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.822708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:40.826628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:40.827336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:40.828455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.008718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:41.032014 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3280f78e-ec27-4d53-8ed5-2aabe72968d4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.528954 Sep 07 10:09:41.062216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2382/4720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:40 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:41.068091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:41.069302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:41.092773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.093437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.094151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.099850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.100600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.101324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.263599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Unlocking {{(pid=128832) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 07 10:09:41.342944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:41.361393 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b9d9213-e79c-4d9a-ae34-1c5a78c2aab0 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.565310 Sep 07 10:09:41.383501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2339/4721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:40 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:41.425932 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1a7929d-c5cc-4889-a457-ae74208fab0a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.361109 Sep 07 10:09:41.431510 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2383/4722] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:41 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:09:41.451645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-220abf75-728e-4b82-a048-967c69661b90 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:41.463688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-220abf75-728e-4b82-a048-967c69661b90 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.464569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-220abf75-728e-4b82-a048-967c69661b90 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.465263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-220abf75-728e-4b82-a048-967c69661b90 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.505660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-220abf75-728e-4b82-a048-967c69661b90 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Going to try to stop instance {{(pid=128833) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:09:41.516815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:41.517685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:41.524568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:41.531000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.531507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.531952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.532790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.533282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.533716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.588535 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-220abf75-728e-4b82-a048-967c69661b90 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.152649 Sep 07 10:09:41.590378 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2340/4723] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:41 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:09:41.622334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:41.623115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:41.640972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.644189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.644853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:41.647593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:41.654919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:41.670907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:42.015129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:42.048760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-696e1b0e-f3dd-4bac-9897-87465ed1a74a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.533634 Sep 07 10:09:42.050379 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2384/4724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:41 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:42.084311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:42.085060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:42.101349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:42.101701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:42.102154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:42.102984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:42.103456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:42.103888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:42.293512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:42.307426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69ed5996-5284-4d9c-94fa-a21935388428 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.699932 Sep 07 10:09:42.331475 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2341/4725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:41 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:42.391645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:42.393262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:42.409918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:42.410781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:42.411463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:42.412414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:42.413370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:42.414031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:42.445517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:42.455644 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1bbfcd45-88b9-425f-9138-1d106cfd05c7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.375302 Sep 07 10:09:42.456552 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2385/4726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:42 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:42.753788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:42.764152 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-86fdf637-59db-40ee-93d7-8c163f227ef3 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.375898 Sep 07 10:09:42.776439 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2342/4727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:42 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:43.074348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:43.074979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:43.086978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.087517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.087972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.088692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.099044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.103286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.139705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:43.286033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8e3fe091-c6f2-47c1-b7d1-4a946c1d587a req-57dea1b9-4469-44a0-93e9-496304caae89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb771408-266f-4ef6-b3cd-22d6186ad87a", "tag": "1f81180d-846d-42aa-97fa-2b0f09af464e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:43.318994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8e3fe091-c6f2-47c1-b7d1-4a946c1d587a req-57dea1b9-4469-44a0-93e9-496304caae89 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.320317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8e3fe091-c6f2-47c1-b7d1-4a946c1d587a req-57dea1b9-4469-44a0-93e9-496304caae89 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.322046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8e3fe091-c6f2-47c1-b7d1-4a946c1d587a req-57dea1b9-4469-44a0-93e9-496304caae89 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.352702 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8e3fe091-c6f2-47c1-b7d1-4a946c1d587a req-57dea1b9-4469-44a0-93e9-496304caae89 service nova] Creating event network-changed:1f81180d-846d-42aa-97fa-2b0f09af464e for instance cb771408-266f-4ef6-b3cd-22d6186ad87a on n-h1-836830-16 Sep 07 10:09:43.362652 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8e3fe091-c6f2-47c1-b7d1-4a946c1d587a req-57dea1b9-4469-44a0-93e9-496304caae89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080912 Sep 07 10:09:43.364339 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2343/4728] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:43.409638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:43.426328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:43.449325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:43.464516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.469054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.470681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.471547 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1e60cfd-3184-41f4-b8fb-320bd61b78b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.401246 Sep 07 10:09:43.472636 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2386/4729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:43 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:43.473436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.474766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.475312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.491153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:43.496100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:43.518663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.521094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.529842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.533014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.535011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.536707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.797310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:43.807231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4580ef27-0275-4700-8438-ce94972c9d2f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.425985 Sep 07 10:09:43.808471 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2344/4730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:43 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:43.813803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:43.814734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:43.821300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.821905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.822860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.824415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:43.825519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:43.826037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:43.900038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:43.911701 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75cd854c-f431-4476-bcd9-0d74f9bf059a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.428380 Sep 07 10:09:43.915145 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2387/4731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:43 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:44.118748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:44.132004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42f66a61-c6e1-4b56-b5b9-17df7ebaefd5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.322213 Sep 07 10:09:44.132940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2345/4732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:43 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:44.526820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:44.533952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:44.568994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:44.571951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:44.577028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:44.578911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:44.580124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:44.580825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:44.834774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:44.836124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:44.852879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:44.853798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:44.859473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:44.860694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:44.861613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:44.862531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:44.926816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:44.944468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-53e2a4d4-f905-42f3-a940-b5f08758f7c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.444606 Sep 07 10:09:44.945452 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2388/4733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:44 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:44.972649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3b9a133d-d164-4157-b992-e88305ab3693 req-98c5a762-ae8b-45a0-9173-1d664ddd79c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de3e34b-ada0-4c49-bf59-155a4094daec", "name": "network-vif-plugged", "status": "completed", "tag": "80d5f69b-d0f8-4053-b7df-6aad05bb59e6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:44.982917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3b9a133d-d164-4157-b992-e88305ab3693 req-98c5a762-ae8b-45a0-9173-1d664ddd79c1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:44.983408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3b9a133d-d164-4157-b992-e88305ab3693 req-98c5a762-ae8b-45a0-9173-1d664ddd79c1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:44.983852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3b9a133d-d164-4157-b992-e88305ab3693 req-98c5a762-ae8b-45a0-9173-1d664ddd79c1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:44.996921 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3b9a133d-d164-4157-b992-e88305ab3693 req-98c5a762-ae8b-45a0-9173-1d664ddd79c1 service nova] Creating event network-vif-plugged:80d5f69b-d0f8-4053-b7df-6aad05bb59e6 for instance 6de3e34b-ada0-4c49-bf59-155a4094daec on n-h2-836830-16 Sep 07 10:09:45.003936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3b9a133d-d164-4157-b992-e88305ab3693 req-98c5a762-ae8b-45a0-9173-1d664ddd79c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040143 Sep 07 10:09:45.005422 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2389/4734] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:45.012613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:45.013699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:45.021809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:45.024083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:45.024083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:45.024083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:45.024827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:45.025720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:45.341398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:45.356330 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f763d57-b407-4f15-9829-9d8f551931ee tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.348220 Sep 07 10:09:45.356846 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2390/4735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:45 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:45.363240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:45.364094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:45.372281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:45.373065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:45.373705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:45.374736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:45.375385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:45.375986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:45.378610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:45.391908 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e47c63b7-71e3-4e1a-998a-c732c906f54e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.560868 Sep 07 10:09:45.394569 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2346/4736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:44 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:45.619179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:45.629122 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae53fd91-d111-4102-ad15-f47720084d49 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.270085 Sep 07 10:09:45.630304 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2391/4737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:45 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:45.980104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:45.980991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:45.997955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:45.998560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:45.999213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.000004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.000976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.001505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.335736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:46.347069 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6ebac85-57e1-43da-a3b4-d4cfdc4e5c74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.373472 Sep 07 10:09:46.347661 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2347/4738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:45 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:46.382900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:46.383736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:46.396074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.396484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.396929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.397671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.398132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.398562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.420464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:46.421096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:46.430496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.430981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.436812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.437595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.438136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.438482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.712610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:46.725322 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a853d55-82bb-483e-97e8-c3c96f1850c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.346444 Sep 07 10:09:46.746344 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2392/4739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:46 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:46.751998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:46.753332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:46.760244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:46.762851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.763843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.764592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.765661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:46.766505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:46.767121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:46.864503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:47.012334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:47.023793 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7da069de-090d-4212-a66c-71ec9b942c49 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.610173 Sep 07 10:09:47.024748 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2348/4740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:46 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:47.134391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:47.143479 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6040c397-bc69-4c49-a7b3-ef8b7c0d59a5 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1292 microversion: 2.1 time: 0.395657 Sep 07 10:09:47.144068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2393/4741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:46 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:47.373590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:47.374500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:47.383711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:47.386771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:47.387419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:47.389458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:47.392303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:47.392996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:47.600928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:47.708259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:47.721031 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a850bfe-9d00-448e-9420-7ff7f5949ed0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.351209 Sep 07 10:09:47.722246 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2349/4742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:47 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:47.754455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:47.755145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:47.765539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:47.768698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:47.769419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:47.770342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:47.772047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:47.773987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.048632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:48.050416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:48.067007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.067923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.070537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.071547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.073354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.074755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.125919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:48.168009 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-632325c2-3147-449c-92cb-b57f25b84d1f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.416072 Sep 07 10:09:48.173912 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2394/4743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:47 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:48.189688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:48.190320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:48.213055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.216400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.217262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.218871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.219516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.220106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.523250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:48.535036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77a64bf9-ae79-44e1-acd5-b5d58083ab97 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.489986 Sep 07 10:09:48.537145 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2350/4744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:48 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:48.629037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:48.643382 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40417c76-11fa-4392-b50d-bd240d609e3f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1483 microversion: 2.1 time: 0.468065 Sep 07 10:09:48.644445 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2395/4745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:48 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1483 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:48.672560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:48.673097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:48.689136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.689684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.690320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.691211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.691832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.692432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.744562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:48.745315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:48.751586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.752078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.752546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.753874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:48.756930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:48.757552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:48.812330 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-158650a3-72da-4520-b139-286467009a06 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148132 Sep 07 10:09:48.813685 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2351/4746] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:09:48 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:48.963362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:48.971821 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-164447ab-a77f-473f-b3cf-bef0aba774d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.231737 Sep 07 10:09:48.986246 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2396/4747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:48 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:49.111826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:49.118936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:49.159272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.160133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.161413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.164163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.164976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.165662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.191816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:49.192579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:49.201408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.201912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.206062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.207028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.209872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.210499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.237413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b76a25ea-43e2-4b3a-9627-724539738ce1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments/b983b0f1-6a65-4432-93fd-eb0867f4ea9d" status: 200 len: 194 microversion: 2.20 time: 0.132288 Sep 07 10:09:49.244290 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2352/4748] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Sep 7 10:09:49 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments/b983b0f1-6a65-4432-93fd-eb0867f4ea9d => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:49.346952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:49.347982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:49.359864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.360641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.361335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.362232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.363591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.366584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.523802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:49.532875 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3307c6bd-0f35-499a-9fc5-dae49bbc41dd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.344706 Sep 07 10:09:49.533496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2397/4749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:49 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:49.564018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:49.564789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:49.567043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lazy-loading 'services' on Instance uuid 216dfce6-78f0-4ed7-ab4b-eec1dde35dff {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:09:49.578659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.578659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.578984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.579759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.580663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.581326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.774600 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-78fa67b6-9ee2-4967-8214-94dccdde64c5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments/b983b0f1-6a65-4432-93fd-eb0867f4ea9d" status: 202 len: 0 microversion: 2.20 time: 0.430987 Sep 07 10:09:49.776932 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2353/4750] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 7 10:09:49 2022] DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments/b983b0f1-6a65-4432-93fd-eb0867f4ea9d => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:09:49.811808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:49.817772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:49.852122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.856377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.856919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.857934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.863625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.864103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.888241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:49.902986 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38f03dce-1098-49d1-ae4d-ca9a7bf84d7b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.341401 Sep 07 10:09:49.903980 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2398/4751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:49 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:49.912824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-51d53387-7eb5-4514-aa19-169ce3b47fa3 req-dc66021c-65a2-401d-99c2-e4a94c19e8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb771408-266f-4ef6-b3cd-22d6186ad87a", "name": "network-vif-plugged", "status": "completed", "tag": "1f81180d-846d-42aa-97fa-2b0f09af464e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:49.939225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-51d53387-7eb5-4514-aa19-169ce3b47fa3 req-dc66021c-65a2-401d-99c2-e4a94c19e8b2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:49.941549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-51d53387-7eb5-4514-aa19-169ce3b47fa3 req-dc66021c-65a2-401d-99c2-e4a94c19e8b2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:49.944710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-51d53387-7eb5-4514-aa19-169ce3b47fa3 req-dc66021c-65a2-401d-99c2-e4a94c19e8b2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:49.989692 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2707bb97-4737-4060-9898-4608bc1e050a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198605 Sep 07 10:09:49.990098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-51d53387-7eb5-4514-aa19-169ce3b47fa3 req-dc66021c-65a2-401d-99c2-e4a94c19e8b2 service nova] Creating event network-vif-plugged:1f81180d-846d-42aa-97fa-2b0f09af464e for instance cb771408-266f-4ef6-b3cd-22d6186ad87a on n-h1-836830-16 Sep 07 10:09:49.996364 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2354/4752] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:49 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:50.002242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-51d53387-7eb5-4514-aa19-169ce3b47fa3 req-dc66021c-65a2-401d-99c2-e4a94c19e8b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096479 Sep 07 10:09:50.006477 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2399/4753] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:50.021107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:50.022343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:50.039034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:50.039405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:50.056017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:50.058182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:50.058688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:50.059141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:50.395523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:50.408837 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0b599b7-7bde-4a92-bb4b-4c5941ea0cdf tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 0.409950 Sep 07 10:09:50.419574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2355/4754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:49 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:50.566769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:50.567605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:50.588271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:50.589837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:50.592664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:50.593672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:50.596902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:50.598203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:50.888568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:50.900007 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6fbb94a9-f7a9-4e86-b4e2-f1612c31189e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1169 microversion: 2.1 time: 0.342796 Sep 07 10:09:50.902307 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2400/4755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:50 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:50.932453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:50.933747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:50.945335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:50.945837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:50.946280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:50.946992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:50.947447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:50.952117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:51.019727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:51.033980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:51.054214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:51.062543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:51.068272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:51.072982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:51.074845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:51.076094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:51.186841 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68a18dc8-00cb-4d39-97bd-fa083f1f3afc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.171613 Sep 07 10:09:51.189348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2401/4756] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:51 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:51.253981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:51.257933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:51.269501 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dd6e3784-3dbc-40e5-9867-5d150d6ed1b5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.341294 Sep 07 10:09:51.272130 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2356/4757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:50 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:51.445706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:51.446702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:51.476916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:51.477625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:51.478094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:51.479633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:51.480285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:51.484420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:51.568179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:51.568873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:51.581360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:51.584461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:51.585122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:51.586306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:51.587129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:51.587724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.433906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:52.448821 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-786ebf38-c384-4ffe-84ad-898ac7330235 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1367 microversion: 2.1 time: 1.007143 Sep 07 10:09:52.453690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:52.464890 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2402/4758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:51 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1367 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:52.467350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e4debd6-26eb-4abb-9dcc-d27853169102 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1483 microversion: 2.1 time: 0.898357 Sep 07 10:09:52.489045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2357/4759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:51 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1483 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:52.498933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:52.499368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-525bc90e-e373-4d31-8c73-9c92693905ab req-fb5da729-fd83-4ce8-84d1-cf7832e8f0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de3e34b-ada0-4c49-bf59-155a4094daec", "tag": "80d5f69b-d0f8-4053-b7df-6aad05bb59e6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:52.502939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:52.519028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.521745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.522786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.523901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.524527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-525bc90e-e373-4d31-8c73-9c92693905ab req-fb5da729-fd83-4ce8-84d1-cf7832e8f0b1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.525354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.526022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.527199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-525bc90e-e373-4d31-8c73-9c92693905ab req-fb5da729-fd83-4ce8-84d1-cf7832e8f0b1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.527630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-525bc90e-e373-4d31-8c73-9c92693905ab req-fb5da729-fd83-4ce8-84d1-cf7832e8f0b1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.558320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-525bc90e-e373-4d31-8c73-9c92693905ab req-fb5da729-fd83-4ce8-84d1-cf7832e8f0b1 service nova] Creating event network-changed:80d5f69b-d0f8-4053-b7df-6aad05bb59e6 for instance 6de3e34b-ada0-4c49-bf59-155a4094daec on n-h2-836830-16 Sep 07 10:09:52.570954 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-525bc90e-e373-4d31-8c73-9c92693905ab req-fb5da729-fd83-4ce8-84d1-cf7832e8f0b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104204 Sep 07 10:09:52.577795 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2403/4760] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:52.585567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:52.587895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:52.609678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.610488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.611125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.612298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.612996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.613691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.707557 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5701ab95-d352-4ed6-9896-32791399790a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128247 Sep 07 10:09:52.716463 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2404/4761] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:52 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:52.726337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:52.731955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:52.744761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.745991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.748714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.749942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:52.755514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:52.756535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:52.787824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:53.721627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:53.729759 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-10f6bc0c-1a38-4ec7-8dbb-9a4fc69dfd54 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 1.238910 Sep 07 10:09:53.730649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2358/4762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:52 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:53.757287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:53.757876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:53.768497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=88 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:09:53.778967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:53.779479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:53.779930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:53.805265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:53.806383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:53.808027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.054829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:54.066583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e1c2924-fe04-4af9-9c82-c9b95423072d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1655 microversion: 2.1 time: 1.348564 Sep 07 10:09:54.085441 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2405/4763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:52 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1655 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:54.085441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:54.094159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:54.103083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.103594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.104046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.113604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.114205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.114663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.179700 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f393d633-15a3-4da8-9ac7-0074d56b46a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103419 Sep 07 10:09:54.187268 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2406/4764] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:54 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:54.192932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6fd02e1-a62e-4b52-87e9-8aee03764149 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:54.199676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6fd02e1-a62e-4b52-87e9-8aee03764149 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.200279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6fd02e1-a62e-4b52-87e9-8aee03764149 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.200981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6fd02e1-a62e-4b52-87e9-8aee03764149 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.301060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f6fd02e1-a62e-4b52-87e9-8aee03764149 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Going to try to start instance {{(pid=128832) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 10:09:54.475268 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6fd02e1-a62e-4b52-87e9-8aee03764149 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.286563 Sep 07 10:09:54.476209 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2407/4765] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:54 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:09:54.490543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:54.506252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:54.515839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.516648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.517378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.518298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.518929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.519543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.627189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:54.654375 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d89bcc37-57e3-4335-859b-32fc90e7030a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1557 microversion: 2.1 time: 0.915247 Sep 07 10:09:54.664123 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2359/4766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:53 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1557 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:54.695952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:54.696802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:54.733592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.734625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.735514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.740872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.741823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.742705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.897868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:54.925075 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b44178fb-efe2-4f6e-a158-c5813ada3467 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1664 microversion: 2.1 time: 0.439533 Sep 07 10:09:54.952207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2408/4767] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:54 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1664 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:54.958451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:54.963454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:54.970143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.970902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.971546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:54.973241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:54.973876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:54.974481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:55.012415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-369ea648-db0d-4bf9-b5d1-e8821b09edbd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321278 Sep 07 10:09:55.013231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2360/4768] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:09:54 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/os-interface => generated 285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:55.164529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:55.179889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14a584aa-4b7e-40cf-9477-5bf63595f702 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.225906 Sep 07 10:09:55.182610 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2409/4769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:54 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:55.194452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:55.196878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:55.227831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:55.228991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:55.233575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:55.235227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:55.238006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:55.246866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:55.350522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d547ace9-4dd1-4464-96f9-c6d33e350f4d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160911 Sep 07 10:09:55.379381 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2361/4770] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:55 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:56.210998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:56.211854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:56.226547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:56.228259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:56.228806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:56.232988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:56.235320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:56.237303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:56.608543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:56.620231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94de6304-acb1-4f56-9433-25f8f30194ff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.414457 Sep 07 10:09:56.620848 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2362/4771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:56 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:56.633604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:56.633604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:56.649586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:56.650129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:56.652215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:56.655255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:56.656830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:56.658552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:56.659014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:56.662237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:56.690308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:56.690820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:56.691272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:56.691995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:56.692462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:56.692897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:56.782151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e588214a-b69d-42a2-bf17-493c12aef29c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160179 Sep 07 10:09:56.793376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2363/4772] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:56 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:56.918877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:56.928134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-80e98881-7591-48ed-bc95-f678806d4b39 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1664 microversion: 2.1 time: 0.973579 Sep 07 10:09:56.933737 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2410/4773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:55 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1664 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:57.648238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:57.649130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:57.698982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0866ae5d-723e-451c-a48d-dd272b0dcdf5 req-7daa9612-0b5c-4710-86dc-c7d148ddfba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb771408-266f-4ef6-b3cd-22d6186ad87a", "tag": "1f81180d-846d-42aa-97fa-2b0f09af464e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:57.721460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:57.724888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:57.727916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:57.732840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:57.733637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:57.735219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0866ae5d-723e-451c-a48d-dd272b0dcdf5 req-7daa9612-0b5c-4710-86dc-c7d148ddfba3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:57.735952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:57.737119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0866ae5d-723e-451c-a48d-dd272b0dcdf5 req-7daa9612-0b5c-4710-86dc-c7d148ddfba3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:57.737827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0866ae5d-723e-451c-a48d-dd272b0dcdf5 req-7daa9612-0b5c-4710-86dc-c7d148ddfba3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:57.788438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0866ae5d-723e-451c-a48d-dd272b0dcdf5 req-7daa9612-0b5c-4710-86dc-c7d148ddfba3 service nova] Creating event network-changed:1f81180d-846d-42aa-97fa-2b0f09af464e for instance cb771408-266f-4ef6-b3cd-22d6186ad87a on n-h1-836830-16 Sep 07 10:09:57.809439 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0866ae5d-723e-451c-a48d-dd272b0dcdf5 req-7daa9612-0b5c-4710-86dc-c7d148ddfba3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117725 Sep 07 10:09:57.815237 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2411/4774] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:09:57.831564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:57.842363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:57.865932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:57.867840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:57.882303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:57.883689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:57.891821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:57.892865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.001523 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ea6d3c5-c740-409d-83ab-18113d223f37 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.181562 Sep 07 10:09:58.006961 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2412/4775] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:57 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:58.014641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:58.015679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:58.023769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:58.024541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:58.025258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.027532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:58.028457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:58.029129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.081937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:58.100505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbd0ebac-2f42-45b9-b7e1-94c11c195a9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.451205 Sep 07 10:09:58.101394 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2364/4776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:57 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:09:58.371644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:58.381725 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-227e7f23-8767-440e-9234-27ebe1e2b217 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.372828 Sep 07 10:09:58.395763 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2413/4777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:58 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:58.415055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:58.415816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:58.433796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:58.434333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:58.434785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.441844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:58.442351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:58.442803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.675044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:58.689411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-248154d9-17bb-41c2-b0f1-481724dfeac1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.274801 Sep 07 10:09:58.690620 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2365/4778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:58 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:58.736515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:09:58.738192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:58.755761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:58.756289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:58.760856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.760856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:58.760856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:58.761110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:58.863104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Unlocking {{(pid=128832) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 07 10:09:58.988872 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e76ab4d3-5c71-42e4-ad1f-acd1d24dab40 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.259607 Sep 07 10:09:58.989715 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2414/4779] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:09:58 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:09:59.002091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:59.003224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:59.015044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:59.016348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.019015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:59.019634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.020283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.022351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.024519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.027176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.041200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.042467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.044321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.045700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.049069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.049877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.189261 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b378cbc-7cf4-4fe8-a2db-889ea6dc8652 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.178650 Sep 07 10:09:59.197533 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2415/4780] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:09:59 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:09:59.224810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:59.230964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:59.241011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.252912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.258750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.266289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.267077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.269518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.379510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:59.391530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c91c7e8a-d6cb-49ae-aa68-5cc662e4a050 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.392730 Sep 07 10:09:59.394261 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2366/4781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:58 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:59.424787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:59.426507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:59.441616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.444595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.445652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.449680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.450660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.451273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.779412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:59.794351 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fff22ea4-96f9-4fc3-817a-36b2b7df3807 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.593762 Sep 07 10:09:59.795988 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2416/4782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:59 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:59.926594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:09:59.935888 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d47c5f4-47f1-459a-8f3f-d34019ae1ba0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.515646 Sep 07 10:09:59.938190 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2367/4783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:59 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:09:59.962060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:09:59.962888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:09:59.972088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.972775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.973425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:09:59.974298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:09:59.974924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:09:59.975648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.203831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:00.207730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:00.240413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.240947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.241374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.242096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.242557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.242986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.248142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:00.257423 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-679622f9-8c06-4759-82fc-5d59d8c6592b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.300176 Sep 07 10:10:00.263188 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2417/4784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:09:59 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:00.289434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:00.290083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:00.306542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.309095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.310216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.311485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.314828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.315497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.345379 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95d49502-c741-4201-8e69-18edd66aa4b7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145692 Sep 07 10:10:00.346593 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2368/4785] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:10:00 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:10:00.400229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:00.485792 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-473de1c0-9502-4355-9552-0a831c154631 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.189260 Sep 07 10:10:00.487512 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2418/4786] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:10:00 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:10:00.495216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:00.496793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:00.503489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.504222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.504853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.506134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.506931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.507526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.818291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:00.824901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:00.826043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:00.829573 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a135ba0-4fb6-4d9f-ab4f-a9d4cb9e955a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1673 microversion: 2.1 time: 0.338351 Sep 07 10:10:00.851600 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2369/4787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:00 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1673 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:00.851719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.851719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.851719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:00.851719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:00.854871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:00.858225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.076732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:01.088031 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99d34923-3314-47f8-9caf-c1813ca25212 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.270312 Sep 07 10:10:01.090081 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2419/4788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:00 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:01.363299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:01.366597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:01.384476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.388294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.389258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.391470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.392180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.393488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.456107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-38c794a4-d769-4244-a8fc-70d125d32941 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.097614 Sep 07 10:10:01.457033 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2370/4789] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:10:01 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:01.564236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:01.565146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:01.574184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.574864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.575677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.576823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.578322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.578990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.624532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:10:01.764457 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-50c24d38-7fce-4b5f-96da-486f6e581bfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 204 len: 0 microversion: 2.20 time: 0.204503 Sep 07 10:10:01.765073 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2420/4790] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:10:01 2022] DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:10:01.774132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:01.774760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:01.783542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.784050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.784493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.785234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.785700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.786250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.865513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:01.874099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:01.891745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.895994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.897369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:01.903099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:01.903755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:01.904305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.085848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:02.098332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:02.099806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:02.101046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b061419-5f3f-47ea-81dd-b0295a0404fc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 0.331579 Sep 07 10:10:02.101643 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2371/4791] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:01 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:10:02.111905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:02.112721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:02.128963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.129722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.130364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.131905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.132554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.133365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.206864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:02.222719 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-48bf66c7-62fd-45c0-ae6e-d8917fef4e1e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1653 microversion: 2.1 time: 0.367593 Sep 07 10:10:02.234910 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2421/4792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:01 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1653 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:02.250568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:02.251308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:02.258109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.258962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.259719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.261418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.261852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.262517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.377614 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85e8a157-f559-423f-91a9-3f62eed8e4f2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.133529 Sep 07 10:10:02.382383 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2422/4793] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:10:02 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:10:02.391952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:02.403778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:02.409943 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ef0078b-d425-4ba9-aa95-e7dcf6eb9bd7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.301655 Sep 07 10:10:02.410547 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2372/4794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:02 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:02.411516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:02.420470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.421175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.422271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.423221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.423697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.424379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.610229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:02.618233 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb8b76c3-5004-4215-b3d2-4858bc04e60f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1660 microversion: 2.1 time: 0.233503 Sep 07 10:10:02.619026 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2423/4795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:02 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1660 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:02.861356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4002f911-327d-44a0-a7bf-86bb4b489d99 req-8590fafd-739c-4cc8-87bc-7ac0731144a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d66249-b73b-4d59-afc7-516d1bb9cdb7", "name": "network-vif-plugged", "status": "completed", "tag": "867d1158-27f7-4342-90c1-bd0a9c3e225e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:02.881858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4002f911-327d-44a0-a7bf-86bb4b489d99 req-8590fafd-739c-4cc8-87bc-7ac0731144a5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:02.882391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4002f911-327d-44a0-a7bf-86bb4b489d99 req-8590fafd-739c-4cc8-87bc-7ac0731144a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:02.882825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4002f911-327d-44a0-a7bf-86bb4b489d99 req-8590fafd-739c-4cc8-87bc-7ac0731144a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:02.906863 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4002f911-327d-44a0-a7bf-86bb4b489d99 req-8590fafd-739c-4cc8-87bc-7ac0731144a5 service nova] Creating event network-vif-plugged:867d1158-27f7-4342-90c1-bd0a9c3e225e for instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 on n-h2-836830-16 Sep 07 10:10:02.918414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4002f911-327d-44a0-a7bf-86bb4b489d99 req-8590fafd-739c-4cc8-87bc-7ac0731144a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062643 Sep 07 10:10:02.920208 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2373/4796] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:03.137632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:03.140238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:03.156311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:03.156803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:03.157520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:03.158236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:03.158696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:03.159302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:03.343203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:03.355203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:03.356692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:03.358395 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-22702253-dc13-4433-8a55-4f0fd157fb5c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1722 microversion: 2.20 time: 0.233140 Sep 07 10:10:03.359106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2424/4797] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:03 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:03.438293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:03.439007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:03.446311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:03.447208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:03.447680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:03.448914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:03.449422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:03.449852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:03.472783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:03.602272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:03.611200 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0d5ee2d-f600-452d-9537-954dbe69552b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1203 microversion: 2.1 time: 0.177913 Sep 07 10:10:03.625774 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2374/4798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:03 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1203 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:03.644776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:03.645683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:03.660187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:03.662861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:03.663577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:03.665267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:03.665943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:03.666689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:03.916912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:03.926337 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd1ca92a-2848-431e-b728-fa6fe1f45462 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.287863 Sep 07 10:10:03.927687 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2425/4799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:03 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:03.976005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:03.977041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:04.004092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.007750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.008393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.010096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.011572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.013446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.245735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:04.270672 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-57481912-b78f-469d-86c0-ad1d9ceac145 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.303845 Sep 07 10:10:04.271268 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2375/4800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:03 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:04.302963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:04.303576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:04.308980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:04.329969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.334572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.335431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.340593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.343236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.343872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.387388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:04.388145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:04.398953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.399827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.401088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.409489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.414668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.415370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.553943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:04.564871 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c513c01e-0117-4565-9f7a-baed17d8a5c0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.265703 Sep 07 10:10:04.565338 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2426/4801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:04 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:04.593443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:04.594074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:04.603124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.603633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.604125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.604861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.609662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.613366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.615399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:04.627895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:04.629469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:04.630731 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e317c560-08ac-498d-a3a1-a0a8fcf1733a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1655 microversion: 2.20 time: 0.248756 Sep 07 10:10:04.631764 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2376/4802] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:04 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1655 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:10:04.645311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:04.647959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:04.663373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.665512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.666689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:04.670353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:04.671049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:04.674187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.047842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.062746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f87e85b7-ecc6-487d-9bd6-991d28bef3ea tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.473595 Sep 07 10:10:05.064703 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2427/4803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:04 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:05.076758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ea4c805e-22ec-4e3b-b9db-a15e3d07e270 req-10e65a4c-1889-40a8-afe7-b96543acfe01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216dfce6-78f0-4ed7-ab4b-eec1dde35dff", "name": "network-vif-deleted", "tag": "2298e088-09ce-40f1-8dcf-4e991c518343"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:05.101038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ea4c805e-22ec-4e3b-b9db-a15e3d07e270 req-10e65a4c-1889-40a8-afe7-b96543acfe01 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.101765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ea4c805e-22ec-4e3b-b9db-a15e3d07e270 req-10e65a4c-1889-40a8-afe7-b96543acfe01 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.102253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ea4c805e-22ec-4e3b-b9db-a15e3d07e270 req-10e65a4c-1889-40a8-afe7-b96543acfe01 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.125623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.125913 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ea4c805e-22ec-4e3b-b9db-a15e3d07e270 req-10e65a4c-1889-40a8-afe7-b96543acfe01 service nova] Creating event network-vif-deleted:2298e088-09ce-40f1-8dcf-4e991c518343 for instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff on n-h1-836830-16 Sep 07 10:10:05.132398 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ea4c805e-22ec-4e3b-b9db-a15e3d07e270 req-10e65a4c-1889-40a8-afe7-b96543acfe01 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066436 Sep 07 10:10:05.134658 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80cf9e57-402c-416b-8974-949ab27dc0d3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1389 microversion: 2.1 time: 0.501619 Sep 07 10:10:05.141415 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2428/4804] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:05.142997 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2377/4805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:04 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1389 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:05.149642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:05.150904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:05.157965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.158664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.159295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.160201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.161909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.162538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.177606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:05.178362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:05.191692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.194652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.195381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.199974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.200948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.201539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.582098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.598392 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae5e601a-5222-4f1b-8884-07ae5bb7abc7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.451977 Sep 07 10:10:05.600602 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2429/4806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:05 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:05.623174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:05.624048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:05.639894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.640749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.641489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.642447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.643122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.643713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.693630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.702491 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c67dcb0-6631-4d86-9bf6-c7339a9b8a70 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1389 microversion: 2.1 time: 0.530689 Sep 07 10:10:05.703082 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2378/4807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:05 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1389 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:05.716639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:05.717286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:05.734483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.734742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.735145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.741387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.742002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.742647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.784141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:05.784634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:05.785070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:05.785548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lazy-loading 'fault' on Instance uuid 216dfce6-78f0-4ed7-ab4b-eec1dde35dff {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:10:05.936007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.948598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.963196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:05.967414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0a413c9-ddcb-4bff-846d-e9a2b39629c7 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 200 len: 1371 microversion: 2.20 time: 0.256981 Sep 07 10:10:05.969164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2379/4808] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:05 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:05.982395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:05.984100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:06.004887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:06.005416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:06.005856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:06.006576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:06.007037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:06.007459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:06.093861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:06.112635 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-099a6c7e-520e-4214-ac0c-70ecc337e46f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.493496 Sep 07 10:10:06.115205 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2430/4809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:05 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:06.239329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:06.256911 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e772dac8-50a3-4d2b-b000-c4e5e5c22b20 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1389 microversion: 2.1 time: 0.286276 Sep 07 10:10:06.259746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2380/4810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:05 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1389 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:06.413064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:06.416587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:06.432794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:06.434037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:06.435859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:06.438567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:06.439694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:06.440312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:06.502299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:10:06.553124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:06.663150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1b098aa-9a88-4fa0-8522-afa0999230b9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 204 len: 0 microversion: 2.1 time: 0.255669 Sep 07 10:10:06.663967 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2431/4811] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:10:06 2022] DELETE /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:10:06.677896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:06.678523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:06.693358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:06.694223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:06.696213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:06.697019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:06.698128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:06.698848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:06.945672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:06.961425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd3c0173-fb22-459d-b58d-5fcd5c203108 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1395 microversion: 2.1 time: 0.292770 Sep 07 10:10:06.969496 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2381/4812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:06 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1395 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:07.004582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:07.005414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:07.012496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:07.013320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:07.013933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:07.015164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:07.015808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:07.016479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:07.037512 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] HTTP exception thrown: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Request method failure captured: Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff HTTP/1.1 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG0AZfJKTWp7EW-3orif81ghOr2tfmigR8fffyfX9KYJyxwLIkwttjwZ1WtRNSmFjxolqbmtngt3DpK9k1FQsRnM13LeJvO5xIK_--ULgG23YeAvniDJFsj3AoUbl9iW9dpNwWsqjBAp86Kek5tx4ad6z5VHh4S-R0K_WFtrgq64ICQ Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dcacc5aca3a4eaa8681cf3eee3633b3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6cb4a2e0094a4c90ae14626b946065e1 Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '216dfce6-78f0-4ed7-ab4b-eec1dde35dff'} Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:07.039251 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Returning 404 to user: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30543dc4-4420-434c-a726-17504e17772f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 404 len: 111 microversion: 2.20 time: 0.043354 Sep 07 10:10:07.045655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2432/4813] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:06 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 10:10:07.051413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ccf82688-ef2e-448f-9c8f-2c9898c1e2ee tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '.version_select at 0x7f14b1295820>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:07.075759 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ccf82688-ef2e-448f-9c8f-2c9898c1e2ee tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907719540" status: 204 len: 0 microversion: 2.20 time: 0.027314 Sep 07 10:10:07.078464 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2382/4814] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 7 10:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907719540 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:10:07.985372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:07.986301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:07.994206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:07.995225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:07.996288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:07.997338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:07.997985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:07.998658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:08.210209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:08.221854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c576ec46-126a-4b45-86e6-ef019dc328e8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1395 microversion: 2.1 time: 0.240967 Sep 07 10:10:08.223185 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2433/4815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:07 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1395 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:08.646149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2966e4e-0445-470e-9d8f-c1aabab91f20 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'create', calling method: .version_select at 0x7f14b5deb310>, body: {"keypair": {"name": "tempest-keypair-865378966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7O+kLuIqvaF3D7z9CavMbKCBoINzpIMWoiIlQNncQzKrRrbn+z780jrWVPAxqyge4VwLADaq5Dw9LIgU5k7wLZ2uLhG4osJF+JlWonEplxlSdudzGhwmYU+7E9VG5PeQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:08.691302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c2966e4e-0445-470e-9d8f-c1aabab91f20 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:10:08.701499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c2966e4e-0445-470e-9d8f-c1aabab91f20 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for user 6cb4a2e0094a4c90ae14626b946065e1 and project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:10:08.758726 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2966e4e-0445-470e-9d8f-c1aabab91f20 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116593 Sep 07 10:10:08.769775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2383/4816] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 7 10:10:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 10:10:09.253925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:09.255261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:09.271571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:09.273632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:09.275258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:09.277169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:09.280265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:09.281122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:09.443455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:09.493647 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-662f6c17-737f-4e68-a35e-f3d9cfbafca8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1353 microversion: 2.1 time: 0.244226 Sep 07 10:10:09.514218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2434/4817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:09 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:09.757406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c2266d0d-f124-4f9f-93bc-b88815beb92b req-354cba2d-8486-49b5-8a3d-f14fc696635f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d66249-b73b-4d59-afc7-516d1bb9cdb7", "name": "network-vif-deleted", "tag": "867d1158-27f7-4342-90c1-bd0a9c3e225e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:09.775103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c2266d0d-f124-4f9f-93bc-b88815beb92b req-354cba2d-8486-49b5-8a3d-f14fc696635f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:09.778319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c2266d0d-f124-4f9f-93bc-b88815beb92b req-354cba2d-8486-49b5-8a3d-f14fc696635f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:09.779561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c2266d0d-f124-4f9f-93bc-b88815beb92b req-354cba2d-8486-49b5-8a3d-f14fc696635f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:09.803233 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c2266d0d-f124-4f9f-93bc-b88815beb92b req-354cba2d-8486-49b5-8a3d-f14fc696635f service nova] Creating event network-vif-deleted:867d1158-27f7-4342-90c1-bd0a9c3e225e for instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 on n-h2-836830-16 Sep 07 10:10:09.847331 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c2266d0d-f124-4f9f-93bc-b88815beb92b req-354cba2d-8486-49b5-8a3d-f14fc696635f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370576 Sep 07 10:10:09.847941 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2384/4818] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:10.527781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:10.529519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:10.546185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:10.547999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:10.549479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:10.566877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:10.567804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:10.568769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:10.859184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:10.872228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-da195718-76cc-41d1-be65-a95dd8eb8569 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1188 microversion: 2.1 time: 0.348708 Sep 07 10:10:10.890575 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2435/4819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:10 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1188 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:11.533694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-907409103", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c89eec50-bb9e-40af-bb53-f85977233779"}], "security_groups": [{"name": "tempest-securitygroup--1297332302"}], "key_name": "tempest-keypair-865378966", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:11.798966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] validate_networks() for [('c89eec50-bb9e-40af-bb53-f85977233779', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:10:11.898249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:11.898960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:11.921413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:11.921859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:11.922320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:11.923048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:11.923519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:11.923957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:12.076277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:12.092036 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a2dc97f7-63fa-44c7-b0b6-144841c35c8c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1188 microversion: 2.1 time: 0.199025 Sep 07 10:10:12.105163 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2436/4820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:11 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1188 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:12.861511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:10:12.862634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:10:12.863347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:10:12.863957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:10:12.864583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:10:12.888682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:12.889624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:12.890267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:12.891659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:12.896376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:12.897166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:12.971664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:10:12.978682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Getting quotas for user 6cb4a2e0094a4c90ae14626b946065e1 and project 3dcacc5aca3a4eaa8681cf3eee3633b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:10:13.012963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:10:13.016817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:10:13.121921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:13.123740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:13.123920 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-575a4c9e-520c-451b-81e9-327ed2b380dc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.596160 Sep 07 10:10:13.129729 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2385/4821] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 10:10:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 10:10:13.137174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d422c72-c367-4bbb-b60b-b93b04351d1e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:13.139958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d422c72-c367-4bbb-b60b-b93b04351d1e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:13.140195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:13.140698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:13.142224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:13.143556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:13.144437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:13.145078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:13.608129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:13.626785 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e33760d-7a9e-4d89-83b0-c7bd972005fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1188 microversion: 2.1 time: 0.512019 Sep 07 10:10:13.627398 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2437/4822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:13 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1188 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:13.708052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d422c72-c367-4bbb-b60b-b93b04351d1e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:13.722419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d422c72-c367-4bbb-b60b-b93b04351d1e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:13.726523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d422c72-c367-4bbb-b60b-b93b04351d1e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:13.730232 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d422c72-c367-4bbb-b60b-b93b04351d1e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1280 microversion: 2.20 time: 0.597695 Sep 07 10:10:13.731708 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2386/4823] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:13 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1280 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:10:14.654885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:14.655567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:14.662968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:14.663791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:14.664411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:14.665354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:14.665992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:14.667377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:14.764707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:14.765363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:14.779115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:14.779615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:14.780057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:14.780866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:14.781327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:14.782619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:14.794283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:14.802480 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-afdae3bb-1e61-4374-bbb4-9627b800978f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1188 microversion: 2.1 time: 0.152001 Sep 07 10:10:14.813076 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2438/4824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:14 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1188 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:14.864166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:14.874970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:14.876834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:14.878175 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9a0b956-a32c-4b50-87df-f4e16ad0aa79 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1332 microversion: 2.20 time: 0.118165 Sep 07 10:10:14.879533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2387/4825] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:14 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:10:15.832121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:15.832942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:15.860032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:15.862495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:15.864474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:15.867061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:15.872076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:15.873275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:15.907390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:15.908114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:15.924838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:15.925443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:15.926441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:15.936920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:15.936920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:15.936920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:16.218784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:16.239942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:16.240544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:16.248519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:16.250151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7553494b-493c-4c01-97d0-2d83d4028c61 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1338 microversion: 2.20 time: 0.348999 Sep 07 10:10:16.258953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2388/4826] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:15 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1338 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:16.287539 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-477ac80d-4f41-4443-bcbc-7e0cc479c66c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1188 microversion: 2.1 time: 0.461798 Sep 07 10:10:16.288499 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2439/4827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:15 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1188 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:17.294210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:17.295512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:17.312744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:17.313633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:17.314247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:17.315193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:17.315840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:17.319351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:17.326106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:17.326919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:17.343142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:17.343693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:17.346776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:17.348653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:17.350066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:17.352210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:17.554501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:17.574664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9fce3ccc-d6d9-4773-9cff-f36810c5802d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1188 microversion: 2.1 time: 0.253924 Sep 07 10:10:17.576960 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2440/4828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:17 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1188 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:17.911258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:17.925129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:17.926635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:17.930043 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e1211bc-b77e-4d2d-a4d4-4bc93e72fbc0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1406 microversion: 2.20 time: 0.640830 Sep 07 10:10:17.933565 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2389/4829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:17 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:18.127928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5ccdade4-5c66-4289-bb66-af51f79f1ce9 req-def679f6-990e-4da8-ae63-e1d9c99607e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:18.177717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5ccdade4-5c66-4289-bb66-af51f79f1ce9 req-def679f6-990e-4da8-ae63-e1d9c99607e9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:18.178491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5ccdade4-5c66-4289-bb66-af51f79f1ce9 req-def679f6-990e-4da8-ae63-e1d9c99607e9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:18.181365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5ccdade4-5c66-4289-bb66-af51f79f1ce9 req-def679f6-990e-4da8-ae63-e1d9c99607e9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:18.234888 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5ccdade4-5c66-4289-bb66-af51f79f1ce9 req-def679f6-990e-4da8-ae63-e1d9c99607e9 service nova] Creating event network-changed:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:10:18.254706 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5ccdade4-5c66-4289-bb66-af51f79f1ce9 req-def679f6-990e-4da8-ae63-e1d9c99607e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126676 Sep 07 10:10:18.257043 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2441/4830] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:18.600233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:18.601498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:18.616721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:18.617754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:18.618366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:18.619411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:18.620407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:18.621704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:18.699805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:18.701834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:18.702501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:18.704484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lazy-loading 'fault' on Instance uuid d0d66249-b73b-4d59-afc7-516d1bb9cdb7 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:10:18.831472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:18.840325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed547566-b7a9-4434-ba90-3244260d1ea3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 200 len: 1147 microversion: 2.1 time: 0.244083 Sep 07 10:10:18.857291 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2390/4831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:18 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 1147 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:18.995915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:19.006391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:19.023924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:19.024744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:19.025980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:19.027247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:19.027933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:19.049857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:19.321415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:19.355196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:19.361884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:19.363095 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0c9c213-bf55-4062-9fa1-07ec82d46b59 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1406 microversion: 2.20 time: 0.393032 Sep 07 10:10:19.377464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2442/4832] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:18 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:19.871121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:19.872062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:19.902740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:19.903250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:19.903701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:19.917047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:19.921118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:19.921723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:19.961258 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 HTTP/1.1 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'd0d66249-b73b-4d59-afc7-516d1bb9cdb7'} Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:19.966887 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:19.971579 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:19.979764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:20.002599 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e392fb3a-1106-4646-a5c8-52eb190f935a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 404 len: 111 microversion: 2.1 time: 0.115605 Sep 07 10:10:20.004069 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2391/4833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:19 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:10:20.423389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:20.424590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:20.434974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:20.442163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:20.443584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:20.444558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:20.445307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:20.445969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:20.900474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:20.925026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:20.933737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:20.935767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0668094a-5dab-403f-9d40-96411b9eb117 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1406 microversion: 2.20 time: 0.526959 Sep 07 10:10:20.949802 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2443/4834] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:20 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:21.971541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:21.972974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:21.976348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:21.989229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:21.993424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:21.994852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:21.995895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:21.997945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:22.000169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:22.504334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:22.520584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:22.525993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:22.530499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be6474dd-5d01-443b-8936-fd19e48c153d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1406 microversion: 2.20 time: 0.563588 Sep 07 10:10:22.538382 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2392/4835] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:21 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1406 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:10:23.581833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:23.582620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:23.598303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:23.598815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:23.599264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:23.599992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:23.600463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:23.607247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:23.837013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-415cf3be-2c9a-482b-a13e-96107e847f7c req-fe0736aa-fe74-4480-a22d-7e1317f885a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "name": "network-vif-plugged", "status": "completed", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:23.864594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:23.872079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:23.879431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-415cf3be-2c9a-482b-a13e-96107e847f7c req-fe0736aa-fe74-4480-a22d-7e1317f885a5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:23.880768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-415cf3be-2c9a-482b-a13e-96107e847f7c req-fe0736aa-fe74-4480-a22d-7e1317f885a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:23.883106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-415cf3be-2c9a-482b-a13e-96107e847f7c req-fe0736aa-fe74-4480-a22d-7e1317f885a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:23.925414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-415cf3be-2c9a-482b-a13e-96107e847f7c req-fe0736aa-fe74-4480-a22d-7e1317f885a5 service nova] Creating event network-vif-plugged:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:10:23.932209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-415cf3be-2c9a-482b-a13e-96107e847f7c req-fe0736aa-fe74-4480-a22d-7e1317f885a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102525 Sep 07 10:10:23.934837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:23.936587 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2393/4836] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:10:23.945641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:23.959693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:23.961394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46c6530c-d018-4896-9195-a199679ebd2c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1406 microversion: 2.20 time: 0.383532 Sep 07 10:10:23.962279 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2444/4837] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:23 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:25.006457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:25.007275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:25.032215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:25.032734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:25.033204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:25.036142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:25.036636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:25.043729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:25.387387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:25.403116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:25.403116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:25.403972 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a28b5b09-3008-48e2-9a28-bae1ede15fd4 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1406 microversion: 2.20 time: 0.410677 Sep 07 10:10:25.404675 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2394/4838] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:24 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:25.608752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:25.610074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:25.622098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:25.630306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:25.632008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:25.633775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:25.636450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:25.637121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:25.695341 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 HTTP/1.1 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd0d66249-b73b-4d59-afc7-516d1bb9cdb7'} Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:25.697948 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.703517 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.705204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:25.708868 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-16239fee-07db-4beb-a9ab-48afa18eb322 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 404 len: 111 microversion: 2.1 time: 0.104055 Sep 07 10:10:25.712458 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2445/4839] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:10:25 2022] DELETE /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:10:25.721592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:25.722217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: d0d66249-b73b-4d59-afc7-516d1bb9cdb7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:25.736746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:25.737325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:25.737776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:25.738712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:25.739299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:25.739750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:25.784949 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 HTTP/1.1 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'd0d66249-b73b-4d59-afc7-516d1bb9cdb7'} Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:25.789248 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance d0d66249-b73b-4d59-afc7-516d1bb9cdb7 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:25.796611 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6296268-c7b0-47c2-95a4-19033fbd3ef1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7" status: 404 len: 111 microversion: 2.1 time: 0.073422 Sep 07 10:10:25.807649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2395/4840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:25 2022] GET /compute/v2.1/servers/d0d66249-b73b-4d59-afc7-516d1bb9cdb7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:10:26.435891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:26.436712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:26.459729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:26.461766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:26.465310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:26.467499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:26.469541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:26.472077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:26.750031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:26.761143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:26.763228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:26.764928 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eaaf9d0d-f695-4ac0-9982-3429a373353b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1599 microversion: 2.20 time: 0.336815 Sep 07 10:10:26.766256 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2446/4841] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:10:26 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1599 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:10:26.794190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:26.794768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:26.810505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:26.811539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:26.812644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:26.813779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:26.814575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:26.815449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:26.927686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aded930c-8a4c-4898-9879-e7c1a004def5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.138478 Sep 07 10:10:26.928420 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2396/4842] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 7 10:10:26 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:10:27.906256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:27.917578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:27.918834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Searching by: {'deleted': False, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:10:27.930589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:27.931913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:27.932747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:27.934427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:27.935567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:27.936780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:27.971327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:10:28.031696 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e692471-530f-47bf-bd65-d3aa09b7b486 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.131566 Sep 07 10:10:28.032651 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2447/4843] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:10:27 2022] GET /compute/v2.1/servers => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:28.051473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:28.071791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:28.074170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Searching by: {'deleted': False, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:10:28.097290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:28.101982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:28.103652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:28.106287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:28.106802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:28.107247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:28.171375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:28.175373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:10:28.234127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:28.241883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:28.242615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:28.243307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:28.466467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e15c970f-7c05-428d-b26e-799665d456e8 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.421619 Sep 07 10:10:28.467053 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2397/4844] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:10:28 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:28.500807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41f84d60-db7b-434d-bb01-9b6c13483f8b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:28.521754 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41f84d60-db7b-434d-bb01-9b6c13483f8b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024480 Sep 07 10:10:28.523333 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2448/4845] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 10:10:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:28.640470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f2100436-5e02-48eb-acc6-59d7e4db4756 req-d5faa0d2-173f-4405-b038-47a061b2d95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:28.658629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f2100436-5e02-48eb-acc6-59d7e4db4756 req-d5faa0d2-173f-4405-b038-47a061b2d95f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:28.660177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f2100436-5e02-48eb-acc6-59d7e4db4756 req-d5faa0d2-173f-4405-b038-47a061b2d95f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:28.662069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f2100436-5e02-48eb-acc6-59d7e4db4756 req-d5faa0d2-173f-4405-b038-47a061b2d95f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:28.676038 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f2100436-5e02-48eb-acc6-59d7e4db4756 req-d5faa0d2-173f-4405-b038-47a061b2d95f service nova] Creating event network-changed:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:10:28.684093 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f2100436-5e02-48eb-acc6-59d7e4db4756 req-d5faa0d2-173f-4405-b038-47a061b2d95f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048779 Sep 07 10:10:28.685342 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2398/4846] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:28.882612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:28.883226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:28.899505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:28.902864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:28.904029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:28.904967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:28.907001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:28.910992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:29.016204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:10:29.114483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:29.258218 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f059453d-a406-4f30-bd28-afe890f48142 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 204 len: 0 microversion: 2.1 time: 0.380195 Sep 07 10:10:29.260444 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2449/4847] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:10:28 2022] DELETE /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:10:29.270589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:29.271859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:29.291620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:29.292349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:29.292952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:29.294201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:29.295069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:29.296694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:29.937806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:30.019825 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1982753a-0a17-48b4-a16b-4a3966db3264 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1606 microversion: 2.1 time: 0.754565 Sep 07 10:10:30.027865 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2399/4848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:29 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1606 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:31.055312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:31.055893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:31.070315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:31.070816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:31.073125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:31.073882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:31.074353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:31.074785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:32.169938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:32.184201 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00173d40-e55b-4f18-9c5b-15388a8cec64 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1606 microversion: 2.1 time: 1.133592 Sep 07 10:10:32.185850 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2450/4849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:31 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1606 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:32.774065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:32.774616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:32.785118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:32.790375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:32.791084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:32.791995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:32.792622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:32.793292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:32.849684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d7b2031-829a-40a5-86c5-6be8f068f0ad tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/ips" status: 200 len: 150 microversion: 2.1 time: 0.079638 Sep 07 10:10:32.855261 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2400/4850] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:10:32 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:32.867703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f6e5766-dbef-4216-b0e4-e332bdbdd20c"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:32.871484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:32.878606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:32.879379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:32.880319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:32.881610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:32.882313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:32.882950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:32.995567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Invalid volume: volume 2f6e5766-dbef-4216-b0e4-e332bdbdd20c is already attached to instances: 65605bef-4101-4f64-ad05-fe9dbe2c3f65 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/os-volume_attachments HTTP/1.1 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 74 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: {"volumeAttachment": {"volumeId": "2f6e5766-dbef-4216-b0e4-e332bdbdd20c"}} Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid volume: volume 2f6e5766-dbef-4216-b0e4-e332bdbdd20c is already attached to instances: 65605bef-4101-4f64-ad05-fe9dbe2c3f65 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': 'cb771408-266f-4ef6-b3cd-22d6186ad87a', 'body': {'volumeAttachment': {'volumeId': '2f6e5766-dbef-4216-b0e4-e332bdbdd20c'}}} Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2f6e5766-dbef-4216-b0e4-e332bdbdd20c is already attached to instances: 65605bef-4101-4f64-ad05-fe9dbe2c3f65 Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:10:32.997693 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2f6e5766-dbef-4216-b0e4-e332bdbdd20c is already attached to instances: 65605bef-4101-4f64-ad05-fe9dbe2c3f65 Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2f6e5766-dbef-4216-b0e4-e332bdbdd20c is already attached to instances: 65605bef-4101-4f64-ad05-fe9dbe2c3f65 Sep 07 10:10:33.002325 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:33.004931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 400 to user: Invalid volume: volume 2f6e5766-dbef-4216-b0e4-e332bdbdd20c is already attached to instances: 65605bef-4101-4f64-ad05-fe9dbe2c3f65 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:33.006104 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ceb887e2-724f-46ba-af6c-6c8ff928fbdb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142801 Sep 07 10:10:33.007274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2451/4851] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:10:32 2022] POST /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:10:33.016497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:33.017495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:33.024349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:33.025347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:33.026636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:33.027656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:33.028375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:33.029042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:33.094251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:10:33.213736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:33.220450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:33.247001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:33.247498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:33.247976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:33.248693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:33.249202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:33.249639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:33.339984 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a5b9bed9-bed5-4c35-bd76-c0206f7d180e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 204 len: 0 microversion: 2.1 time: 0.324671 Sep 07 10:10:33.342321 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2401/4852] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:10:33 2022] DELETE /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:10:33.359965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:33.363696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:33.378784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:33.379555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:33.380218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:33.383100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:33.383904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:33.388310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:33.984211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:34.013492 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b926f78d-501e-42fe-92af-db0abbb02b09 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1540 microversion: 2.1 time: 0.787479 Sep 07 10:10:34.014478 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2452/4853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:33 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1540 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:34.108467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:34.119879 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93e692de-e9d4-4a7e-ad35-78bc26e0205b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1682 microversion: 2.1 time: 0.770666 Sep 07 10:10:34.121466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2402/4854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:33 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1682 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:34.389356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ceb2962a-adab-4a0f-871d-dc7435d454e1 req-031d2dfe-43c1-494d-8bb2-04f978ff2768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de3e34b-ada0-4c49-bf59-155a4094daec", "name": "network-vif-deleted", "tag": "80d5f69b-d0f8-4053-b7df-6aad05bb59e6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:34.424770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:34.431927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ceb2962a-adab-4a0f-871d-dc7435d454e1 req-031d2dfe-43c1-494d-8bb2-04f978ff2768 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:34.433586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ceb2962a-adab-4a0f-871d-dc7435d454e1 req-031d2dfe-43c1-494d-8bb2-04f978ff2768 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:34.434033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ceb2962a-adab-4a0f-871d-dc7435d454e1 req-031d2dfe-43c1-494d-8bb2-04f978ff2768 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:34.471781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ceb2962a-adab-4a0f-871d-dc7435d454e1 req-031d2dfe-43c1-494d-8bb2-04f978ff2768 service nova] Creating event network-vif-deleted:80d5f69b-d0f8-4053-b7df-6aad05bb59e6 for instance 6de3e34b-ada0-4c49-bf59-155a4094daec on n-h2-836830-16 Sep 07 10:10:34.489777 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ceb2962a-adab-4a0f-871d-dc7435d454e1 req-031d2dfe-43c1-494d-8bb2-04f978ff2768 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103090 Sep 07 10:10:34.491473 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2453/4855] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:35.042741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:35.043364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:35.061661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:35.062278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:35.062745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:35.063504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:35.063975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:35.064419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:35.155052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:35.159921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:35.182817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:35.183529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:35.184070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:35.184913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:35.185517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:35.186679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:35.429552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:35.448062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0508156b-ccb7-4421-8b4f-e3655d4f2429 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.410728 Sep 07 10:10:35.451982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2403/4856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:35 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:35.779680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:35.794039 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2bca8dcb-6131-48d5-aead-38f49ba3654f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1682 microversion: 2.1 time: 0.648976 Sep 07 10:10:35.801784 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2454/4857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:35 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1682 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:36.478913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:36.480447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:36.494519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:36.497263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:36.501209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:36.502095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:36.503134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:36.504001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:36.669301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:36.680753 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d3160606-4859-4258-884f-2c454f3ff60d tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.205999 Sep 07 10:10:36.684745 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2404/4858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:36 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:36.840912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:36.841583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:36.856722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:36.858534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:36.860869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:36.862511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:36.862991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:36.864372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.158895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:37.174357 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e498a3cc-8126-4143-b57f-a6019b259324 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1615 microversion: 2.1 time: 0.352097 Sep 07 10:10:37.175797 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2455/4859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:36 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1615 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:37.578116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:37.581703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:37.598932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:37.599533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:37.600058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.600863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:37.606692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:37.609238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.713854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:37.714801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:37.725977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:37.733263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:37.735168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.737492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:37.739296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:37.743448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.832874 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-daf81472-f408-4fa6-8d43-9f596596ef08 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.256047 Sep 07 10:10:37.846120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2405/4860] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:10:37 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:10:37.864568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:37.873941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:37.891414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:37.901201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:37.902010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.903326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:37.906092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:37.906799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:37.944888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:37.967552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:37.981088 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c130f5ed-8cea-4e10-89fe-6f1f087cc292 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.275596 Sep 07 10:10:37.997483 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2456/4861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:37 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:38.004696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d24c344b-88a2-4ce8-b22c-2106fbaa053f req-e207b354-0be9-4fca-b109-7fe0d3f2e917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb771408-266f-4ef6-b3cd-22d6186ad87a", "name": "network-vif-deleted", "tag": "1f81180d-846d-42aa-97fa-2b0f09af464e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:38.031134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d24c344b-88a2-4ce8-b22c-2106fbaa053f req-e207b354-0be9-4fca-b109-7fe0d3f2e917 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:38.031643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d24c344b-88a2-4ce8-b22c-2106fbaa053f req-e207b354-0be9-4fca-b109-7fe0d3f2e917 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:38.032336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d24c344b-88a2-4ce8-b22c-2106fbaa053f req-e207b354-0be9-4fca-b109-7fe0d3f2e917 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:38.082710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d24c344b-88a2-4ce8-b22c-2106fbaa053f req-e207b354-0be9-4fca-b109-7fe0d3f2e917 service nova] Creating event network-vif-deleted:1f81180d-846d-42aa-97fa-2b0f09af464e for instance cb771408-266f-4ef6-b3cd-22d6186ad87a on n-h1-836830-16 Sep 07 10:10:38.107773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d24c344b-88a2-4ce8-b22c-2106fbaa053f req-e207b354-0be9-4fca-b109-7fe0d3f2e917 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103909 Sep 07 10:10:38.109663 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2457/4862] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:38.140764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:38.208643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:38.209694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:38.229487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:38.230342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:38.231081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:38.232525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:38.233396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:38.235673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:38.238391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:38.383697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:38.393454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:38.393894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:38.394400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lazy-loading 'fault' on Instance uuid cb771408-266f-4ef6-b3cd-22d6186ad87a {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:10:38.515816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:38.527080 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b3ed00ef-9ede-4d34-afa1-189e7ad7f0dd tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 200 len: 1332 microversion: 2.1 time: 0.327798 Sep 07 10:10:38.529917 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2458/4863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:38 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 1332 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:38.583535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:38.610459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42b4b8ed-89cf-4625-8e24-fcb952373768 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1670 microversion: 2.1 time: 0.756891 Sep 07 10:10:38.611621 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2406/4864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:37 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1670 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:39.006397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:39.007035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:39.021246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:39.022901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:39.025636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:39.027539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:39.028344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:39.029669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:39.214598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:39.226578 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-222afc08-9bdb-4afe-bd0e-f98a90d6b13e tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.226321 Sep 07 10:10:39.227185 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2459/4865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:38 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:39.551925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:39.552917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:39.562280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:39.563885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:39.564663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:39.565742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:39.566535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:39.567409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:39.612522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a HTTP/1.1 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'cb771408-266f-4ef6-b3cd-22d6186ad87a'} Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:39.615088 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:10:39.620044 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:39.639795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:39.642283 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b0a9493-06ea-4850-8e20-72998779d94f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 404 len: 111 microversion: 2.1 time: 0.094668 Sep 07 10:10:39.643339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:39.644439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:39.645430 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2407/4866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:39 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:10:39.668959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4e2a718a-d4d0-4336-a7e2-a0dcac493922 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '.version_select at 0x7f14b111c670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:39.677139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:39.678856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:39.685354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:39.691152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:39.692108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:39.692744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:39.715891 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4e2a718a-d4d0-4336-a7e2-a0dcac493922 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901777919" status: 202 len: 0 microversion: 2.1 time: 0.068276 Sep 07 10:10:39.720226 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2408/4867] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:10:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901777919 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:10:40.078229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:40.091732 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2763ee98-3ed3-4132-9391-3f7a82886925 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1670 microversion: 2.1 time: 0.454392 Sep 07 10:10:40.107807 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2460/4868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:39 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1670 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:40.255303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:40.255798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:40.264573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:40.265075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:40.265557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:40.266274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:40.268024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:40.268024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:40.412217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:40.432513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4ceea6af-380f-47c5-8e12-00aca9c4147b tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.180825 Sep 07 10:10:40.433101 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2409/4869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:40 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:41.119825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:41.120532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:41.132053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.132561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.133014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.136522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.137052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.137646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.205450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:41.205964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:41.227124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.227881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.229021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.230407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.231372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.232260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.387905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lazy-loading 'services' on Instance uuid 65605bef-4101-4f64-ad05-fe9dbe2c3f65 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:10:41.410250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:41.425917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3614dc81-900f-475b-9e64-b1cdb199b14f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.305392 Sep 07 10:10:41.426568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2461/4870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:41 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:41.456187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:41.457115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:41.465377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.467587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.468210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.469146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.475334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.475989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.535203 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9946f13-cae6-4cdb-b736-cd53656e31c4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments/2f6e5766-dbef-4216-b0e4-e332bdbdd20c" status: 202 len: 0 microversion: 2.1 time: 0.336535 Sep 07 10:10:41.536606 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2410/4871] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:10:41 2022] DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments/2f6e5766-dbef-4216-b0e4-e332bdbdd20c => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:10:41.547217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:41.550978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:41.570805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.571300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.573369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.574458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:41.577099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:41.578643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:41.611584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:41.639089 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0970180-ec0c-4605-92c1-07d145638c0f tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.181914 Sep 07 10:10:41.646249 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2462/4872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:41 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:41.664211 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8a98cf44-6ecc-4d1d-9a85-a56622864c75 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123123 Sep 07 10:10:41.664803 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2411/4873] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:41 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:42.668769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:42.669957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:42.680932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:42.685336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:42.700356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:42.701121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:42.701592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:42.702595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:42.702747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:42.703184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:42.703566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:42.704511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:42.705334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:42.706401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:42.707019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:42.707800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:42.737458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:42.756225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15f4ab57-0a7b-48cc-96a3-8f1f8577bfb6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082506 Sep 07 10:10:42.757278 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2412/4874] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:42 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:42.824017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:42.834640 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0334899-d67b-46e9-9bff-e393ecab97f6 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1253 microversion: 2.1 time: 0.170029 Sep 07 10:10:42.835775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2463/4875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:42 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1253 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:43.771166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:43.774233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:43.786817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:43.786817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:43.787171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:43.789316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:43.792290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:43.793762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:43.856975 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-13fc4c13-8626-476a-9de3-c8b93355b0b6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090821 Sep 07 10:10:43.866621 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2413/4876] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:43 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:43.867701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:43.869118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:43.877165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:43.878275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:43.878954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:43.880561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:43.881587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:43.882492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:43.925969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:43.926698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:43.927394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:43.928148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lazy-loading 'fault' on Instance uuid 6de3e34b-ada0-4c49-bf59-155a4094daec {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:10:44.011282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1530e0cafad4cf6b10e9da58d2ffaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99d3f866a9f4d8ea033d85f3ec53016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:44.023249 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88fc8826-2aef-47dd-bb19-c6050fe96d81 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 200 len: 1258 microversion: 2.1 time: 0.160524 Sep 07 10:10:44.024170 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2464/4877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:43 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:10:44.875334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:44.877850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:44.886568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:44.887166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:44.887900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:44.888709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:44.889408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:44.890106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:44.926111 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd0377b9-f524-47ba-8059-fee202556fab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055099 Sep 07 10:10:44.926759 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2414/4878] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:44 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:45.047359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:45.048615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] [instance: 6de3e34b-ada0-4c49-bf59-155a4094daec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:45.056244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:45.056758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:45.057245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:45.058120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:45.065155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:45.065826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:45.086268 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] HTTP exception thrown: Instance 6de3e34b-ada0-4c49-bf59-155a4094daec could not be found. Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Request method failure captured: Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec HTTP/1.1 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG2R0e0_s9KkZ9o8TIXGlJB-dIppp8Qcq7eq_94sy4sjsqw9Yz4A2kefgSW9-CUksWGmqXA8NFxzeCysHE_Vy2Cp7-I2LEVkr-6K7ajcdqn-M62Tf1T5BfUeEaju4P89ixLiz5F0orgLOOKLMgfSp2UHfMHMtDDsY3JMTVFh9-c8hds Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: a99d3f866a9f4d8ea033d85f3ec53016 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestBootFromVolume-1495232690 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a99d3f866a9f4d8ea033d85f3ec53016"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a99d3f866a9f4d8ea033d85f3ec53016"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a99d3f866a9f4d8ea033d85f3ec53016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a99d3f866a9f4d8ea033d85f3ec53016", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestBootFromVolume-1495232690 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: a99d3f866a9f4d8ea033d85f3ec53016 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1495232690 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestBootFromVolume-1495232690-project Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b1530e0cafad4cf6b10e9da58d2ffaa9 Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestBootFromVolume-1495232690-project Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6de3e34b-ada0-4c49-bf59-155a4094daec could not be found. Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6de3e34b-ada0-4c49-bf59-155a4094daec'} Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de3e34b-ada0-4c49-bf59-155a4094daec could not be found. Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de3e34b-ada0-4c49-bf59-155a4094daec could not be found. Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:45.089053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de3e34b-ada0-4c49-bf59-155a4094daec could not be found. Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Returning 404 to user: Instance 6de3e34b-ada0-4c49-bf59-155a4094daec could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c8d458e-8107-4d11-800e-76459d2c3a37 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec" status: 404 len: 111 microversion: 2.1 time: 0.047581 Sep 07 10:10:45.095060 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2465/4879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:45 2022] GET /compute/v2.1/servers/6de3e34b-ada0-4c49-bf59-155a4094daec => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:10:45.099569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21077df9-2205-4a9e-b325-4f928aae9193 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] Calling method '.version_select at 0x7f14b0947040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:45.125213 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21077df9-2205-4a9e-b325-4f928aae9193 tempest-ServersTestBootFromVolume-1495232690 tempest-ServersTestBootFromVolume-1495232690-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058019951" status: 202 len: 0 microversion: 2.1 time: 0.029482 Sep 07 10:10:45.127898 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2415/4880] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058019951 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:10:45.940126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:45.944368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:45.953846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:45.954662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:45.955384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:45.956317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:45.957065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:45.958461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:46.022002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:46.039117 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd0d8b3b-883e-4c09-a2a3-f948ad1c1801 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103889 Sep 07 10:10:46.040545 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2466/4881] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:45 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:47.052441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:47.055112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:47.070531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:47.073487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:47.074201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:47.075151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:47.076100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:47.078731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:47.163748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab240be7-e40f-47b5-b450-852c39898378 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115368 Sep 07 10:10:47.167573 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2416/4882] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:47 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:48.176654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:48.179753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:48.229570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:48.230592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:48.233278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:48.234722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:48.246023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:48.247100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:48.330299 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ccfe2b3c-7cb2-4564-a211-c779421288f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157836 Sep 07 10:10:48.331126 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2467/4883] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:48 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:49.345803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:49.348765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:49.367459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:49.369815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:49.370547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:49.372469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:49.374814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:49.375488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:49.451967 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97d5cc4a-30f2-41c2-bf13-5ccfb579d621 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112289 Sep 07 10:10:49.452790 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2417/4884] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:10:49 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:10:49.555138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:49.557306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:49.569353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:49.570150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:49.570794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:49.571731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:49.572368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:49.572975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:49.604073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:10:49.750333 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b671e41e-2fa8-4f63-8f90-d6baa509698a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 204 len: 0 microversion: 2.1 time: 0.199072 Sep 07 10:10:49.756940 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2468/4885] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:10:49 2022] DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:10:49.761920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:49.762547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:49.773035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:49.774223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:49.775244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:49.780468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:49.781116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:49.781865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:50.083843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:50.109832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19b3b95b-7610-4d9e-b804-489fda966a80 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1679 microversion: 2.1 time: 0.350734 Sep 07 10:10:50.113127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2418/4886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:49 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:51.138603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:51.139844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:51.155473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:51.156955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:51.159224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:51.161927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:51.162611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:51.166201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:51.559976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:51.585756 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c3aa1599-cf97-47cc-9173-b89730285062 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1679 microversion: 2.1 time: 0.450129 Sep 07 10:10:51.589730 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2469/4887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:51 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1679 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:52.642683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:52.648470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:52.655660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:10:52.690528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:52.691036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:52.696020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:52.699030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:52.700315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:52.703621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:53.014424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:53.027368 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60686b66-b806-4ed6-bbba-32977f0ea5aa tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1679 microversion: 2.1 time: 0.414668 Sep 07 10:10:53.030510 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2419/4888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:52 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1679 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:54.058920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:54.060146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:54.073599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:54.074094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:54.074535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:54.083284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:54.083798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:54.084251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:54.379969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:54.420268 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4b0400c-e8f3-420a-86c6-79043a5b7b79 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1612 microversion: 2.1 time: 0.365680 Sep 07 10:10:54.434692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-978e4046-b986-414d-898e-92a1905d1940 req-abff5e9d-01e4-483a-96d6-193e24e4e1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65605bef-4101-4f64-ad05-fe9dbe2c3f65", "name": "network-vif-deleted", "tag": "19e17a81-1b2c-4cda-a71f-5519113ea77f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:10:54.436690 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2470/4889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:54 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1612 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:54.503194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-978e4046-b986-414d-898e-92a1905d1940 req-abff5e9d-01e4-483a-96d6-193e24e4e1b0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:54.508078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-978e4046-b986-414d-898e-92a1905d1940 req-abff5e9d-01e4-483a-96d6-193e24e4e1b0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:54.508588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-978e4046-b986-414d-898e-92a1905d1940 req-abff5e9d-01e4-483a-96d6-193e24e4e1b0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:54.574850 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-978e4046-b986-414d-898e-92a1905d1940 req-abff5e9d-01e4-483a-96d6-193e24e4e1b0 service nova] Creating event network-vif-deleted:19e17a81-1b2c-4cda-a71f-5519113ea77f for instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 on n-h2-836830-16 Sep 07 10:10:54.595684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-978e4046-b986-414d-898e-92a1905d1940 req-abff5e9d-01e4-483a-96d6-193e24e4e1b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172287 Sep 07 10:10:54.601552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2420/4890] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:10:55.516820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:55.516820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:55.519929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:55.521146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:55.523792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:55.528186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:55.528186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:55.530576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:55.618988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:55.620560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:55.621775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:55.622341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lazy-loading 'fault' on Instance uuid 65605bef-4101-4f64-ad05-fe9dbe2c3f65 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:10:55.691644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:10:55.705773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03fd6ca0-62bb-4271-b393-c09eb267e9b4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 200 len: 1331 microversion: 2.1 time: 0.229081 Sep 07 10:10:55.707535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2471/4891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:55 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 1331 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:10:56.755150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:56.758289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:10:56.774254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:56.775308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:56.778878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:56.782963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:10:56.784396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:10:56.805444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:10:56.830572 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 HTTP/1.1 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '65605bef-4101-4f64-ad05-fe9dbe2c3f65'} Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:10:56.834454 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:10:56.840800 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:10:56.841915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:10:56.844106 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6bb95950-6c4a-47c4-a4a2-4ac61058e7ef tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 404 len: 111 microversion: 2.1 time: 0.117939 Sep 07 10:10:56.849464 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2421/4892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:10:56 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:10:56.862491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-deb1b086-a8bf-4048-83bb-859ce34fa42d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '.version_select at 0x7f14b1bd63a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:10:56.925852 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-deb1b086-a8bf-4048-83bb-859ce34fa42d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479952548" status: 202 len: 0 microversion: 2.1 time: 0.073400 Sep 07 10:10:56.928867 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2472/4893] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479952548 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:11:01.161477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-763bbda9-08e2-4d0f-b932-43ef3e9646ae tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: .version_select at 0x7f14b0a385e0>, body: {"keypair": {"name": "tempest-keypair-906865526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/m0IGHRKnVlUoUdpIZMf+dn63peS/7Q+s5GDtPbo9C+FNYrapsfz2OEAWF64GdQr2lgkoY7NbPqZZNhOWa/lXk93nmCYluPcT9gMyFJi3Sefg75zqrHw9ORDHbbwjNTw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:01.229567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-763bbda9-08e2-4d0f-b932-43ef3e9646ae tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:01.249676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-763bbda9-08e2-4d0f-b932-43ef3e9646ae tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:01.324656 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-763bbda9-08e2-4d0f-b932-43ef3e9646ae tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168073 Sep 07 10:11:01.326188 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2422/4894] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:11:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:04.154586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:04.155339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:04.201422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:04.202448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:04.203085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:04.209249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:04.210047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:04.210512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:04.336362 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f6bfc12-25f3-40ee-8a3b-2c2fb434f640 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/ips" status: 200 len: 152 microversion: 2.20 time: 0.744325 Sep 07 10:11:04.344280 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2473/4895] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 7 10:11:03 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/ips => generated 152 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:11:05.482993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1531435390", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1850076c-60ca-4b3b-8a8e-057cac39480d"}], "security_groups": [{"name": "tempest-securitygroup--317065593"}], "key_name": "tempest-keypair-906865526", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:05.796872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] validate_networks() for [('1850076c-60ca-4b3b-8a8e-057cac39480d', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:11:06.818893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=42 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:07.148721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:11:07.149727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:11:07.150206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:11:07.150658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:11:07.151070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:11:07.199945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:07.203420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:07.207950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:07.210752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:07.212308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:07.229361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:07.342726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:07.349224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:07.383080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:11:07.400784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:11:07.499529 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cbe782b5-6117-499e-a1a9-6574adc903da tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.024046 Sep 07 10:11:07.500196 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2423/4896] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:11:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:11:07.511669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd62a8ee-41fc-4917-b569-93902f79164d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:07.518017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd62a8ee-41fc-4917-b569-93902f79164d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:07.521897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:07.720659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd62a8ee-41fc-4917-b569-93902f79164d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:07.739096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd62a8ee-41fc-4917-b569-93902f79164d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1241 microversion: 2.1 time: 0.231509 Sep 07 10:11:07.740027 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2474/4897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:07 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1241 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:07.874428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f49dad6a-ae01-4aee-ba24-50578486e488 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Action: 'create', calling method: .version_select at 0x7f14b1295ca0>, body: {"keypair": {"name": "tempest-keypair-102392184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnXMA0Qi4mPStQSybRS2O1mXSk/JxJbzHUO25dYT9GSNKgcqwfYKbHw4ANdUuuL1jNKV5GxdXrK5nnzB4y7Rw0R/MIU3zVjAwO4xFoe28JKoIBYCVJvPviy7kVoCcjBDw=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:07.898311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f49dad6a-ae01-4aee-ba24-50578486e488 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Getting quotas for project d7d356b5ee55408a81d25b6dbe5a4af6. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:07.907892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-f49dad6a-ae01-4aee-ba24-50578486e488 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Getting quotas for user 96c2d2416c6d43e0bf1f654ca42f8053 and project d7d356b5ee55408a81d25b6dbe5a4af6. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:07.955951 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f49dad6a-ae01-4aee-ba24-50578486e488 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.315270 Sep 07 10:11:07.956821 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2424/4898] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:11:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:11:08.775205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ea8bd04-ac97-47a5-b123-a10f05bfdec2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:08.776583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ea8bd04-ac97-47a5-b123-a10f05bfdec2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:09.012238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ea8bd04-ac97-47a5-b123-a10f05bfdec2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:09.024771 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ea8bd04-ac97-47a5-b123-a10f05bfdec2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1241 microversion: 2.1 time: 0.254768 Sep 07 10:11:09.027397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2475/4899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:08 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1241 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:09.038499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:09.040292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:09.049850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:09.053851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:09.055152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:09.056969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:09.058933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:09.060907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:09.124054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lazy-loading 'flavor' on Instance uuid 32b1bd08-e57d-4438-8436-97be926bf5cd {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:11:09.761318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-749918f3-e2db-459e-ba58-d02a37d80335 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/action" status: 202 len: 0 microversion: 2.20 time: 0.726918 Sep 07 10:11:09.772413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:09.774711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:09.788494 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2425/4900] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:11:09 2022] POST /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:11:09.811746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:09.825939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:09.830225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:09.833799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:09.836833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:09.838387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:10.056234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:10.057614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:10.099458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:10.099994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:10.100459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:10.105609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:10.105609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:10.105609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:10.330334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:10.340867 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-572a6ff7-cd9e-44dd-83b7-697aa6c1d10e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1293 microversion: 2.1 time: 0.289969 Sep 07 10:11:10.342149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2426/4901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:10 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:10.896064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:10.914535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:10.916481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:10.922663 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f86ec038-2489-4310-b987-aa95ac32345a tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 1.155080 Sep 07 10:11:10.942479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2476/4902] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:09 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:11.369956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:11.370600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:11.385864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:11.394280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:11.395033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:11.395954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:11.396590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:11.397222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:11.638870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:11.659834 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e7f93818-892d-43b1-b4fc-aa30ab047117 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1299 microversion: 2.1 time: 0.294214 Sep 07 10:11:11.661248 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2427/4903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:11 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:11.954420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:11.955036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:11.969723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:11.970236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:11.970825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:11.971553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:11.972018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:11.972455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:12.619870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:12.642026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:12.649150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:12.653168 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f434c26-68ea-4419-9c5a-97058ae370f9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.703356 Sep 07 10:11:12.656501 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2477/4904] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:11 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:12.688280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:12.688919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:12.707063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:12.713934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:12.714498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:12.715264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:12.719623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:12.720084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:13.438356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:13.464163 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5878c81-f837-482d-bfc6-4e375abbc090 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.781413 Sep 07 10:11:13.474151 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2428/4905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:12 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:13.692433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:13.692433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:13.719748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:13.720354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:13.723732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:13.725085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:13.726096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:13.728515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:13.828648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-619830591", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "eded4f7f-cc55-4303-bc95-1c756d25dbcf"}], "security_groups": [{"name": "tempest-securitygroup--680445645"}], "key_name": "tempest-keypair-102392184", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:15.223819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:15.253597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] validate_networks() for [('eded4f7f-cc55-4303-bc95-1c756d25dbcf', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:11:15.279569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:15.282597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:15.293807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5e1570b-e7ad-4e8a-9d40-fe2e28a891a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 1.613781 Sep 07 10:11:15.312705 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2478/4906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:13 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:15.324132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-913522987", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "eb468e65-7d7f-4284-9cc2-082906fba615", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:15.442802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:11:16.356534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Getting quotas for project d7d356b5ee55408a81d25b6dbe5a4af6. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:16.381833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Getting quotas for user 96c2d2416c6d43e0bf1f654ca42f8053 and project d7d356b5ee55408a81d25b6dbe5a4af6. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:16.432128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:11:16.440896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:11:16.440896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:11:16.440896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:11:16.440896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:11:16.475353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:16.475860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:16.480744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:16.482721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:16.485387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:16.485887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:16.550941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Getting quotas for project d7d356b5ee55408a81d25b6dbe5a4af6. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:16.564268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Getting quotas for user 96c2d2416c6d43e0bf1f654ca42f8053 and project d7d356b5ee55408a81d25b6dbe5a4af6. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:16.595497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:11:16.599828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:11:16.686707 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-986f0599-239a-4ea2-9f03-bfa29e4f11e6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.864385 Sep 07 10:11:16.687967 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2429/4907] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:11:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:11:16.699156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:16.700303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:16.710224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:16.711128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:16.712856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:16.714460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:16.715656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:16.716254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:16.915083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:11:16.916372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:11:16.917299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:11:16.917906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:11:16.918317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:11:16.937742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:16.938405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:16.938989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:16.939779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:16.940252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:16.942083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:16.990291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:17.001226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:17.117602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:11:17.120268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb468e65-7d7f-4284-9cc2-082906fba615',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:11:17.214283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:17.234107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-57885c55-43ce-4114-812d-4cc8699f1a78 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.542773 Sep 07 10:11:17.237215 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2430/4908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:16 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:17.254263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:17.257492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:17.280625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.282747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.283610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:17.284860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.287405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.288131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:17.473714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e6270ca8-8637-48db-80bd-e171d74e4cf3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.159401 Sep 07 10:11:17.478510 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2479/4909] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:11:17.493590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-cf7de0a2-543b-482c-bc86-8f4be095ee15 req-cfcdff11-e301-4910-83ac-b255d44a5961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfde246-fc65-4404-a624-dd8cdf1471b3", "tag": "fd52a8e5-a77f-407c-8a16-d04357477dda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:17.520392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf7de0a2-543b-482c-bc86-8f4be095ee15 req-cfcdff11-e301-4910-83ac-b255d44a5961 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.531818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf7de0a2-543b-482c-bc86-8f4be095ee15 req-cfcdff11-e301-4910-83ac-b255d44a5961 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.532927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf7de0a2-543b-482c-bc86-8f4be095ee15 req-cfcdff11-e301-4910-83ac-b255d44a5961 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:17.564975 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-cf7de0a2-543b-482c-bc86-8f4be095ee15 req-cfcdff11-e301-4910-83ac-b255d44a5961 service nova] Creating event network-changed:fd52a8e5-a77f-407c-8a16-d04357477dda for instance cdfde246-fc65-4404-a624-dd8cdf1471b3 on n-h2-836830-16 Sep 07 10:11:17.576774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-cf7de0a2-543b-482c-bc86-8f4be095ee15 req-cfcdff11-e301-4910-83ac-b255d44a5961 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095530 Sep 07 10:11:17.580371 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2480/4910] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:17.594138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:17.595917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:17.613586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.615107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.617555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:17.620572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.622733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.623575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:17.801026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:17.810369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:17.811905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:17.813092 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e396331a-95b8-4178-b410-a50605827bc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.573117 Sep 07 10:11:17.826134 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2431/4911] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:17 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:17.851422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:17.854915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:17.858674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:17.863391 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-caa91420-5420-4770-8701-57c5f82b7532 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1280 microversion: 2.1 time: 0.281400 Sep 07 10:11:17.869252 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2481/4912] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:17 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:17.888214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35f8c207-c624-49a8-a51f-6df8812044ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:17.888820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35f8c207-c624-49a8-a51f-6df8812044ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:17.914480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.920905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.921413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:17.922186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:17.922671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:17.927739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.043367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35f8c207-c624-49a8-a51f-6df8812044ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:18.056826 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35f8c207-c624-49a8-a51f-6df8812044ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1070 microversion: 2.1 time: 0.184818 Sep 07 10:11:18.062079 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2482/4913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:17 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1070 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:18.263945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:18.264873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:18.278150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.279172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.283581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.285129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.285897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.286729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.314389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:18.556314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:18.565748 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aabadf11-6746-4bc5-a601-7aa2a620a3fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.737774 Sep 07 10:11:18.566340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2432/4914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:17 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:18.596298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:18.597656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:18.606436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.607361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.608042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.609042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.609752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.610422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.645865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:18.660197 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c06f329-6988-4137-8aae-e1039e60e9d8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.400708 Sep 07 10:11:18.675181 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2483/4915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:18 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:18.844956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:18.857397 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b3f81245-0a7c-4260-9db2-6b833cd71450 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.266804 Sep 07 10:11:18.857583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:18.858024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:18.858173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2433/4916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:18 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:18.873170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.874528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.874658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.875387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.875860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.876306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.888735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:18.890265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:18.901838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.902742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.903448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:18.904385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:18.905065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:18.905743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.157342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:19.168905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2afc05bc-8586-414c-be63-09931974f650 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.288791 Sep 07 10:11:19.182694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2434/4917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:18 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:19.195775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:19.197665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:19.206399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.209001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.209759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.210872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.212372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.213613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.234038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:19.243615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:19.245870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:19.247589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74dcada3-22d8-4aca-9cc9-2190215e13a3 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.395774 Sep 07 10:11:19.261808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2484/4918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:18 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:11:19.271889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:19.272522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:19.280156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.280767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.281242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.281962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.282503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.282968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.341852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:19.350985 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36a85cf6-6d6c-4123-ad33-ec5c2308cf02 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1336 microversion: 2.1 time: 0.166708 Sep 07 10:11:19.353825 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2435/4919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:19 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1336 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:19.360460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:19.361082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:19.367432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.368331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.369256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.370186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.370823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.371572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.407655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:19.426736 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7fdd61f0-1db9-49f7-9f5a-8dc9297249ab tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1112 microversion: 2.1 time: 0.163728 Sep 07 10:11:19.427329 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2485/4920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:19 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1112 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:19.686291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:19.686919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:19.702986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.703512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.710632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:19.710632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:19.710632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:19.710632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:20.103617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:20.118449 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e0b3c85-4b1c-4d8d-9fb1-2438578d1451 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.761682 Sep 07 10:11:20.129491 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2436/4921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:19 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:20.280060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:20.280696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:20.284669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:20.293660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d11b3109-2faa-4bb2-86f1-fab58b91a651 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.611173 Sep 07 10:11:20.294268 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2486/4922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:19 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:20.312105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:20.312535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:20.313008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:20.313779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:20.316697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:20.317377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:20.361368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-357378483", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:20.481618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] validate_networks() for [('a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:11:20.835663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:20.849514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:20.854465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:20.861880 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2325ba51-cd8b-4e52-a2b6-7a2ebf01733f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.587772 Sep 07 10:11:20.885131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2437/4923] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:20 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:20.890696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:20.900042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:20.912445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:20.913166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:20.915796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:20.921510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:20.922002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:20.922627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:21.241332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:21.256493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0defb58d-052a-4496-a5f0-8a8c1652dd42 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1334 microversion: 2.1 time: 0.369127 Sep 07 10:11:21.260368 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2438/4924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:20 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:21.272765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:21.273605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:21.281573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:21.290876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:21.291875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:21.293772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:21.294866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:21.297286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:21.300190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:22.579862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:22.590587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:22.621327 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a3f6e75f-ef48-4d8f-8dec-ba5e60e870f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 1.353830 Sep 07 10:11:22.623259 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2439/4925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:21 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:22.647973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:22.655922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:22.696818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:22.697736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:22.699004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:22.699884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:22.707148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:22.708612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:23.359073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:11:23.360109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:11:23.361196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:11:23.361784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:11:23.362373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:11:23.380876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:23.381414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:23.388061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:23.388901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:23.389684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:23.390135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:23.429218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:23.464881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:23.468385 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bee16e7e-9657-4819-a7ce-a6cc1de5d3c0 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.843571 Sep 07 10:11:23.474228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2440/4926] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:22 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:23.490482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:23.491746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for user 6a8b10f41570421a9292168d0326bae0 and project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:23.498917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:23.535121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:23.539542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:23.540921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:23.543570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:23.544339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:11:23.545338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:23.546053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:23.550661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:11:23.661157 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-abad0a3b-695f-4fc8-8b82-88bf2bc337e7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.293529 Sep 07 10:11:23.663584 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2487/4927] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:11:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 10:11:23.711128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:23.711128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:23.727107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:23.727934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:23.728486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:23.729300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:23.729712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:23.735003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:24.160506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:24.179673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:24.185847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:24.188468 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9708a09-85e0-4d6e-959b-fa9ebddefc91 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.711532 Sep 07 10:11:24.191506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2441/4928] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:23 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:24.206777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:24.207789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:24.229456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:24.231250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:24.234863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:24.236414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:24.240442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:24.242418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:24.535162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:24.544631 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5fda3d0a-b3d3-4c40-844b-924d19fe77be tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 0.877494 Sep 07 10:11:24.552598 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2488/4929] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:23 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:24.558173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0f2b86e-1299-4dba-a932-0e428c8bd5c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:24.561765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b0f2b86e-1299-4dba-a932-0e428c8bd5c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:24.759745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0f2b86e-1299-4dba-a932-0e428c8bd5c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:24.785440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0f2b86e-1299-4dba-a932-0e428c8bd5c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1214 microversion: 2.1 time: 0.231351 Sep 07 10:11:24.786459 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2489/4930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:24 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:24.793625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d801330e-2f97-415b-84ff-54fd9adb963e req-fd7810a4-22f7-4110-bb99-082b353a69ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7fc9772-2919-4489-986b-53d881e1945e", "tag": "ccfa4c7f-9443-4d23-8424-8e10fd1287ef"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:24.814897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d801330e-2f97-415b-84ff-54fd9adb963e req-fd7810a4-22f7-4110-bb99-082b353a69ac service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:24.819799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d801330e-2f97-415b-84ff-54fd9adb963e req-fd7810a4-22f7-4110-bb99-082b353a69ac service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:24.822966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d801330e-2f97-415b-84ff-54fd9adb963e req-fd7810a4-22f7-4110-bb99-082b353a69ac service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:24.859479 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d801330e-2f97-415b-84ff-54fd9adb963e req-fd7810a4-22f7-4110-bb99-082b353a69ac service nova] Creating event network-changed:ccfa4c7f-9443-4d23-8424-8e10fd1287ef for instance a7fc9772-2919-4489-986b-53d881e1945e on n-h2-836830-16 Sep 07 10:11:24.876370 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d801330e-2f97-415b-84ff-54fd9adb963e req-fd7810a4-22f7-4110-bb99-082b353a69ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088446 Sep 07 10:11:24.878817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:24.882335 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2490/4931] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:24.888498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:24.898015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:24.903078 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-40fd685e-4fbb-4bc4-973d-e562fc68a582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 0.704494 Sep 07 10:11:24.906879 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2442/4932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:24 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:24.922063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:24.924820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:24.927388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:24.928227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:24.931301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:24.931837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:25.217250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:25.218355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:25.240325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:25.244077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:25.244709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:25.248156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:25.249843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:25.250484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:25.776744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:25.798286 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-deb3fc69-3945-4bf3-8b93-885c803e936f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.914441 Sep 07 10:11:25.799190 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2491/4933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:24 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:26.150495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f95fc05a-8a04-4ce5-8844-42f149307963 req-995109ec-9cf6-4dc5-bab0-e42165741add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfde246-fc65-4404-a624-dd8cdf1471b3", "name": "network-vif-plugged", "status": "completed", "tag": "fd52a8e5-a77f-407c-8a16-d04357477dda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:26.181438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:26.190712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f95fc05a-8a04-4ce5-8844-42f149307963 req-995109ec-9cf6-4dc5-bab0-e42165741add service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.191309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f95fc05a-8a04-4ce5-8844-42f149307963 req-995109ec-9cf6-4dc5-bab0-e42165741add service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.191767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f95fc05a-8a04-4ce5-8844-42f149307963 req-995109ec-9cf6-4dc5-bab0-e42165741add service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:26.197595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:26.206499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:26.215401 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c439acc2-fb27-4207-ad69-51d54f505479 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 1.002126 Sep 07 10:11:26.217036 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2443/4934] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:25 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:11:26.254252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:26.255635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:26.256178 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f95fc05a-8a04-4ce5-8844-42f149307963 req-995109ec-9cf6-4dc5-bab0-e42165741add service nova] Creating event network-vif-plugged:fd52a8e5-a77f-407c-8a16-d04357477dda for instance cdfde246-fc65-4404-a624-dd8cdf1471b3 on n-h2-836830-16 Sep 07 10:11:26.264499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f95fc05a-8a04-4ce5-8844-42f149307963 req-995109ec-9cf6-4dc5-bab0-e42165741add service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463179 Sep 07 10:11:26.266673 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2492/4935] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:26.276387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:26.277445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:26.286087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.287204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.287994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:26.289013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.290415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.291187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:26.315328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.315874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.316302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:26.317046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.317528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.317957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:26.517167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:26.572736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:26.584261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=24 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:26.588789 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c67b0c30-b265-4b12-9bca-1bd019ad4ba1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1284 microversion: 2.1 time: 0.314787 Sep 07 10:11:26.593262 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2493/4936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:26 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:26.610915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:26.612684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:26.633792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.637354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.638041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:26.639007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:26.641474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:26.642127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:27.389478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:27.447137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ee6ab9d3-ff4b-492b-a2be-9be4f83058a9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 1.211180 Sep 07 10:11:27.452740 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2444/4937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:26 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:27.477948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:27.484282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:27.495514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:27.496758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:27.499893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:27.502282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:27.504069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:27.505238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:27.523742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:27.550410 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb3ea63b-3e5b-4e03-8a2f-abf3dfc17eff tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 0.953600 Sep 07 10:11:27.554184 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2494/4938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:26 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:27.564407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:27.575694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:27.632974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:27.639070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:27.640544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:27.642994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:27.648037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:27.650235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:28.233443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:28.241666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41759e9c-d183-4298-8e43-c32d6ef25f5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1366 microversion: 2.1 time: 0.787728 Sep 07 10:11:28.242239 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2445/4939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:27 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1366 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:28.287526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:28.303654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:28.317894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:28.318386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:28.318824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:28.319529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:28.344639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:28.344639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:28.560065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:28.589060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:28.594130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:28.598505 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-679e7fac-acb6-46f3-a708-59716d4caa94 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 1.040916 Sep 07 10:11:28.599775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2495/4940] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:27 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:28.635614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1b76eda4-3437-45eb-ad0f-266afb4d3062 req-a5945ee4-7cfb-409a-b643-1bb327214794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de385a1f-bced-4979-9729-1bec5035fced", "tag": "a1ab271b-6f77-4302-ba8e-6ed457b79c4e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:28.664725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b76eda4-3437-45eb-ad0f-266afb4d3062 req-a5945ee4-7cfb-409a-b643-1bb327214794 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:28.667229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b76eda4-3437-45eb-ad0f-266afb4d3062 req-a5945ee4-7cfb-409a-b643-1bb327214794 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:28.670009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b76eda4-3437-45eb-ad0f-266afb4d3062 req-a5945ee4-7cfb-409a-b643-1bb327214794 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:28.694535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1b76eda4-3437-45eb-ad0f-266afb4d3062 req-a5945ee4-7cfb-409a-b643-1bb327214794 service nova] Creating event network-changed:a1ab271b-6f77-4302-ba8e-6ed457b79c4e for instance de385a1f-bced-4979-9729-1bec5035fced on n-h2-836830-16 Sep 07 10:11:28.729577 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1b76eda4-3437-45eb-ad0f-266afb4d3062 req-a5945ee4-7cfb-409a-b643-1bb327214794 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125105 Sep 07 10:11:28.730877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2496/4941] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:28.757981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:28.762527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:28.796722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:28.798461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:28.802395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:28.803630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:28.807285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:28.810517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:30.901067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:30.916807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0723a313-dc46-4fd6-800a-c0595e1c6b3e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 2.182402 Sep 07 10:11:30.927165 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2497/4942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:28 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:30.947113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:30.951228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:30.983277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:30.983796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:30.984250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:30.995627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:30.998697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:30.999291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:31.479048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:31.506837 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3fc3ea5c-4288-46d4-9570-92f195d8f3e2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1314 microversion: 2.1 time: 3.251781 Sep 07 10:11:31.511115 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2446/4943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:28 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1314 bytes in 3260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:31.526194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:31.527045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:31.543851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:31.546760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:31.549672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:31.553165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:31.553870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:31.554484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:31.822655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:31.850731 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fbe0d980-b9f4-4dde-ba47-40496521e8a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 0.921414 Sep 07 10:11:31.852623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2498/4944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:30 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:31.875606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a0f9723b-cf05-4f0e-aaf8-70a11b6985dc req-7f35b1cd-ca79-41d9-80ef-870ac3e7e37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "name": "network-vif-plugged", "status": "completed", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:31.913056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a0f9723b-cf05-4f0e-aaf8-70a11b6985dc req-7f35b1cd-ca79-41d9-80ef-870ac3e7e37a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:31.920678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a0f9723b-cf05-4f0e-aaf8-70a11b6985dc req-7f35b1cd-ca79-41d9-80ef-870ac3e7e37a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:31.921643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a0f9723b-cf05-4f0e-aaf8-70a11b6985dc req-7f35b1cd-ca79-41d9-80ef-870ac3e7e37a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:31.967561 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a0f9723b-cf05-4f0e-aaf8-70a11b6985dc req-7f35b1cd-ca79-41d9-80ef-870ac3e7e37a service nova] Creating event network-vif-plugged:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:11:31.980843 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a0f9723b-cf05-4f0e-aaf8-70a11b6985dc req-7f35b1cd-ca79-41d9-80ef-870ac3e7e37a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125664 Sep 07 10:11:31.981490 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2499/4945] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:31.998439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:31.999580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:32.011798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.012536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.013546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.014628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.015258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.015865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.323553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:32.339124 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29323eb6-a92b-4c60-bd46-74b12ec4dbd8 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1555 microversion: 2.1 time: 0.822393 Sep 07 10:11:32.349518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2447/4946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:31 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1555 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:32.365929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0b2128f1-5612-4010-9670-0def599f7fee req-e934675e-b639-454f-b527-706ad70d1fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ca3fb1-2e7c-4070-bb55-448a9471aa4c", "tag": "d897db88-2bd0-46a1-9368-d6677fe23afb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:32.404295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0b2128f1-5612-4010-9670-0def599f7fee req-e934675e-b639-454f-b527-706ad70d1fad service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.404937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0b2128f1-5612-4010-9670-0def599f7fee req-e934675e-b639-454f-b527-706ad70d1fad service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.405443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0b2128f1-5612-4010-9670-0def599f7fee req-e934675e-b639-454f-b527-706ad70d1fad service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.442327 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0b2128f1-5612-4010-9670-0def599f7fee req-e934675e-b639-454f-b527-706ad70d1fad service nova] Creating event network-changed:d897db88-2bd0-46a1-9368-d6677fe23afb for instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c on n-h1-836830-16 Sep 07 10:11:32.455700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0b2128f1-5612-4010-9670-0def599f7fee req-e934675e-b639-454f-b527-706ad70d1fad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100199 Sep 07 10:11:32.457227 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2448/4947] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:32.465676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:32.466647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:32.478647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.479734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.480928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.481956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.482950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.483558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.529543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:32.549711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:32.559281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:32.561017 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4ddc650-c20b-4597-9e48-1fc9b863d9cb tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.575485 Sep 07 10:11:32.562972 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2500/4948] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:31 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:32.601897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:32.604238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:32.643119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.643555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.644108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.644834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.651646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.652228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.927625 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-402a4a22-e7c9-4487-9715-cc02fa35c296 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360597 Sep 07 10:11:32.930997 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2501/4949] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:11:32 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-interface => generated 284 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:32.936241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:32.937135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:32.952755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:32.963278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.964912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.965362 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7df2463-cb81-42cd-a710-dffc9e5bd09a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 0.503008 Sep 07 10:11:32.966183 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2449/4950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:32 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:32.966842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.968392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:32.969795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:32.972716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:32.979437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:32.982028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:32.999152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:33.002523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:33.005587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:33.007072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:33.007775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:33.010784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:33.420916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:34.037391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:34.049535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d37bb4c0-cf3a-4e8f-8472-5f7718be6f34 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1314 microversion: 2.1 time: 1.117133 Sep 07 10:11:34.057103 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2502/4951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:32 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:34.067065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:34.073146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:34.094230 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cac2ae1-5801-48a8-88b4-fd7e34208545 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 1.124868 Sep 07 10:11:34.096780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:34.098515 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2450/4952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:32 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:34.118793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:34.122573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:34.123468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:34.130789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:34.134644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:34.139582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:34.143363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:34.145967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:34.167994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:34.170247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:34.171110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:34.176940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:34.177883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:34.181643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:34.769947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=20 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:35.052711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:35.064101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:35.076238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:35.079604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-505c71b8-437f-4116-9c38-c4da0c84b7ed tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 1.020021 Sep 07 10:11:35.080401 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2503/4953] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:34 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:35.097224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:35.101476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:35.102404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:35.109569 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4207ae9e-1076-4feb-8b98-ad3d300675b5 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 1.008800 Sep 07 10:11:35.119820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:35.120327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:35.120788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:35.121533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:35.121997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:35.122460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:35.135315 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2451/4954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:34 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:35.151023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:35.161620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:35.189046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:35.201897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:35.208547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:35.209111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:35.220152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:35.220152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:35.220152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:36.568949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:36.580952 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-312f5865-0295-4d9c-a3b7-64f50d02f889 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 1.435628 Sep 07 10:11:36.590184 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2452/4955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:35 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:36.600677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:36.608185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:36.634593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:36.637643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:36.638157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:36.639007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:36.645676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:36.646298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:36.661506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:36.670536 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4dbe898a-e22c-455e-8f6a-71de4127cc2a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1314 microversion: 2.1 time: 1.587321 Sep 07 10:11:36.687224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2504/4956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:35 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1314 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:36.697397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:36.719175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:36.731525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:36.732132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:36.732589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:36.733490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:36.734123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:36.734706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:37.189947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:37.207021 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-325286c7-2e10-44a8-93e9-439b97e004f0 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 0.516443 Sep 07 10:11:37.209981 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2505/4957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:36 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:37.229611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:37.240518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:37.250522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:37.252066 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e343c071-aadc-4dac-b9cd-1b3ddda3e50c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.660859 Sep 07 10:11:37.253235 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2453/4958] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:36 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:37.599259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1896722a-c40e-4b34-8786-2c5093b3d864 req-0391c343-9f27-45f1-b966-2ff852f86752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfde246-fc65-4404-a624-dd8cdf1471b3", "tag": "fd52a8e5-a77f-407c-8a16-d04357477dda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:37.605576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:37.606940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:37.607563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:37.627987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1896722a-c40e-4b34-8786-2c5093b3d864 req-0391c343-9f27-45f1-b966-2ff852f86752 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:37.634864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:37.635377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:37.638126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1896722a-c40e-4b34-8786-2c5093b3d864 req-0391c343-9f27-45f1-b966-2ff852f86752 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:37.643586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1896722a-c40e-4b34-8786-2c5093b3d864 req-0391c343-9f27-45f1-b966-2ff852f86752 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:37.647539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:37.648448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:37.649531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:37.650031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:37.694213 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1896722a-c40e-4b34-8786-2c5093b3d864 req-0391c343-9f27-45f1-b966-2ff852f86752 service nova] Creating event network-changed:fd52a8e5-a77f-407c-8a16-d04357477dda for instance cdfde246-fc65-4404-a624-dd8cdf1471b3 on n-h2-836830-16 Sep 07 10:11:37.717544 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1896722a-c40e-4b34-8786-2c5093b3d864 req-0391c343-9f27-45f1-b966-2ff852f86752 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121468 Sep 07 10:11:37.721522 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2506/4959] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:37.763907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:37.766215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:37.795467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:37.796003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:37.796465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:37.799477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:37.805262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:37.809385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:38.914383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:38.939116 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4afcffc2-a72e-4d8d-a1b5-f971d5779cbd tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 1.334710 Sep 07 10:11:38.950679 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2454/4960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:37 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:38.966992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:38.973515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:39.000497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:39.003689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:39.004302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:39.005200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:39.007706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:39.008888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:39.840724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:39.849049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1de30e78-469a-4d13-b200-69230509c43b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1314 microversion: 2.1 time: 2.123587 Sep 07 10:11:39.862954 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2507/4961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:37 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1314 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:39.869301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:39.873750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:39.886256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:39.893763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:39.895169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:39.898010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:39.899301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:39.899910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:40.229667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:40.247239 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-144291b0-a515-43d2-8039-61f495ed0199 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 1.294868 Sep 07 10:11:40.269827 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2455/4962] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:38 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:40.292991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ccb450ab-409e-4904-b8aa-627bfc034418 req-cf621fe1-607e-4b7b-8df4-2a441fd792e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ca3fb1-2e7c-4070-bb55-448a9471aa4c", "name": "network-vif-plugged", "status": "completed", "tag": "d897db88-2bd0-46a1-9368-d6677fe23afb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:40.326876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ccb450ab-409e-4904-b8aa-627bfc034418 req-cf621fe1-607e-4b7b-8df4-2a441fd792e8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:40.328860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ccb450ab-409e-4904-b8aa-627bfc034418 req-cf621fe1-607e-4b7b-8df4-2a441fd792e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:40.331260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ccb450ab-409e-4904-b8aa-627bfc034418 req-cf621fe1-607e-4b7b-8df4-2a441fd792e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:40.366375 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ccb450ab-409e-4904-b8aa-627bfc034418 req-cf621fe1-607e-4b7b-8df4-2a441fd792e8 service nova] Creating event network-vif-plugged:d897db88-2bd0-46a1-9368-d6677fe23afb for instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c on n-h1-836830-16 Sep 07 10:11:40.380633 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ccb450ab-409e-4904-b8aa-627bfc034418 req-cf621fe1-607e-4b7b-8df4-2a441fd792e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107514 Sep 07 10:11:40.384305 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2456/4963] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:40.427481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:40.430798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:40.452684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:40.456900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:40.458562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:40.463593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:40.464737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:40.465681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:40.947926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:40.960556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:40.965938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:40.968668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-711c6676-1f66-4768-802b-9386199aee14 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 1.104453 Sep 07 10:11:40.970587 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2508/4964] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:39 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:40.981694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:40.982324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:40.997151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:40.999534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:41.005365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:41.008625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:41.009454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:41.010081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:41.266675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:41.270782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:41.280461 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8123620-bfae-46cb-9a41-3f395f889956 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1228 microversion: 2.1 time: 0.893401 Sep 07 10:11:41.285575 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2457/4965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:40 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1228 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:41.295444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:41.296601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:41.309585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:41.314627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:41.315323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:41.316357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:41.317101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:41.317679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:43.368510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:43.377708 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-97bef0e8-0f69-425f-889b-9aafc1861bf6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1314 microversion: 2.1 time: 2.403677 Sep 07 10:11:43.395324 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2509/4966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:40 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1314 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:43.417655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:43.418479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:43.446046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:43.446973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:43.448163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:43.451723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:43.452360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:43.454152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:43.513832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:43.528010 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ffe266cf-b114-45f8-810d-02b9981b7499 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 2.236574 Sep 07 10:11:43.530867 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2458/4967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:41 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:43.538029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:43.539474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:43.560703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:43.568425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:43.570273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:43.571654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:43.576339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:43.577814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:43.800795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:43.816922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:43.822645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:43.827171 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a7fa5dd-4147-4630-83ce-1cf58020d952 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.430497 Sep 07 10:11:43.832587 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2510/4968] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:43 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:43.845851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2025da32-7e4f-492d-9d43-4d835f47186d req-8b34fbfa-84de-413a-8aff-656bd4320f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de385a1f-bced-4979-9729-1bec5035fced", "name": "network-vif-plugged", "status": "completed", "tag": "a1ab271b-6f77-4302-ba8e-6ed457b79c4e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:43.875663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2025da32-7e4f-492d-9d43-4d835f47186d req-8b34fbfa-84de-413a-8aff-656bd4320f79 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:43.876384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2025da32-7e4f-492d-9d43-4d835f47186d req-8b34fbfa-84de-413a-8aff-656bd4320f79 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:43.876836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2025da32-7e4f-492d-9d43-4d835f47186d req-8b34fbfa-84de-413a-8aff-656bd4320f79 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:43.903139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2025da32-7e4f-492d-9d43-4d835f47186d req-8b34fbfa-84de-413a-8aff-656bd4320f79 service nova] Creating event network-vif-plugged:a1ab271b-6f77-4302-ba8e-6ed457b79c4e for instance de385a1f-bced-4979-9729-1bec5035fced on n-h2-836830-16 Sep 07 10:11:43.928506 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2025da32-7e4f-492d-9d43-4d835f47186d req-8b34fbfa-84de-413a-8aff-656bd4320f79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093628 Sep 07 10:11:43.933507 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2511/4969] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:44.160742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:44.233695 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d3ad54e1-eac8-4f2b-845c-3cead8e95bec tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1216 microversion: 2.1 time: 0.700627 Sep 07 10:11:44.236054 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2459/4970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:43 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1216 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:44.421923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:44.422787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:44.445237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.445752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.450136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.456018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.456529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.459848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.558716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:44.562008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:44.574551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.581141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.583240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.585041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.587318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.589537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.711717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:44.728740 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5ea83b8-cf03-4a77-aa54-cec40a4f9826 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1500 microversion: 2.1 time: 0.308354 Sep 07 10:11:44.729799 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2512/4971] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:44 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1500 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:44.756291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:44.756915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:44.767298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.767801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.768250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.772638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.775916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.776470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.910096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:44.932049 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67450086-86da-49bc-97bd-07153714585c tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1401 microversion: 2.1 time: 0.374403 Sep 07 10:11:44.935188 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2460/4972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:44 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1401 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:44.948731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:44.951210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:44.968630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.970002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.971233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:44.973631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:44.975030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:44.975696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:45.055082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Removing security group fe4efbaf-15f8-432f-ac90-924673abcf68 from port d897db88-2bd0-46a1-9368-d6677fe23afb Sep 07 10:11:45.419498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:45.440545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:45.444599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:45.448719 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c93be1ad-37d2-4f85-8b17-f3ea1deda1f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.508987 Sep 07 10:11:45.465210 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2461/4973] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:44 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:45.465210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:45.465210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:45.494225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:45.496875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:45.497448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:45.503969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:45.505696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:45.506751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:45.909597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:45.935918 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a37f59a-1366-466a-a787-c5a97ed7e169 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1216 microversion: 2.1 time: 0.477938 Sep 07 10:11:45.936860 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2462/4974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:45 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1216 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:45.962785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:45.963676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:46.004585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.004933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.011620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.014575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.015316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.024811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.152272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25419047-75a7-4238-a530-25018a57c478 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c/action" status: 202 len: 0 microversion: 2.1 time: 1.400390 Sep 07 10:11:46.155743 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2513/4975] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:11:44 2022] POST /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c/action => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:11:46.161363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:46.162241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:46.186651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.187149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.187595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.188336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.188808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.189312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.489499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:46.506322 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f55985f-5c25-456a-9484-a8fb1db719b6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1458 microversion: 2.1 time: 0.349307 Sep 07 10:11:46.516045 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2514/4976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:46 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1458 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:46.546221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-914fc5eb-30ed-4d8f-8b72-0b78a3ee8488 req-f53fa82d-0dba-446e-81c8-b7141719eeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ca3fb1-2e7c-4070-bb55-448a9471aa4c", "tag": "d897db88-2bd0-46a1-9368-d6677fe23afb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:46.556708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:46.575144 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d25ad286-6375-4edd-8987-2f1664c5ab32 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1588 microversion: 2.1 time: 0.616965 Sep 07 10:11:46.607928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2463/4977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:45 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1588 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:46.616762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-914fc5eb-30ed-4d8f-8b72-0b78a3ee8488 req-f53fa82d-0dba-446e-81c8-b7141719eeef service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.620118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-914fc5eb-30ed-4d8f-8b72-0b78a3ee8488 req-f53fa82d-0dba-446e-81c8-b7141719eeef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.621535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-914fc5eb-30ed-4d8f-8b72-0b78a3ee8488 req-f53fa82d-0dba-446e-81c8-b7141719eeef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.623512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:46.624143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:46.670795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.671055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.671556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.672326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.672797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.673286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.674609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-914fc5eb-30ed-4d8f-8b72-0b78a3ee8488 req-f53fa82d-0dba-446e-81c8-b7141719eeef service nova] Creating event network-changed:d897db88-2bd0-46a1-9368-d6677fe23afb for instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c on n-h1-836830-16 Sep 07 10:11:46.688523 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-914fc5eb-30ed-4d8f-8b72-0b78a3ee8488 req-f53fa82d-0dba-446e-81c8-b7141719eeef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170747 Sep 07 10:11:46.690016 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2515/4978] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:46.699154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:46.700314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:46.710394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.712989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.713786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:46.714931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:46.715628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:46.716335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:47.179170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:47.192412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:47.196726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:47.200301 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11e0d180-cae2-4ff9-9850-e118ea045703 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.591332 Sep 07 10:11:47.203293 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2464/4979] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:46 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:47.215849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:47.216423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:47.230359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:47.230869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:47.236121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:47.237073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:47.237655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:47.238227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:47.255393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:47.265083 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8dd2b82-5456-41c5-9730-bab4729dbd29 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.572133 Sep 07 10:11:47.265722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2516/4980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:46 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:47.290676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:47.291300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:47.297738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:47.298237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:47.298684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:47.299397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:47.299861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:47.300294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:47.437866 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-327596b9-3c19-4a66-881a-ae6aef361364 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232698 Sep 07 10:11:47.438835 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2465/4981] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:11:47 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:47.443472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:47.444096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:47.463270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:47.463774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:47.464223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:47.464939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:47.465437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:47.465869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:48.020388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:48.030261 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5515761-73f8-442f-8a41-5741114e3f4b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1216 microversion: 2.1 time: 0.743928 Sep 07 10:11:48.053781 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2517/4982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:47 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1216 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:48.232146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:48.232767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:48.243710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:48.246295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:48.247148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:48.248195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:48.250422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:48.251010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:48.555459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:48.568287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-079a2e50-39fa-4655-b9d8-9b1a7bbbfffc tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.128269 Sep 07 10:11:48.586355 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2466/4983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:47 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:48.609087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:48.610945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:48.629610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:48.631370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:48.632076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:48.638139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:48.638847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:48.639488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:49.197480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:49.219545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:49.221089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:49.228254 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8df7ac62-5823-45fd-a145-61f55148a717 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.997756 Sep 07 10:11:49.229502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2518/4984] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:48 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:49.246829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:49.247676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:49.261859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:49.262999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:49.264822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:49.266894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:49.267567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:49.270260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:49.453626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:49.476287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1871f31c-7407-459b-a3ad-1122e0207eeb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.875617 Sep 07 10:11:49.483804 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2467/4985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:48 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:49.506857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:49.508082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:49.525968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:49.526991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:49.527718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:49.532623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:49.533325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:49.534317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:49.900683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:49.933078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9fe5f44-f737-4e78-883f-11616326c529 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1216 microversion: 2.1 time: 0.690564 Sep 07 10:11:49.933796 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2519/4986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:49 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1216 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:50.083147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:50.104324 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06e9b104-5322-45e1-899d-aa422cd58f31 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.601525 Sep 07 10:11:50.105490 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2468/4987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:49 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:50.257788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:50.259301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:50.282860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:50.284778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:50.285618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:50.287415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:50.290628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:50.305782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:50.338224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-709512649", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:50.469742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] validate_networks() for [('a64f0d88-c02f-4e0c-9442-5ed1ae9d9ad4', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:11:51.047432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:51.077653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:51.105276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:51.110083 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-381f5de3-c7aa-4506-9c65-f68d0ad0164c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.853690 Sep 07 10:11:51.115133 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2520/4988] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:50 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:51.146921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:51.151930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:51.201329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:51.208154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:51.208917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:51.212241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:51.221341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:51.227314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:51.685960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:51.696666 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-49e01c60-df9e-45b6-9183-71425027df52 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1588 microversion: 2.1 time: 0.574363 Sep 07 10:11:51.701807 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2521/4989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:51 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1588 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:51.717062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-146900af-3704-49dc-b69d-7ddac40fe726 req-a383d391-2eb9-4587-a242-d0005ea24f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de385a1f-bced-4979-9729-1bec5035fced", "tag": "a1ab271b-6f77-4302-ba8e-6ed457b79c4e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:51.735865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-146900af-3704-49dc-b69d-7ddac40fe726 req-a383d391-2eb9-4587-a242-d0005ea24f00 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:51.736579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-146900af-3704-49dc-b69d-7ddac40fe726 req-a383d391-2eb9-4587-a242-d0005ea24f00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:51.737196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-146900af-3704-49dc-b69d-7ddac40fe726 req-a383d391-2eb9-4587-a242-d0005ea24f00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:51.770750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-146900af-3704-49dc-b69d-7ddac40fe726 req-a383d391-2eb9-4587-a242-d0005ea24f00 service nova] Creating event network-changed:a1ab271b-6f77-4302-ba8e-6ed457b79c4e for instance de385a1f-bced-4979-9729-1bec5035fced on n-h2-836830-16 Sep 07 10:11:51.777082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-146900af-3704-49dc-b69d-7ddac40fe726 req-a383d391-2eb9-4587-a242-d0005ea24f00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073541 Sep 07 10:11:51.778241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2522/4990] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:51.783588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:51.804576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:51.811741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:51.812435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:51.813039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:51.813907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:51.818546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:51.819192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:52.938801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:11:52.939298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:11:52.940446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:11:52.941899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:11:52.942434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:11:52.948101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=62 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:52.980002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:52.988274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:52.988911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:52.990684 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e3971ff-ae99-41d1-b6d8-74a478a7ca0b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1216 microversion: 2.1 time: 1.210989 Sep 07 10:11:52.991321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:52.995309 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2523/4991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:51 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1216 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:52.997467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:52.998706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:53.003098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:53.007947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-2e23180b-b235-45b7-be68-c0569f64dbe3 req-bd6e54d7-9626-48b3-a379-b50922af432d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fc9772-2919-4489-986b-53d881e1945e", "name": "network-vif-plugged", "status": "completed", "tag": "ccfa4c7f-9443-4d23-8424-8e10fd1287ef"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:53.055842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2e23180b-b235-45b7-be68-c0569f64dbe3 req-bd6e54d7-9626-48b3-a379-b50922af432d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:53.056369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2e23180b-b235-45b7-be68-c0569f64dbe3 req-bd6e54d7-9626-48b3-a379-b50922af432d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:53.056821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-2e23180b-b235-45b7-be68-c0569f64dbe3 req-bd6e54d7-9626-48b3-a379-b50922af432d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:53.059122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:11:53.072107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Getting quotas for user 6a8b10f41570421a9292168d0326bae0 and project e080e21e856141b7850ea79bafd5b8e9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:11:53.075266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:53.111115 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-2e23180b-b235-45b7-be68-c0569f64dbe3 req-bd6e54d7-9626-48b3-a379-b50922af432d service nova] Creating event network-vif-plugged:ccfa4c7f-9443-4d23-8424-8e10fd1287ef for instance a7fc9772-2919-4489-986b-53d881e1945e on n-h2-836830-16 Sep 07 10:11:53.111944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:11:53.118868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:11:53.127961 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-2e23180b-b235-45b7-be68-c0569f64dbe3 req-bd6e54d7-9626-48b3-a379-b50922af432d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129821 Sep 07 10:11:53.133952 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2524/4992] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:11:53.149312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:53.150285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:53.178536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:53.179054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:53.179577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:53.180321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:53.180789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:53.181249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:53.260549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0a896527-f03e-4ed9-a873-e7b78d249698 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.926451 Sep 07 10:11:53.265470 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2469/4993] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:11:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:11:53.295612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-970771c9-d4e7-4f80-a969-cbf8f5f6580b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:53.300603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-970771c9-d4e7-4f80-a969-cbf8f5f6580b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:53.592806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-970771c9-d4e7-4f80-a969-cbf8f5f6580b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:53.605793 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-970771c9-d4e7-4f80-a969-cbf8f5f6580b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1214 microversion: 2.1 time: 0.322910 Sep 07 10:11:53.605793 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2470/4994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:53 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:54.009970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:54.018833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:54.019457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:54.025602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:54.030975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:54.040758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:54.041324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:54.041903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:54.049158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:54.049738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:54.050745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:54.051937 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2b2c49f-a464-4f02-8d62-3169342afdc9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.916711 Sep 07 10:11:54.062479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2525/4995] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:53 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:54.589629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:54.606815 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5dcea00-49c5-478e-aa24-81c03bbcc513 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1216 microversion: 2.1 time: 0.586988 Sep 07 10:11:54.625956 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2471/4996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:54 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1216 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:54.637666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:54.638317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:54.654288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:54.654810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:54.655227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:54.655945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:54.656403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:54.669758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:55.064356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:55.075292 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46eed643-138d-4a76-b127-14edcebb1554 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1218 microversion: 2.1 time: 0.442310 Sep 07 10:11:55.091097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:55.092592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:55.102844 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2526/4997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:54 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1218 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:55.109125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:55.113101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:55.113794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:55.117340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:55.118656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:55.119498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:55.599924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:55.631221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:55.635432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:55.637553 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-38775f05-30cc-42bf-9dca-4fba6d83e865 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.550382 Sep 07 10:11:55.638388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:55.639018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:55.639737 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2472/4998] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:55 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:55.656131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:55.656623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:55.657065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:55.673655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:55.674178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:55.674771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:56.113072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:56.113647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:56.142635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:56.143159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:56.153736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:56.156124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:56.160061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:56.161089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:56.243852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:56.252092 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d75df8c0-4ecc-40fa-9eae-b89da523e54e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1402 microversion: 2.1 time: 0.617450 Sep 07 10:11:56.272588 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2527/4999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:55 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1402 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:56.300407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:56.301034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:56.350055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:56.362526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:56.363199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:56.363903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:56.364391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:56.364823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:56.458216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:56.471239 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-befa1dd4-bbe5-4303-8e4d-d564d18b0255 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1274 microversion: 2.1 time: 0.363900 Sep 07 10:11:56.477753 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2473/5000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:56 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:11:56.680689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:56.682540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:56.711213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:56.712961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:56.718766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:56.720055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:56.724091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:56.724722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:57.277004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:57.287817 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e74c0f56-29bc-422e-b5d6-beaccc66a8bc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1402 microversion: 2.1 time: 0.991425 Sep 07 10:11:57.289586 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2528/5001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:56 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1402 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:57.316907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:57.335526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-951856101"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:11:57.336525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:57.338649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:57.341894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:57.343754 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc5a49a6-96ab-4f42-b117-99742008f4c1 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.670569 Sep 07 10:11:57.349027 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2474/5002] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:56 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:11:57.355430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:57.356663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:57.357845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:57.359336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:57.360612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:57.361664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:57.503860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:57.512204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:57.532068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:57.533311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:57.537523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:57.540018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:57.544320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:57.545604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:57.833699 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Attempting to quiesce instance before volume snapshot. Sep 07 10:11:57.866421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:57.892943 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 07 10:11:57.901910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ec038d38-afd9-42c7-b3e6-a6b6d81371f0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1272 microversion: 2.1 time: 0.404903 Sep 07 10:11:57.904327 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2475/5003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:57 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:58.078792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Creating snapshot from volume eb468e65-7d7f-4284-9cc2-082906fba615. {{(pid=128832) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 07 10:11:58.376509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:58.377301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:58.394427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:58.396754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:58.397385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:58.399321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:58.402728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:58.403306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:58.438304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:11:58.749853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:58.760705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:58.772116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:58.774350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76a60f6a-391d-48d8-9cf9-17155518d699 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.403288 Sep 07 10:11:58.775415 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2476/5004] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:58 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:11:58.931736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:58.932575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:58.942493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:58.946011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:58.946897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:58.947798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:58.948594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:58.949864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:59.355779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:11:59.379317 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06125c27-37b7-4314-810b-9612912f57a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.452026 Sep 07 10:11:59.384254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2477/5005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:11:58 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:11:59.808541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:11:59.809633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:11:59.837010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:59.837546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:59.837994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:11:59.838717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:11:59.839180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:11:59.839613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:00.302391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:00.315595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:00.347370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:00.350062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6a0e409-a295-4d72-a754-cc132dd2dca9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1739 microversion: 2.20 time: 0.546795 Sep 07 10:12:00.350710 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2478/5006] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:11:59 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1739 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:00.420406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:00.421032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:00.445505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:00.448162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:00.448804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:00.449727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:00.453832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:00.454986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:00.656030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-914a7e10-4c84-4c70-8cf8-c742eba7f937 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e/action" status: 202 len: 0 microversion: 2.1 time: 3.332419 Sep 07 10:12:00.656684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2529/5007] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:11:57 2022] POST /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e/action => generated 0 bytes in 3343 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 07 10:12:00.762461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:00.770554 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b9665d4-d386-4f14-bd22-5c80c059644f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.363587 Sep 07 10:12:00.771137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2479/5008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:00 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:01.158123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e4a1b7cc-f12b-45b6-8c4c-e22ad39887f5 req-039b3528-c0c7-4ebd-ac37-c1fac8ba334e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc006408-7767-420b-b2bf-6dec07c840e4", "tag": "935ada26-9b30-4960-9ae2-e927a225506e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:01.174220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e4a1b7cc-f12b-45b6-8c4c-e22ad39887f5 req-039b3528-c0c7-4ebd-ac37-c1fac8ba334e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.176317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e4a1b7cc-f12b-45b6-8c4c-e22ad39887f5 req-039b3528-c0c7-4ebd-ac37-c1fac8ba334e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.177717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e4a1b7cc-f12b-45b6-8c4c-e22ad39887f5 req-039b3528-c0c7-4ebd-ac37-c1fac8ba334e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:01.197247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e4a1b7cc-f12b-45b6-8c4c-e22ad39887f5 req-039b3528-c0c7-4ebd-ac37-c1fac8ba334e service nova] Creating event network-changed:935ada26-9b30-4960-9ae2-e927a225506e for instance dc006408-7767-420b-b2bf-6dec07c840e4 on n-h1-836830-16 Sep 07 10:12:01.212364 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e4a1b7cc-f12b-45b6-8c4c-e22ad39887f5 req-039b3528-c0c7-4ebd-ac37-c1fac8ba334e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285497 Sep 07 10:12:01.213464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2530/5009] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:01.380229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:01.380767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:01.395237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.420932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.421433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:01.422173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.422641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.423079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:01.462543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:01.472173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:01.482747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.483590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.484273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:01.485262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.486038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.486682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:01.581596 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31f33641-003e-448a-bf2d-dbc14332229b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/ips" status: 200 len: 148 microversion: 2.1 time: 0.124150 Sep 07 10:12:01.590958 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2531/5010] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:12:01 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/ips => generated 148 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:01.803159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:01.803788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:01.815950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.823307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.830013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:01.831005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:01.838220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:01.838885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:02.443909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:02.459222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:02.461859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:02.464197 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cfebfcd-7735-4c3d-bb5c-85cdc1daa409 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1721 microversion: 2.20 time: 1.087198 Sep 07 10:12:02.465497 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2480/5011] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:01 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1721 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:02.474715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:02.501556 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d64891e-5478-4b21-8cb7-2f3c965d29fd tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.709966 Sep 07 10:12:02.506528 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2532/5012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:01 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:03.459669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-492381356", "imageRef": "5db7043d-6956-4539-a779-92fc14625a6e", "flavorRef": "452", "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:03.482111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:03.500383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:03.500953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:03.510738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:03.511250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:03.511701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:03.512425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:03.512891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:03.513362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:03.546801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:12:03.601552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:03.936288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:03.965859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:03.967523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:03.968829 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1bf98340-7881-4d99-bf9b-aef933c323f8 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1721 microversion: 2.20 time: 0.473712 Sep 07 10:12:03.969974 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2533/5013] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:03 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1721 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:03.986432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:03.987070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:04.008829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.009380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.009839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.011102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.011594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.012031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.374834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:04.390155 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35598c63-fad6-43a2-908c-8b8afbca3349 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.415941 Sep 07 10:12:04.391169 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2534/5014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:03 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:04.402102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-440567ab-541e-48e8-a589-5a3e08439d9e req-50f00257-6d0a-43f7-a3b4-221098b2b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "name": "network-vif-unplugged", "status": "completed", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:04.456312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-440567ab-541e-48e8-a589-5a3e08439d9e req-50f00257-6d0a-43f7-a3b4-221098b2b5ae service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.463372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-440567ab-541e-48e8-a589-5a3e08439d9e req-50f00257-6d0a-43f7-a3b4-221098b2b5ae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.465202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-440567ab-541e-48e8-a589-5a3e08439d9e req-50f00257-6d0a-43f7-a3b4-221098b2b5ae service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.501864 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-440567ab-541e-48e8-a589-5a3e08439d9e req-50f00257-6d0a-43f7-a3b4-221098b2b5ae service nova] Creating event network-vif-unplugged:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:12:04.516668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-440567ab-541e-48e8-a589-5a3e08439d9e req-50f00257-6d0a-43f7-a3b4-221098b2b5ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121361 Sep 07 10:12:04.517624 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2535/5015] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:04.590125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:12:04.591299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:12:04.591940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:12:04.592492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:12:04.592653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3a5b985-948d-4fd1-84db-0b7300f919d7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:04.593210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:12:04.595165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:04.603719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.604128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.604246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.604666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.605041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.605426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.605833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.606019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.606465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.607395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:04.608014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:04.608608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:04.641336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:12:04.647778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:12:04.661377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:12:04.664614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1e49ebba-9291-4c6f-8982-0bd6708e42b8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:12:04.786397 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2d1c317-4bd1-4c54-bec5-dda097a41a40 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333678 Sep 07 10:12:04.787940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2481/5016] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:12:04.803879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2433ca4d-f664-4fa4-ae4b-599813e61e22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:04.809950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2433ca4d-f664-4fa4-ae4b-599813e61e22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:05.053807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-939b416d-4796-4e3c-84a6-e6b1eeaa7f70 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466026 Sep 07 10:12:05.064205 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2536/5017] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:12:04 2022] POST /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:05.085986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:05.086871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:05.106943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:05.121536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2433ca4d-f664-4fa4-ae4b-599813e61e22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:05.125755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:05.126347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:05.131482 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2433ca4d-f664-4fa4-ae4b-599813e61e22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1229 microversion: 2.1 time: 0.335124 Sep 07 10:12:05.132929 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2482/5018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:04 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1229 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:05.133146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:05.133694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:05.134161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:05.416622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:05.417744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:05.447844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:05.448355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:05.448808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:05.454895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:05.455605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:05.456178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:05.531895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:05.548242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:05.551151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:05.559766 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-daff1b35-6ba4-4c08-b408-d5c2b56aaf65 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1724 microversion: 2.20 time: 0.486723 Sep 07 10:12:05.561232 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2537/5019] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:05 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:05.596362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6ad5e21-8e32-4dab-9a66-b7ea3fcfd092"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:05.610051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:05.643567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:05.649417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:05.649761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:05.650606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:05.652123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:05.652581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:06.171224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:06.197440 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1668b416-8608-4e90-95c8-2ce5728bc022 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.785602 Sep 07 10:12:06.201490 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2483/5020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:05 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:06.231845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:06.235535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:06.250559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:06.250662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:06.252809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:06.253623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:06.254257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:06.271806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:06.289917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:06.489801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:06.503716 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0c19c5c-6d0d-43e0-97a8-bf4c6563c5b6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1225 microversion: 2.1 time: 0.300028 Sep 07 10:12:06.518090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2484/5021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:06 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1225 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:06.633311 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ef79483c-8426-4d03-8c74-95b2b6aef764 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.038015 Sep 07 10:12:06.636264 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2538/5022] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 7 10:12:05 2022] POST /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-volume_attachments => generated 188 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:12:07.076978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:07.077616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:07.114702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:07.118764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:07.119945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:07.122160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:07.125476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:07.127441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:07.227386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:07.228225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:07.254907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:07.255761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:07.256379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:07.261013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:07.261781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:07.262396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:07.870518 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04488f1e-f3d5-4f49-856d-2774308db1ba tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-volume_attachments/c6ad5e21-8e32-4dab-9a66-b7ea3fcfd092" status: 202 len: 0 microversion: 2.20 time: 0.796539 Sep 07 10:12:07.874110 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2485/5023] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 7 10:12:07 2022] DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-volume_attachments/c6ad5e21-8e32-4dab-9a66-b7ea3fcfd092 => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:12:07.891869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:07.893597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:07.922223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:07.923325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:07.924185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:07.927454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:07.928276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:07.928980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:08.001123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:08.013859 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd1b966d-04df-4131-9d8c-a4e304553f64 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.789023 Sep 07 10:12:08.016042 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2539/5024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:07 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:08.083973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:08.096466 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-446c15ea-cc24-4f87-b49d-849194f2e148 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1299 microversion: 2.1 time: 0.217823 Sep 07 10:12:08.114666 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2486/5025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:07 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:08.170081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:08.170844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:08.177156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=68 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:08.193480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:08.204598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:08.205603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:08.206939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:08.208557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:08.211852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:08.307675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128832) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 10:12:08.520500 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ffb22b3-e153-414b-aeb6-06d277758b58 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "POST /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/action" status: 202 len: 0 microversion: 2.20 time: 0.358075 Sep 07 10:12:08.531338 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2540/5026] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:12:08 2022] POST /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:12:08.538952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:08.540229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:08.570110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:08.572567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:08.578129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:08.580533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:08.583056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:08.586680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:08.631698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8c031a73-dfcd-4bd3-a519-79d22b6185a9 req-7810c277-abdd-49ba-9abf-2dfa780bbf18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc006408-7767-420b-b2bf-6dec07c840e4", "name": "network-vif-plugged", "status": "completed", "tag": "935ada26-9b30-4960-9ae2-e927a225506e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:08.671971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8c031a73-dfcd-4bd3-a519-79d22b6185a9 req-7810c277-abdd-49ba-9abf-2dfa780bbf18 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:08.681769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8c031a73-dfcd-4bd3-a519-79d22b6185a9 req-7810c277-abdd-49ba-9abf-2dfa780bbf18 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:08.688997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8c031a73-dfcd-4bd3-a519-79d22b6185a9 req-7810c277-abdd-49ba-9abf-2dfa780bbf18 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:08.736191 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8c031a73-dfcd-4bd3-a519-79d22b6185a9 req-7810c277-abdd-49ba-9abf-2dfa780bbf18 service nova] Creating event network-vif-plugged:935ada26-9b30-4960-9ae2-e927a225506e for instance dc006408-7767-420b-b2bf-6dec07c840e4 on n-h1-836830-16 Sep 07 10:12:08.766971 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8c031a73-dfcd-4bd3-a519-79d22b6185a9 req-7810c277-abdd-49ba-9abf-2dfa780bbf18 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125005 Sep 07 10:12:08.774140 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2541/5027] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:09.043314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:09.044190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:09.063449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:09.066138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:09.069085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:09.071513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:09.073716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:09.078650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:09.515524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:09.531498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:09.536853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:09.542098 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f3f352f-a0ac-461a-a8e4-83a16b6a63ec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1672 microversion: 2.20 time: 1.009267 Sep 07 10:12:09.544924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2487/5028] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:08 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1672 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:09.558238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:09.559473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:09.572807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:09.578362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:09.579756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:09.583339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:09.584253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:09.584811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:09.588891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:09.623399 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca48cb0e-abd9-473b-90d0-08d4239de21d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 0.585255 Sep 07 10:12:09.625743 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2542/5029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:09 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:10.264398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:10.277029 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b91c80e-31d4-4913-a029-ff4ea04896c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.729510 Sep 07 10:12:10.279634 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2488/5030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:09 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:10.570768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:10.571516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:10.583469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:10.585879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:10.599387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:10.606841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:10.607683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:10.614118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:10.650289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:10.650914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:10.670980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:10.671485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:10.671925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:10.672636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:10.673087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:10.681876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:11.780565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:11.790100 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9e08453-1f6b-4029-a36c-3cb5f410f8a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1314 microversion: 2.1 time: 1.144238 Sep 07 10:12:11.790616 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2489/5031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:10 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:11.812926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:11.819196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:11.832316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:11.834096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:11.835975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:11.837022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:11.838972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:11.840413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:12.047865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:12.057016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:12.066820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:12.068328 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a1b7d62-d313-4766-88d2-71b56f761649 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1672 microversion: 2.20 time: 1.502150 Sep 07 10:12:12.069065 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2543/5032] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:10 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1672 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:12.728181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:12.750225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b09fafd8-1e7e-43ef-8534-143c1206a23a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.958410 Sep 07 10:12:12.758314 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2490/5033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:11 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:12.815616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:12.816941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:12.831914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:12.832437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:12.832899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:12.839005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:12.841272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:12.842322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:13.097456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:13.098419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:13.112859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:13.115419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:13.116168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:13.117239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:13.119306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:13.121082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:13.687752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:13.697535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5acd26a0-83a9-4a0c-952f-b3672f5a314d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1501 microversion: 2.1 time: 0.885803 Sep 07 10:12:13.698046 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2544/5034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:12 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1501 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:13.725200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:13.728923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:13.755179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:13.755718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:13.756181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:13.760528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:13.762399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:13.765273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:13.966788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aebfcbc2-b1fa-4430-b516-3627a471e440 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4/action" status: 202 len: 0 microversion: 2.1 time: 0.246490 Sep 07 10:12:13.973575 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2545/5035] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:12:13 2022] POST /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:12:13.979941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:13.990283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:14.007510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:14.008195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:14.008796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:14.009834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:14.010486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:14.011127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:14.063407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:14.082022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:14.089502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:14.096388 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2a80cd4f-4bf1-4c23-9ad2-98bb6575de06 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.001998 Sep 07 10:12:14.097066 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2491/5036] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:13 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:12:14.120100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:14.123366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:14.145206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:14.147534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:14.150373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:14.170958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:14.171689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:14.172289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:14.268838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:14.625703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:15.049903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:15.059950 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cf8f95f-84cc-477a-9fe0-05bfdfe1add5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1506 microversion: 2.1 time: 0.957027 Sep 07 10:12:15.063129 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2492/5037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:14 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1506 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:15.069292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fb89ba84-bca6-4408-a056-5fb11c0492cd req-b7074b50-5ebc-4440-b22e-218ffe7adb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79421056-6138-4f20-b1f9-4b6345e2ed15", "tag": "1e46baa4-d030-4b4a-b5c0-7179e380433e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:15.083411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:15.094914 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81f468a1-5967-4db4-9d6d-2938b8757feb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 1.119740 Sep 07 10:12:15.098050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fb89ba84-bca6-4408-a056-5fb11c0492cd req-b7074b50-5ebc-4440-b22e-218ffe7adb74 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:15.098925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fb89ba84-bca6-4408-a056-5fb11c0492cd req-b7074b50-5ebc-4440-b22e-218ffe7adb74 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:15.099504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fb89ba84-bca6-4408-a056-5fb11c0492cd req-b7074b50-5ebc-4440-b22e-218ffe7adb74 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:15.111244 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2546/5038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:13 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:15.129085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:15.129695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:15.135584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:15.138675 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fb89ba84-bca6-4408-a056-5fb11c0492cd req-b7074b50-5ebc-4440-b22e-218ffe7adb74 service nova] Creating event network-changed:1e46baa4-d030-4b4a-b5c0-7179e380433e for instance 79421056-6138-4f20-b1f9-4b6345e2ed15 on n-h2-836830-16 Sep 07 10:12:15.154325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fb89ba84-bca6-4408-a056-5fb11c0492cd req-b7074b50-5ebc-4440-b22e-218ffe7adb74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089247 Sep 07 10:12:15.154963 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2493/5039] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:15.157083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:15.157893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:15.167426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:15.168853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:15.170429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:15.174178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:15.915372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:15.949974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:15.952127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:15.966825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54de5115-5d49-4b99-9f1d-0ad1ffb64bec tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.842207 Sep 07 10:12:15.971193 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2547/5040] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:15 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:16.091155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:16.091875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:16.108160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:16.109212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:16.109893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:16.110839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:16.113793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:16.114412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:16.123549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:16.124793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:16.140689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:16.145872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:16.151911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:16.153598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:16.157858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:16.160676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:16.787796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:16.813237 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d33cce5d-b83c-415e-93a6-5330459e87bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1486 microversion: 2.1 time: 0.722481 Sep 07 10:12:16.814141 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2494/5041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:16 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1486 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:16.844234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:16.855001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:16.875430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:16.875852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:16.876290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:16.876993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:16.877478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:16.877907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:16.973077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lazy-loading 'flavor' on Instance uuid dc006408-7767-420b-b2bf-6dec07c840e4 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:12:16.975703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:17.010016 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2abb27d-9b38-4c66-a25a-abc9eef2161c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.889748 Sep 07 10:12:17.020479 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2548/5042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:16 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:17.046581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:17.050865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:17.080114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:17.084292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:17.087091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:17.092474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:17.098624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:17.099810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:17.607917 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de4dd939-05e5-4511-9770-2b97a963b955 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4/action" status: 202 len: 0 microversion: 2.1 time: 0.769645 Sep 07 10:12:17.611776 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2495/5043] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:12:16 2022] POST /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:12:17.640982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:17.641780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:17.676525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:17.676991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:17.677548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:17.700200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:17.700899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:17.709769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:18.888838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:18.906252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:18.911693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:18.927180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:18.927863 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5db770b6-1afd-4fb5-b132-87b59b7a1b52 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1492 microversion: 2.1 time: 1.293591 Sep 07 10:12:18.933474 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2496/5044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:17 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1492 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:18.949545 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-50e7780b-3922-4679-a69d-f5f1f66db8e9 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.926151 Sep 07 10:12:18.967287 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2549/5045] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:17 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:18.968550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:18.970909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:18.981366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:18.982719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:18.983563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:18.986144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:18.987613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:18.989086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:19.505141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:19.517803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85da79a8-1a61-4b5f-af97-714036e1c941 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.582760 Sep 07 10:12:19.519026 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2497/5046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:18 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:19.952798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:19.954096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:19.966532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:19.972076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:19.983530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:19.984302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:19.990364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:19.991248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:19.991751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:19.992407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:20.014528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:20.016528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:20.017129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:20.017915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:20.026962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:20.027675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:21.045151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:21.055988 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f4eb46f4-7c96-4d6e-82df-a284b6c893c1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1513 microversion: 2.1 time: 1.107920 Sep 07 10:12:21.070433 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2550/5047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:19 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1513 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:21.093819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:21.102790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:21.139066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:21.148766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:21.152241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:21.157062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:21.159949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:21.160759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:21.161577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:21.251623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:21.276275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:21.291724 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-041b0b12-7bde-4ac2-937f-eda82315c2df tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.307139 Sep 07 10:12:21.295995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2498/5048] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:19 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:12:21.660872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:21.684966 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ec2ef35a-04b8-430b-aa4f-e9fdaa483d00 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.606922 Sep 07 10:12:21.711363 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2551/5049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:21 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:22.102319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:22.103828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:22.131757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:22.138275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:22.139446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:22.149320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:22.150638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:22.151577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:22.328697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:22.329463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:22.359211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:22.359728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:22.360182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:22.360918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:22.377614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:22.378230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:22.497015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:23.247569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:23.287216 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7e2fe22a-b8d6-4e56-b741-440dd34d473f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 1.173951 Sep 07 10:12:23.336568 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2499/5050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:22 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:23.390630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:23.395461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:23.398805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:23.418956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:23.424766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:23.427706 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-16d2b68e-4e24-413e-9da4-56a44d10a526 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.103117 Sep 07 10:12:23.430107 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2552/5051] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:22 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:12:23.459137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:23.496300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:23.508626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:23.514833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:23.524547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:23.529719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:23.534722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:24.082357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:24.095063 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-204b00a8-bd02-45c7-b88c-e7a04ff8c1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.760662 Sep 07 10:12:24.124034 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2500/5052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:23 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:24.365474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:24.374191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:24.392203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:24.398695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:24.401463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:24.404441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:24.406970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:24.409024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:24.488579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:24.499700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:24.562350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:24.572343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:24.575314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:24.576854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:24.580978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:24.583322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.121499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.139190 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a6628e6-0adb-4e90-803d-97133681e913 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 0.798262 Sep 07 10:12:25.153211 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2553/5053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:24 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:25.164153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:25.169402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.184533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Searching by: {'deleted': False, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:12:25.203760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.204471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.205047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.205941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.206532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.207175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.272988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:12:25.304080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.313450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.321514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.323186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ad696678-9283-49be-8cad-0ea220f96234 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.850837 Sep 07 10:12:25.327047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2501/5054] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:24 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:25.332003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e8da3979-2da7-4f97-8e81-523439c1adb3 req-a41205ba-9d52-49cb-9b75-a7d7ac9a6668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc006408-7767-420b-b2bf-6dec07c840e4", "name": "network-vif-plugged", "status": "completed", "tag": "935ada26-9b30-4960-9ae2-e927a225506e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:25.362972 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01f8936a-aade-40e5-8109-407ec3782e18 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.208369 Sep 07 10:12:25.365906 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2554/5055] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:12:25 2022] GET /compute/v2.1/servers => generated 339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:25.377428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8da3979-2da7-4f97-8e81-523439c1adb3 req-a41205ba-9d52-49cb-9b75-a7d7ac9a6668 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.379632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8da3979-2da7-4f97-8e81-523439c1adb3 req-a41205ba-9d52-49cb-9b75-a7d7ac9a6668 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.380240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8da3979-2da7-4f97-8e81-523439c1adb3 req-a41205ba-9d52-49cb-9b75-a7d7ac9a6668 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.394412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3a5b985-948d-4fd1-84db-0b7300f919d7"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:25.397263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:25.417941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.420118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.420616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.422604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.423508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.424588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.466989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e8da3979-2da7-4f97-8e81-523439c1adb3 req-a41205ba-9d52-49cb-9b75-a7d7ac9a6668 service nova] Creating event network-vif-plugged:935ada26-9b30-4960-9ae2-e927a225506e for instance dc006408-7767-420b-b2bf-6dec07c840e4 on n-h1-836830-16 Sep 07 10:12:25.476704 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e8da3979-2da7-4f97-8e81-523439c1adb3 req-a41205ba-9d52-49cb-9b75-a7d7ac9a6668 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148073 Sep 07 10:12:25.477595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2502/5056] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:25.494871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:25.498854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:25.517012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.517954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.518629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.519494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.521317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.523712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.612323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Invalid volume: volume d3a5b985-948d-4fd1-84db-0b7300f919d7 is already attached to instances: cdfde246-fc65-4404-a624-dd8cdf1471b3 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments HTTP/1.1 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 74 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: {"volumeAttachment": {"volumeId": "d3a5b985-948d-4fd1-84db-0b7300f919d7"}} Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid volume: volume d3a5b985-948d-4fd1-84db-0b7300f919d7 is already attached to instances: cdfde246-fc65-4404-a624-dd8cdf1471b3 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': 'cdfde246-fc65-4404-a624-dd8cdf1471b3', 'body': {'volumeAttachment': {'volumeId': 'd3a5b985-948d-4fd1-84db-0b7300f919d7'}}} Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3a5b985-948d-4fd1-84db-0b7300f919d7 is already attached to instances: cdfde246-fc65-4404-a624-dd8cdf1471b3 Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:12:25.614333 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3a5b985-948d-4fd1-84db-0b7300f919d7 is already attached to instances: cdfde246-fc65-4404-a624-dd8cdf1471b3 Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3a5b985-948d-4fd1-84db-0b7300f919d7 is already attached to instances: cdfde246-fc65-4404-a624-dd8cdf1471b3 Sep 07 10:12:25.618401 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:12:25.626097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 400 to user: Invalid volume: volume d3a5b985-948d-4fd1-84db-0b7300f919d7 is already attached to instances: cdfde246-fc65-4404-a624-dd8cdf1471b3 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:12:25.627266 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b162f4a-4441-4f29-9af8-73dff0fe7a1b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.250500 Sep 07 10:12:25.628528 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2555/5057] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:12:25 2022] POST /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 174 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:12:25.644902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:25.679682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.680935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Searching by: {'deleted': False, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:12:25.696224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.705127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.705839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.706862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.713377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.714017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.783601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:12:25.872755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:25.889545 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b69d91c9-3bb8-4c2e-968f-d7a132974f7d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.394417 Sep 07 10:12:25.897557 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2503/5058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:25 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:25.910710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:25.911439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:25.933055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.935111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.936768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.939626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:25.940273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:25.946192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:25.980471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:26.010398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:26.010911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:26.011374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:26.337481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lazy-loading 'services' on Instance uuid cdfde246-fc65-4404-a624-dd8cdf1471b3 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:12:26.585268 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c95f79b9-c3a0-4d84-aadc-4fdabe776f85 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments/d3a5b985-948d-4fd1-84db-0b7300f919d7" status: 202 len: 0 microversion: 2.1 time: 0.685570 Sep 07 10:12:26.589153 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2504/5059] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:12:25 2022] DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments/d3a5b985-948d-4fd1-84db-0b7300f919d7 => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:12:26.597219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:26.597935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:26.620069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:26.625221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:26.625999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:26.627163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:26.628642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:26.634188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:27.903980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75ed1fcc-eace-42b4-ad04-f9a31e9d4099 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 2.273745 Sep 07 10:12:27.905311 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2556/5060] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:12:25 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:27.910949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:27.911799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:27.931805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:27.949142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:27.951026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:27.951896 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ead7c746-aea6-4350-9a6b-f1ef11fbf19e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 1.357883 Sep 07 10:12:27.952843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:27.955654 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2505/5061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:26 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:27.958570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:27.959340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:27.962682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:27.980115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:27.992548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:28.030920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:28.032595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:28.034451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:28.037042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:28.039313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:28.040365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:28.237320 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bfe35e3a-6e25-467b-b766-d2297f4e9e36 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.276455 Sep 07 10:12:28.248183 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2506/5062] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:27 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:28.277872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:28.285915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:28.324324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:28.328175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:28.329208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:28.333659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:28.334275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:28.338836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:28.809831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:28.825241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:28.834296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:28.841901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc9b1e60-20fd-42b3-893c-1bc5443fbdfc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.935184 Sep 07 10:12:28.844912 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2557/5063] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:27 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:28.870995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3465994a-c401-4e88-9ead-82b2ba5cad37 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:28.907924 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3465994a-c401-4e88-9ead-82b2ba5cad37 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058258 Sep 07 10:12:28.908794 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2558/5064] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 10:12:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:28.987978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:28.988818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:28.999332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:29.006190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:29.007369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:29.014578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:29.015502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:29.016500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:29.367177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:29.370919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:29.399737 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9739ca48-88f3-4f7f-89f4-90a111d15746 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 1.148082 Sep 07 10:12:29.414639 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2507/5065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:28 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:29.431521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:29.440201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:29.479494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:29.482382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:29.483114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:29.484215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:29.488105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:29.489889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:29.728374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:12:30.046884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:30.071745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-929767a9-be6e-4098-87e3-00c78047d5d0 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 1.091231 Sep 07 10:12:30.077908 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2559/5066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:28 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:30.108519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:30.109159 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d649619d-5219-4f76-abd5-3600fa43acce tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "DELETE /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 204 len: 0 microversion: 2.1 time: 0.692556 Sep 07 10:12:30.111731 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2508/5067] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:12:29 2022] DELETE /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:12:30.123473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:30.135402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:30.144371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:30.150663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:30.151195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:30.151661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:30.152400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:30.152874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:30.158685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:30.170049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:30.172472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:30.181339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:30.182999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:30.184593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:30.185676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:30.250793 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc724d53-46d2-40c7-a166-435743c2092d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165317 Sep 07 10:12:30.252077 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2560/5068] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:30 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:30.262486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:30.263301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:30.296532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:30.298700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:30.300837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:30.303181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:30.306716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:30.310175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:31.204403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:31.213650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:31.230409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:31.243113 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e4562542-56cb-4747-90c0-5423c7ff6c34 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.119961 Sep 07 10:12:31.260227 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2509/5069] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:30 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:31.266867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:31.289559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:31.291857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:31.304953 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45d637a3-34c4-48c0-b2e6-59a8246e8c66 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1713 microversion: 2.1 time: 1.051510 Sep 07 10:12:31.307319 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2561/5070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:30 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1713 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:31.317631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:31.320452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:31.329160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:31.343735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:31.345330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:31.350034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:31.351806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:31.358859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:31.366340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:31.367201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:31.368470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:31.368581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:31.370765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:31.371588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:32.135664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:32.151634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89221538-ea17-4b72-9fe9-2d91907c455e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 0.842881 Sep 07 10:12:32.191003 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2562/5071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:31 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:32.222302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:32.231458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:32.272029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:32.283812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:32.287469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:32.287469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:32.287720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:32.288561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:32.440148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b0f6032-af98-42f4-86ca-a87298823eec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246883 Sep 07 10:12:32.446955 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2563/5072] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:32 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:32.465772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:32.466571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:32.475007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:32.476014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:32.476624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:32.477554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:32.478116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:32.478689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:33.754423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:33.764000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76af3795-e26b-44a4-9163-6e7a2f566945 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 2.501274 Sep 07 10:12:33.777218 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2510/5073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:31 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:33.783118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:33.783118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:33.797957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:33.798467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:33.798920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:33.804318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:33.805140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:33.806131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:34.034233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:34.059561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:34.061075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:34.062375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-04fa0c1e-a46e-47c4-9b15-f7d0469805f0 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.619214 Sep 07 10:12:34.095743 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2564/5074] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:32 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:34.106383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:34.107029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:34.154774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:34.155302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:34.155768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:34.156507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:34.156992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:34.157474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:34.973818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:34.997703 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ab81026-d6a6-491a-bc1a-8c0cbf35b0a6 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1713 microversion: 2.1 time: 1.228384 Sep 07 10:12:35.010049 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2511/5075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:33 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1713 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:35.158983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:35.169058 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f56dcff-3e44-46e0-8191-84894f42a9d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 1.072028 Sep 07 10:12:35.174896 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2565/5076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:34 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:35.185086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:35.189129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:35.204110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:35.207734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:35.208476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:35.209711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:35.211886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:35.213012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:35.647316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:35.651074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:35.672957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:35.673824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:35.675873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:35.677420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:35.681327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:35.683217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:35.752721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:35.760578 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5713a8eb-8916-4fb9-8f8b-9c1f05da381d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.749341 Sep 07 10:12:35.765543 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2512/5077] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:35 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:35.770699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:35.771321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:35.785737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:35.791192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:35.792519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:35.793897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:35.794679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:35.795377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:35.973825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:36.202792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:36.211678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138e6a6d-bba6-43a3-a53a-8822674b7431 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 1.035322 Sep 07 10:12:36.227381 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2566/5078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:35 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:36.240201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:36.241498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:36.269222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:36.269751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:36.270214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:36.271005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:36.271515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:36.272507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:36.361165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:36.387864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:36.391465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:36.397837 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7aa58f17-ad5a-403d-865d-ef12aa8aed1b tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.628249 Sep 07 10:12:36.426262 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2513/5079] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:35 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:36.462817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:36.466840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:36.487304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:36.488435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:36.489141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:36.490102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:36.491392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:36.492329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:36.617681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:36.656633 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72ef9d20-7278-468c-8bc0-997186b7907e tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1646 microversion: 2.1 time: 0.397963 Sep 07 10:12:36.698711 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2567/5080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:36 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1646 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:36.773959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:36.777343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:36.796678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:36.798425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:36.801737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:36.805256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:36.810866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:36.812520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:36.998140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:37.005281 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-efeaa62c-45b9-498a-8010-fe76601f04cc tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235654 Sep 07 10:12:37.017973 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2568/5081] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:36 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:37.254692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:37.256287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:37.279508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.283145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.285152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.290190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.292277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.296541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.527385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:37.588508 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3dab6601-d78b-40ee-b3fb-543379f99c05 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 1.142310 Sep 07 10:12:37.597229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2514/5082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:36 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:37.635084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:37.637606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:37.650012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:37.667005 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5276d221-54f9-4d8a-a16a-ba8cf956ec87 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.415352 Sep 07 10:12:37.670460 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2569/5083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:37 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:37.685250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fdcb3de5-1f75-43c7-bf50-712c20a9c875 req-b0cb18c3-8eeb-4695-abc8-2f0c8cf25b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de385a1f-bced-4979-9729-1bec5035fced", "name": "network-vif-deleted", "tag": "a1ab271b-6f77-4302-ba8e-6ed457b79c4e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:37.686836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.687370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.687823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.688540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.689002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.689561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.720845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fdcb3de5-1f75-43c7-bf50-712c20a9c875 req-b0cb18c3-8eeb-4695-abc8-2f0c8cf25b4c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.721857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fdcb3de5-1f75-43c7-bf50-712c20a9c875 req-b0cb18c3-8eeb-4695-abc8-2f0c8cf25b4c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.726545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fdcb3de5-1f75-43c7-bf50-712c20a9c875 req-b0cb18c3-8eeb-4695-abc8-2f0c8cf25b4c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.750651 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fdcb3de5-1f75-43c7-bf50-712c20a9c875 req-b0cb18c3-8eeb-4695-abc8-2f0c8cf25b4c service nova] Creating event network-vif-deleted:a1ab271b-6f77-4302-ba8e-6ed457b79c4e for instance de385a1f-bced-4979-9729-1bec5035fced on n-h2-836830-16 Sep 07 10:12:37.758739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fdcb3de5-1f75-43c7-bf50-712c20a9c875 req-b0cb18c3-8eeb-4695-abc8-2f0c8cf25b4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085275 Sep 07 10:12:37.766135 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2570/5084] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:37.777091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:37.778137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:37.785519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.786277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.787046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.788962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:37.789747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:37.790549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:37.971870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c2d2416c6d43e0bf1f654ca42f8053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d356b5ee55408a81d25b6dbe5a4af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:37.982150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-128aace6-2ebc-47d5-800c-9ca87e52bb56 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 200 len: 1361 microversion: 2.1 time: 0.214413 Sep 07 10:12:38.002790 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2571/5085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:37 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:38.027937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:38.034072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:38.057065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:38.057870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:38.058586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:38.062835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:38.063605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:38.064858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:38.143879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:38.157231 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-602156dc-7330-488f-a91a-938b4eeaaae4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135050 Sep 07 10:12:38.159093 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2572/5086] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:38 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:12:38.160567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:38.162200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:38.166565 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7516504-a57a-474d-b44e-4debb661121d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.570559 Sep 07 10:12:38.169515 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2515/5087] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:37 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:38.621166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:38.621847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:38.643502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:38.662310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:38.664440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:38.664936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:38.672351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:38.674708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:38.675325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:38.697005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:38.698488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:38.730247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:38.735528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:38.737723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:38.741711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:38.749883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:38.750770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.282311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:39.291639 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-112c0293-b776-4c49-87bf-89b98c5fe7c5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.599484 Sep 07 10:12:39.313207 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2516/5088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:38 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:39.319215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:39.324866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:39.329475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] [instance: de385a1f-bced-4979-9729-1bec5035fced] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:39.332224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40518c7f-4163-49dd-b3ce-9ceb86bdc3a5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 0.724166 Sep 07 10:12:39.333398 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2573/5089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:38 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:39.339492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:39.355844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:39.358267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:39.358851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:39.359333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.360149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:39.360620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:39.369130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.383105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:39.383240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:39.383631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.384348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:39.393270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:39.394015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.424962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] HTTP exception thrown: Instance de385a1f-bced-4979-9729-1bec5035fced could not be found. Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Request method failure captured: Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced HTTP/1.1 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG47nJSvduqoT959P2dLg5IIQoyp-hCXUxJpNYLcE1m-wcG1pGlp2YV_UrphpIPN_23RNkcd4xkmnmZaNost37W4lWYfw4TNBXSX3U-AMhiSbY5Nk_QesRuWrinqg5UxjtIjTb1zzsWbu5NDsyOzUhOVAwtwvoTebtVm1MaEBSIcZhc Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d7d356b5ee55408a81d25b6dbe5a4af6 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestManualDisk-678075312 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d7d356b5ee55408a81d25b6dbe5a4af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d7d356b5ee55408a81d25b6dbe5a4af6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d7d356b5ee55408a81d25b6dbe5a4af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d7d356b5ee55408a81d25b6dbe5a4af6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestManualDisk-678075312 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d7d356b5ee55408a81d25b6dbe5a4af6 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestManualDisk-678075312 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestManualDisk-678075312-project Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 96c2d2416c6d43e0bf1f654ca42f8053 Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestManualDisk-678075312-project Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance de385a1f-bced-4979-9729-1bec5035fced could not be found. Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'de385a1f-bced-4979-9729-1bec5035fced'} Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de385a1f-bced-4979-9729-1bec5035fced could not be found. Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de385a1f-bced-4979-9729-1bec5035fced could not be found. Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:12:39.435629 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de385a1f-bced-4979-9729-1bec5035fced could not be found. Sep 07 10:12:39.440171 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:39.442156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Returning 404 to user: Instance de385a1f-bced-4979-9729-1bec5035fced could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:12:39.443236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea0c71fd-b895-4efd-b7f4-94310149351a tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced" status: 404 len: 111 microversion: 2.1 time: 0.135072 Sep 07 10:12:39.452166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2517/5090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:39 2022] GET /compute/v2.1/servers/de385a1f-bced-4979-9729-1bec5035fced => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:12:39.460812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:39.469986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:39.484805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:39.485729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:39.492537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.500949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:39.502305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:39.502960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:39.544311 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a058e855-5c7c-44cb-9b54-28a37494bec3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208760 Sep 07 10:12:39.553843 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2574/5091] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:39 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:39.559000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3b2579f-024d-4e5e-b9a7-20e7363b9ce9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] Calling method '.version_select at 0x7f14b5d95f70>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:39.627096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3b2579f-024d-4e5e-b9a7-20e7363b9ce9 tempest-ServersTestManualDisk-678075312 tempest-ServersTestManualDisk-678075312-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102392184" status: 202 len: 0 microversion: 2.1 time: 0.071870 Sep 07 10:12:39.696235 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2575/5092] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102392184 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:12:40.326820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:40.330524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:40.357338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:40.357908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:40.358442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:40.359273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:40.359792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:40.367106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:40.446576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:40.463960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:40.466949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:40.468436 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bbf51a90-6605-4cb4-8672-339cf2bba37d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.014887 Sep 07 10:12:40.469585 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2518/5093] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:39 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:40.480593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:40.481717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:40.505683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:40.508814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:40.509957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:40.512530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:40.514073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:40.514694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:41.311193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:41.322035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adeca9ad-e1cc-4e45-8ce1-88ebb1a5c1e4 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 0.850367 Sep 07 10:12:41.329944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:41.334463 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2519/5094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:40 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:41.339174 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b3aa36f0-6cd3-4526-aa9a-15a95cf5418e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 1.017000 Sep 07 10:12:41.342567 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2576/5095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:40 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:41.349307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:41.352685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:41.375664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:41.376341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:41.382080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:41.383842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:41.384480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:41.385064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:41.503261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:41.503837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:41.508066 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4c46a817-57f0-4759-9096-22ac59fc2c1e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.167460 Sep 07 10:12:41.514882 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2520/5096] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:12:41 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:12:41.533867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:41.534323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:41.541914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:41.543012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:41.543683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:41.565956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:41.987226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:41.987895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:42.004714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.007450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.011467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.012362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.017765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.018331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.107904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:42.120448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:42.122775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:42.127488 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-724cdce2-8f72-404a-ba0a-54eb04ab0b3f tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.629322 Sep 07 10:12:42.140569 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2577/5097] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:41 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:12:42.157852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:12:42.360110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:42.372307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:42.413809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:42.416755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.419270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.422455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.423638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.427746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.429527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.524183 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9dca4494-47fd-4ecf-8b61-bea94a6796cb tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 204 len: 0 microversion: 2.1 time: 0.535241 Sep 07 10:12:42.528776 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2521/5098] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:12:41 2022] DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:12:42.533543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:42.536072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:42.545895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.546932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.547684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.548920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.550049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.550842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.921513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:42.936125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1ab1ca1-9509-409a-840b-121209178b8c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 0.580767 Sep 07 10:12:42.939119 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2578/5099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:42 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:42.951483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:42.955314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:42.975137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.976066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.978013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:42.979945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:42.982148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:42.984055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:43.003199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:43.022150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-756c9ea4-332e-44da-8ed7-16fff02180b7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.490181 Sep 07 10:12:43.023216 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2522/5100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:42 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:43.192225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:43.192897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:43.213394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:43.213903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:43.214347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:43.215127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:43.215639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:43.216092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:43.682740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:43.710575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:43.712353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:43.716695 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b4eb8172-0cce-45ca-a3ae-c548520cb7fe tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.525496 Sep 07 10:12:43.737333 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2523/5101] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:43 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:43.769626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:43.787150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2d153fcf-85dd-4f3e-adbe-8d3a6e987194 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1679 microversion: 2.1 time: 0.841027 Sep 07 10:12:43.791691 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2579/5102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:42 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1679 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:43.964838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:43.965519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:43.972841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:43.984935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:43.985452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:43.986222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:43.986789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:43.987153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:44.059836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:44.067304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:44.108996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:44.111530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:44.114000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:44.119668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:44.124182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:44.124930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:46.094064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:46.105558 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89f229dc-3c23-4423-b453-291afcfd34bb tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 2.144546 Sep 07 10:12:46.106171 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2524/5103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:43 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:46.127660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:46.128286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:46.164856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:46.165408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:46.165860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:46.166596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:46.167062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:46.171379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:47.076833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:47.105307 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9e71fd15-b8d2-4107-93b9-4589f76ca5f7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 3.051447 Sep 07 10:12:47.125083 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2580/5104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:44 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 3073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:47.139362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:47.140014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:47.164445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:47.164971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:47.165461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:47.169763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:47.170268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:47.171171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:47.530612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:47.550276 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b1e2279-4caf-4ba6-b35f-20193ef88e6e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1612 microversion: 2.1 time: 0.417311 Sep 07 10:12:47.556132 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2581/5105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:47 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1612 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:47.573513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-689461713", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "4dcc7ef2-c4f3-4f1f-9d00-889c0bb8cb9e"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:47.681868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] validate_networks() for [('4dcc7ef2-c4f3-4f1f-9d00-889c0bb8cb9e', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:12:47.688908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:47.719239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:47.731547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:47.733036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1fddf88-87b9-4339-8351-6ae3a6184b3e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 1.609325 Sep 07 10:12:47.761646 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2525/5106] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:46 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:47.769942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:47.773156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:47.786845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:47.788171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:47.794028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:47.795028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:47.796007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:47.797907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:48.544379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:48.558531 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5619c79-0871-44da-89e8-504f7f3ee603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1505 microversion: 2.1 time: 0.794956 Sep 07 10:12:48.562369 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2526/5107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:47 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1505 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:48.572360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:48.575046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:48.594218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:48.594920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:48.595477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:48.596630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:48.597490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:48.598296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:49.264772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:49.283435 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3a135431-46e4-4452-825d-870f750e014d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.719402 Sep 07 10:12:49.286599 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2527/5108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:48 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:49.303801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:49.304666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:49.319207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:49.323362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:49.324069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:49.327951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:49.331110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:49.331811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:49.765053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:49.779766 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-09944180-be55-4dfa-a2f5-334afdef1885 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 200 len: 1612 microversion: 2.1 time: 0.485637 Sep 07 10:12:49.784526 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2528/5109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:49 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 1612 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:49.805716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:49.805716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:49.837765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:49.840524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:49.841154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:49.846378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:49.847091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:49.851725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.246302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:50.268567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:50.270709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:12:50.271355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:12:50.272000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:12:50.272542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:12:50.273084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:12:50.285921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:50.287984 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-453b6755-2d16-4640-8bed-44383f3c4b02 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.501832 Sep 07 10:12:50.291493 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2529/5110] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:49 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:50.304401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.305926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.308548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.313424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.315507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.315997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.318142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-caf4d016-6f7f-4177-80ab-45f7f626e429 req-84095b6d-7ed1-4afc-8573-4b7bbecceef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "name": "network-vif-plugged", "status": "completed", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:50.351969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caf4d016-6f7f-4177-80ab-45f7f626e429 req-84095b6d-7ed1-4afc-8573-4b7bbecceef4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.353937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caf4d016-6f7f-4177-80ab-45f7f626e429 req-84095b6d-7ed1-4afc-8573-4b7bbecceef4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.356012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caf4d016-6f7f-4177-80ab-45f7f626e429 req-84095b6d-7ed1-4afc-8573-4b7bbecceef4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.390441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Getting quotas for project 826ecd5ccfea4b1bb6d4e3e9958b272e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:12:50.398402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Getting quotas for user b4ba47d053f340d890b3be0e8d77284c and project 826ecd5ccfea4b1bb6d4e3e9958b272e. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:12:50.404797 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-caf4d016-6f7f-4177-80ab-45f7f626e429 req-84095b6d-7ed1-4afc-8573-4b7bbecceef4 service nova] Creating event network-vif-plugged:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:12:50.417143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:12:50.419890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:12:50.463265 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-caf4d016-6f7f-4177-80ab-45f7f626e429 req-84095b6d-7ed1-4afc-8573-4b7bbecceef4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168525 Sep 07 10:12:50.464459 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2530/5111] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:50.481096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:50.482130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:50.507377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.510199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.514946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.519423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.530990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.536022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.557348 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-994db8ad-e2fa-4b81-986e-6f01b85aa53c tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.999929 Sep 07 10:12:50.558021 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2582/5112] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:12:50.571436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b4d584f3-a104-4ef7-85ab-7d27e896bb15 req-09831e83-dbbd-48bb-9483-1af9f9c4a2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfde246-fc65-4404-a624-dd8cdf1471b3", "name": "network-vif-deleted", "tag": "fd52a8e5-a77f-407c-8a16-d04357477dda"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:50.612422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b4d584f3-a104-4ef7-85ab-7d27e896bb15 req-09831e83-dbbd-48bb-9483-1af9f9c4a2a8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.612987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b4d584f3-a104-4ef7-85ab-7d27e896bb15 req-09831e83-dbbd-48bb-9483-1af9f9c4a2a8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.613462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b4d584f3-a104-4ef7-85ab-7d27e896bb15 req-09831e83-dbbd-48bb-9483-1af9f9c4a2a8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.672086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b4d584f3-a104-4ef7-85ab-7d27e896bb15 req-09831e83-dbbd-48bb-9483-1af9f9c4a2a8 service nova] Creating event network-vif-deleted:fd52a8e5-a77f-407c-8a16-d04357477dda for instance cdfde246-fc65-4404-a624-dd8cdf1471b3 on n-h2-836830-16 Sep 07 10:12:50.687397 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b4d584f3-a104-4ef7-85ab-7d27e896bb15 req-09831e83-dbbd-48bb-9483-1af9f9c4a2a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119765 Sep 07 10:12:50.691929 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2583/5113] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:50.706149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:50.710378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:50.730418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.734967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.737305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:50.738244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:50.739782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:50.741360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:51.332400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:51.346039 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca7766d3-0c6e-4a93-ab66-101d287a28a1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1341 microversion: 2.1 time: 0.652352 Sep 07 10:12:51.350286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2584/5114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:50 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1341 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:51.359251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5ed633b8-c247-42cc-9eda-c64525d8530e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:51.360293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5ed633b8-c247-42cc-9eda-c64525d8530e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:51.486567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:51.495688 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5c728ea3-0964-4a03-8fa2-a40ebd18d511 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1505 microversion: 2.1 time: 1.028041 Sep 07 10:12:51.507258 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2531/5115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:50 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1505 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:51.545951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:51.546646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:51.572267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:51.572767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:51.590155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:51.591149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:51.591745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:51.592078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:51.619348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5ed633b8-c247-42cc-9eda-c64525d8530e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:51.637271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5ed633b8-c247-42cc-9eda-c64525d8530e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1213 microversion: 2.1 time: 0.283920 Sep 07 10:12:51.638055 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2585/5116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:51 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1213 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:51.652573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:51.657030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:51.670989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 HTTP/1.1 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'cdfde246-fc65-4404-a624-dd8cdf1471b3'} Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:12:51.674128 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:12:51.677978 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:12:51.684779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:12:51.685207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:51.685749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:51.686188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:51.702434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:51.704188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ba0207a4-b713-4d75-8480-e48e524c80a4 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 404 len: 111 microversion: 2.1 time: 0.190802 Sep 07 10:12:51.708799 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2532/5117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:51 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:12:51.713648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:51.714334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:51.731360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35ae1109-7aef-42b0-9a2e-3716bc879ab9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '.version_select at 0x7f14b1b545e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:51.825638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-35ae1109-7aef-42b0-9a2e-3716bc879ab9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-906865526" status: 202 len: 0 microversion: 2.1 time: 0.108133 Sep 07 10:12:51.827414 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2533/5118] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:12:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-906865526 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:12:52.338245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:52.347857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:52.352260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:52.361845 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23b43df2-985a-4e45-8f34-806986caabda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.718673 Sep 07 10:12:52.362856 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2586/5119] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:51 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:52.394921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:52.399399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:52.423394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.424058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.424762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.425667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.426278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.426849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.496667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8f2b06d8-2bfb-4a41-91c0-3a4d9961c919 req-82c244be-87ec-4a57-8796-11e1d923e5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc006408-7767-420b-b2bf-6dec07c840e4", "name": "network-vif-unplugged", "status": "completed", "tag": "935ada26-9b30-4960-9ae2-e927a225506e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:52.517083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8f2b06d8-2bfb-4a41-91c0-3a4d9961c919 req-82c244be-87ec-4a57-8796-11e1d923e5a0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.518119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8f2b06d8-2bfb-4a41-91c0-3a4d9961c919 req-82c244be-87ec-4a57-8796-11e1d923e5a0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.518906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8f2b06d8-2bfb-4a41-91c0-3a4d9961c919 req-82c244be-87ec-4a57-8796-11e1d923e5a0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.555100 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8f2b06d8-2bfb-4a41-91c0-3a4d9961c919 req-82c244be-87ec-4a57-8796-11e1d923e5a0 service nova] Creating event network-vif-unplugged:935ada26-9b30-4960-9ae2-e927a225506e for instance dc006408-7767-420b-b2bf-6dec07c840e4 on n-h1-836830-16 Sep 07 10:12:52.561004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8f2b06d8-2bfb-4a41-91c0-3a4d9961c919 req-82c244be-87ec-4a57-8796-11e1d923e5a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070142 Sep 07 10:12:52.564658 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2587/5120] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:52.585134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:52.588957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:52.609811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.610722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.611193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.611983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.612626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.613366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.882515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:52.910530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff206168-4650-4f33-ac00-f311a176609b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1387 microversion: 2.1 time: 0.526481 Sep 07 10:12:52.923569 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2534/5121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:52 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1387 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:52.924403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:52.935396 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f3455b9-84d3-44c6-bbdd-740702a43ba2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 200 len: 1508 microversion: 2.1 time: 0.369386 Sep 07 10:12:52.937511 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2588/5122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:52 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:52.941932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:52.947073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:52.964508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:52.966511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:52.987530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.987981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.989534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.993261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:52.994018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:52.994682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:52.998149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:53.000561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:53.001767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:53.007610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:53.009071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:53.010142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:53.298771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:53.311898 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a5e55ce-909d-4f66-9212-864b162bb935 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1209 microversion: 2.1 time: 0.388958 Sep 07 10:12:53.312820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2535/5123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:52 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1209 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:53.392497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:53.393377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:53.418126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:53.419103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:53.421390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:53.424528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:53.427465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:53.428751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:53.483672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:53.523795 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-165d23a5-e868-4e8b-8873-faa336ec690b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.563957 Sep 07 10:12:53.543171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2589/5124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:52 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:53.562472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:53.570902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:53.585001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:53.591509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:53.592228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:53.597086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:53.597760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:53.598329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:53.611709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:53.996685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:54.012812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c8d432a-74fb-41f4-8719-a894a1573e8f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.452333 Sep 07 10:12:54.015755 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2590/5125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:53 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:54.026031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18f08d60-172b-4817-bb19-17965d34c560 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: .version_select at 0x7f14b134b5e0>, body: {"keypair": {"name": "tempest-keypair-422773613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL9czrEX8mjnEXoQ7EgA0GuteJfLq5dMyZkC+iU/GkUvBUQpfOBK4bbtsZTPQtKzl9+CAOSRBzL8w9aQpUwfApKVG1FFqN8N3MsBBIxB+TfbDymxht9vBfFRFbUB36Tpw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:54.081386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-18f08d60-172b-4817-bb19-17965d34c560 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:12:54.087971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:54.097171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-18f08d60-172b-4817-bb19-17965d34c560 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:12:54.098990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:54.101707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:54.103495 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3ac0653d-6a4d-461e-825a-98484fe9a45e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.717322 Sep 07 10:12:54.113688 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2536/5126] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:53 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:12:54.135231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:54.136042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:54.143971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:54.146328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:54.147594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:54.148580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:54.149532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:54.150153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:54.150729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:54.172997 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-18f08d60-172b-4817-bb19-17965d34c560 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154980 Sep 07 10:12:54.174235 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2591/5127] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:12:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:12:54.213003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:54.219680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:54.245616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:54.249094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:54.252114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:54.254051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:54.255599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:54.257498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:54.836037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:54.847914 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-46b6045c-4dc6-424e-a9ac-d7622f6a1cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.721513 Sep 07 10:12:54.851456 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2537/5128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:54 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:54.867067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:54.867922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:54.877889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:54.880314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:54.882047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:54.886354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:54.891417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:54.892545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.095164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:55.107833 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-768604a4-9463-412b-b0e3-d30d79a296f4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1271 microversion: 2.1 time: 0.253782 Sep 07 10:12:55.108667 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2538/5129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:54 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:55.137884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:55.138763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:55.151700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.152746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.154993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.155893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.157880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.158488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.217700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:55.228518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4dba4d73-0491-46ca-8dd1-afab6c895926 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.052531 Sep 07 10:12:55.229846 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2592/5130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:54 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:55.254774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:55.258476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:55.269456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.270143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.270840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.272803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.274517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.275712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.786205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:55.797314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:55.799000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:55.800358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fe20174d-75ea-40f0-9720-df21b418a6cc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1730 microversion: 2.20 time: 0.667888 Sep 07 10:12:55.803120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2539/5131] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:55 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1730 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:12:55.877280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:55.878948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:55.889683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:55.899055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.899574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.902400 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5e970fa-83fe-41e2-b3ab-e2d63ce99976 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.654262 Sep 07 10:12:55.903004 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2593/5132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:55 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:55.903806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.904559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.905221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.905659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.926128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf785ab2-1565-4e02-aa0e-5373fead7d0b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:55.936294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf785ab2-1565-4e02-aa0e-5373fead7d0b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:55.937080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf785ab2-1565-4e02-aa0e-5373fead7d0b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:55.937723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf785ab2-1565-4e02-aa0e-5373fead7d0b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:55.997016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf785ab2-1565-4e02-aa0e-5373fead7d0b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Going to try to stop instance {{(pid=128832) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:12:56.084458 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf785ab2-1565-4e02-aa0e-5373fead7d0b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.162233 Sep 07 10:12:56.085779 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2594/5133] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:12:55 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:12:56.094705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:56.098976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:56.118142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:56.118958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:56.119732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:56.120816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:56.122508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:56.123201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:56.378447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:56.383980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:12:56.409825 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36ac881d-bead-424c-a01a-4b4d7fac739a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.536547 Sep 07 10:12:56.418679 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2540/5134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:55 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:56.448864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:56.449687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:56.458847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:56.464424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:56.465076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:56.466021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:56.466663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:56.468787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:56.970491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:56.980193 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0babf99a-e23e-4131-8863-5706553d75b6 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1271 microversion: 2.1 time: 0.560060 Sep 07 10:12:56.988354 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2541/5135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:56 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1271 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:56.994326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:57.000454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:57.011004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:57.011708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:57.012321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:57.016197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:57.016906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:57.017613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:57.023606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:57.041530 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03487e90-e57d-47aa-8113-2cb3c39dede7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.947818 Sep 07 10:12:57.042153 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2595/5136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:56 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:12:57.368466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:57.388795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:57.393035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:57.396525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a0e6d09-d8cc-4d95-9ce6-ca2380912cbc tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1717 microversion: 2.20 time: 0.406523 Sep 07 10:12:57.398065 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2542/5137] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:12:56 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1717 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:12:57.436193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:57.436939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:57.450766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:57.451560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:57.452031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:57.452765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:57.453274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:57.453726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:57.894716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:57.904695 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0791a15-b88d-479a-998c-23318a6056b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.472337 Sep 07 10:12:57.924605 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2596/5138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:57 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:58.018319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:58.019247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:58.044206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:58.044737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:58.045211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:58.046748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:58.047227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:58.047675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:58.081257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:58.086982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:58.107088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:58.109834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:58.110697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:58.112184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:58.114425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:58.115646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:58.548331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:58.564177 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b99a2b4-c0e2-4eb4-bc65-cf35374cdcfb tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 0.551993 Sep 07 10:12:58.567945 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2543/5139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:58 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:58.583007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:58.605847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1c2c004-c6f6-4e70-9626-180b380590e5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.532961 Sep 07 10:12:58.607783 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2597/5140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:58 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:58.936926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:58.941662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:58.961702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:58.972640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:58.980009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:58.981281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:58.982379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:58.986379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:59.414224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-993de4e8-6b92-4844-bf92-e6820ad90c69 req-bc8d5725-3056-4f2a-93d6-5417bfa82f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6f5b52-f20e-457c-b1ba-8c940d929051", "tag": "a068c4c8-006f-494b-b95e-57eb6effae39"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:59.437171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-993de4e8-6b92-4844-bf92-e6820ad90c69 req-bc8d5725-3056-4f2a-93d6-5417bfa82f65 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:59.438054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-993de4e8-6b92-4844-bf92-e6820ad90c69 req-bc8d5725-3056-4f2a-93d6-5417bfa82f65 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:59.438678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-993de4e8-6b92-4844-bf92-e6820ad90c69 req-bc8d5725-3056-4f2a-93d6-5417bfa82f65 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:59.458201 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-993de4e8-6b92-4844-bf92-e6820ad90c69 req-bc8d5725-3056-4f2a-93d6-5417bfa82f65 service nova] Creating event network-changed:a068c4c8-006f-494b-b95e-57eb6effae39 for instance df6f5b52-f20e-457c-b1ba-8c940d929051 on n-h1-836830-16 Sep 07 10:12:59.473098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-993de4e8-6b92-4844-bf92-e6820ad90c69 req-bc8d5725-3056-4f2a-93d6-5417bfa82f65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071148 Sep 07 10:12:59.475391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2598/5141] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:12:59.484641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-567741531", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1850076c-60ca-4b3b-8a8e-057cac39480d"}], "security_groups": [{"name": "tempest-securitygroup--1800404805"}], "key_name": "tempest-keypair-422773613", "user_data": "}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:12:59.606699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:12:59.619998 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-43c56a15-9943-4973-8cea-3d40d4137341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.691527 Sep 07 10:12:59.621589 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2544/5142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:58 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:12:59.629462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:12:59.634018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:12:59.654251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:59.654960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:59.655828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:59.656724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:12:59.657368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:12:59.658003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:12:59.859112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] validate_networks() for [('1850076c-60ca-4b3b-8a8e-057cac39480d', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:13:00.100473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:00.111148 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53988195-eabb-4582-a7cf-bb78d8ede6b2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 0.486715 Sep 07 10:13:00.114694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2545/5143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:12:59 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:00.121724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:00.123086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:00.140127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:00.144709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:00.146443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:00.151721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:00.152214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:00.155118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:00.366076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:00.666247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:00.675418 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc2f86d5-2c28-4e0b-a0df-c69ea9391fa2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.558067 Sep 07 10:13:00.676014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2546/5144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:00 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:00.694923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:00.695399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:00.725490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:00.726024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:00.726473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:00.727198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:00.727692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:00.728123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:01.048253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:01.066422 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3bdaf7d9-e844-4c8f-9ec7-df016f7c7152 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.378192 Sep 07 10:13:01.067248 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2547/5145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:00 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:01.136340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:01.137275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:01.148657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:01.149926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:01.150752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:01.152725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:01.153416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:01.154012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:01.195324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:13:01.195828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:13:01.196338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:13:01.196820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:13:01.197311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:13:01.214104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:01.214865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:01.215329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:01.216105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:01.216569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:01.221651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:01.272241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:13:01.295937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Getting quotas for user e63083ee90514491ac086a7dba0efeff and project cc5cd65575ed4a498704c266af28f654. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:13:01.333206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:13:01.344248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:13:01.436399 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f915f07-74c1-472f-a315-18825c8b9e74 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.958981 Sep 07 10:13:01.438809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2599/5146] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:12:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:13:01.451600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:01.459631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a76d5d9-6eb4-4c3f-9f16-c73c2477ee5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:01.461641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a76d5d9-6eb4-4c3f-9f16-c73c2477ee5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:01.463569 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-59b72de5-e048-42c8-a9ab-343725d23021 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 0.331512 Sep 07 10:13:01.466625 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2548/5147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:01 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:01.474965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:01.703828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:01.704574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:01.705814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a76d5d9-6eb4-4c3f-9f16-c73c2477ee5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:01.716230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:01.719303 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a76d5d9-6eb4-4c3f-9f16-c73c2477ee5b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1240 microversion: 2.1 time: 0.272051 Sep 07 10:13:01.720497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:01.722901 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2600/5148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:01 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1240 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:01.736471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:01.746731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:01.750990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:01.751582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:02.099443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:02.101975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:02.170838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:02.178800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:02.179908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:02.184663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:02.186368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:02.189354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:02.643538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:02.658425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-236fffa0-087d-460f-ba73-ca3c3335139c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.959257 Sep 07 10:13:02.662832 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2549/5149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:01 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:02.685772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:02.689555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:02.713579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:02.714318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:02.717412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:02.718271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:02.719934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:02.720389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:02.817785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:02.835243 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d35fa79-b879-4054-a914-cee5c989021c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.746526 Sep 07 10:13:02.845956 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2601/5150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:02 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:02.853084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:02.867330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:02.890666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:02.894472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:02.895184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:02.897016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:02.897682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:02.898275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:03.151392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:03.160962 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19901c2a-644f-4649-a7be-3888d69b621b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1292 microversion: 2.1 time: 0.313639 Sep 07 10:13:03.169315 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2602/5151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:02 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1292 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:03.220372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:03.232437 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7b7bd874-f4a3-4701-9e78-c96898c3ff56 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 0.567137 Sep 07 10:13:03.233994 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2550/5152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:02 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:03.686545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:03.687606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:03.698894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:03.699614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:03.700279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:03.701645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:03.702546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:03.703139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:03.873451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:03.874071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:03.906094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:03.907925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:03.908401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:03.911177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:03.914883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:03.915736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:04.043081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:04.054429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ce48a11-8760-4cd1-ac23-6adadad84eca tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.371659 Sep 07 10:13:04.056070 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2603/5153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:03 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:04.190206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:04.190845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:04.205665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:04.206180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:04.217000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:04.218028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:04.226003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:04.226556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:04.583233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:04.595120 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9246ace7-2e59-4296-bcf3-0b7a2b2ab50b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1300 microversion: 2.1 time: 0.408442 Sep 07 10:13:04.595629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2604/5154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:04 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1300 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:04.613453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:04.614343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:04.633887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:04.634398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:04.634856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:04.635583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:04.636069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:04.636503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:04.688558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:04.702062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65452279-aedd-42ae-a931-aace386d4fd5 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.830117 Sep 07 10:13:04.707460 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2551/5155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:03 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:04.727939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-db2155c5-472e-42d1-8e32-a159a32046d6 req-c404557b-66be-4443-bc7e-ce4bbcbc52ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79421056-6138-4f20-b1f9-4b6345e2ed15", "name": "network-vif-plugged", "status": "completed", "tag": "1e46baa4-d030-4b4a-b5c0-7179e380433e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:04.747536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-db2155c5-472e-42d1-8e32-a159a32046d6 req-c404557b-66be-4443-bc7e-ce4bbcbc52ed service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:04.748309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-db2155c5-472e-42d1-8e32-a159a32046d6 req-c404557b-66be-4443-bc7e-ce4bbcbc52ed service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:04.750319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-db2155c5-472e-42d1-8e32-a159a32046d6 req-c404557b-66be-4443-bc7e-ce4bbcbc52ed service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:04.779461 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-db2155c5-472e-42d1-8e32-a159a32046d6 req-c404557b-66be-4443-bc7e-ce4bbcbc52ed service nova] Creating event network-vif-plugged:1e46baa4-d030-4b4a-b5c0-7179e380433e for instance 79421056-6138-4f20-b1f9-4b6345e2ed15 on n-h2-836830-16 Sep 07 10:13:04.789665 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-db2155c5-472e-42d1-8e32-a159a32046d6 req-c404557b-66be-4443-bc7e-ce4bbcbc52ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080645 Sep 07 10:13:04.790826 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2552/5156] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:04.981460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:04.991210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82939222-c7bf-45ea-a3f0-5cdb8256c5c0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 0.391093 Sep 07 10:13:04.991829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2605/5157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:04 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:05.083297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:05.083948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:05.096261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:05.096767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:05.097231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:05.097958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:05.098433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:05.098867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:05.623491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:05.624727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:05.641552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:05.642335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:05.642955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:05.643841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:05.644472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:05.645099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:05.728213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:05.737153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99b3d55a-fc00-40c0-8860-331023f4b37e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1678 microversion: 2.1 time: 0.658250 Sep 07 10:13:05.739251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2553/5158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:05 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1678 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:05.745054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:05.745986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:05.757128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:05.758173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:05.758903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:05.759628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:05.760318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:05.760762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:05.900645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:05.909890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd90c601-9c63-4f26-8d0c-41b30b460307 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1298 microversion: 2.1 time: 0.290238 Sep 07 10:13:05.910488 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2606/5159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:05 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1298 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:06.021880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:06.022883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:06.034684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:06.036160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:06.040538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:06.041705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:06.043059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:06.043715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:06.212698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:06.222135 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c12437c4-a450-4bc2-9019-351c5094759c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1375 microversion: 2.1 time: 0.481649 Sep 07 10:13:06.223264 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2554/5160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:05 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1375 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:06.762688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:06.763559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:06.770959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:06.772438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:06.773328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:06.774464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:06.775081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:06.775683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.224060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:07.248135 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c3edc84c-1c18-4f8d-a8f9-e2af890a4337 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 1.232464 Sep 07 10:13:07.248872 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2607/5161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:06 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:07.255588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:07.256487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:07.268908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:07.269563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:07.270024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.272429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:07.273122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:07.273772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.496962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:07.509543 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95b9bedb-3439-493f-a54e-39b1ce85abed tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1655 microversion: 2.1 time: 0.750829 Sep 07 10:13:07.511073 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2555/5162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:06 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1655 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:07.526283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:07.530876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:07.549335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:07.552233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:07.555032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.557316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:07.558048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:07.559292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.714964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:07.735570 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b8f69ef-e81f-46fb-b747-7286909b2bd3 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.483951 Sep 07 10:13:07.737360 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2608/5163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:07 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:07.754577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e5977cb9-c43d-41ef-a063-bd9588ad8057 req-fe6c2826-5c6d-4203-98d8-be4bd364ec2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6f5b52-f20e-457c-b1ba-8c940d929051", "name": "network-vif-plugged", "status": "completed", "tag": "a068c4c8-006f-494b-b95e-57eb6effae39"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:07.790835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e5977cb9-c43d-41ef-a063-bd9588ad8057 req-fe6c2826-5c6d-4203-98d8-be4bd364ec2a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:07.791792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e5977cb9-c43d-41ef-a063-bd9588ad8057 req-fe6c2826-5c6d-4203-98d8-be4bd364ec2a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:07.792481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e5977cb9-c43d-41ef-a063-bd9588ad8057 req-fe6c2826-5c6d-4203-98d8-be4bd364ec2a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.797105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:07.828886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e5977cb9-c43d-41ef-a063-bd9588ad8057 req-fe6c2826-5c6d-4203-98d8-be4bd364ec2a service nova] Creating event network-vif-plugged:a068c4c8-006f-494b-b95e-57eb6effae39 for instance df6f5b52-f20e-457c-b1ba-8c940d929051 on n-h1-836830-16 Sep 07 10:13:07.837737 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e5977cb9-c43d-41ef-a063-bd9588ad8057 req-fe6c2826-5c6d-4203-98d8-be4bd364ec2a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095665 Sep 07 10:13:07.838949 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2609/5164] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:07.849451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-29a3d919-06e5-4e2d-a03f-456906a2e829 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:07.869669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29a3d919-06e5-4e2d-a03f-456906a2e829 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:07.870446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29a3d919-06e5-4e2d-a03f-456906a2e829 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:07.871118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-29a3d919-06e5-4e2d-a03f-456906a2e829 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:07.930464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-29a3d919-06e5-4e2d-a03f-456906a2e829 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Going to try to start instance {{(pid=128832) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 10:13:08.050080 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-29a3d919-06e5-4e2d-a03f-456906a2e829 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.209311 Sep 07 10:13:08.050737 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2610/5165] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:13:07 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:13:08.060394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:08.066307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:08.081889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.082774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.083381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.086037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.086707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.093438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.327527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:08.340094 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc017e89-d8ba-4aa4-968c-4da251e4b6fa tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1562 microversion: 2.1 time: 0.822883 Sep 07 10:13:08.340695 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2556/5166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:07 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1562 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:08.350206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:08.350841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:08.373931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.374441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.375076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.375977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.376603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.377410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.756301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:08.772974 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e1cb058-03b9-4256-9f0e-91086525df81 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1664 microversion: 2.1 time: 0.716637 Sep 07 10:13:08.785207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2611/5167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:08 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1664 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:08.785815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:08.786493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:08.806516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.807043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.807512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.811236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.811777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.818743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.854476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:08.871686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65b41ab7-0761-47c9-a2bb-93cd21a7cbdf tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1313 microversion: 2.1 time: 0.525138 Sep 07 10:13:08.873338 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2557/5168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:08 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:08.885280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:08.886205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:08.903210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.903993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.904619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.905563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:08.906194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:08.906778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:08.910215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:09.325420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:09.335394 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2ba4dd2-e360-4657-beb9-05a217e31d0a tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.460567 Sep 07 10:13:09.344361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:09.345224 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2558/5169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:08 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:09.358191 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d51b42c4-4a95-4554-8591-8e437380966b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1562 microversion: 2.1 time: 0.580564 Sep 07 10:13:09.359141 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2612/5170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:08 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1562 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:09.523285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:09.523862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:09.534605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:09.535737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:09.537344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:09.538481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:09.538968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:09.539409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:09.608246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:09.801994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:09.803586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:09.823248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:09.823818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:09.824599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:09.825549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:09.829862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:09.831168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:09.868930 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1de22304-8547-4c31-847e-d0dc46ede353 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 204 len: 0 microversion: 2.1 time: 0.352904 Sep 07 10:13:09.872282 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2559/5171] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:09 2022] DELETE /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:09.886790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:09.888753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:09.909338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:09.910263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:09.911534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:09.913049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:09.913889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:09.915054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:10.387823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:10.392563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:10.402964 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e321529-dc04-4d77-9907-5b28778e9783 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1568 microversion: 2.1 time: 0.523044 Sep 07 10:13:10.404606 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae9849a5-8009-47e2-bae3-ef3ece25f246 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1664 microversion: 2.1 time: 0.605686 Sep 07 10:13:10.405048 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2560/5172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:09 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1568 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:10.416393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:10.417463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:10.430808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2613/5173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:09 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1664 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:10.435632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:10.436500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-188247382", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "99c04da2-3375-4e0a-bf7b-a5cb108314b7"}, {"uuid": "5f7c8a2d-0114-45e3-8283-f0e9809fa991"}, {"uuid": "99c04da2-3375-4e0a-bf7b-a5cb108314b7"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:10.444010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:10.444763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:10.445576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:10.446071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:10.446505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:10.518312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] validate_networks() for [('99c04da2-3375-4e0a-bf7b-a5cb108314b7', None, None, None, None, None), ('5f7c8a2d-0114-45e3-8283-f0e9809fa991', None, None, None, None, None), ('99c04da2-3375-4e0a-bf7b-a5cb108314b7', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:13:10.809575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:10.823039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d1385978-6b9d-4546-a953-3740301b51c4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1497 microversion: 2.1 time: 0.415014 Sep 07 10:13:10.826017 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2561/5174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:10 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1497 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:10.874625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:10.885581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:10.902247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:10.913114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:10.914610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:10.918262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:10.925375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:10.929760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:11.249781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:11.518275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:11.528525 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e97ecd8-458d-4dc7-ba80-7d3e45733bf7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.667254 Sep 07 10:13:11.533223 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2562/5175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:10 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:11.545933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8d0af5b7-6fcc-48be-928e-63494b663264 req-18c89394-ade4-454d-95f8-25cb548b3945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5636944-261f-4fba-8d05-de3cf0423eb9", "tag": "0614aef7-9aa1-4566-a69a-9e5973453439"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:11.579020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d0af5b7-6fcc-48be-928e-63494b663264 req-18c89394-ade4-454d-95f8-25cb548b3945 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:11.581690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d0af5b7-6fcc-48be-928e-63494b663264 req-18c89394-ade4-454d-95f8-25cb548b3945 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:11.582256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d0af5b7-6fcc-48be-928e-63494b663264 req-18c89394-ade4-454d-95f8-25cb548b3945 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:11.621714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8d0af5b7-6fcc-48be-928e-63494b663264 req-18c89394-ade4-454d-95f8-25cb548b3945 service nova] Creating event network-changed:0614aef7-9aa1-4566-a69a-9e5973453439 for instance a5636944-261f-4fba-8d05-de3cf0423eb9 on n-h2-836830-16 Sep 07 10:13:11.632445 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8d0af5b7-6fcc-48be-928e-63494b663264 req-18c89394-ade4-454d-95f8-25cb548b3945 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097721 Sep 07 10:13:11.638014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2563/5176] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:11.658807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:11.659885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:11.677516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:11.678466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:11.679273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:11.680138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:11.683078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:11.683830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:11.712275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=20 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:12.632640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:12.658886 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06102189-b3ce-400a-bb24-abc33c1b9c47 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.019295 Sep 07 10:13:12.686248 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2564/5177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:11 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:12.694494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:12.695133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:12.726258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:12.726812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:12.727648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:12.728408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:12.728884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:12.729354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:13.237365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:13.250459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c771c8d-4c9d-4552-ae38-44ce43005c22 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1568 microversion: 2.1 time: 0.561552 Sep 07 10:13:13.263370 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2565/5178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:12 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1568 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:13.276665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:13.287398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:13.300399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:13.303705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:13.306086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:13.313576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:13.318336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:13.318984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:13.371936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:13.591137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e57b9916-2ff1-4442-a7f3-fbdadc2363ec tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "DELETE /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 204 len: 0 microversion: 2.1 time: 0.324022 Sep 07 10:13:13.591748 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2566/5179] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:13 2022] DELETE /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:13.600696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:13.601935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:13.609765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:13.610273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:13.610728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:13.611495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:13.612010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:13.612447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:14.766074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:14.775498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a00333c-1422-4678-b7aa-a107e534157d tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 1.182516 Sep 07 10:13:14.785494 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2567/5180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:13 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:14.785494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:14.785494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:14.795920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:13:14.796417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:13:14.797046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:14.797554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:13:14.797675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:14.798002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:14.798276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:13:14.798713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:14.798909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:13:14.799168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:14.799596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:14.811724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:14.812380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:14.812936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:14.815257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:14.815257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:14.815257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:14.839678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Getting quotas for project 21db58d08d3548439c5a2426cb3e8cca. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:13:14.847561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Getting quotas for user 695925f2661b4399b48b76c2d57c3a3c and project 21db58d08d3548439c5a2426cb3e8cca. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:13:14.863622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:13:14.873910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:13:14.997989 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6fdc6c7f-f969-468d-b6db-7b98ab3f7fa2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.565512 Sep 07 10:13:15.005013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2614/5181] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:13:15.010508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:15.011371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:15.022941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:15.030434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.033950 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f58878b-53b2-48c4-a4e1-fa11c91eb8c5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.256113 Sep 07 10:13:15.035598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.036133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.036408 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2568/5182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:14 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:15.037421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.037935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.038396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.042623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:15.043449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:15.050388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.051106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.051821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.053736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.054417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.055280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.194631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:15.207702 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-729ae7ed-369c-4985-9414-8fcdd9f184e4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1526 microversion: 2.1 time: 0.169320 Sep 07 10:13:15.211096 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2569/5183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:15 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:15.221897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-88bdcfce-c004-4516-a0f3-5ccbe5ffea98 req-6ebf43a2-7900-443c-8160-d80f5362e150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79421056-6138-4f20-b1f9-4b6345e2ed15", "name": "network-vif-deleted", "tag": "1e46baa4-d030-4b4a-b5c0-7179e380433e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:15.258419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-88bdcfce-c004-4516-a0f3-5ccbe5ffea98 req-6ebf43a2-7900-443c-8160-d80f5362e150 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.259567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-88bdcfce-c004-4516-a0f3-5ccbe5ffea98 req-6ebf43a2-7900-443c-8160-d80f5362e150 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.260028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-88bdcfce-c004-4516-a0f3-5ccbe5ffea98 req-6ebf43a2-7900-443c-8160-d80f5362e150 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.289931 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-88bdcfce-c004-4516-a0f3-5ccbe5ffea98 req-6ebf43a2-7900-443c-8160-d80f5362e150 service nova] Creating event network-vif-deleted:1e46baa4-d030-4b4a-b5c0-7179e380433e for instance 79421056-6138-4f20-b1f9-4b6345e2ed15 on n-h2-836830-16 Sep 07 10:13:15.336259 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-88bdcfce-c004-4516-a0f3-5ccbe5ffea98 req-6ebf43a2-7900-443c-8160-d80f5362e150 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122301 Sep 07 10:13:15.337334 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2570/5184] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:15.365365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-103800b6-a2a5-401b-a1b4-a5d53d429cdc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:15.383561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-103800b6-a2a5-401b-a1b4-a5d53d429cdc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:15.411841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:15.424109 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9be751c-fc15-4ec0-8004-9e5cfc5562aa tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1503 microversion: 2.1 time: 0.417325 Sep 07 10:13:15.426151 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2615/5185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:15 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:15.445865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:15.466104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:15.483295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.483295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.484178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.485134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.485809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.486642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.873234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-103800b6-a2a5-401b-a1b4-a5d53d429cdc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:15.904747 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-103800b6-a2a5-401b-a1b4-a5d53d429cdc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1212 microversion: 2.1 time: 0.559663 Sep 07 10:13:15.905457 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2571/5186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:15 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1212 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:15.912702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:15.913809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:15.921057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.921863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.922548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:15.923437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:15.924049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:15.925347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.546312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:16.586914 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81c9025a-1e65-4cb4-8b90-c9fd219d833d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.157259 Sep 07 10:13:16.592451 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2616/5187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:15 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:16.608412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a28a55b3-045c-4024-a68a-286c36252c09 req-41f1b728-12f6-4701-a053-822566662181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6f5b52-f20e-457c-b1ba-8c940d929051", "name": "network-vif-deleted", "tag": "a068c4c8-006f-494b-b95e-57eb6effae39"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:16.634357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a28a55b3-045c-4024-a68a-286c36252c09 req-41f1b728-12f6-4701-a053-822566662181 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.643307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a28a55b3-045c-4024-a68a-286c36252c09 req-41f1b728-12f6-4701-a053-822566662181 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.643886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a28a55b3-045c-4024-a68a-286c36252c09 req-41f1b728-12f6-4701-a053-822566662181 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.685948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a28a55b3-045c-4024-a68a-286c36252c09 req-41f1b728-12f6-4701-a053-822566662181 service nova] Creating event network-vif-deleted:a068c4c8-006f-494b-b95e-57eb6effae39 for instance df6f5b52-f20e-457c-b1ba-8c940d929051 on n-h1-836830-16 Sep 07 10:13:16.697858 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a28a55b3-045c-4024-a68a-286c36252c09 req-41f1b728-12f6-4701-a053-822566662181 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101939 Sep 07 10:13:16.699600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2617/5188] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:16.709942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:16.711929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:16.726733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:16.743026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.743546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.747544 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c93d2208-12e2-457d-be95-808ab8254d38 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.839702 Sep 07 10:13:16.748293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.749577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.750222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.754184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.768077 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2572/5189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:15 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:16.776477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:16.777112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:16.787665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.788429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.789643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.790737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.791423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.792865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.891348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.893875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.894973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.895778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lazy-loading 'fault' on Instance uuid df6f5b52-f20e-457c-b1ba-8c940d929051 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:16.901789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:16.942430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:16.961438 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be739603-fc00-423d-aea5-264b3c1a289e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1360 microversion: 2.1 time: 0.258403 Sep 07 10:13:16.962257 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2618/5190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:16 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1360 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:16.975848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:16.976494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:16.993228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.993747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.994846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:16.995583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:16.996060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:16.996558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.120444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:17.139430 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab9a2f48-7938-4d48-89d0-c57376c9741d tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 200 len: 1303 microversion: 2.1 time: 0.370191 Sep 07 10:13:17.140249 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2573/5191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:16 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 1303 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:17.181487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:17.183577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:17.191817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.192605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.194529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.195413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.196485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.197252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.398130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:17.419101 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e737ed38-3b77-4a0d-b180-3d0c10bfca40 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1208 microversion: 2.1 time: 0.243805 Sep 07 10:13:17.419726 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2574/5192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:17 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1208 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:17.420711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:17.440618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d43c8ca9-9432-4387-9a12-b00609fb678d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.475787 Sep 07 10:13:17.443814 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2619/5193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:16 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:17.468136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:17.469001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:17.492136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.492836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.493648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.494583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.495210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.504674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.781300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:17.781300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:17.793907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.796096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.796664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.801254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.801909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.803409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.878328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:17.888781 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7cbe7b5b-0e65-4c23-9c7d-c583a2ba7b56 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.424917 Sep 07 10:13:17.906999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2575/5194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:17 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:17.916315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:17.916894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:17.932853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.934013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.934471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.935199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:17.935670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:17.939238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:17.997662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lazy-loading 'flavor' on Instance uuid 269aa25f-08f2-4a84-bf93-2a9a614ed126 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:18.078729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:18.095746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7277e2de-9b62-4065-b45a-cc9dfeb1fa4e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.326415 Sep 07 10:13:18.097007 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2620/5195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:17 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:18.104625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:18.105718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:18.138046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.138561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.142496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.146387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cb1f193-3612-423b-b844-10087bb59229 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.233710 Sep 07 10:13:18.147940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.148659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.149340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.150420 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2576/5196] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:13:17 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:13:18.156094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:18.156812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:18.167781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.168296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.169027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.170013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.170371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.170806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.414357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:18.442861 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23981cfb-4402-4325-aa63-f0c975adbe9a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1360 microversion: 2.1 time: 0.339705 Sep 07 10:13:18.444745 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2621/5197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:18 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1360 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:18.456860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:18.457539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: df6f5b52-f20e-457c-b1ba-8c940d929051] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:18.477013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.477796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.478441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.479342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.494933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.495536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.542884 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] HTTP exception thrown: Instance df6f5b52-f20e-457c-b1ba-8c940d929051 could not be found. Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Request method failure captured: Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 HTTP/1.1 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG6Tefm75atIaFs6wnWWRPSAj-vMphhyqZon9OPqJ-8QdjYsVYhhQh34UbhWvSB6_mLcnwO_Q-2ln9vgcfQAQi_5QgHWKz5aw7d3gE48PL9Cz5txA_k1w6Y7iJsc1kvCPSrKiEpyXjTOgosYTD3gEBUoKpLekwzwS32bxhgijXLhPi0 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 826ecd5ccfea4b1bb6d4e3e9958b272e Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesActionsTest-426971703 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/826ecd5ccfea4b1bb6d4e3e9958b272e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/826ecd5ccfea4b1bb6d4e3e9958b272e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/826ecd5ccfea4b1bb6d4e3e9958b272e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_826ecd5ccfea4b1bb6d4e3e9958b272e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesActionsTest-426971703 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 826ecd5ccfea4b1bb6d4e3e9958b272e Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesActionsTest-426971703 Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesActionsTest-426971703-project Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b4ba47d053f340d890b3be0e8d77284c Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesActionsTest-426971703-project Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance df6f5b52-f20e-457c-b1ba-8c940d929051 could not be found. Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'df6f5b52-f20e-457c-b1ba-8c940d929051'} Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6f5b52-f20e-457c-b1ba-8c940d929051 could not be found. Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6f5b52-f20e-457c-b1ba-8c940d929051 could not be found. Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:18.549751 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6f5b52-f20e-457c-b1ba-8c940d929051 could not be found. Sep 07 10:13:18.554055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:18.556494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Returning 404 to user: Instance df6f5b52-f20e-457c-b1ba-8c940d929051 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:18.559048 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4ba7063-dae2-4567-8388-d764a8289553 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051" status: 404 len: 111 microversion: 2.1 time: 0.113049 Sep 07 10:13:18.559656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2622/5198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:18 2022] GET /compute/v2.1/servers/df6f5b52-f20e-457c-b1ba-8c940d929051 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:18.564320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:18.564955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:18.610467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.610985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.611566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.612302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:18.612783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:18.613257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:18.658863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:18.671966 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00f24eba-795e-46b1-93c8-a5002696024a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1676 microversion: 2.1 time: 0.520232 Sep 07 10:13:18.674319 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2577/5199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:18 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1676 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:18.801636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:18.816030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00708ad7-6ee8-48e5-b9b6-2a21e0ed3153 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1282 microversion: 2.1 time: 0.252965 Sep 07 10:13:18.830193 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2623/5200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:18 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:18.866497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1505515727", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "4dcc7ef2-c4f3-4f1f-9d00-889c0bb8cb9e"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:18.970342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] validate_networks() for [('4dcc7ef2-c4f3-4f1f-9d00-889c0bb8cb9e', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:13:19.121562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:19.122371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:19.136407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.137672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.138151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.139380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.139591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.140376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.584580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:19.597658 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1257094b-2c4c-4fa6-9828-c6be2c9a31d5 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.481102 Sep 07 10:13:19.600190 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2624/5201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:19 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:19.610819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:19.611469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:19.636631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.642705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.644620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.645640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.649169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.649836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.800624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:19.815069 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-581e2a68-2df5-49c5-9b71-79aadceadb9f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1360 microversion: 2.1 time: 0.212928 Sep 07 10:13:19.816072 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2625/5202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:19 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:19.829339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:19.830350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:19.852626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.855988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.856707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.857661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.860357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.860998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.912255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:13:19.913922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:13:19.914597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:13:19.915231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:13:19.915831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:13:19.925060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:19.940858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.944546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.945311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.946871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:19.947546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:19.948172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:19.971376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Getting quotas for project 826ecd5ccfea4b1bb6d4e3e9958b272e. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:13:19.979885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Getting quotas for user b4ba47d053f340d890b3be0e8d77284c and project 826ecd5ccfea4b1bb6d4e3e9958b272e. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:13:19.996066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:13:20.001240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:13:20.119435 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bed46e21-1c55-4dd6-9ca7-0297002a00d5 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257376 Sep 07 10:13:20.121647 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2578/5203] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:13:20.137663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:20.139807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:20.158270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.160725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.162146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.167724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.169569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.170725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.250170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:20.265042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-76b3d0a0-f67f-4211-91e6-75c356a906d7 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1659 microversion: 2.1 time: 0.443909 Sep 07 10:13:20.266371 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2626/5204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:19 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1659 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:20.290359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-004c4c30-17e7-4bda-bc12-f85debc344bd tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:20.295167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-004c4c30-17e7-4bda-bc12-f85debc344bd tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:20.532743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-004c4c30-17e7-4bda-bc12-f85debc344bd tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:20.540150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-004c4c30-17e7-4bda-bc12-f85debc344bd tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1214 microversion: 2.1 time: 0.269697 Sep 07 10:13:20.547383 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2627/5205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:20 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:20.591668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:20.592244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:20.613935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.614555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.618460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.622118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.622659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.624345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.633725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:20.647535 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e60efc1c-b325-453b-bded-13f3bad6a312 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1312 microversion: 2.1 time: 0.524720 Sep 07 10:13:20.660280 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2579/5206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:20 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:20.671459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-edb44d69-f632-4795-bd8c-00e7df5c96f0 req-24042767-b9b3-473b-9337-2f53836e0965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5636944-261f-4fba-8d05-de3cf0423eb9", "name": "network-vif-plugged", "status": "completed", "tag": "0614aef7-9aa1-4566-a69a-9e5973453439"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:20.695458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:20.703946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-edb44d69-f632-4795-bd8c-00e7df5c96f0 req-24042767-b9b3-473b-9337-2f53836e0965 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.705345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-edb44d69-f632-4795-bd8c-00e7df5c96f0 req-24042767-b9b3-473b-9337-2f53836e0965 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.707195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-edb44d69-f632-4795-bd8c-00e7df5c96f0 req-24042767-b9b3-473b-9337-2f53836e0965 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.743848 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-edb44d69-f632-4795-bd8c-00e7df5c96f0 req-24042767-b9b3-473b-9337-2f53836e0965 service nova] Creating event network-vif-plugged:0614aef7-9aa1-4566-a69a-9e5973453439 for instance a5636944-261f-4fba-8d05-de3cf0423eb9 on n-h2-836830-16 Sep 07 10:13:20.759109 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-edb44d69-f632-4795-bd8c-00e7df5c96f0 req-24042767-b9b3-473b-9337-2f53836e0965 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095798 Sep 07 10:13:20.762113 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2580/5207] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:20.770457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:20.772124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:20.781636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.788724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.789540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.790685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.791297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.791982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.821065 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1539328a-3b34-456d-b892-e7c2b54d168a tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action" status: 202 len: 0 microversion: 2.1 time: 0.244955 Sep 07 10:13:20.822837 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2628/5208] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:13:20 2022] POST /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:13:20.836660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:20.845792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:20.890458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.895234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.895966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:20.897457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:20.900233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:20.900863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.524373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:21.534997 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88d70ca7-a1bc-4d00-a104-8267d756322e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1665 microversion: 2.1 time: 0.705629 Sep 07 10:13:21.537274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2629/5209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:20 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1665 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:21.542837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:21.543470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:21.550687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:21.551773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:21.552989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.554236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:21.554859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:21.555452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.580828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:21.594270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5835c540-0624-4729-a403-3eca8c525644 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.830821 Sep 07 10:13:21.597714 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2581/5210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:20 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:21.608981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:21.611123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:21.628106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:21.628831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:21.630238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.631435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:21.632054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:21.632641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.679946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:21.694329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b75ce13a-f926-4cd9-81d6-4f586060fa26 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1360 microversion: 2.1 time: 0.155471 Sep 07 10:13:21.696607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2630/5211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:21 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:21.703536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:21.704443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:21.714913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:21.715698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:21.716449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.717409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:21.718029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:21.718791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:21.742375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:21.757603 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2113ecd-f727-4b7c-8f39-79c630f21e90 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1210 microversion: 2.1 time: 0.157164 Sep 07 10:13:21.759616 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2582/5212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:21 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1210 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:21.991835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:22.001118 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b37b7208-8ab6-47ea-8b5d-268eae110e89 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1333 microversion: 2.1 time: 0.303176 Sep 07 10:13:22.004023 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2631/5213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:21 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1333 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:22.564489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:22.565264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:22.579213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:22.579885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:22.581666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:22.584512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:22.585314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:22.586908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:22.624726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:22.625598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:22.635192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:22.641501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:22.649277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:22.650494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:22.654479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:22.655087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:22.998378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:23.009348 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56b92f58-9f8c-4c0a-9fcf-c71c2aa34d56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1366 microversion: 2.1 time: 0.389256 Sep 07 10:13:23.012341 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2632/5214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:22 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:23.017214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:23.024080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:23.039058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.044249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.044891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:23.045879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.046519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.049679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:23.104908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:23.123188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04810682-0744-4f47-835d-67252446d835 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1665 microversion: 2.1 time: 0.563886 Sep 07 10:13:23.124147 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2583/5215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:22 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1665 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:23.135869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:23.137974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:23.152482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.154040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.155500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:23.158833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.159591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.160240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:23.321702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:23.323054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:23.332467 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1c2cdc18-5302-4b5e-86a6-2cb2d9a91383 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 200 len: 1360 microversion: 2.1 time: 0.318778 Sep 07 10:13:23.337109 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f02ae87d-06e5-4e28-b016-9a2ed6ece0e2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1272 microversion: 2.1 time: 0.209437 Sep 07 10:13:23.337610 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2633/5216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:23 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 1360 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:23.337834 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2584/5217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:23 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:23.342934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:23.343943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:23.356235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.357098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.363999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:23.365798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.366316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.366837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:23.671513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:23.683045 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-08805f5a-2be6-43b4-8902-0c44efa9263c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.342744 Sep 07 10:13:23.686336 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2634/5218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:23 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:23.956415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-224a32f4-0077-4341-81e0-bebb6e6fc5db req-7fe82e30-ead6-4340-85b8-3815c628187f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "tag": "ef3137da-bab2-4213-82ee-18825381ab6e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:23.981988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-224a32f4-0077-4341-81e0-bebb6e6fc5db req-7fe82e30-ead6-4340-85b8-3815c628187f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:23.982692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-224a32f4-0077-4341-81e0-bebb6e6fc5db req-7fe82e30-ead6-4340-85b8-3815c628187f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:23.983041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-224a32f4-0077-4341-81e0-bebb6e6fc5db req-7fe82e30-ead6-4340-85b8-3815c628187f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:24.005139 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-224a32f4-0077-4341-81e0-bebb6e6fc5db req-7fe82e30-ead6-4340-85b8-3815c628187f service nova] Creating event network-changed:ef3137da-bab2-4213-82ee-18825381ab6e for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:24.014746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-224a32f4-0077-4341-81e0-bebb6e6fc5db req-7fe82e30-ead6-4340-85b8-3815c628187f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063074 Sep 07 10:13:24.038540 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2585/5219] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:24.040209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:24.041792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:24.053536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:24.057533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:24.058022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:24.058853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:24.063445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:24.064058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:24.148734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:24.150288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:24.160777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:24.162246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:24.162865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:24.164331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:24.164952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:24.165560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:24.827361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:25.218849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:25.231565 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9eee902-e9c9-4fb0-987d-fc0bdf413f11 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 1.087492 Sep 07 10:13:25.235483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2586/5220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:24 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:25.249408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:25.250260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:25.263975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.269377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.270042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.271522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.272512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.276235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.302708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:25.319415 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98eca1a9-4faf-405d-ac0a-f92b66252042 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1556 microversion: 2.1 time: 1.282941 Sep 07 10:13:25.320219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 HTTP/1.1 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '79421056-6138-4f20-b1f9-4b6345e2ed15'} Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:25.322120 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:25.326664 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:25.327830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:25.328840 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b96cdcc0-a43e-4284-90ea-032a150595c9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 404 len: 111 microversion: 2.1 time: 0.092247 Sep 07 10:13:25.336260 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2587/5221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:25 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:25.341758 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2635/5222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:24 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1556 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:25.356989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:25.357268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:25.358029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:25.358548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:25.374588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.376452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.378034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.378445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.378637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.379108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.381023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.381541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.381932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.382592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.383234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.383851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.841426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:25.850843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c84a6fba-0e73-4866-a7a9-b2c0c050f57f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.503765 Sep 07 10:13:25.865390 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2588/5223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:25 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:25.874971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:25.875601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:25.898793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.899298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.899736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:25.900461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:25.900916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:25.905081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.275203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:26.286744 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7aeba455-ff13-465c-b19d-c4b2065f6758 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.943675 Sep 07 10:13:26.289872 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2636/5224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:25 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:26.316975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:26.319566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:26.327615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.328642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.329319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.330398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.331241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.331963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.481200 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c7b52be1-ffca-4469-b1b5-486b1d2ab8f7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174400 Sep 07 10:13:26.482240 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2637/5225] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:13:26 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:26.488432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-378d6bee-9053-4bb9-a910-fb80cb521751 req-07e40e72-12ed-4479-a9b7-88f7d5ca04f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "tag": "1deb90fb-3770-40e2-bcd5-1792f8c50565"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:26.514653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-378d6bee-9053-4bb9-a910-fb80cb521751 req-07e40e72-12ed-4479-a9b7-88f7d5ca04f5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.515154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-378d6bee-9053-4bb9-a910-fb80cb521751 req-07e40e72-12ed-4479-a9b7-88f7d5ca04f5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.515619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-378d6bee-9053-4bb9-a910-fb80cb521751 req-07e40e72-12ed-4479-a9b7-88f7d5ca04f5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.547400 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-378d6bee-9053-4bb9-a910-fb80cb521751 req-07e40e72-12ed-4479-a9b7-88f7d5ca04f5 service nova] Creating event network-changed:1deb90fb-3770-40e2-bcd5-1792f8c50565 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:26.556812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-378d6bee-9053-4bb9-a910-fb80cb521751 req-07e40e72-12ed-4479-a9b7-88f7d5ca04f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073088 Sep 07 10:13:26.560290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2638/5226] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:26.767815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:26.778145 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c438308-4eaa-4e29-a4b9-845ff2f72e20 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1668 microversion: 2.1 time: 0.915481 Sep 07 10:13:26.778746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2589/5227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:25 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1668 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:26.808462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:26.809075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:26.821760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.822261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.822717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.823467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.823888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.824325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.878078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:26.878696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:26.891493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.891992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.901571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:26.903522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.904353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:26.904843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:26.907445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:26.930254 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Working on deleting snapshot 848ce7e7-1266-4016-95b2-b95dd6e4fd86 from shelved instance... Sep 07 10:13:27.633507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:27.642597 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d1d38fe-e0de-4233-8348-a8af8b8faf6c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.769078 Sep 07 10:13:27.661045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2590/5228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:26 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:27.679432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:27.680457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:27.688797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:27.691176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:27.691674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:27.707439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:27.709917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:27.711151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:27.714872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:28.062295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Doing local delete in cell f6da09e8-203a-4fea-baad-b6e28ec12187(cell1) {{(pid=128832) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 07 10:13:28.064248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:28.065778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:28.066259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:28.066741 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 07 10:13:28.076783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] deallocate_for_instance() {{(pid=128832) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 07 10:13:28.624714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:28.643365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f8f11225-7b54-410d-9ce3-9674353b5f83 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.978487 Sep 07 10:13:28.643989 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2591/5229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:27 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:28.679457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-df19428e-e1d1-4f8c-adb8-b9c5df3b22b6 req-dccab7cc-1288-4045-b729-d46527fc62d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "tag": "4b1b6751-3edc-44fd-b523-9dcc75dcb238"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:28.723898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df19428e-e1d1-4f8c-adb8-b9c5df3b22b6 req-dccab7cc-1288-4045-b729-d46527fc62d1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:28.724743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df19428e-e1d1-4f8c-adb8-b9c5df3b22b6 req-dccab7cc-1288-4045-b729-d46527fc62d1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:28.725392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df19428e-e1d1-4f8c-adb8-b9c5df3b22b6 req-dccab7cc-1288-4045-b729-d46527fc62d1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:28.750746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-df19428e-e1d1-4f8c-adb8-b9c5df3b22b6 req-dccab7cc-1288-4045-b729-d46527fc62d1 service nova] Creating event network-changed:4b1b6751-3edc-44fd-b523-9dcc75dcb238 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:28.763977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-df19428e-e1d1-4f8c-adb8-b9c5df3b22b6 req-dccab7cc-1288-4045-b729-d46527fc62d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097040 Sep 07 10:13:28.769274 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2592/5230] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:28.781613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:28.783044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:28.800487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:28.801262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:28.802578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:28.803936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:28.804651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:28.805382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:29.960410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:29.993594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:30.174975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:30.186437 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-df9ec03f-56b6-4832-9e01-81f7f91f4588 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 1.415584 Sep 07 10:13:30.188312 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2593/5231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:28 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:30.200769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:30.203695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:30.223718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:30.225280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:30.226013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:30.228899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:30.229584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:30.230205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:30.328514 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67e801fb-9796-490d-be86-75d1d995012e tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.137332 Sep 07 10:13:30.331599 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2594/5232] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 7 10:13:30 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:30.344978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:30.345663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:30.357878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:30.358911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:30.361025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:30.362170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:30.362877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:30.363508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:30.540550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:31.011876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:31.023733 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ca985df-2bab-4794-acc2-0620a7b98ab4 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.691015 Sep 07 10:13:31.024664 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2595/5233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:30 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:31.040242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-591efcbb-c611-470b-b501-e8c9414b4e9c req-20be5b9e-42c9-4fba-828b-8c5bf36a2b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c85e31-5ebf-4d68-86e4-2bc538db9c19", "tag": "0119c227-20b2-447c-be32-b99cc7b4f32a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:31.058356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-591efcbb-c611-470b-b501-e8c9414b4e9c req-20be5b9e-42c9-4fba-828b-8c5bf36a2b21 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:31.059941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-591efcbb-c611-470b-b501-e8c9414b4e9c req-20be5b9e-42c9-4fba-828b-8c5bf36a2b21 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:31.061371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-591efcbb-c611-470b-b501-e8c9414b4e9c req-20be5b9e-42c9-4fba-828b-8c5bf36a2b21 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:31.088679 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-591efcbb-c611-470b-b501-e8c9414b4e9c req-20be5b9e-42c9-4fba-828b-8c5bf36a2b21 service nova] Creating event network-changed:0119c227-20b2-447c-be32-b99cc7b4f32a for instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 on n-h1-836830-16 Sep 07 10:13:31.096077 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-591efcbb-c611-470b-b501-e8c9414b4e9c req-20be5b9e-42c9-4fba-828b-8c5bf36a2b21 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066015 Sep 07 10:13:31.097120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2596/5234] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:31.104812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:31.107686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:31.117421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:31.118887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:31.119570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:31.120656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:31.121799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:31.123008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:31.162024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:31.300765 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-920edfdd-4edc-41b0-bc50-59d1306e8397 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 204 len: 0 microversion: 2.20 time: 0.201468 Sep 07 10:13:31.302486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2597/5235] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:13:31 2022] DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:13:31.310309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:31.311441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:31.322021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:31.322690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:31.323233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:31.324150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:31.325139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:31.325707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:31.667314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Updating instance_info_cache with network_info: [] {{(pid=128832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 10:13:31.935130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:31.950378 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a361ddf6-9d8f-4bc4-83f8-2683602bd0d0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.646438 Sep 07 10:13:31.962982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:31.981957 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2598/5236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:31 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:31.996831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:31.997659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:32.020411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.027239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.027775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.028538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.029019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.029503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.213476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:32.249149 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a615e1f5-abb4-4dc6-bf57-54893140356d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 204 len: 0 microversion: 2.1 time: 5.445207 Sep 07 10:13:32.253628 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2639/5237] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:26 2022] DELETE /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 0 bytes in 5450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:32.260966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:32.262809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:32.271576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.272632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.273323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.274275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.274950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.275595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.280098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:32.289946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:32.291401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:32.292596 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ad20a690-7fd2-4eb3-9d96-d251606a791d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.309349 Sep 07 10:13:32.300232 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2599/5238] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:31 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:13:32.309988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:32.314105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: dc006408-7767-420b-b2bf-6dec07c840e4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:32.347576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.348083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.352415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.353241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.354965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.355402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.426290 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] HTTP exception thrown: Instance dc006408-7767-420b-b2bf-6dec07c840e4 could not be found. Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Request method failure captured: Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 HTTP/1.1 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzHI4_Gs1AYCsuN-nstt6RfgCFlbQJx2Y7t1xTba8onie0D-p3dYmj4ETDluGw23VZ-TI88rSdpp2PKXSvonJ_41bjSbUVIF6F_z1PYTp7NtwRlUHYOB7Rv76Aw67_NCxbTeua_jq2FFTf93vJmiFWgHyHPh0TUMHb2J9KhW_fTKRU Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e080e21e856141b7850ea79bafd5b8e9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a8b10f41570421a9292168d0326bae0 Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance dc006408-7767-420b-b2bf-6dec07c840e4 could not be found. Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'dc006408-7767-420b-b2bf-6dec07c840e4'} Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc006408-7767-420b-b2bf-6dec07c840e4 could not be found. Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc006408-7767-420b-b2bf-6dec07c840e4 could not be found. Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:32.428013 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc006408-7767-420b-b2bf-6dec07c840e4 could not be found. Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Returning 404 to user: Instance dc006408-7767-420b-b2bf-6dec07c840e4 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:32.431910 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa206b81-7424-4442-a8a1-e74ea266789b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4" status: 404 len: 111 microversion: 2.1 time: 0.128120 Sep 07 10:13:32.432478 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2600/5239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:32 2022] GET /compute/v2.1/servers/dc006408-7767-420b-b2bf-6dec07c840e4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:32.455843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:32.456246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:32.480438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.480938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.481404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.482111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.482562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.482984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.577281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:32.743848 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc0a1801-e0a0-4dfe-be71-50cc455b6ae1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 204 len: 0 microversion: 2.1 time: 0.309189 Sep 07 10:13:32.747980 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2601/5240] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:32 2022] DELETE /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:32.761401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:32.765171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:32.780065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.782791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.783209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.784080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.784646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.785093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.947492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:32.952729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:32.960160 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e7aa376-a04c-44a8-95ef-aae99a9445a6 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1464 microversion: 2.1 time: 0.209451 Sep 07 10:13:32.961689 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2602/5241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:32 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:32.963697 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f117924-92cc-4dc3-affe-a556bc4d6e11 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.708463 Sep 07 10:13:32.964364 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2640/5242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:32 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:32.983305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:32.984141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:32.992403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.993065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.993603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:32.994441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:32.995023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:32.995553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.177672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:33.178424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:33.185084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.195417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.195900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.196664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.197490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.198443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.205393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:33.217626 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9cb3bc9-8344-41df-93a0-d4b558e06310 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.237951 Sep 07 10:13:33.218656 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2603/5243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:32 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:33.224177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc006408-7767-420b-b2bf-6dec07c840e4", "name": "network-vif-deleted", "tag": "935ada26-9b30-4960-9ae2-e927a225506e"}, {"name": "network-changed", "server_uuid": "a5636944-261f-4fba-8d05-de3cf0423eb9", "tag": "0614aef7-9aa1-4566-a69a-9e5973453439"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:33.241301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.241702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.242176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.258384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:33.266628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_external_events [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] Unable to find a host for instance dc006408-7767-420b-b2bf-6dec07c840e4. Dropping event network-vif-deleted {{(pid=128833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 10:13:33.267151 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] Creating event network-changed:0614aef7-9aa1-4566-a69a-9e5973453439 for instance a5636944-261f-4fba-8d05-de3cf0423eb9 on n-h2-836830-16 Sep 07 10:13:33.289869 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b978bdb5-eeea-4edd-a487-46c3a42a0dc9 req-e92a6126-071b-43a9-a51b-b004a171b5bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.069468 Sep 07 10:13:33.291341 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2604/5244] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 10:13:33.327594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:33.328562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:33.336746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.337488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.340132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.342014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.343364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.343364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.450122 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86aa5448-2bb3-4665-9979-c51349667a90 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 204 len: 0 microversion: 2.1 time: 0.276742 Sep 07 10:13:33.454349 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2641/5245] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:33 2022] DELETE /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:33.462237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:33.462976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:33.492160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.492629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.493141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.496009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.500349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:33.501646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:33.731162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:33.744459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:33.746143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:33.747365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-059584c3-f2a6-4aac-a8ef-b223fffa0841 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.424476 Sep 07 10:13:33.752119 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2605/5246] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:33 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:13:33.771225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:33.789139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0425ee7-8037-4cd5-ab69-63149e12bdc6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1408 microversion: 2.1 time: 0.330537 Sep 07 10:13:33.801269 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2642/5247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:33 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:33.985472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:33.986101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:33.989702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:33.991049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:33.997006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:33.997476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.000874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.001816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.002297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.002742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.012661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.013416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.014037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.014918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.015383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.015986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.210384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:34.221872 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7606a320-66de-4a62-b3b1-05e88a53ea1b tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1464 microversion: 2.1 time: 0.240368 Sep 07 10:13:34.223479 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2606/5248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:33 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1464 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:34.240979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:34.242137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:34.258259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.258779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.259248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.263230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.264103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.264717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.274209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:34.278153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:34.287381 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5626a425-c52b-4f23-88cc-832e20aab766 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.302997 Sep 07 10:13:34.308280 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2643/5249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:33 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:34.479861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:34.490457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-176217cf-d706-42ad-936f-a55a42e2403f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.254209 Sep 07 10:13:34.505488 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2607/5250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:34 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:34.780024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:34.780888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:34.808070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.808574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.809435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.810320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.810959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.811542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.818141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:34.818883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:34.829912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.830831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.831422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:34.832424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:34.832617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:34.833571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:35.294196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:35.313677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:35.318717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:35.328791 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ce0e0bac-ea09-44f8-9667-aee5ccdb8f51 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.554270 Sep 07 10:13:35.330155 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2644/5251] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:34 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:13:35.342042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:35.346257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:35.374125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:35.380693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:35.381374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:35.386154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:35.388797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:35.389587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:35.431964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:35.440026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7be4694-c431-41a0-a858-c015e241ed60 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1408 microversion: 2.1 time: 0.627914 Sep 07 10:13:35.440894 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2608/5252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:34 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1408 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:35.457141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:35.458826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:35.467052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:35.474824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:35.475588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:35.476544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:35.477174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:35.477818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:36.281145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:36.292233 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f7c65a35-0096-4b8a-acfa-cce198c876d5 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 200 len: 1464 microversion: 2.1 time: 0.960539 Sep 07 10:13:36.292827 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2645/5253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:35 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 1464 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:36.315146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:36.317046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:36.336376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:36.337080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:36.337731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:36.338696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:36.339325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:36.339919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:36.860543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:36.868540 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-89897fea-943d-4c34-9b21-15af649a8cf2 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 1.426458 Sep 07 10:13:36.869131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2609/5254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:35 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:36.873815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-deba3be9-90f4-49e2-b725-5e0957aefe8a req-8b4c8e16-aaca-4e98-8415-f4c8ff4a9e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ca3fb1-2e7c-4070-bb55-448a9471aa4c", "name": "network-vif-deleted", "tag": "d897db88-2bd0-46a1-9368-d6677fe23afb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:36.884294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-deba3be9-90f4-49e2-b725-5e0957aefe8a req-8b4c8e16-aaca-4e98-8415-f4c8ff4a9e94 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:36.884777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-deba3be9-90f4-49e2-b725-5e0957aefe8a req-8b4c8e16-aaca-4e98-8415-f4c8ff4a9e94 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:36.885403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-deba3be9-90f4-49e2-b725-5e0957aefe8a req-8b4c8e16-aaca-4e98-8415-f4c8ff4a9e94 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:36.898280 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-deba3be9-90f4-49e2-b725-5e0957aefe8a req-8b4c8e16-aaca-4e98-8415-f4c8ff4a9e94 service nova] Creating event network-vif-deleted:d897db88-2bd0-46a1-9368-d6677fe23afb for instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c on n-h1-836830-16 Sep 07 10:13:36.903515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-deba3be9-90f4-49e2-b725-5e0957aefe8a req-8b4c8e16-aaca-4e98-8415-f4c8ff4a9e94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033050 Sep 07 10:13:36.904135 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2610/5255] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:36.909387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:36.910090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:36.916914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:36.917485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:36.917932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:36.918631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:36.919096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:36.919531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.219830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:37.230936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a088f4d5-86e0-4c77-a34d-bc94d393beb2 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.931941 Sep 07 10:13:37.253260 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2646/5256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:36 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:37.259430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:37.262492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:37.273439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.274132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.275122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.276242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.276809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.278566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.647829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:37.682115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:37.684570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:37.686276 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be92943f-f5c2-46fd-9968-b746d6761e11 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1723 microversion: 2.20 time: 0.781049 Sep 07 10:13:37.687298 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2611/5257] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:36 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1723 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:13:37.712001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-53615086-09d4-4090-a02c-002410ba55d7 req-026da1c5-9b44-4875-b5d8-ae0f0b41044b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c85e31-5ebf-4d68-86e4-2bc538db9c19", "name": "network-vif-plugged", "status": "completed", "tag": "0119c227-20b2-447c-be32-b99cc7b4f32a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:37.722204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-53615086-09d4-4090-a02c-002410ba55d7 req-026da1c5-9b44-4875-b5d8-ae0f0b41044b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.722680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-53615086-09d4-4090-a02c-002410ba55d7 req-026da1c5-9b44-4875-b5d8-ae0f0b41044b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.723115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-53615086-09d4-4090-a02c-002410ba55d7 req-026da1c5-9b44-4875-b5d8-ae0f0b41044b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.739179 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-53615086-09d4-4090-a02c-002410ba55d7 req-026da1c5-9b44-4875-b5d8-ae0f0b41044b service nova] Creating event network-vif-plugged:0119c227-20b2-447c-be32-b99cc7b4f32a for instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 on n-h1-836830-16 Sep 07 10:13:37.744487 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-53615086-09d4-4090-a02c-002410ba55d7 req-026da1c5-9b44-4875-b5d8-ae0f0b41044b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055014 Sep 07 10:13:37.749251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2612/5258] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:37.778573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:37.781648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 48ca3fb1-2e7c-4070-bb55-448a9471aa4c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:37.794683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.795676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.796338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.797786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.798562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.799214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.822901 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] HTTP exception thrown: Instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c could not be found. Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Request method failure captured: Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c HTTP/1.1 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzHI4_Gs1AYCsuN-nstt6RfgCFlbQJx2Y7t1xTba8onie0D-p3dYmj4ETDluGw23VZ-TI88rSdpp2PKXSvonJ_41bjSbUVIF6F_z1PYTp7NtwRlUHYOB7Rv76Aw67_NCxbTeua_jq2FFTf93vJmiFWgHyHPh0TUMHb2J9KhW_fTKRU Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e080e21e856141b7850ea79bafd5b8e9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a8b10f41570421a9292168d0326bae0 Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c could not be found. Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '48ca3fb1-2e7c-4070-bb55-448a9471aa4c'} Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c could not be found. Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c could not be found. Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:37.825107 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c could not be found. Sep 07 10:13:37.829070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:37.831409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:37.832735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Returning 404 to user: Instance 48ca3fb1-2e7c-4070-bb55-448a9471aa4c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:37.834711 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d6aa3f59-1780-43e7-a328-6207454ee45c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c" status: 404 len: 111 microversion: 2.1 time: 0.084141 Sep 07 10:13:37.835832 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2613/5259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:37 2022] GET /compute/v2.1/servers/48ca3fb1-2e7c-4070-bb55-448a9471aa4c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:37.842978 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e227790a-18ba-425f-9a49-db39f1edf1b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1408 microversion: 2.1 time: 0.588252 Sep 07 10:13:37.843565 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2647/5260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:37 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1408 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:37.849613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:37.850437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:37.863946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.864746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.865078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.865815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.866285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.866714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.893539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:37.894058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:37.905077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.905488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.906118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.907001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:37.907476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:37.907915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:37.918034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:38.054151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:38.075099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b233e7fd-a6f8-448a-8e6b-565523c9991f tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 204 len: 0 microversion: 2.1 time: 0.234945 Sep 07 10:13:38.075849 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2614/5261] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:37 2022] DELETE /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:38.096893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:38.097917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:38.106641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.107251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.108575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:38.109804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.110389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.111289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:38.512225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:38.522178 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-30322ac1-91c0-4081-99b4-3be9f5b8d703 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.631257 Sep 07 10:13:38.524037 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2648/5262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:37 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:38.533652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:38.534432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:38.543505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.544275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.544825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:38.545670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.546064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.546867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:38.581915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:38.590800 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb52b65c-e56d-411e-8213-c4c7ca3862c2 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1505 microversion: 2.1 time: 0.510447 Sep 07 10:13:38.591387 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2615/5263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:38 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:38.611104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ed537ece-85f1-4bb9-a02d-5b082550c6c5 req-52d045c0-7ed8-4101-b59d-60f7c971354e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fc9772-2919-4489-986b-53d881e1945e", "name": "network-vif-deleted", "tag": "ccfa4c7f-9443-4d23-8424-8e10fd1287ef"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:38.640071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed537ece-85f1-4bb9-a02d-5b082550c6c5 req-52d045c0-7ed8-4101-b59d-60f7c971354e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.641099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed537ece-85f1-4bb9-a02d-5b082550c6c5 req-52d045c0-7ed8-4101-b59d-60f7c971354e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.641807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed537ece-85f1-4bb9-a02d-5b082550c6c5 req-52d045c0-7ed8-4101-b59d-60f7c971354e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:38.656925 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ed537ece-85f1-4bb9-a02d-5b082550c6c5 req-52d045c0-7ed8-4101-b59d-60f7c971354e service nova] Creating event network-vif-deleted:ccfa4c7f-9443-4d23-8424-8e10fd1287ef for instance a7fc9772-2919-4489-986b-53d881e1945e on n-h2-836830-16 Sep 07 10:13:38.663433 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ed537ece-85f1-4bb9-a02d-5b082550c6c5 req-52d045c0-7ed8-4101-b59d-60f7c971354e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064865 Sep 07 10:13:38.680085 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2616/5264] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:38.715236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:38.715959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:38.727663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.728190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.728603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:38.729342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:38.729805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:38.730237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:39.308924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:39.319150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:39.322940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:39.327715 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e90bf9f8-f358-412b-b772-05d54a4a4eda tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1655 microversion: 2.20 time: 0.617247 Sep 07 10:13:39.328888 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2617/5265] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:38 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1655 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:13:39.333435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:39.340564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:39.342210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:39.343498 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-224e7256-2445-4e3e-a773-8e9bc3275095 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.818362 Sep 07 10:13:39.344569 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2649/5266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:38 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:39.354796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:39.355222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:39.355672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:39.356382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:39.357020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:39.357645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:39.443072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:39.455093 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8100e1f3-393e-419e-81ca-92c21038aab3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1201 microversion: 2.1 time: 0.118672 Sep 07 10:13:39.469969 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2618/5267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:39 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1201 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:39.550575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:39.551305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:39.562495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:39.563413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:39.565796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:39.566811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:39.568932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:39.570315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:39.621574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:39.622452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:39.639201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:39.639800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:39.640444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:39.644970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:39.646096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:39.646696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:40.256677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:40.268674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d12508ce-14a1-4c6c-8d9b-4cd92f10db66 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1314 microversion: 2.1 time: 0.721938 Sep 07 10:13:40.271636 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2650/5268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:39 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:40.302745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-215d4ae5-71d5-4a07-b022-69876819d278 req-6b2ebd42-c54f-433a-9ba5-8e48861d37a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "name": "network-vif-unplugged", "status": "completed", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:40.345932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-215d4ae5-71d5-4a07-b022-69876819d278 req-6b2ebd42-c54f-433a-9ba5-8e48861d37a2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:40.347036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-215d4ae5-71d5-4a07-b022-69876819d278 req-6b2ebd42-c54f-433a-9ba5-8e48861d37a2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:40.357499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-215d4ae5-71d5-4a07-b022-69876819d278 req-6b2ebd42-c54f-433a-9ba5-8e48861d37a2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:40.378028 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-215d4ae5-71d5-4a07-b022-69876819d278 req-6b2ebd42-c54f-433a-9ba5-8e48861d37a2 service nova] Creating event network-vif-unplugged:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:13:40.392308 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-215d4ae5-71d5-4a07-b022-69876819d278 req-6b2ebd42-c54f-433a-9ba5-8e48861d37a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093156 Sep 07 10:13:40.394377 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2651/5269] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:40.445916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:40.446644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:40.460592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:40.461517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:40.462132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:40.465354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:40.466001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:40.467510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:40.549258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:40.550011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:40.551458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:40.552113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lazy-loading 'fault' on Instance uuid 32b1bd08-e57d-4438-8436-97be926bf5cd {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:40.612032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:40.633288 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3248339c-d413-4099-a697-c842b31d7eb1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1505 microversion: 2.1 time: 1.018660 Sep 07 10:13:40.646952 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2619/5270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:39 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1505 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:40.665726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:40.666358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:40.690421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:40.690914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:40.691353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:40.703995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:40.704823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:40.705501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:41.144164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:41.182388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:41.186317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cb4a2e0094a4c90ae14626b946065e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcacc5aca3a4eaa8681cf3eee3633b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:41.188926 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5bfc2a7-f09c-4e0c-b2d2-097c228d9092 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 200 len: 1370 microversion: 2.20 time: 0.782061 Sep 07 10:13:41.214289 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2652/5271] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:40 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 1370 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:13:41.226490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:41.227958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:41.235754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:41.236618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:41.237317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:41.238247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:41.238925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:41.240140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:41.459099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:41.492444 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ed933ead-7ca3-42fd-bc54-014b82aa5645 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1201 microversion: 2.1 time: 0.274733 Sep 07 10:13:41.494549 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2653/5272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:41 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1201 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:41.516569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b26a1e00-3529-4284-a13d-90e25d6f83dd req-d79dd078-fb3b-4167-8856-df377b3a5e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1bd08-e57d-4438-8436-97be926bf5cd", "name": "network-vif-deleted", "tag": "6d6abd62-a3a8-4b76-b267-24c9ef5671a7"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:41.560098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b26a1e00-3529-4284-a13d-90e25d6f83dd req-d79dd078-fb3b-4167-8856-df377b3a5e76 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:41.560598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b26a1e00-3529-4284-a13d-90e25d6f83dd req-d79dd078-fb3b-4167-8856-df377b3a5e76 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:41.569925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b26a1e00-3529-4284-a13d-90e25d6f83dd req-d79dd078-fb3b-4167-8856-df377b3a5e76 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:41.586672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:DELETE=2,nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:41.635544 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b26a1e00-3529-4284-a13d-90e25d6f83dd req-d79dd078-fb3b-4167-8856-df377b3a5e76 service nova] Creating event network-vif-deleted:6d6abd62-a3a8-4b76-b267-24c9ef5671a7 for instance 32b1bd08-e57d-4438-8436-97be926bf5cd on n-h1-836830-16 Sep 07 10:13:41.653899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b26a1e00-3529-4284-a13d-90e25d6f83dd req-d79dd078-fb3b-4167-8856-df377b3a5e76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152323 Sep 07 10:13:41.657606 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2654/5273] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:41.668422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:41.672516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:41.707594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:41.708209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:41.711929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:41.716546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:41.719176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:41.720558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:41.932578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:41.964581 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab8b0a63-f067-4fb5-a9ac-4194ea3cba66 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 1.315259 Sep 07 10:13:41.966805 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2620/5274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:40 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:42.001752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:42.002479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:42.013964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:42.016102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:42.028315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:42.029588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:42.030329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:42.030842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:42.259553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:42.270577 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9885c4d-fa5c-4342-ae90-7254d7850d42 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 200 len: 1298 microversion: 2.1 time: 0.301058 Sep 07 10:13:42.273131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2621/5275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:41 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 1298 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:42.287907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:42.288706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:42.298770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:42.299561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:42.302263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:42.303262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:42.304010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:42.306507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:42.345797 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] HTTP exception thrown: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Request method failure captured: Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd HTTP/1.1 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG0AZfJKTWp7EW-3orif81ghOr2tfmigR8fffyfX9KYJyxwLIkwttjwZ1WtRNSmFjxolqbmtngt3DpK9k1FQsRnM13LeJvO5xIK_--ULgG23YeAvniDJFsj3AoUbl9iW9dpNwWsqjBAp86Kek5tx4ad6z5VHh4S-R0K_WFtrgq64ICQ Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dcacc5aca3a4eaa8681cf3eee3633b3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6cb4a2e0094a4c90ae14626b946065e1 Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '32b1bd08-e57d-4438-8436-97be926bf5cd'} Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:42.349113 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:42.353106 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:42.355092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Returning 404 to user: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:42.356203 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f57e3431-2036-4a1c-a3b3-5f3ece47e1e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 404 len: 111 microversion: 2.20 time: 0.081260 Sep 07 10:13:42.357574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2622/5276] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:42 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:13:42.368511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68212241-65d8-4813-af13-81120a25c7e2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '.version_select at 0x7f14b25ef3a0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:42.407393 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68212241-65d8-4813-af13-81120a25c7e2 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-865378966" status: 204 len: 0 microversion: 2.20 time: 0.044746 Sep 07 10:13:42.416798 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2623/5277] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 7 10:13:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-865378966 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:13:42.524463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:42.524834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:42.549752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:42.550265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:42.550711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:42.557758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:42.558316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:42.558779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:42.847662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:42.871461 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-44daceaf-616f-43c6-b810-8e3da35bd90b tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1497 microversion: 2.1 time: 1.212108 Sep 07 10:13:42.872061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2655/5278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:41 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1497 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:42.885565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:42.897454 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cccd1ea-d9a3-4d23-be68-24fb2aecde61 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1201 microversion: 2.1 time: 0.373345 Sep 07 10:13:42.897454 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2624/5279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:42 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1201 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:42.994796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:42.995709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:43.011428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.011957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.014370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.016256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.019016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.019488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.298357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:43.299651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 6317208c-813d-44f8-8011-875e3c181122] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:43.342407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.343039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.349876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.369399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.369932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.373005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.410473 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] HTTP exception thrown: Instance 6317208c-813d-44f8-8011-875e3c181122 could not be found. Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Request method failure captured: Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 HTTP/1.1 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzHI4_Gs1AYCsuN-nstt6RfgCFlbQJx2Y7t1xTba8onie0D-p3dYmj4ETDluGw23VZ-TI88rSdpp2PKXSvonJ_41bjSbUVIF6F_z1PYTp7NtwRlUHYOB7Rv76Aw67_NCxbTeua_jq2FFTf93vJmiFWgHyHPh0TUMHb2J9KhW_fTKRU Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e080e21e856141b7850ea79bafd5b8e9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a8b10f41570421a9292168d0326bae0 Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 6317208c-813d-44f8-8011-875e3c181122 could not be found. Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6317208c-813d-44f8-8011-875e3c181122'} Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6317208c-813d-44f8-8011-875e3c181122 could not be found. Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6317208c-813d-44f8-8011-875e3c181122 could not be found. Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:43.415792 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6317208c-813d-44f8-8011-875e3c181122 could not be found. Sep 07 10:13:43.420214 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:43.426314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Returning 404 to user: Instance 6317208c-813d-44f8-8011-875e3c181122 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:43.429414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d90791f3-494d-4050-b18f-16323beaa089 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122" status: 404 len: 111 microversion: 2.1 time: 0.134079 Sep 07 10:13:43.431343 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2625/5280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:43 2022] GET /compute/v2.1/servers/6317208c-813d-44f8-8011-875e3c181122 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:43.444534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:43.445566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:43.486022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.486733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.489475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.496777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.504674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.505337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.564871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:43.590076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:43.684796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:43.700492 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b2a9f42-dbaa-401c-93e5-469fd8e386d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.712527 Sep 07 10:13:43.702306 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2656/5281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:42 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:43.726664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5abf3156-8016-4abf-af41-dca58e994a21 req-93005bdf-427e-4b5e-8250-446f04521d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6317208c-813d-44f8-8011-875e3c181122", "name": "network-vif-deleted", "tag": "a3b89a6c-c489-416d-acde-c94605259523"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:43.755844 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1cc87502-9b3f-4faf-95ec-468ffbecc46d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 204 len: 0 microversion: 2.1 time: 0.320934 Sep 07 10:13:43.757473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5abf3156-8016-4abf-af41-dca58e994a21 req-93005bdf-427e-4b5e-8250-446f04521d38 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.757746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2626/5282] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:43 2022] DELETE /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:43.758065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5abf3156-8016-4abf-af41-dca58e994a21 req-93005bdf-427e-4b5e-8250-446f04521d38 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.758528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5abf3156-8016-4abf-af41-dca58e994a21 req-93005bdf-427e-4b5e-8250-446f04521d38 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.772982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:43.775748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:43.787353 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5abf3156-8016-4abf-af41-dca58e994a21 req-93005bdf-427e-4b5e-8250-446f04521d38 service nova] Creating event network-vif-deleted:a3b89a6c-c489-416d-acde-c94605259523 for instance 6317208c-813d-44f8-8011-875e3c181122 on n-h2-836830-16 Sep 07 10:13:43.791201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.792656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.792781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5abf3156-8016-4abf-af41-dca58e994a21 req-93005bdf-427e-4b5e-8250-446f04521d38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082564 Sep 07 10:13:43.793825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2657/5283] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:43.794594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.799131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.800457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.801283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.930992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:43.931451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:43.941053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.941615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.942101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:43.943172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:43.943738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:43.944220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:44.115634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:44.127550 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8b3f4029-8d5b-4315-b56e-2b4591b17cbf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1201 microversion: 2.1 time: 0.200747 Sep 07 10:13:44.131540 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2658/5284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:43 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1201 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:44.140425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:44.147437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:44.160626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:44.166324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:44.167135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:44.169690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:44.171951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:44.172760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:44.253341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:44.284923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:44.298704 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e9f32de0-5d98-4d46-8e31-0f7e351c00f1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1494 microversion: 2.1 time: 0.536914 Sep 07 10:13:44.322066 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2627/5285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:43 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1494 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:44.448560 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c87bb893-8400-4f64-8106-297c255d469f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "DELETE /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 204 len: 0 microversion: 2.1 time: 0.314065 Sep 07 10:13:44.450626 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2659/5286] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:44 2022] DELETE /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:44.460663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:44.461483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:44.471289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:44.475804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:44.479020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:44.480952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:44.482993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:44.483693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:44.734502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:44.736249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:44.748827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:44.752032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:44.756608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:44.758621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:44.759631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:44.761892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:45.562044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:45.566229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:45.574371 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e40c7c1-6920-4e7f-adeb-8b76be62ecb7 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1503 microversion: 2.1 time: 1.118837 Sep 07 10:13:45.575638 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-80b4088a-fd27-4ea8-a53b-de6107d7caf0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.846946 Sep 07 10:13:45.577069 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2660/5287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:44 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:45.577773 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2628/5288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:44 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1503 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:45.585606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:45.586359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:45.593753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:45.594266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:45.594720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:45.595495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:45.595969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:45.596693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:45.602013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:45.602903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:45.623561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:45.630424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:45.632382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:45.636322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:45.638075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:45.649898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:45.753129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:45.767173 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54e2d440-2e15-4597-9b47-b63b14db1665 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1201 microversion: 2.1 time: 0.188398 Sep 07 10:13:45.769993 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2661/5289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:45 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1201 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:45.827766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7c05b1b0-2a57-4127-b385-0591e7ed1937 req-55e4f187-ed0b-4f3c-806d-d2bfc436f510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0496fd-94ae-433f-b2dc-fb7834094202", "name": "network-vif-deleted", "tag": "4276e99b-903b-4b21-b5c1-849f5aed900e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:45.858125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7c05b1b0-2a57-4127-b385-0591e7ed1937 req-55e4f187-ed0b-4f3c-806d-d2bfc436f510 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:45.858934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7c05b1b0-2a57-4127-b385-0591e7ed1937 req-55e4f187-ed0b-4f3c-806d-d2bfc436f510 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:45.859864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7c05b1b0-2a57-4127-b385-0591e7ed1937 req-55e4f187-ed0b-4f3c-806d-d2bfc436f510 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:45.882934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:45.892614 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-264f0ef1-94a1-4b91-ac39-6587d9d2573c tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 200 len: 1287 microversion: 2.1 time: 0.311468 Sep 07 10:13:45.893431 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7c05b1b0-2a57-4127-b385-0591e7ed1937 req-55e4f187-ed0b-4f3c-806d-d2bfc436f510 service nova] Creating event network-vif-deleted:4276e99b-903b-4b21-b5c1-849f5aed900e for instance 1c0496fd-94ae-433f-b2dc-fb7834094202 on n-h1-836830-16 Sep 07 10:13:45.897084 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2629/5290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:45 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 1287 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:45.923270 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7c05b1b0-2a57-4127-b385-0591e7ed1937 req-55e4f187-ed0b-4f3c-806d-d2bfc436f510 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098263 Sep 07 10:13:45.927633 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2662/5291] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:46.276386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fd831780-6dbd-49e9-b3fe-211b1a13a62d req-3d698b0c-fbb0-4f70-bb20-0470f8941814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-plugged", "status": "completed", "tag": "ef3137da-bab2-4213-82ee-18825381ab6e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:46.300574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fd831780-6dbd-49e9-b3fe-211b1a13a62d req-3d698b0c-fbb0-4f70-bb20-0470f8941814 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:46.304612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fd831780-6dbd-49e9-b3fe-211b1a13a62d req-3d698b0c-fbb0-4f70-bb20-0470f8941814 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:46.305402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fd831780-6dbd-49e9-b3fe-211b1a13a62d req-3d698b0c-fbb0-4f70-bb20-0470f8941814 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:46.335919 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fd831780-6dbd-49e9-b3fe-211b1a13a62d req-3d698b0c-fbb0-4f70-bb20-0470f8941814 service nova] Creating event network-vif-plugged:ef3137da-bab2-4213-82ee-18825381ab6e for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:46.346977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fd831780-6dbd-49e9-b3fe-211b1a13a62d req-3d698b0c-fbb0-4f70-bb20-0470f8941814 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074770 Sep 07 10:13:46.353269 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2630/5292] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:46.617925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:46.618675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:46.624781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:46.628232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:46.634948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:46.636721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:46.637775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:46.640976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:46.643874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:46.644547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:46.647746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:46.662851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:46.663475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:46.664317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:46.665475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:46.665989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.140212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:47.159987 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aeb54694-5a61-45c6-a4a4-31543ccec140 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1461 microversion: 2.1 time: 0.544158 Sep 07 10:13:47.160681 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2631/5293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:46 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1461 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:47.170307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:47.171126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:47.185252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.186111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.186731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.187590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.188879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.189486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.432329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:47.441912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d86befd5-7237-4012-98a0-8a1647ec3360 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1201 microversion: 2.1 time: 0.279561 Sep 07 10:13:47.462328 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2632/5294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:47 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1201 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:47.467330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:47.467952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 1c0496fd-94ae-433f-b2dc-fb7834094202] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:47.493768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.494267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.495075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.495952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.496421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.496853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.503848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:47.516579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0ad63fb8-bd9f-4f55-8df8-30ba594dbb37 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.904616 Sep 07 10:13:47.529611 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2663/5295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:46 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:47.529710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] HTTP exception thrown: Instance 1c0496fd-94ae-433f-b2dc-fb7834094202 could not be found. Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Request method failure captured: Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 HTTP/1.1 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzHI4_Gs1AYCsuN-nstt6RfgCFlbQJx2Y7t1xTba8onie0D-p3dYmj4ETDluGw23VZ-TI88rSdpp2PKXSvonJ_41bjSbUVIF6F_z1PYTp7NtwRlUHYOB7Rv76Aw67_NCxbTeua_jq2FFTf93vJmiFWgHyHPh0TUMHb2J9KhW_fTKRU Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e080e21e856141b7850ea79bafd5b8e9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a8b10f41570421a9292168d0326bae0 Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 1c0496fd-94ae-433f-b2dc-fb7834094202 could not be found. Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1c0496fd-94ae-433f-b2dc-fb7834094202'} Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0496fd-94ae-433f-b2dc-fb7834094202 could not be found. Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0496fd-94ae-433f-b2dc-fb7834094202 could not be found. Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:47.530234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0496fd-94ae-433f-b2dc-fb7834094202 could not be found. Sep 07 10:13:47.538356 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:47.550129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Returning 404 to user: Instance 1c0496fd-94ae-433f-b2dc-fb7834094202 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:47.550929 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d1e88888-d368-4f40-adb5-c6a8706a0c60 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202" status: 404 len: 111 microversion: 2.1 time: 0.087523 Sep 07 10:13:47.551566 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2633/5296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:47 2022] GET /compute/v2.1/servers/1c0496fd-94ae-433f-b2dc-fb7834094202 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:47.564179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:47.565213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:47.583585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.584157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.586539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.588745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.590752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.591268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.637782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:47.795611 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d6c32fd5-9193-4227-ad70-e2fef1d0375e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "DELETE /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 204 len: 0 microversion: 2.1 time: 0.237922 Sep 07 10:13:47.798688 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2664/5297] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:47 2022] DELETE /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:47.807836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:47.808584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:47.816357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.819859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.820310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.821034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.821531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.822007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:47.948055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a8685d78-02cd-497f-a4a4-fdab67c5a905 req-4a66238f-9fda-4837-b149-fccd19bafe63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c85e31-5ebf-4d68-86e4-2bc538db9c19", "name": "network-vif-deleted", "tag": "0119c227-20b2-447c-be32-b99cc7b4f32a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:47.995869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a8685d78-02cd-497f-a4a4-fdab67c5a905 req-4a66238f-9fda-4837-b149-fccd19bafe63 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:47.996764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a8685d78-02cd-497f-a4a4-fdab67c5a905 req-4a66238f-9fda-4837-b149-fccd19bafe63 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:47.998187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a8685d78-02cd-497f-a4a4-fdab67c5a905 req-4a66238f-9fda-4837-b149-fccd19bafe63 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.044155 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a8685d78-02cd-497f-a4a4-fdab67c5a905 req-4a66238f-9fda-4837-b149-fccd19bafe63 service nova] Creating event network-vif-deleted:0119c227-20b2-447c-be32-b99cc7b4f32a for instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 on n-h1-836830-16 Sep 07 10:13:48.054876 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a8685d78-02cd-497f-a4a4-fdab67c5a905 req-4a66238f-9fda-4837-b149-fccd19bafe63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111309 Sep 07 10:13:48.057665 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2665/5298] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:48.105933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:48.116312 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0978d050-a187-4c8c-980c-3616cc988603 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1674 microversion: 2.1 time: 0.313251 Sep 07 10:13:48.117165 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2634/5299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:47 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1674 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:48.190298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:48.190940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:48.198363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.198879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.199484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.200332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.200810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.201296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.251414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.251923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.252573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.253045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lazy-loading 'fault' on Instance uuid 29c85e31-5ebf-4d68-86e4-2bc538db9c19 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:48.342127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:48.356934 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3df8c94b-cdf7-43b3-b156-8f9c0ca2fab0 tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1304 microversion: 2.1 time: 0.171191 Sep 07 10:13:48.358000 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2666/5300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:48 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:48.390137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-plugged", "status": "completed", "tag": "1deb90fb-3770-40e2-bcd5-1792f8c50565"}, {"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-plugged", "status": "completed", "tag": "4b1b6751-3edc-44fd-b523-9dcc75dcb238"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:48.418492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.419171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.419798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.448062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] Creating event network-vif-plugged:1deb90fb-3770-40e2-bcd5-1792f8c50565 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:48.448590 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] Creating event network-vif-plugged:4b1b6751-3edc-44fd-b523-9dcc75dcb238 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:48.454652 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-aa9d9f13-7ef9-4f75-af76-a1f8c5948b1a req-53f367a0-b943-41df-8f02-4c3eb8650e09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068179 Sep 07 10:13:48.455595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2635/5301] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:48.468964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:48.469707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:48.479281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.480364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.481220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.482300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.482902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.483997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.530856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.531730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.532559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.533426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lazy-loading 'fault' on Instance uuid a7fc9772-2919-4489-986b-53d881e1945e {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:48.550566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:48.551480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:48.569976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.570760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.571437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.586786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:48.588874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:48.589687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:48.590644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:48.607672 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-609c4b62-e3dc-4e27-8237-4a6dde586856 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 200 len: 1206 microversion: 2.1 time: 0.142554 Sep 07 10:13:48.624172 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2667/5302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:48 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 1206 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:48.849110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:48.861844 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6e9f5aa1-fc60-4dbf-a0d6-3448ae37b785 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.316060 Sep 07 10:13:48.863070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2636/5303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:48 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:49.140099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:49.141481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:49.154503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.155375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.156047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.161839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.162905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.163605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.220920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:49.221672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:49.250614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.258249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.259822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.266154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.269534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.271672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.332724 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] HTTP exception thrown: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Request method failure captured: Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd HTTP/1.1 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG0AZfJKTWp7EW-3orif81ghOr2tfmigR8fffyfX9KYJyxwLIkwttjwZ1WtRNSmFjxolqbmtngt3DpK9k1FQsRnM13LeJvO5xIK_--ULgG23YeAvniDJFsj3AoUbl9iW9dpNwWsqjBAp86Kek5tx4ad6z5VHh4S-R0K_WFtrgq64ICQ Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dcacc5aca3a4eaa8681cf3eee3633b3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6cb4a2e0094a4c90ae14626b946065e1 Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '32b1bd08-e57d-4438-8436-97be926bf5cd'} Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:49.345699 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Returning 404 to user: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:49.349926 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ffaae91-f80a-4863-a52e-4575f0a7a35c tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 404 len: 111 microversion: 2.20 time: 0.131024 Sep 07 10:13:49.351694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2637/5304] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:13:49 2022] DELETE /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:13:49.356795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:49.357454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 32b1bd08-e57d-4438-8436-97be926bf5cd] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:49.370098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.370603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.371052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.371789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.372238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.372674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.419708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] HTTP exception thrown: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Request method failure captured: Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd HTTP/1.1 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG0AZfJKTWp7EW-3orif81ghOr2tfmigR8fffyfX9KYJyxwLIkwttjwZ1WtRNSmFjxolqbmtngt3DpK9k1FQsRnM13LeJvO5xIK_--ULgG23YeAvniDJFsj3AoUbl9iW9dpNwWsqjBAp86Kek5tx4ad6z5VHh4S-R0K_WFtrgq64ICQ Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dcacc5aca3a4eaa8681cf3eee3633b3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6cb4a2e0094a4c90ae14626b946065e1 Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '32b1bd08-e57d-4438-8436-97be926bf5cd'} Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.421349 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Returning 404 to user: Instance 32b1bd08-e57d-4438-8436-97be926bf5cd could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:49.424931 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d1313eb-5b1c-4bbc-9ca3-dca5a52ff79d tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd" status: 404 len: 111 microversion: 2.20 time: 0.070083 Sep 07 10:13:49.427406 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2638/5305] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:49 2022] GET /compute/v2.1/servers/32b1bd08-e57d-4438-8436-97be926bf5cd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:13:49.432829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:49.438886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:49.455873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.456389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.456836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.458105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.462850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.466595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.554937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.555438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.556053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.556529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lazy-loading 'fault' on Instance uuid 29c85e31-5ebf-4d68-86e4-2bc538db9c19 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:49.788219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:49.805134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d30dc3c9-3496-45e6-8aef-182ef78f4766 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1674 microversion: 2.1 time: 0.661589 Sep 07 10:13:49.805847 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2668/5306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:49 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1674 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:49.828421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:49.829826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:49.847235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.858474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.861957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.863520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.864874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.866669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.903018 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e HTTP/1.1 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a7fc9772-2919-4489-986b-53d881e1945e'} Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:49.904776 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc439f58-0e47-4645-804b-51ea884160f1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 404 len: 111 microversion: 2.1 time: 0.092720 Sep 07 10:13:49.908367 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2669/5307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:49 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:49.912952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:49.913705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:49.920766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.921338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.921804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.922526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:49.929657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:49.930456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:49.935253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:49.996874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ba47d053f340d890b3be0e8d77284c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826ecd5ccfea4b1bb6d4e3e9958b272e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:50.013209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d4ac5b3f-a89b-48ed-a9e6-8fdbcaae399e tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 200 len: 1304 microversion: 2.1 time: 0.582458 Sep 07 10:13:50.014562 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2639/5308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:49 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 1304 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:50.685021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:50.709032 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e84a2ff-c2e3-4c2d-88f7-0469a32c8862 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.800655 Sep 07 10:13:50.733731 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2670/5309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:49 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:50.836519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:50.837629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:50.861696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:50.862204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:50.862646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:50.863372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:50.863878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:50.864812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:51.043333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:51.043985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] [instance: 29c85e31-5ebf-4d68-86e4-2bc538db9c19] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:51.070388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:51.070934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:51.071601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:51.072223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:51.072658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:51.073038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:51.135567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] HTTP exception thrown: Instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 could not be found. Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Request method failure captured: Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 HTTP/1.1 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG6Tefm75atIaFs6wnWWRPSAj-vMphhyqZon9OPqJ-8QdjYsVYhhQh34UbhWvSB6_mLcnwO_Q-2ln9vgcfQAQi_5QgHWKz5aw7d3gE48PL9Cz5txA_k1w6Y7iJsc1kvCPSrKiEpyXjTOgosYTD3gEBUoKpLekwzwS32bxhgijXLhPi0 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 826ecd5ccfea4b1bb6d4e3e9958b272e Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesActionsTest-426971703 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/826ecd5ccfea4b1bb6d4e3e9958b272e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/826ecd5ccfea4b1bb6d4e3e9958b272e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/826ecd5ccfea4b1bb6d4e3e9958b272e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_826ecd5ccfea4b1bb6d4e3e9958b272e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesActionsTest-426971703 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 826ecd5ccfea4b1bb6d4e3e9958b272e Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesActionsTest-426971703 Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesActionsTest-426971703-project Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: b4ba47d053f340d890b3be0e8d77284c Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesActionsTest-426971703-project Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 could not be found. Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '29c85e31-5ebf-4d68-86e4-2bc538db9c19'} Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 could not be found. Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 could not be found. Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:51.140407 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 could not be found. Sep 07 10:13:51.144524 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:51.150710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] Returning 404 to user: Instance 29c85e31-5ebf-4d68-86e4-2bc538db9c19 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:51.151761 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd75cae2-232d-4117-bb6f-c6391c24ff1f tempest-VolumesActionsTest-426971703 tempest-VolumesActionsTest-426971703-project] 10.222.0.60 "GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19" status: 404 len: 111 microversion: 2.1 time: 0.112402 Sep 07 10:13:51.152355 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2671/5310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:51 2022] GET /compute/v2.1/servers/29c85e31-5ebf-4d68-86e4-2bc538db9c19 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:13:51.752863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:51.753783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:51.784349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:51.785124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:51.786619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:51.792014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:51.793230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:51.797965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:51.986174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:52.002992 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8dd5d856-47b1-40da-85ca-7516e85868da tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1674 microversion: 2.1 time: 1.171351 Sep 07 10:13:52.017614 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2640/5311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:50 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1674 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:52.376631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:52.388500 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40d7b4b1-880b-4a4b-a02c-27370d1fed76 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1354 microversion: 2.1 time: 0.642673 Sep 07 10:13:52.407956 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2672/5312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:51 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1354 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:53.040742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:53.041596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:53.066022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:53.066529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:53.067027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:53.067778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:53.068240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:53.076134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:53.387059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:53.414719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:53.416437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:53.420906 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6dc60680-fa7b-48e7-82af-f6a697f3cb0d tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1607 microversion: 2.1 time: 0.386652 Sep 07 10:13:53.421523 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2641/5313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:53 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1607 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:53.435053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:53.435802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:53.436414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:53.437964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:53.438585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:53.439386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:53.839192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6fea8c78-776c-42d6-ac11-955de5b7c312 req-c1ab8962-2339-4b6b-aedf-40aecb1bff09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa25f-08f2-4a84-bf93-2a9a614ed126", "name": "network-vif-deleted", "tag": "404ca653-e286-41f3-9f40-74346acc0bda"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:53.872675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6fea8c78-776c-42d6-ac11-955de5b7c312 req-c1ab8962-2339-4b6b-aedf-40aecb1bff09 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:53.873378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6fea8c78-776c-42d6-ac11-955de5b7c312 req-c1ab8962-2339-4b6b-aedf-40aecb1bff09 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:53.874366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6fea8c78-776c-42d6-ac11-955de5b7c312 req-c1ab8962-2339-4b6b-aedf-40aecb1bff09 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:53.909994 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6fea8c78-776c-42d6-ac11-955de5b7c312 req-c1ab8962-2339-4b6b-aedf-40aecb1bff09 service nova] Creating event network-vif-deleted:404ca653-e286-41f3-9f40-74346acc0bda for instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 on n-h1-836830-16 Sep 07 10:13:53.922912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6fea8c78-776c-42d6-ac11-955de5b7c312 req-c1ab8962-2339-4b6b-aedf-40aecb1bff09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088628 Sep 07 10:13:53.924505 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2642/5314] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:54.023732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:54.047387 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4940d12a-7e6f-4266-8a1b-490ad83bfa96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1806 microversion: 2.1 time: 0.639158 Sep 07 10:13:54.051332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2673/5315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:53 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1806 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:54.079835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:54.080439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:54.112796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.113315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.113738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.114577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.115048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.115487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.205406 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a3b13c6a-5cc9-4fba-beb4-890d50af8a9d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535/ips" status: 200 len: 220 microversion: 2.1 time: 0.132147 Sep 07 10:13:54.206030 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2643/5316] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:13:54 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535/ips => generated 220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:54.218825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:54.219372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:54.239613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.240155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.240740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.246821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.251139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.253372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.341332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:13:54.449135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:54.455757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:54.479499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.492362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.492362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.492362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.492362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.492362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.508741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:54.525420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ebad5db-927b-447e-af9e-98f2ab7d28e4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 204 len: 0 microversion: 2.1 time: 0.310040 Sep 07 10:13:54.527269 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2674/5317] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:54 2022] DELETE /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:13:54.550265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:54.552126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:54.566011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.566770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.567718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.568824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.569509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.570188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.746595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:54.747105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:54.747558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:54.748098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lazy-loading 'fault' on Instance uuid 269aa25f-08f2-4a84-bf93-2a9a614ed126 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:55.043116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:55.059786 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3ed4d19-b837-4445-98fe-942e193e3081 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1329 microversion: 2.1 time: 0.611983 Sep 07 10:13:55.062134 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2644/5318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:54 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1329 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:55.088074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:55.117764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-426656fa-96c6-438a-b26f-4ca76b5a291b tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1812 microversion: 2.1 time: 0.580393 Sep 07 10:13:55.121356 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2675/5319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:54 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1812 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:13:55.758343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:55.758849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:55.785455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:55.800338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:55.800928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:55.804752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:55.806801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:55.807556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:55.857249 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 HTTP/1.1 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '79421056-6138-4f20-b1f9-4b6345e2ed15'} Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:55.870886 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.876027 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.880598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:55.883736 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1d030cef-18b7-453d-a4f7-e57bd9131991 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 404 len: 111 microversion: 2.1 time: 0.129773 Sep 07 10:13:55.891267 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2645/5320] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:55 2022] DELETE /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:55.894418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:55.895678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 79421056-6138-4f20-b1f9-4b6345e2ed15] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:55.911246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:55.922755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:55.923588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:55.924388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:55.930125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:55.930994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:55.966910 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 HTTP/1.1 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '79421056-6138-4f20-b1f9-4b6345e2ed15'} Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:55.968791 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance 79421056-6138-4f20-b1f9-4b6345e2ed15 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:55.972405 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e71730ac-e91b-4648-8a46-ee38cc2e5834 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15" status: 404 len: 111 microversion: 2.1 time: 0.079985 Sep 07 10:13:55.974576 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2676/5321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:55 2022] GET /compute/v2.1/servers/79421056-6138-4f20-b1f9-4b6345e2ed15 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:56.085206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:56.085914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:56.110909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:56.111531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:56.115894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:56.121887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:56.124633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:56.125330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:56.150768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:56.152101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:56.164958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:56.167612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:56.168287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:56.170705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:56.171511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:56.172173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:56.179277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:56.314986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:56.325256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:56.328750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:56.329331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lazy-loading 'fault' on Instance uuid 269aa25f-08f2-4a84-bf93-2a9a614ed126 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:13:57.107921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b10f41570421a9292168d0326bae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e080e21e856141b7850ea79bafd5b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:57.123396 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dfc133bc-a0bf-4946-9ce0-a183043f83a1 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 200 len: 1329 microversion: 2.1 time: 1.037717 Sep 07 10:13:57.125857 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2646/5322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:56 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 1329 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:57.191034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:57.191538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:57.202115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.208755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.209334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.210280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.216936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.218703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.295895 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a37cba88-d8ef-4a0c-a523-094e6387e21e tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/ips" status: 200 len: 149 microversion: 2.1 time: 0.108526 Sep 07 10:13:57.297209 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2647/5323] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:13:57 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/ips => generated 149 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:13:57.438580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:57.439220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:57.472392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.473640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.474650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.475245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.475805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.476561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.531123 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e HTTP/1.1 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a7fc9772-2919-4489-986b-53d881e1945e'} Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:57.538933 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.543447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.557892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:57.561414 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-38fdda08-7d09-4241-8371-4e4f420ff5e6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 404 len: 111 microversion: 2.1 time: 0.127957 Sep 07 10:13:57.566274 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2648/5324] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:13:57 2022] DELETE /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:57.581828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:57.594867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:57.621994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.625791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.626796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.630636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.635290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.637166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.760743 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] HTTP exception thrown: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Request method failure captured: Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff HTTP/1.1 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG0AZfJKTWp7EW-3orif81ghOr2tfmigR8fffyfX9KYJyxwLIkwttjwZ1WtRNSmFjxolqbmtngt3DpK9k1FQsRnM13LeJvO5xIK_--ULgG23YeAvniDJFsj3AoUbl9iW9dpNwWsqjBAp86Kek5tx4ad6z5VHh4S-R0K_WFtrgq64ICQ Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dcacc5aca3a4eaa8681cf3eee3633b3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6cb4a2e0094a4c90ae14626b946065e1 Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '216dfce6-78f0-4ed7-ab4b-eec1dde35dff'} Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:57.773541 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Returning 404 to user: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:57.777870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a8ffc7d9-193e-4898-a9bd-497db232b9e5 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 404 len: 111 microversion: 2.20 time: 0.205287 Sep 07 10:13:57.785660 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2649/5325] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:13:57 2022] DELETE /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:13:57.817907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:57.824332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a7fc9772-2919-4489-986b-53d881e1945e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:57.849930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.852198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.855575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.857960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:57.864727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:57.865563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:57.936162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e HTTP/1.1 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a7fc9772-2919-4489-986b-53d881e1945e'} Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:57.940516 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. Sep 07 10:13:57.944782 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:57.951170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance a7fc9772-2919-4489-986b-53d881e1945e could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:57.952500 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9005d976-8979-44ee-a530-6faf61c23341 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e" status: 404 len: 111 microversion: 2.1 time: 0.165691 Sep 07 10:13:57.959881 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2650/5326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:57 2022] GET /compute/v2.1/servers/a7fc9772-2919-4489-986b-53d881e1945e => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:57.998466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:58.003979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] [instance: 216dfce6-78f0-4ed7-ab4b-eec1dde35dff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:58.020739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:13:58.037749 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad450c37-5363-41a8-bfd0-6eaf3d9461d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1812 microversion: 2.1 time: 1.894488 Sep 07 10:13:58.050861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:58.058529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:58.071707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:58.071707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:58.071707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:58.071707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:58.073637 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2677/5327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:56 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1812 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:13:58.120430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-cdcd03f3-a1e2-41a7-a623-06dbe948f765 req-005ba123-cc8c-4e54-85f4-411521613db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-deleted", "tag": "1deb90fb-3770-40e2-bcd5-1792f8c50565"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:58.160047 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] HTTP exception thrown: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Request method failure captured: Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff HTTP/1.1 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG0AZfJKTWp7EW-3orif81ghOr2tfmigR8fffyfX9KYJyxwLIkwttjwZ1WtRNSmFjxolqbmtngt3DpK9k1FQsRnM13LeJvO5xIK_--ULgG23YeAvniDJFsj3AoUbl9iW9dpNwWsqjBAp86Kek5tx4ad6z5VHh4S-R0K_WFtrgq64ICQ Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dcacc5aca3a4eaa8681cf3eee3633b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dcacc5aca3a4eaa8681cf3eee3633b3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 3dcacc5aca3a4eaa8681cf3eee3633b3 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395075816 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6cb4a2e0094a4c90ae14626b946065e1 Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395075816-project Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '216dfce6-78f0-4ed7-ab4b-eec1dde35dff'} Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.163093 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. Sep 07 10:13:58.167983 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.171961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] Returning 404 to user: Instance 216dfce6-78f0-4ed7-ab4b-eec1dde35dff could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:58.173369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cdcd03f3-a1e2-41a7-a623-06dbe948f765 req-005ba123-cc8c-4e54-85f4-411521613db9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:58.176853 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91ffa263-799f-4387-8733-35c2bf45de01 tempest-AttachVolumeShelveTestJSON-1395075816 tempest-AttachVolumeShelveTestJSON-1395075816-project] 10.222.0.60 "GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff" status: 404 len: 111 microversion: 2.20 time: 0.210857 Sep 07 10:13:58.178101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cdcd03f3-a1e2-41a7-a623-06dbe948f765 req-005ba123-cc8c-4e54-85f4-411521613db9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:58.181110 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2651/5328] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:13:57 2022] GET /compute/v2.1/servers/216dfce6-78f0-4ed7-ab4b-eec1dde35dff => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:13:58.183621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cdcd03f3-a1e2-41a7-a623-06dbe948f765 req-005ba123-cc8c-4e54-85f4-411521613db9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:58.195355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:58.196374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] [instance: 269aa25f-08f2-4a84-bf93-2a9a614ed126] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:58.212909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:58.213683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:58.214365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:58.216976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:58.217917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:58.222255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:58.275747 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] HTTP exception thrown: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 could not be found. Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Request method failure captured: Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 HTTP/1.1 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzHI4_Gs1AYCsuN-nstt6RfgCFlbQJx2Y7t1xTba8onie0D-p3dYmj4ETDluGw23VZ-TI88rSdpp2PKXSvonJ_41bjSbUVIF6F_z1PYTp7NtwRlUHYOB7Rv76Aw67_NCxbTeua_jq2FFTf93vJmiFWgHyHPh0TUMHb2J9KhW_fTKRU Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e080e21e856141b7850ea79bafd5b8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e080e21e856141b7850ea79bafd5b8e9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e080e21e856141b7850ea79bafd5b8e9 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-1976199228 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6a8b10f41570421a9292168d0326bae0 Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-1976199228-project Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 could not be found. Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '269aa25f-08f2-4a84-bf93-2a9a614ed126'} Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 could not be found. Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 could not be found. Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:13:58.279047 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 could not be found. Sep 07 10:13:58.283593 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:13:58.289248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-cdcd03f3-a1e2-41a7-a623-06dbe948f765 req-005ba123-cc8c-4e54-85f4-411521613db9 service nova] Creating event network-vif-deleted:1deb90fb-3770-40e2-bcd5-1792f8c50565 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:13:58.290272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Returning 404 to user: Instance 269aa25f-08f2-4a84-bf93-2a9a614ed126 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:13:58.294195 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a17e2fa7-f5de-4d4b-8e91-988959e83251 tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126" status: 404 len: 111 microversion: 2.1 time: 0.111558 Sep 07 10:13:58.302874 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2652/5329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:58 2022] GET /compute/v2.1/servers/269aa25f-08f2-4a84-bf93-2a9a614ed126 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:13:58.328574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e37c47c0-9797-43f0-afdb-43860d1a9f2b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: .version_select at 0x7f14b116f310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-161723041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9wTngsuD5p7LKQMBVDVWHLGmAEZhzUdHWcYy4cgGAqorBjQE2Usr8fhqKhvtE8qXLbMJnaRcZsTinVN8ZBtji2xzHQh5yH3uTtpZZ3jqRTa22p9iR53i4hueNO/1oAnQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:13:58.336242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-cdcd03f3-a1e2-41a7-a623-06dbe948f765 req-005ba123-cc8c-4e54-85f4-411521613db9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214786 Sep 07 10:13:58.337159 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2678/5330] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 07 10:13:58.395599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-366f0b5b-72d0-4737-a21e-38bbfb2dc92e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] Calling method '.version_select at 0x7f14b0c564c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:58.425395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e37c47c0-9797-43f0-afdb-43860d1a9f2b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:13:58.453874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e37c47c0-9797-43f0-afdb-43860d1a9f2b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:13:58.468807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:13:58.507768 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-366f0b5b-72d0-4737-a21e-38bbfb2dc92e tempest-ServerActionsTestJSON-1976199228 tempest-ServerActionsTestJSON-1976199228-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520667217" status: 202 len: 0 microversion: 2.1 time: 0.165859 Sep 07 10:13:58.516235 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2679/5331] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520667217 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:13:58.568220 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e37c47c0-9797-43f0-afdb-43860d1a9f2b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.264118 Sep 07 10:13:58.570354 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2653/5332] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:13:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:13:59.101889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:13:59.103066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:13:59.133234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:59.134781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:59.138377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:13:59.140781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:13:59.143315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:13:59.148598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:00.056000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:00.072483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b4777bb-5690-45b3-99c6-ef7f69f86abd tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1632 microversion: 2.1 time: 0.973591 Sep 07 10:14:00.075900 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2680/5333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:13:59 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1632 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:00.498527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0afa6d97-89b1-48d1-b21c-0d844a9593de req-6036f8af-7d7a-4c86-8801-4e3bc9ab0045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-unplugged", "status": "completed", "tag": "4b1b6751-3edc-44fd-b523-9dcc75dcb238"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:00.512525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-65625cb0-e102-4c74-9a9c-57c076300acf req-43e42cef-c689-4a77-83a9-b799e81e166c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-deleted", "tag": "ef3137da-bab2-4213-82ee-18825381ab6e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:00.562199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-65625cb0-e102-4c74-9a9c-57c076300acf req-43e42cef-c689-4a77-83a9-b799e81e166c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:00.571031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-65625cb0-e102-4c74-9a9c-57c076300acf req-43e42cef-c689-4a77-83a9-b799e81e166c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:00.575163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-65625cb0-e102-4c74-9a9c-57c076300acf req-43e42cef-c689-4a77-83a9-b799e81e166c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:00.610406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0afa6d97-89b1-48d1-b21c-0d844a9593de req-6036f8af-7d7a-4c86-8801-4e3bc9ab0045 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:00.617220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0afa6d97-89b1-48d1-b21c-0d844a9593de req-6036f8af-7d7a-4c86-8801-4e3bc9ab0045 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:00.618263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0afa6d97-89b1-48d1-b21c-0d844a9593de req-6036f8af-7d7a-4c86-8801-4e3bc9ab0045 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:00.639078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-65625cb0-e102-4c74-9a9c-57c076300acf req-43e42cef-c689-4a77-83a9-b799e81e166c service nova] Creating event network-vif-deleted:ef3137da-bab2-4213-82ee-18825381ab6e for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:14:00.646488 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-65625cb0-e102-4c74-9a9c-57c076300acf req-43e42cef-c689-4a77-83a9-b799e81e166c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137191 Sep 07 10:14:00.647676 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2681/5334] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:14:00.780309 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0afa6d97-89b1-48d1-b21c-0d844a9593de req-6036f8af-7d7a-4c86-8801-4e3bc9ab0045 service nova] Creating event network-vif-unplugged:4b1b6751-3edc-44fd-b523-9dcc75dcb238 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:14:00.796717 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0afa6d97-89b1-48d1-b21c-0d844a9593de req-6036f8af-7d7a-4c86-8801-4e3bc9ab0045 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.310780 Sep 07 10:14:00.797396 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2654/5335] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:01.105004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:01.106488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:01.124172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:01.125658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:01.126137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:01.129059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:01.130361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:01.132043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:01.624919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:01.637778 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4da2be6-55a1-4bb0-8376-78276a91845c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1496 microversion: 2.1 time: 0.537827 Sep 07 10:14:01.638397 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2682/5336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:01 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1496 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:01.690217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70fc49fe-4f15-408f-9fb4-3dfbd3760c69"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:01.696679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:01.716781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:01.718629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:01.719826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:01.724742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:01.725714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:01.728468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:02.475758 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-479efed1-fb16-4bdc-8d85-8d8ec84565ff tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "POST /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791036 Sep 07 10:14:02.490224 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2655/5337] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:14:01 2022] POST /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:02.676753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:02.677803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:02.693763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:02.696560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:02.696857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:02.697799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:02.706666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:02.706850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a7c15fec-6e25-4a1a-bcb9-89a6ed343fd5 req-43b3ed12-9b3c-484e-9e68-100c09344b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf8bcd5-41e5-427c-8ca2-b0418a282535", "name": "network-vif-deleted", "tag": "4b1b6751-3edc-44fd-b523-9dcc75dcb238"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:02.707949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:02.744103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a7c15fec-6e25-4a1a-bcb9-89a6ed343fd5 req-43b3ed12-9b3c-484e-9e68-100c09344b3c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:02.757516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a7c15fec-6e25-4a1a-bcb9-89a6ed343fd5 req-43b3ed12-9b3c-484e-9e68-100c09344b3c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:02.758272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a7c15fec-6e25-4a1a-bcb9-89a6ed343fd5 req-43b3ed12-9b3c-484e-9e68-100c09344b3c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:02.828446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a7c15fec-6e25-4a1a-bcb9-89a6ed343fd5 req-43b3ed12-9b3c-484e-9e68-100c09344b3c service nova] Creating event network-vif-deleted:4b1b6751-3edc-44fd-b523-9dcc75dcb238 for instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 on n-h1-836830-16 Sep 07 10:14:02.851432 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a7c15fec-6e25-4a1a-bcb9-89a6ed343fd5 req-43b3ed12-9b3c-484e-9e68-100c09344b3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150032 Sep 07 10:14:02.855611 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2656/5338] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:02.880621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:02.886590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:02.888598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:02.889106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lazy-loading 'fault' on Instance uuid 4bf8bcd5-41e5-427c-8ca2-b0418a282535 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:14:03.088609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:03.096502 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7daf7ba4-6605-4a62-8c5a-904dc9c994d1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 200 len: 1302 microversion: 2.1 time: 0.424084 Sep 07 10:14:03.102527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2683/5339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:02 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 1302 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:04.136617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:04.137863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:04.164933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:04.166194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:04.170665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:04.182428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:04.187526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:04.190865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:04.239627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] HTTP exception thrown: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Request method failure captured: Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 HTTP/1.1 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG6wY-ZAm3vH3e5enDbEnvqrW0JASB-35PNmvyAd7YC6woCX6QPz-KLrr-t3HpkeEhkHN00gXv6m3xpSDC-RcNPKGSxixXVlcntVKruO81w6HixdXH2hkwvpUWIYqYIgeWCjHkZitWfB9pcqSIXF2IHlCRbvfr5pkw6gNjozPheNE1E Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21db58d08d3548439c5a2426cb3e8cca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestMultiNic-27353088 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestMultiNic-27353088-project Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 695925f2661b4399b48b76c2d57c3a3c Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestMultiNic-27353088-project Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4bf8bcd5-41e5-427c-8ca2-b0418a282535'} Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:04.245497 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:04.250479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Returning 404 to user: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:14:04.251244 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8937a24-33c8-4e73-a179-6d445b830cd9 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 404 len: 111 microversion: 2.1 time: 0.123234 Sep 07 10:14:04.254659 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2657/5340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:04 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:14:09.122177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f172dc7-8878-4e03-bbc4-a8c277c1daf9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Action: 'create', calling method: .version_select at 0x7f14b0843790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-284265718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAuJeetiWwjCoRAzRZ6eJh5fZ1s3B4NS3uFETCwOI5L1gwqLWOVHtfxAvyCGLdY+ZEaoSq0M2s5j7NtS1UJWwKXJoMNE/yMQXEmsZiMebk47/l46fLrTmMgFBRyPDbncQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:09.161092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2f172dc7-8878-4e03-bbc4-a8c277c1daf9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Getting quotas for project c25592ca4dca40b49fe664804d13b84a. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:09.185309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2f172dc7-8878-4e03-bbc4-a8c277c1daf9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Getting quotas for user dcb05ab7bca64333b3daff1f50e3a8e9 and project c25592ca4dca40b49fe664804d13b84a. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:09.276395 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f172dc7-8878-4e03-bbc4-a8c277c1daf9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.841666 Sep 07 10:14:09.283880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2684/5341] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:14:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:18.142487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:18.147074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:18.156774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:18.377692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b511a500-4bf7-4b25-9dc6-e2f4a0a9c701 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Action: 'create', calling method: .version_select at 0x7f14b06f1160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2036757581"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:19.085285 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b511a500-4bf7-4b25-9dc6-e2f4a0a9c701 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.948881 Sep 07 10:14:19.086648 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2658/5342] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Sep 7 10:14:18 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 951 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 10:14:19.109823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41c47b74-dc2d-481a-8b1a-4cb11e48c9d3 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b096fe50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:19.136706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:19.188738 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41c47b74-dc2d-481a-8b1a-4cb11e48c9d3 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 200 len: 345 microversion: 2.1 time: 0.083009 Sep 07 10:14:19.197508 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2685/5343] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:19 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:20.205481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c771fb2f-5e02-419c-baf1-d80aca1038d5 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0b75430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:21.106538 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c771fb2f-5e02-419c-baf1-d80aca1038d5 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 200 len: 345 microversion: 2.1 time: 0.906354 Sep 07 10:14:21.108251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2659/5344] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:20 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 345 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:21.398408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:21.400508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:21.782287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2096264964", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": "none"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:22.126904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3cec59ba-7abf-4590-9cbe-efcd84af4e42 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b071a160>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:22.319547 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3cec59ba-7abf-4590-9cbe-efcd84af4e42 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 200 len: 346 microversion: 2.1 time: 0.199548 Sep 07 10:14:22.322826 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2660/5345] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:22 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:14:22.335621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d92143d7-c6c8-450d-8221-afd32b06f614 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Action: 'create', calling method: .version_select at 0x7f14b0908670>, body: {"snapshot": {"volume_id": "ce83c7e2-0121-445a-9022-b5031e6abbd6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-829817158"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:22.914700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d92143d7-c6c8-450d-8221-afd32b06f614 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.583481 Sep 07 10:14:22.918598 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2661/5346] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Sep 7 10:14:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:14:22.927264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-35400005", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "1ddab740-faaa-4691-b6ac-a85ab7b919ad"}, {"uuid": "7e251b8a-7d21-4b8b-b9fa-1c80817b372d"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:31.804219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:32.953922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:34.890648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:14:34.890648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:14:34.890648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:14:34.890648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:14:34.890648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:14:34.921464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] validate_networks() for [('1ddab740-faaa-4691-b6ac-a85ab7b919ad', None, None, None, None, None), ('7e251b8a-7d21-4b8b-b9fa-1c80817b372d', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:14:34.944544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:34.946823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:34.948917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:34.949920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:34.956033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:34.956790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:35.002833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Getting quotas for project bce2a50ea31745398fd22d8f18d5b035. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:35.018315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Getting quotas for user 352cee065c98457785dbc7856066cd57 and project bce2a50ea31745398fd22d8f18d5b035. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:35.051974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:14:35.061057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:14:35.179482 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1573717-5534-499b-91f2-7c057b221b86 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 13.782920 Sep 07 10:14:35.180171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2686/5347] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 7 10:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 13787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 10:14:35.196207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:35.199118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:35.223429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:35.223951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:35.224411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:35.236426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:35.239554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:35.240389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:35.538795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lazy-loading 'services' on Instance uuid a5636944-261f-4fba-8d05-de3cf0423eb9 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:14:35.732664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34f2e079-dfb5-44cb-b188-16052185fe88 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments/70fc49fe-4f15-408f-9fb4-3dfbd3760c69" status: 202 len: 0 microversion: 2.1 time: 0.547964 Sep 07 10:14:35.751983 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2687/5348] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:14:35 2022] DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments/70fc49fe-4f15-408f-9fb4-3dfbd3760c69 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:14:35.771850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21d3eb10-42f0-4161-b5a2-774c70c2669a tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b09ce0d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:35.927552 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21d3eb10-42f0-4161-b5a2-774c70c2669a tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 200 len: 287 microversion: 2.1 time: 0.173793 Sep 07 10:14:35.928275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2688/5349] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:14:35 2022] GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:35.945834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1752326549-access_point-1141918158", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "b9ed0d1e-b78c-4522-b48c-fbd95d8f9f61"}], "key_name": "tempest-TestSecurityGroupsBasicOps-284265718", "security_groups": [{"name": "tempest-secgroup_access--1684842632"}, {"name": "tempest-secgroup_general--1059649509"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:37.031013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] validate_networks() for [('b9ed0d1e-b78c-4522-b48c-fbd95d8f9f61', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:14:37.846339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:14:37.846935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:14:37.848547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:14:37.848985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:14:37.849440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:14:37.874623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:37.878951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:37.879424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:37.880255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:37.880726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:37.890220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:37.955281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Getting quotas for project 21db58d08d3548439c5a2426cb3e8cca. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:37.966527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Getting quotas for user 695925f2661b4399b48b76c2d57c3a3c and project 21db58d08d3548439c5a2426cb3e8cca. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:38.002098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:14:38.008524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:14:38.138882 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9b5674b9-e6f5-4b54-ae43-5c76ff834eb0 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.218723 Sep 07 10:14:38.139904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2662/5350] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 15220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:14:38.153634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5193a7b3-2650-434c-8cae-06aff045c909 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'create', calling method: .version_select at 0x7f14b0b75550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1477628023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp3+FKcpTUTBT4RnO4DymsIDqs4dw8s5fH8Km8Dyb4cBDyYKdjrtJqfkGOweXAV88+g5LfBe5d7N6+FQcfTqq6GrEhA4dVX3JPHAuwm8o/lXxl66uByYojUd5soGyPAcQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:38.206210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5193a7b3-2650-434c-8cae-06aff045c909 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:38.223136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5193a7b3-2650-434c-8cae-06aff045c909 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for user f569c9d96f2045ba979a4fb85fa3acb2 and project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:38.279865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5193a7b3-2650-434c-8cae-06aff045c909 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.137919 Sep 07 10:14:38.280908 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2663/5351] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:14:38 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:38.290854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:38.292359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:38.318806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:38.321218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:38.321905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:38.323572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:38.325342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:38.326029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:38.638712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:38.655228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:38.663945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:38.674000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b443233-5e94-4528-8b8c-8ca2483b99f1 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 200 len: 1351 microversion: 2.47 time: 0.387265 Sep 07 10:14:38.698194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:14:38.698731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:14:38.699340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:14:38.699973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:14:38.700487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:14:38.705695 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2664/5352] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:14:38 2022] GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 1351 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:14:38.725782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:38.727458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:38.730933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:38.732130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:38.741735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:38.742393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:38.744189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:38.745719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:38.760113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:38.760113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:38.760113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:38.760113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:38.760532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:38.760707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:38.815905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Getting quotas for project c25592ca4dca40b49fe664804d13b84a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:38.841481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Getting quotas for user dcb05ab7bca64333b3daff1f50e3a8e9 and project c25592ca4dca40b49fe664804d13b84a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:38.870624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:14:38.873043 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27888644-1da4-44c5-b384-e14a61fa5c05 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164291 Sep 07 10:14:38.874352 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2665/5353] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:38 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:38.884744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ef1ee6c3-3711-4d8c-b4fe-de82bd12c9f0 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b126b430>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:38.897852 n-d-836830-16 devstack@n-api.service[128832]: WARNING nova.utils [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1752326549-access_point-1141918158 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1752326549-ac Sep 07 10:14:38.899987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:14:39.022015 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ef1ee6c3-3711-4d8c-b4fe-de82bd12c9f0 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.146111 Sep 07 10:14:39.025933 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2666/5354] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 7 10:14:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:39.039077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-439ee62b-fd77-46c0-adc9-1990a0b7cc7a tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.040806 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b863518-0489-402c-b514-d227f310de93 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 3.111546 Sep 07 10:14:39.041799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-439ee62b-fd77-46c0-adc9-1990a0b7cc7a tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:39.058982 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2689/5355] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:14:35 2022] POST /compute/v2.1/servers => generated 458 bytes in 3130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:14:39.083068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f1a3d22b-e3c5-4238-9571-e97e212c3680 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0997820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.180625 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f1a3d22b-e3c5-4238-9571-e97e212c3680 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 200 len: 287 microversion: 2.1 time: 0.118001 Sep 07 10:14:39.182014 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2690/5356] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:14:39 2022] GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:39.194983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-04c2236e-a75e-4683-9283-061e2112e25a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.197230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-04c2236e-a75e-4683-9283-061e2112e25a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:39.337746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-439ee62b-fd77-46c0-adc9-1990a0b7cc7a tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:39.346352 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-439ee62b-fd77-46c0-adc9-1990a0b7cc7a tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1211 microversion: 2.1 time: 0.317437 Sep 07 10:14:39.347755 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2667/5357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:39 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1211 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:39.368624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27b49527-1a3b-486f-8798-3848e5d2b2d2 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0b751f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.429580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-04c2236e-a75e-4683-9283-061e2112e25a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:39.447121 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-04c2236e-a75e-4683-9283-061e2112e25a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1294 microversion: 2.1 time: 0.263060 Sep 07 10:14:39.449852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2691/5358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:39 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1294 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:39.570408 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27b49527-1a3b-486f-8798-3848e5d2b2d2 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 202 len: 0 microversion: 2.1 time: 0.216922 Sep 07 10:14:39.571010 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2668/5359] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 7 10:14:39 2022] DELETE /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:14:39.579812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2e93cef-a736-49b6-9eb8-009fc1934bca tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0997670>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.683020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2e93cef-a736-49b6-9eb8-009fc1934bca tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 200 len: 286 microversion: 2.1 time: 0.107556 Sep 07 10:14:39.683926 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2692/5360] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:14:39 2022] GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:39.703618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.704343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:39.732820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:39.733025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:39.733490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:39.734203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:39.734659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:39.755481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:39.888444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:39.892416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:39.923138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:39.923646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:39.924298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:39.925260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:39.926225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:39.926922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:40.020010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-acb6a78c-1b48-44c3-b5da-787248ab4b56 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136367 Sep 07 10:14:40.025069 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2693/5361] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:39 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:40.159453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:40.188251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:40.197792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:40.202618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94406d27-27f8-4b0f-8301-f7f6e0a398c8 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 200 len: 1339 microversion: 2.47 time: 0.504246 Sep 07 10:14:40.207966 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2669/5362] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:14:39 2022] GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 1339 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 10:14:40.372352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:40.381436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:40.402500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:40.405329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:40.405826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:40.406590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:40.407074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:40.412917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:40.476358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:40.476973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:40.490982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:40.498540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:40.499261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:40.501587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:40.502850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:40.506564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:40.631526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:40.658632 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-77a71689-6ebe-43cd-8f9d-050c41229baa tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1263 microversion: 2.1 time: 0.282132 Sep 07 10:14:40.662102 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2694/5363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:40 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1263 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:40.698125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1df68938-ef77-40a7-986f-d53713b499f4 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0896e50>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:40.728797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:40.747452 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-980ed34f-b131-471a-97b5-01b61ddc77df tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1298 microversion: 2.1 time: 0.275152 Sep 07 10:14:40.759367 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2670/5364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:40 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:14:40.788157 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1df68938-ef77-40a7-986f-d53713b499f4 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 200 len: 286 microversion: 2.1 time: 0.095049 Sep 07 10:14:40.790402 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2695/5365] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:14:40 2022] GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:14:41.042433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:41.060527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:41.086371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.087295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.087993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.092242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.093158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.093820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.193353 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15b5ed73-c134-4a6c-a059-35f622e56d11 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160781 Sep 07 10:14:41.201511 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2671/5366] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:41 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:41.248321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:41.248956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:41.277893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.278584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.279064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.279824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.280301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.293560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.551889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:41.568853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:41.584379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:41.591121 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcbaf2fb-f7a0-4048-b0f6-a8bd252b2739 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 200 len: 1360 microversion: 2.47 time: 0.358921 Sep 07 10:14:41.620383 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2696/5367] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:14:41 2022] GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 1360 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:14:41.626675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1537072129"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:41.642970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:41.687529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.688030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.688473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.693517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:41.696083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:41.706823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.713770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.717387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.721683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.737023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.745373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:41.748490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:41.751329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:41.758252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.106010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:42.125843 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-69ffe82b-3d71-4824-a25e-f428580c37cf tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1269 microversion: 2.1 time: 0.437210 Sep 07 10:14:42.126494 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2697/5368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:41 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1269 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:42.155846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:42.163293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:42.199162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:42.202770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:42.205583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.205583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:42.212755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:42.220235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.539514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:42.559649 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-77596362-4ef4-4948-8598-3bf5a0a15679 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1346 microversion: 2.1 time: 0.423202 Sep 07 10:14:42.564795 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2698/5369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:42 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1346 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:42.593847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-86c94243-beb3-45dd-a6a2-dedefd98fbe0 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b099c430>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:42.707245 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-86c94243-beb3-45dd-a6a2-dedefd98fbe0 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 200 len: 286 microversion: 2.1 time: 0.140612 Sep 07 10:14:42.708477 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2699/5370] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:14:42 2022] GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:42.714981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:42.724277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2747885d-8296-4f77-8af2-b21e92e4f3ff tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "POST /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db/action" status: 202 len: 52 microversion: 2.47 time: 1.098738 Sep 07 10:14:42.734740 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2672/5371] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 7 10:14:41 2022] POST /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db/action => generated 52 bytes in 1113 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 07 10:14:42.738660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:42.760536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:42.768525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:42.782103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:42.784483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:42.790960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.794669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:42.797006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:42.802015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.802227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:42.802599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:42.806429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.810589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:42.811537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:42.814769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:42.931641 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4eae1892-ecd5-4010-830a-23de74c31b73 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221774 Sep 07 10:14:42.932786 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2700/5372] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:42 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:42.971058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:14:43.163838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:43.165650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:43.193219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:43.195756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:43.200540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:43.202645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:43.207616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:43.209907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:43.233299 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a1aa177-825c-4ef4-8c98-02ea9e5588c9 tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 204 len: 0 microversion: 2.47 time: 0.495409 Sep 07 10:14:43.239290 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2673/5373] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 7 10:14:42 2022] DELETE /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 10:14:43.248559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-266533409", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "ed5197f1-f30c-4c93-b6b8-f94dfa08d59f"}], "key_name": "tempest-TestNetworkBasicOps-1477628023", "security_groups": [{"name": "tempest-secgroup-smoke-1386772829"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:43.481525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:43.496480 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4489ed91-07f3-4f20-bcfc-7f7dc728aadc tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1269 microversion: 2.1 time: 0.341466 Sep 07 10:14:43.520853 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2701/5374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:43 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1269 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:43.539700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:43.540773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:43.561056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:43.561980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:43.566390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:43.567908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:43.569767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:43.570408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:43.795060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:43.810484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:43.827915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:43.832272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05d634a6-f567-462d-b2cf-fd1c5681aacf tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 200 len: 1366 microversion: 2.47 time: 0.303745 Sep 07 10:14:43.854339 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2702/5375] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:14:43 2022] GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:14:43.867259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:43.867941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:43.875900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:43.876426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:43.876893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:43.877681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:43.878842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:43.879299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:44.403875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] validate_networks() for [('ed5197f1-f30c-4c93-b6b8-f94dfa08d59f', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:14:44.692215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:44.704030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1da8e44d-8175-4a47-8e55-fb3c3029a00b tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1352 microversion: 2.1 time: 0.847975 Sep 07 10:14:44.707943 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2703/5376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:43 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1352 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:44.741980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54c7c2c8-6110-45ca-9209-f31ff56ca352 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b08929d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:44.807461 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-54c7c2c8-6110-45ca-9209-f31ff56ca352 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] HTTP exception thrown: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54c7c2c8-6110-45ca-9209-f31ff56ca352 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Request method failure captured: Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 HTTP/1.1 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG75Oa_-9i3-Lg8wn3C61ywyeVArpgs68bOKwdNqj8jELE9aHkrzjBIoPD6By7j9ifoBRMoNoiVrTdRhMDDUtk5amJ3vgbkXIAUcxdlvKWeP4uLszK7wfEAHVeExUrM5EiQrZ0ew950_3G1E7PUDOyfXOODAbNvDCfBrApOlWtmzPK8 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f7e0f415da5a4fd6bd554df885c4a74d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6c8fbf4cac084180ba532e169b936c54 Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: exception: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '84684448-7adc-418d-a906-045364d5e7f4'} Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. (HTTP 404) (Request-ID: req-b7c50721-15d0-4ed9-a1d9-d59f98fc4297) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:14:44.825125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54c7c2c8-6110-45ca-9209-f31ff56ca352 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Returning 404 to user: Snapshot 84684448-7adc-418d-a906-045364d5e7f4 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:14:44.830138 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54c7c2c8-6110-45ca-9209-f31ff56ca352 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4" status: 404 len: 111 microversion: 2.1 time: 0.099901 Sep 07 10:14:44.833373 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2704/5377] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:14:44 2022] GET /compute/v2.1/os-snapshots/84684448-7adc-418d-a906-045364d5e7f4 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:14:44.844318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:44.861329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:44.873865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:44.878633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:44.879549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:44.880353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:44.880859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:44.881354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:44.979290 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c44b3716-cf9c-45dc-a579-768bd47933c2 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145322 Sep 07 10:14:44.980216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2705/5378] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:44 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:44.985313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:44.985951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:44.993725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:44.994233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:44.994693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:44.995947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:44.996083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:44.996554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:46.771676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:46.788182 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-770bae10-37b5-442e-a608-6812cbbcd5d5 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1311 microversion: 2.1 time: 1.806715 Sep 07 10:14:46.793281 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2706/5379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:44 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1311 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:46.798061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-411a7526-a98e-4da4-a789-bc1a61582e9d tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b082d8b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:46.989675 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-411a7526-a98e-4da4-a789-bc1a61582e9d tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 202 len: 0 microversion: 2.1 time: 0.194697 Sep 07 10:14:46.990674 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2707/5380] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:14:46 2022] DELETE /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:14:46.998976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:47.000014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:47.046250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:47.047114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:47.048138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:47.049071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:47.049762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:47.050483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:47.714481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:47.724827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:47.734451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '352cee065c98457785dbc7856066cd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce2a50ea31745398fd22d8f18d5b035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:47.735724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bda63c95-476b-49f6-adf2-a6d8ac3cdfcd tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 200 len: 1366 microversion: 2.47 time: 0.741194 Sep 07 10:14:47.748423 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2708/5381] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:14:46 2022] GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 1366 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 10:14:47.755275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:47.755919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:47.801924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:47.808331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:47.819077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:47.820802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:47.822929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:47.828902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:47.930181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:48.720687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:48.731898 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca8e0b89-fd55-446a-9981-fe7dc0f963d9 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1472 microversion: 2.1 time: 0.982205 Sep 07 10:14:48.738152 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2709/5382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:47 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1472 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:48.752115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:48.757652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:48.773642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:48.774495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:48.775173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:48.779609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:48.780340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:48.780987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:48.784049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:48.897604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba40559e-6ebe-48aa-8dfe-c9f0555c9298 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156423 Sep 07 10:14:48.906232 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2710/5383] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:48 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:48.914220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a97ad934-6c1a-4091-b2aa-8b66fdfb2ad3 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0855af0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:49.020199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:14:49.022171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:14:49.022171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:14:49.022171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:14:49.022961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:14:49.055313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.059538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.060540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.064049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.068703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.070971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.088965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a97ad934-6c1a-4091-b2aa-8b66fdfb2ad3 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 200 len: 345 microversion: 2.1 time: 0.178440 Sep 07 10:14:49.090832 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2711/5384] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:48 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:49.096266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d125232e-9118-4061-8b46-74d3bbd1e9f4 req-e9bca432-04e5-45f4-bd2c-b21cba274987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c04ed6c-bc7e-4e72-9f48-cc88ebc18342", "tag": "703c3eb9-a941-4729-b1c1-3f6874b67ff8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:49.143463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d125232e-9118-4061-8b46-74d3bbd1e9f4 req-e9bca432-04e5-45f4-bd2c-b21cba274987 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.149547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d125232e-9118-4061-8b46-74d3bbd1e9f4 req-e9bca432-04e5-45f4-bd2c-b21cba274987 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.157878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d125232e-9118-4061-8b46-74d3bbd1e9f4 req-e9bca432-04e5-45f4-bd2c-b21cba274987 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.183567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:49.204793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:49.219817 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d125232e-9118-4061-8b46-74d3bbd1e9f4 req-e9bca432-04e5-45f4-bd2c-b21cba274987 service nova] Creating event network-changed:703c3eb9-a941-4729-b1c1-3f6874b67ff8 for instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 on n-h2-836830-16 Sep 07 10:14:49.236317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for user f569c9d96f2045ba979a4fb85fa3acb2 and project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:49.244313 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d125232e-9118-4061-8b46-74d3bbd1e9f4 req-e9bca432-04e5-45f4-bd2c-b21cba274987 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151870 Sep 07 10:14:49.249733 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2712/5385] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:49.269854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:49.271358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:49.295030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.296166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.298457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.302547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.304616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.306430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.330876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:14:49.339898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:14:49.444255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:49.542494 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b02139b1-6287-47be-99a9-e770654f605b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 6.300915 Sep 07 10:14:49.543180 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2674/5386] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:14:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 6302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:14:49.559769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:49.562277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] [instance: c48c0593-65f6-4fac-bd53-b3241335e8db] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:49.577722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.583284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.583915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.584630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:49.593986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:49.598182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:49.651147 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] HTTP exception thrown: Instance c48c0593-65f6-4fac-bd53-b3241335e8db could not be found. Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Request method failure captured: Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db HTTP/1.1 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG7832HLcvAwHByoC-BNOzUiSfBS_45UvkwrUJgD71CF7Zk1oglJWwqDMGKLhr8J-kSOlmlOB_ecExEogRE6lMJg_RGZLyLIp5RLdIObA84umsY8C9cH8Tl3YzHIp03QYKZgWQZ7uvDkQlXjhjVqeqvZgt49zwqVFSSwS_Pt_faCOCc Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Openstack-Nova-Api-Version: 2.47 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: bce2a50ea31745398fd22d8f18d5b035 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAaction247Test-460760381 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bce2a50ea31745398fd22d8f18d5b035"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bce2a50ea31745398fd22d8f18d5b035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bce2a50ea31745398fd22d8f18d5b035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bce2a50ea31745398fd22d8f18d5b035", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAaction247Test-460760381 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: bce2a50ea31745398fd22d8f18d5b035 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAaction247Test-460760381 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAaction247Test-460760381-project Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 352cee065c98457785dbc7856066cd57 Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAaction247Test-460760381-project Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance c48c0593-65f6-4fac-bd53-b3241335e8db could not be found. Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'c48c0593-65f6-4fac-bd53-b3241335e8db'} Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48c0593-65f6-4fac-bd53-b3241335e8db could not be found. Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48c0593-65f6-4fac-bd53-b3241335e8db could not be found. Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:49.652851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48c0593-65f6-4fac-bd53-b3241335e8db could not be found. Sep 07 10:14:49.657694 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:49.659320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] Returning 404 to user: Instance c48c0593-65f6-4fac-bd53-b3241335e8db could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:14:49.661105 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-584e2518-f41b-415e-b397-077f90d1312d tempest-ServersAaction247Test-460760381 tempest-ServersAaction247Test-460760381-project] 10.222.0.60 "GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db" status: 404 len: 111 microversion: 2.47 time: 0.114229 Sep 07 10:14:49.668077 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2675/5387] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 7 10:14:49 2022] GET /compute/v2.1/servers/c48c0593-65f6-4fac-bd53-b3241335e8db => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:14:49.687688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b313ae83-c471-4b6b-88aa-32056f31d405 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:49.688335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b313ae83-c471-4b6b-88aa-32056f31d405 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:50.117807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b313ae83-c471-4b6b-88aa-32056f31d405 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:50.147305 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b313ae83-c471-4b6b-88aa-32056f31d405 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1248 microversion: 2.1 time: 0.472323 Sep 07 10:14:50.149261 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2676/5388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:49 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1248 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:50.196793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:50.202194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:50.277118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:50.278008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:50.278694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:50.279500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:50.279996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:50.280448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:50.391862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:50.419105 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e7834fe-34cd-4106-99a3-39986592b610 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 1.166590 Sep 07 10:14:50.423654 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2713/5389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:49 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:50.448315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:50.461110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:50.497063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:50.497819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:50.498308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:50.499101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:50.499596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:50.500054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:50.635808 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc698d8d-b16b-4bea-897c-f9ba386db9b9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210839 Sep 07 10:14:50.638330 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2714/5390] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:50 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:50.654124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e7bbfaa-e2e4-4549-8cb8-1d7a030adc2f tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b0988820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:50.879281 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e7bbfaa-e2e4-4549-8cb8-1d7a030adc2f tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 200 len: 345 microversion: 2.1 time: 0.235336 Sep 07 10:14:50.880264 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2715/5391] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:50 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 345 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:51.173413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:51.174440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:51.185128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:51.191464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:51.192286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:51.193343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:51.194041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:51.194659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:51.468561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:51.478182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:51.491719 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cfc87124-f613-480e-a933-e9dfb68a62fb tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1252 microversion: 2.1 time: 0.323091 Sep 07 10:14:51.493474 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2716/5392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:51 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:51.498533 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-211569df-13a4-4099-9e4b-abb5cf7d2cb0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1472 microversion: 2.1 time: 1.346656 Sep 07 10:14:51.501379 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2677/5393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:50 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1472 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:51.505751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:51.506592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:51.518064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:51.522077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:51.522834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:51.532555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:51.532555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:51.532555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:51.652274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:51.655254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:51.696431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:51.697534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:51.698372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:51.701462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:51.703368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:51.703848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:51.789768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b2d2102-90f2-4ac2-ad56-74d6227f35d9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142230 Sep 07 10:14:51.800243 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2678/5394] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:14:51 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 10:14:51.896655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8eb63be8-c726-4a21-b5ee-e3a81582ae86 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b18cdc10>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:51.983312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:51.999331 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-603e66ed-44dd-485e-a6d8-9e1733f930b3 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 0.504543 Sep 07 10:14:52.000035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2717/5395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:51 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:52.013265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:52.013804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:52.027677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8eb63be8-c726-4a21-b5ee-e3a81582ae86 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 200 len: 345 microversion: 2.1 time: 0.137151 Sep 07 10:14:52.028735 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2679/5396] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:51 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:14:52.035315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.035826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.036277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.036996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.037494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.037932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.111453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:14:52.324601 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-42a828c3-cc40-4788-b8db-65610f8e37c9 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 204 len: 0 microversion: 2.1 time: 0.323215 Sep 07 10:14:52.325828 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2718/5397] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:14:52 2022] DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:14:52.334852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:52.335487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:52.356958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.358496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.359268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.360255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.387331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.391071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.519573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:52.520291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:52.536141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.536941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.542902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.543761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.545785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.546237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.834593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:52.856508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93af2f43-0501-440a-9aa1-278c05af1124 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1318 microversion: 2.1 time: 0.341044 Sep 07 10:14:52.862178 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2719/5398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:52 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:14:52.888970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:52.890859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:52.923312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.924135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.926344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:52.929535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:52.932481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:52.935394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:53.529058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:53.539603 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5355dba-1b1b-4964-8d41-da8685ba0391 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1680 microversion: 2.1 time: 1.209321 Sep 07 10:14:53.552825 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2680/5399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:52 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1680 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:53.561483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:53.562370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:53.579698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:53.579698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:53.592939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:53.595013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:53.596296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:53.598444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:53.670920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:53.691991 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-02ad6cad-4cad-4535-bda3-e9700ad3d657 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1472 microversion: 2.1 time: 0.825202 Sep 07 10:14:53.693501 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2720/5400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:52 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:53.700868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e3ee443-01b5-4421-b81a-9721b1a24660 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b08920d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:53.823073 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-5e3ee443-01b5-4421-b81a-9721b1a24660 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] HTTP exception thrown: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e3ee443-01b5-4421-b81a-9721b1a24660 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Request method failure captured: Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 HTTP/1.1 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG75Oa_-9i3-Lg8wn3C61ywyeVArpgs68bOKwdNqj8jELE9aHkrzjBIoPD6By7j9ifoBRMoNoiVrTdRhMDDUtk5amJ3vgbkXIAUcxdlvKWeP4uLszK7wfEAHVeExUrM5EiQrZ0ew950_3G1E7PUDOyfXOODAbNvDCfBrApOlWtmzPK8 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f7e0f415da5a4fd6bd554df885c4a74d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 6c8fbf4cac084180ba532e169b936c54 Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: exception: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ce83c7e2-0121-445a-9022-b5031e6abbd6'} Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. (HTTP 404) (Request-ID: req-43a89af6-c544-4b3b-a843-89f64e9bf020) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:14:53.825904 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e3ee443-01b5-4421-b81a-9721b1a24660 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Returning 404 to user: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:14:53.830728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e3ee443-01b5-4421-b81a-9721b1a24660 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 404 len: 109 microversion: 2.1 time: 0.131216 Sep 07 10:14:53.837217 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2721/5401] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:53 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:14:53.840345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a9194604-8a4f-4708-9e23-2481958992f2 req-a972dc68-3ccd-416b-b213-3bdd5f761be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "tag": "2d3a8da8-7281-4fec-9c3b-8056a83e7f4a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:53.884138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a9194604-8a4f-4708-9e23-2481958992f2 req-a972dc68-3ccd-416b-b213-3bdd5f761be1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:53.885922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a9194604-8a4f-4708-9e23-2481958992f2 req-a972dc68-3ccd-416b-b213-3bdd5f761be1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:53.886390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a9194604-8a4f-4708-9e23-2481958992f2 req-a972dc68-3ccd-416b-b213-3bdd5f761be1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:53.901617 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a9194604-8a4f-4708-9e23-2481958992f2 req-a972dc68-3ccd-416b-b213-3bdd5f761be1 service nova] Creating event network-changed:2d3a8da8-7281-4fec-9c3b-8056a83e7f4a for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:14:53.909983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a9194604-8a4f-4708-9e23-2481958992f2 req-a972dc68-3ccd-416b-b213-3bdd5f761be1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073290 Sep 07 10:14:53.916008 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2722/5402] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:53.921733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1803102682", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-161723041", "security_groups": [{"name": "tempest-secgroup-smoke-1648999643"}], "block_device_mapping_v2": [{"uuid": "8506d391-b0fb-405e-8aa9-ba9c77a23160", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:54.379454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:54.399703 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa012048-e3fe-40b4-9f2d-2905780b1b77 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 0.845364 Sep 07 10:14:54.400294 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2681/5403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:53 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:54.404894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d1590e9-c380-40e8-b8bf-62677273ceeb tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b1dd9040>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:54.462485 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-9d1590e9-c380-40e8-b8bf-62677273ceeb tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] HTTP exception thrown: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d1590e9-c380-40e8-b8bf-62677273ceeb tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Request method failure captured: Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 HTTP/1.1 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG75Oa_-9i3-Lg8wn3C61ywyeVArpgs68bOKwdNqj8jELE9aHkrzjBIoPD6By7j9ifoBRMoNoiVrTdRhMDDUtk5amJ3vgbkXIAUcxdlvKWeP4uLszK7wfEAHVeExUrM5EiQrZ0ew950_3G1E7PUDOyfXOODAbNvDCfBrApOlWtmzPK8 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f7e0f415da5a4fd6bd554df885c4a74d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6c8fbf4cac084180ba532e169b936c54 Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: exception: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ce83c7e2-0121-445a-9022-b5031e6abbd6'} Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. (HTTP 404) (Request-ID: req-7b5d09da-9c7f-4abe-ad55-0d0e37ae886e) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:14:54.466476 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.471050 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.480816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d1590e9-c380-40e8-b8bf-62677273ceeb tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Returning 404 to user: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:14:54.481999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d1590e9-c380-40e8-b8bf-62677273ceeb tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 404 len: 109 microversion: 2.1 time: 0.080684 Sep 07 10:14:54.483210 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2682/5404] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:14:54 2022] DELETE /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:14:54.491591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:54.497043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:54.510272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:54.510816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:54.511342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:54.512146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:54.512690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:54.513220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:54.546989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:14:54.710432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:54.727480 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7512584-4cc2-42a9-90f7-04518ce3736d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1306 microversion: 2.1 time: 0.242343 Sep 07 10:14:54.751171 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2683/5405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:54 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1306 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:54.761766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-dd700450-8445-4c2b-b544-a2b62a2981df req-1a079b10-5cd9-4f44-b0ff-af80c6f2cc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c04ed6c-bc7e-4e72-9f48-cc88ebc18342", "name": "network-vif-plugged", "status": "completed", "tag": "703c3eb9-a941-4729-b1c1-3f6874b67ff8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:54.774527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dd700450-8445-4c2b-b544-a2b62a2981df req-1a079b10-5cd9-4f44-b0ff-af80c6f2cc3c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:54.775380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dd700450-8445-4c2b-b544-a2b62a2981df req-1a079b10-5cd9-4f44-b0ff-af80c6f2cc3c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:54.776745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dd700450-8445-4c2b-b544-a2b62a2981df req-1a079b10-5cd9-4f44-b0ff-af80c6f2cc3c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:54.821814 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-dd700450-8445-4c2b-b544-a2b62a2981df req-1a079b10-5cd9-4f44-b0ff-af80c6f2cc3c service nova] Creating event network-vif-plugged:703c3eb9-a941-4729-b1c1-3f6874b67ff8 for instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 on n-h2-836830-16 Sep 07 10:14:54.835955 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-dd700450-8445-4c2b-b544-a2b62a2981df req-1a079b10-5cd9-4f44-b0ff-af80c6f2cc3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076872 Sep 07 10:14:54.836643 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2684/5406] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:54.853954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2271988-df27-4d1a-96e5-0136c3a59969 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Calling method '.version_select at 0x7f14b1264310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:54.905340 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c2271988-df27-4d1a-96e5-0136c3a59969 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] HTTP exception thrown: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2271988-df27-4d1a-96e5-0136c3a59969 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Request method failure captured: Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 HTTP/1.1 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG75Oa_-9i3-Lg8wn3C61ywyeVArpgs68bOKwdNqj8jELE9aHkrzjBIoPD6By7j9ifoBRMoNoiVrTdRhMDDUtk5amJ3vgbkXIAUcxdlvKWeP4uLszK7wfEAHVeExUrM5EiQrZ0ew950_3G1E7PUDOyfXOODAbNvDCfBrApOlWtmzPK8 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f7e0f415da5a4fd6bd554df885c4a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f7e0f415da5a4fd6bd554df885c4a74d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f7e0f415da5a4fd6bd554df885c4a74d Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438473055 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 6c8fbf4cac084180ba532e169b936c54 Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438473055-project Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: method: Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: exception: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ce83c7e2-0121-445a-9022-b5031e6abbd6'} Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. (HTTP 404) (Request-ID: req-de6c0f64-daa6-4168-9911-9398f9cc206e) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:14:54.907527 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2271988-df27-4d1a-96e5-0136c3a59969 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] Returning 404 to user: Volume ce83c7e2-0121-445a-9022-b5031e6abbd6 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:14:54.912659 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2271988-df27-4d1a-96e5-0136c3a59969 tempest-VolumesSnapshotsTestJSON-438473055 tempest-VolumesSnapshotsTestJSON-438473055-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6" status: 404 len: 109 microversion: 2.1 time: 0.070659 Sep 07 10:14:54.916228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2685/5407] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:14:54 2022] GET /compute/v2.1/os-volumes/ce83c7e2-0121-445a-9022-b5031e6abbd6 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:14:54.922240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:54.926254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:54.963255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:54.963918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:54.967847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:54.971311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:54.973291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:54.973981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:54.981998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:55.962334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:55.977193 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f90b682c-0705-4436-8d9a-4aab4f1bfa4f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1680 microversion: 2.1 time: 1.060257 Sep 07 10:14:55.978187 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2686/5408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:54 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1680 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:55.984658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:55.985643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:55.995946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:55.996774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:55.997610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:55.998552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:55.999981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:56.000749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:56.708151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:56.717635 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0cfa9dda-9e75-4597-a2f8-4aa3080f5d01 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1472 microversion: 2.1 time: 0.737819 Sep 07 10:14:56.718482 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2687/5409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:55 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1472 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:56.724195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:56.725371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:56.733878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:56.734779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:56.735226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:56.736351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:56.737018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:56.738182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.020378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:14:57.021470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:14:57.022374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:14:57.023147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:14:57.023917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:14:57.054335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.054920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.055470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.056589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.057139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.057679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.084916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:14:57.092566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:57.094262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:14:57.220288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:14:57.224405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8506d391-b0fb-405e-8aa9-ba9c77a23160',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:14:57.487468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27a539a2-a343-4e09-b90f-4ca1deae4643 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.569498 Sep 07 10:14:57.489010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2723/5410] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:14:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 3572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:14:57.494204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-50362cdd-e26e-4fc9-8d70-58f61aa80d5a req-29f29a92-cf93-4117-ae04-237eaa38231c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "tag": "297f5a51-6d91-471f-a1e6-de9e436b345b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:14:57.508151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-50362cdd-e26e-4fc9-8d70-58f61aa80d5a req-29f29a92-cf93-4117-ae04-237eaa38231c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.508996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-50362cdd-e26e-4fc9-8d70-58f61aa80d5a req-29f29a92-cf93-4117-ae04-237eaa38231c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.509867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-50362cdd-e26e-4fc9-8d70-58f61aa80d5a req-29f29a92-cf93-4117-ae04-237eaa38231c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.542369 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-50362cdd-e26e-4fc9-8d70-58f61aa80d5a req-29f29a92-cf93-4117-ae04-237eaa38231c service nova] Creating event network-changed:297f5a51-6d91-471f-a1e6-de9e436b345b for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:14:57.547773 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-50362cdd-e26e-4fc9-8d70-58f61aa80d5a req-29f29a92-cf93-4117-ae04-237eaa38231c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056900 Sep 07 10:14:57.552805 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2724/5411] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:14:57.558725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:57.559671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:57.567856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.568643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.569359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.570914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.571588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.572221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.797373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:57.805774 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70f4837e-747a-4082-9fcb-1bed11ef0414 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 1.085786 Sep 07 10:14:57.818099 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2688/5412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:56 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:57.838852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:57.839709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:57.851431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.852377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.854014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:57.855769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:57.856596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:57.860240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:58.397317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:58.423342 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-970529ad-9f52-4927-85db-0a2fdb65c56b tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1612 microversion: 2.1 time: 0.588071 Sep 07 10:14:58.424361 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2689/5413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:57 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1612 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:58.435746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:58.436552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:58.486329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:58.494863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:58.495252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:58.504252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:58.505105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:58.506200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:58.712063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:58.733212 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dced3b7f-f715-4d76-a973-f7e2bf556dbf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 1.179146 Sep 07 10:14:58.753813 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2725/5414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:57 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:58.758386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:58.758386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:58.774887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:58.775505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:58.789607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:58.790607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:58.791121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:58.791584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:58.957132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:58.974505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ca53db0-c766-4b40-a8b5-18685d08099d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1136 microversion: 2.1 time: 0.547773 Sep 07 10:14:58.976157 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2690/5415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:58 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1136 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:58.984590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:58.995988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:59.020080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:59.021656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:59.022718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:59.024024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:59.025215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:59.026250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:59.125622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:59.873422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:14:59.884075 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a6bb571-84c8-4bd3-94a0-055240fc0a61 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 0.903190 Sep 07 10:14:59.896099 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2691/5416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:58 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:14:59.909644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:14:59.910762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:14:59.914354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:14:59.921938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:59.924801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:59.929155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:14:59.930285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:14:59.930985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:14:59.931659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:00.122718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=20 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:00.223789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:00.248050 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7bef79d5-86e7-4a32-b23d-c33620b756e0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1644 microversion: 2.1 time: 1.497260 Sep 07 10:15:00.248726 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2726/5417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:58 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1644 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:00.294396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:00.296157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:00.303819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:00.304900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:00.306053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:00.307186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:00.307888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:00.308562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:00.478458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63083ee90514491ac086a7dba0efeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5cd65575ed4a498704c266af28f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:00.491410 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-35b0e730-c69a-4e84-828e-578e57983679 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 200 len: 1612 microversion: 2.1 time: 0.593956 Sep 07 10:15:00.492400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2692/5418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:14:59 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 1612 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:00.548885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:00.552741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:00.567926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:00.568865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:00.569576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:00.570443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:00.571001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:00.571543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:00.820279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:00.834031 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f85326c2-d611-4cdb-98ae-ff1863683ac9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1210 microversion: 2.1 time: 0.313997 Sep 07 10:15:00.836219 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2693/5419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:00 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1210 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:00.869764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:00.870615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:00.892540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:00.893050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:00.894260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:00.902264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:00.903128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:00.904299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:01.555433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:01.577827 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d8b0f59-2341-49a8-ad64-524eb5f9c58c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 1.325663 Sep 07 10:15:01.599362 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2727/5420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:00 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:01.618081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-34d566f0-2dfd-446a-bc3d-8feca3ef7985 req-0527c5a2-903a-4fca-a833-1788f59a8dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5636944-261f-4fba-8d05-de3cf0423eb9", "name": "network-vif-deleted", "tag": "0614aef7-9aa1-4566-a69a-9e5973453439"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:01.654572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-34d566f0-2dfd-446a-bc3d-8feca3ef7985 req-0527c5a2-903a-4fca-a833-1788f59a8dcd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:01.655565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-34d566f0-2dfd-446a-bc3d-8feca3ef7985 req-0527c5a2-903a-4fca-a833-1788f59a8dcd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:01.656221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-34d566f0-2dfd-446a-bc3d-8feca3ef7985 req-0527c5a2-903a-4fca-a833-1788f59a8dcd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:01.680163 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-34d566f0-2dfd-446a-bc3d-8feca3ef7985 req-0527c5a2-903a-4fca-a833-1788f59a8dcd service nova] Creating event network-vif-deleted:0614aef7-9aa1-4566-a69a-9e5973453439 for instance a5636944-261f-4fba-8d05-de3cf0423eb9 on n-h2-836830-16 Sep 07 10:15:01.688081 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-34d566f0-2dfd-446a-bc3d-8feca3ef7985 req-0527c5a2-903a-4fca-a833-1788f59a8dcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086336 Sep 07 10:15:01.689490 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2728/5421] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:01.698896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:01.700065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:01.719776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:01.720633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:01.723391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:01.724986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:01.728186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:01.728711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:02.463365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:02.476045 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c0915ca-9929-44ea-bf22-2b24cf18a753 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1644 microversion: 2.1 time: 1.622253 Sep 07 10:15:02.493221 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2694/5422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:00 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1644 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:02.493706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:02.494346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:02.510558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:02.515104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:02.515618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:02.516370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:02.516839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:02.517350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:02.568962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 HTTP/1.1 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a5636944-261f-4fba-8d05-de3cf0423eb9'} Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:02.573959 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-74ae54fa-4c22-44cb-82e2-50275afcbb2f tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 404 len: 111 microversion: 2.1 time: 0.094957 Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2695/5423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:02 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:02.585982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:02.593255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:02.609274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:02.609987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:02.610792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:02.611551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:02.612630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:02.613364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:02.911993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:02.936742 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2215251f-28bb-4f1a-825e-5e49a886afc2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1210 microversion: 2.1 time: 0.353035 Sep 07 10:15:02.938186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2696/5424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:02 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1210 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:02.943793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:02.950332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:02.951530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:02.962478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be30a5e4-5e8d-467c-9f2f-00895b6cb70f tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 1.268651 Sep 07 10:15:02.979587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:02.984135 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2729/5425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:01 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:02.984964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:02.985705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:02.988552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:02.989345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-819540a1-0217-40be-9896-5936f79db3b7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '.version_select at 0x7f14b08453a0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:02.991931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:02.992404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:03.029443 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-819540a1-0217-40be-9896-5936f79db3b7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422773613" status: 202 len: 0 microversion: 2.1 time: 0.044067 Sep 07 10:15:03.030175 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2730/5426] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422773613 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:15:03.039098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:03.040066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:03.062178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:03.063082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:03.063791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:03.064743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:03.065540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:03.066199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:03.743168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:03.751675 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98e2da23-5fab-4cf0-8270-7626f2ba4bcf tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 0.720202 Sep 07 10:15:03.752260 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2731/5427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:03 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:03.966169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:03.966784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:03.986654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:03.986654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:03.986654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:03.986654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:03.988157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:03.988157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:04.474051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:04.485901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2615d10-6efa-4079-ab1f-717c6c8c86b2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1210 microversion: 2.1 time: 0.523283 Sep 07 10:15:04.488702 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2732/5428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:03 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1210 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:04.493643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:04.503682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:04.520080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:04.525137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:04.525701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:04.526465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:04.529254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:04.529753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:04.575448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:04.962039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b02a2793-b7c3-46e3-82e4-35133ec056a0 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1797 microversion: 2.1 time: 2.019432 Sep 07 10:15:04.963449 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2697/5429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:02 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1797 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:04.968905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ea44a836-9b73-46ef-8145-81940d0879ce req-8a978de9-da78-4139-8d0c-2cb2a468eca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f", "tag": "09ee054e-6ccc-42ca-a71f-722587063162"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:05.012578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea44a836-9b73-46ef-8145-81940d0879ce req-8a978de9-da78-4139-8d0c-2cb2a468eca7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:05.015605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea44a836-9b73-46ef-8145-81940d0879ce req-8a978de9-da78-4139-8d0c-2cb2a468eca7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:05.016413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea44a836-9b73-46ef-8145-81940d0879ce req-8a978de9-da78-4139-8d0c-2cb2a468eca7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:05.049219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ea44a836-9b73-46ef-8145-81940d0879ce req-8a978de9-da78-4139-8d0c-2cb2a468eca7 service nova] Creating event network-changed:09ee054e-6ccc-42ca-a71f-722587063162 for instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f on n-h1-836830-16 Sep 07 10:15:05.060498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ea44a836-9b73-46ef-8145-81940d0879ce req-8a978de9-da78-4139-8d0c-2cb2a468eca7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095409 Sep 07 10:15:05.064930 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2698/5430] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:05.071198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:05.071905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:05.078624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:05.079311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:05.079901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:05.081352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:05.081970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:05.082589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:05.948149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:05.957551 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8aebbf72-f9e3-44b6-946e-579a50ede87c tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 1.467652 Sep 07 10:15:05.973943 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2733/5431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:04 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:05.979186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:05.980060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:05.992564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:05.993380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:05.994063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:05.994796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:05.997790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:05.998476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:06.088489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:06.099999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7b82f5f7-2e02-4326-80bd-3614db197cce tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 1.032813 Sep 07 10:15:06.107791 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2699/5432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:05 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:06.774416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:06.789862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1b34e4d6-84de-4303-8da3-1399051c52bf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1278 microversion: 2.1 time: 0.814670 Sep 07 10:15:06.805015 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2734/5433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:05 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1278 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:06.987586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:06.988619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:06.996463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:06.997611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:06.998286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:06.999208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:06.999993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:07.001323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:07.134358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:07.134995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:07.137767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:07.138460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:07.147676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:07.157796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:07.158343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:07.159168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:07.159855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:07.160310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:08.070506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:08.086228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d7fa27b-cd5e-474c-8e98-29761551dde4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 1.104951 Sep 07 10:15:08.090561 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2700/5434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:06 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:08.100167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:08.106239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:08.122784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:08.123860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:08.124538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:08.126863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:08.134134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:08.134852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:08.422243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:08.450160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8817c53d-ccd8-42c1-97e6-3679cb0612bc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 1.319527 Sep 07 10:15:08.471464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2735/5435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:07 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:08.483590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-06347a6a-ccf8-43b3-9f86-44273475f04f req-05af01a3-ffb4-4654-abb5-73fde821a011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c04ed6c-bc7e-4e72-9f48-cc88ebc18342", "tag": "703c3eb9-a941-4729-b1c1-3f6874b67ff8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:08.512197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06347a6a-ccf8-43b3-9f86-44273475f04f req-05af01a3-ffb4-4654-abb5-73fde821a011 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:08.512637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06347a6a-ccf8-43b3-9f86-44273475f04f req-05af01a3-ffb4-4654-abb5-73fde821a011 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:08.513091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06347a6a-ccf8-43b3-9f86-44273475f04f req-05af01a3-ffb4-4654-abb5-73fde821a011 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:08.543399 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-06347a6a-ccf8-43b3-9f86-44273475f04f req-05af01a3-ffb4-4654-abb5-73fde821a011 service nova] Creating event network-changed:703c3eb9-a941-4729-b1c1-3f6874b67ff8 for instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 on n-h2-836830-16 Sep 07 10:15:08.555591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-06347a6a-ccf8-43b3-9f86-44273475f04f req-05af01a3-ffb4-4654-abb5-73fde821a011 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082139 Sep 07 10:15:08.558810 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2736/5436] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:09.114248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:09.114973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:09.129075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:09.129673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:09.130132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:09.145918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:09.148191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:09.148675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:09.842036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:09.854367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-12972105-f777-4dda-aa85-15e5fea68dde tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1278 microversion: 2.1 time: 1.762320 Sep 07 10:15:09.860251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2701/5437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:08 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1278 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:09.882052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:09.882701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:09.903571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:09.904085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:09.904533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:09.909943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:09.912551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:09.913043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:10.337939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:10.349670 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72fc3bfb-bef0-489c-92ba-0ff4e26bf9e7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 1.241035 Sep 07 10:15:10.368678 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2737/5438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:09 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:10.884883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:10.885755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:10.896921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:10.900910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:10.904106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:10.905085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:10.909553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:10.914917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:11.603476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:11.620190 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5df09dfb-e217-44c0-993d-66ddfa59ad77 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 1.758797 Sep 07 10:15:11.621429 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2702/5439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:09 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:11.637155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:11.638080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:11.653898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:11.661148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:11.661855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:11.663093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:11.663735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:11.664339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:11.891035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:11.901025 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-713aeb35-8496-4832-a34b-a1d0b00758f0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 1.020303 Sep 07 10:15:11.913794 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2738/5440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:10 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:11.918952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0e146a86-236d-471a-ba58-527d12f9b6a1 req-27953fb7-0896-4947-9560-f1e499625d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "name": "network-vif-plugged", "status": "completed", "tag": "2d3a8da8-7281-4fec-9c3b-8056a83e7f4a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:11.937846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e146a86-236d-471a-ba58-527d12f9b6a1 req-27953fb7-0896-4947-9560-f1e499625d92 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:11.944653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e146a86-236d-471a-ba58-527d12f9b6a1 req-27953fb7-0896-4947-9560-f1e499625d92 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:11.945454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e146a86-236d-471a-ba58-527d12f9b6a1 req-27953fb7-0896-4947-9560-f1e499625d92 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:11.976819 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0e146a86-236d-471a-ba58-527d12f9b6a1 req-27953fb7-0896-4947-9560-f1e499625d92 service nova] Creating event network-vif-plugged:2d3a8da8-7281-4fec-9c3b-8056a83e7f4a for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:15:11.982850 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0e146a86-236d-471a-ba58-527d12f9b6a1 req-27953fb7-0896-4947-9560-f1e499625d92 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067397 Sep 07 10:15:11.984267 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2739/5441] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:12.171299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:12.191173 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-088104e6-4e55-4c6d-8c28-d63974e3c9ed tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 0.568372 Sep 07 10:15:12.191957 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2703/5442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:11 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:12.249324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:12.249980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:12.263605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.268749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.269435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.271256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.273058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.274404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.331682 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 HTTP/1.1 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a5636944-261f-4fba-8d05-de3cf0423eb9'} Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:12.335053 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.339631 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.342952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:12.344068 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3f1011c4-1826-498a-9976-7569e04f3ca6 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 404 len: 111 microversion: 2.1 time: 0.098993 Sep 07 10:15:12.345294 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2740/5443] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:12 2022] DELETE /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:12.357007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:12.357908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: a5636944-261f-4fba-8d05-de3cf0423eb9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:12.367590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.368484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.369645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.370787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.371477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.372071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.391038 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 HTTP/1.1 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a5636944-261f-4fba-8d05-de3cf0423eb9'} Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:12.403917 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. Sep 07 10:15:12.410644 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:12.413337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance a5636944-261f-4fba-8d05-de3cf0423eb9 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:12.414579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7dba75f0-08a5-456b-b40a-892f72f34320 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9" status: 404 len: 111 microversion: 2.1 time: 0.064634 Sep 07 10:15:12.415540 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2741/5444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:12 2022] GET /compute/v2.1/servers/a5636944-261f-4fba-8d05-de3cf0423eb9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:12.646514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:12.646919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:12.670722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.683033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.686728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.690954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.691669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.693423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.903929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-232b78a4-cea2-47a5-862c-27cd8d2fa6ca req-6d557546-5486-4c6a-9dcf-fd15c222fd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f81ee3-2899-412a-a0e2-7dc4b08abb3b", "tag": "97524004-9ab4-4f83-bb05-df6c0fca2b9b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:12.937403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-232b78a4-cea2-47a5-862c-27cd8d2fa6ca req-6d557546-5486-4c6a-9dcf-fd15c222fd12 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:12.938133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-232b78a4-cea2-47a5-862c-27cd8d2fa6ca req-6d557546-5486-4c6a-9dcf-fd15c222fd12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:12.941608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-232b78a4-cea2-47a5-862c-27cd8d2fa6ca req-6d557546-5486-4c6a-9dcf-fd15c222fd12 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:12.986513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:12.989134 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-232b78a4-cea2-47a5-862c-27cd8d2fa6ca req-6d557546-5486-4c6a-9dcf-fd15c222fd12 service nova] Creating event network-changed:97524004-9ab4-4f83-bb05-df6c0fca2b9b for instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b on n-h1-836830-16 Sep 07 10:15:13.003188 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-232b78a4-cea2-47a5-862c-27cd8d2fa6ca req-6d557546-5486-4c6a-9dcf-fd15c222fd12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.670959 Sep 07 10:15:13.006560 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2704/5445] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:15:13.022174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:13.023046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:13.043492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:13.044641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:13.047076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:13.049026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:13.049712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:13.050156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:13.251678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:13.263591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4fcbb0dc-f1ab-4778-85d0-54f67aae8369 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 0.622111 Sep 07 10:15:13.270668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2742/5446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:12 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:13.282764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:13.283424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:13.297938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:13.298455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:13.298913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:13.299730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:13.300211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:13.300656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:13.857753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:13.869845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31fac995-e015-4a09-be1a-8eac50a18582 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.858567 Sep 07 10:15:13.872864 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2705/5447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:13 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:13.915719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:13.928449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-057492df-50b1-4c0a-8473-340d6a0ec169 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 0.656579 Sep 07 10:15:13.933276 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2743/5448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:13 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:14.092897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-280eac8a-4268-4200-a22f-da5dfe450eda req-4b6e333e-4064-4b1f-a041-351fea817fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "name": "network-vif-plugged", "status": "completed", "tag": "297f5a51-6d91-471f-a1e6-de9e436b345b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:14.108602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-280eac8a-4268-4200-a22f-da5dfe450eda req-4b6e333e-4064-4b1f-a041-351fea817fd7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:14.110972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-280eac8a-4268-4200-a22f-da5dfe450eda req-4b6e333e-4064-4b1f-a041-351fea817fd7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:14.111465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-280eac8a-4268-4200-a22f-da5dfe450eda req-4b6e333e-4064-4b1f-a041-351fea817fd7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:14.138999 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-280eac8a-4268-4200-a22f-da5dfe450eda req-4b6e333e-4064-4b1f-a041-351fea817fd7 service nova] Creating event network-vif-plugged:297f5a51-6d91-471f-a1e6-de9e436b345b for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:15:14.147939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-280eac8a-4268-4200-a22f-da5dfe450eda req-4b6e333e-4064-4b1f-a041-351fea817fd7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058592 Sep 07 10:15:14.153570 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2744/5449] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:14.242368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-175661064", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "d4340467-84ad-4363-b095-1dc16371f88a"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:14.295389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:14.296293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:14.333165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:14.338293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:14.350295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:14.351320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:14.353721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:14.357467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:14.418885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] validate_networks() for [('d4340467-84ad-4363-b095-1dc16371f88a', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:15:14.875060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:14.890481 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99e4effa-bc14-4489-b1ec-41c2d2f1e637 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 0.601903 Sep 07 10:15:14.891392 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2745/5450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:14 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:14.899118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:14.900046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:14.907728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:14.911613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:14.912294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:14.913348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:14.914292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:14.915104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:15.697817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:15.707088 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b3def4f-dc0c-482e-9b2f-af3e2e7dcf4c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.811829 Sep 07 10:15:15.707693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2746/5451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:14 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:15.723283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:15.723940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:15.738405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:15.739031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:15.739369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:15.740097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:15.740594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:15.741026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.166295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:15:16.167322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:15:16.169479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:15:16.170164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:15:16.173593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:15:16.181670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:16.192984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.193523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.193969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.194087 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bbb7fc44-4bba-4ef4-9791-ea0eadda3e2e tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1332 microversion: 2.1 time: 0.478120 Sep 07 10:15:16.194663 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2747/5452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:15 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1332 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:16.204790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:16.210173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:16.210564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.211191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.211651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.224937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.233480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.234048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.234828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.235926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.236385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.251502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Getting quotas for project 0d716109363147c8bce116dc4e8fb1bb. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:15:16.266802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Getting quotas for user cf833818f54341f783eb076e636bcbfe and project 0d716109363147c8bce116dc4e8fb1bb. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:15:16.294322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:15:16.296599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:15:16.391492 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bedf8906-9edd-4f6d-9932-952a3e8532ee tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.515664 Sep 07 10:15:16.392412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2706/5453] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:15:16.405779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-32a95f46-375b-4eba-b8ab-f58734b69740 req-e3f1369e-71ce-4a5e-acb9-3d359c66615a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f", "name": "network-vif-plugged", "status": "completed", "tag": "09ee054e-6ccc-42ca-a71f-722587063162"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:16.454286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-32a95f46-375b-4eba-b8ab-f58734b69740 req-e3f1369e-71ce-4a5e-acb9-3d359c66615a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.454781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-32a95f46-375b-4eba-b8ab-f58734b69740 req-e3f1369e-71ce-4a5e-acb9-3d359c66615a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.455224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-32a95f46-375b-4eba-b8ab-f58734b69740 req-e3f1369e-71ce-4a5e-acb9-3d359c66615a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.492778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:16.504581 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c7964e53-a590-4c05-a965-8a5720a71eda tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 0.306167 Sep 07 10:15:16.505553 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2748/5454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:16 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:16.517700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-32a95f46-375b-4eba-b8ab-f58734b69740 req-e3f1369e-71ce-4a5e-acb9-3d359c66615a service nova] Creating event network-vif-plugged:09ee054e-6ccc-42ca-a71f-722587063162 for instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f on n-h1-836830-16 Sep 07 10:15:16.518893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d6a2107-41d4-4857-9d3a-1f09748e310d tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:16.519749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d6a2107-41d4-4857-9d3a-1f09748e310d tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:16.534104 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-32a95f46-375b-4eba-b8ab-f58734b69740 req-e3f1369e-71ce-4a5e-acb9-3d359c66615a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131195 Sep 07 10:15:16.534780 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2707/5455] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:16.611966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d6a2107-41d4-4857-9d3a-1f09748e310d tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:16.620512 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d6a2107-41d4-4857-9d3a-1f09748e310d tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1215 microversion: 2.1 time: 0.112273 Sep 07 10:15:16.637245 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2749/5456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:16 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:16.736486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:16.737202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:16.753248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.753818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.754188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:16.754903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:16.755367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:16.755798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.218740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:17.219386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:17.236888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.239362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.241556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.244978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.246110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:17.248053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.255371 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0173583c-3b82-400a-b4ae-028e4ce137c4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.523099 Sep 07 10:15:17.261058 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2708/5457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:16 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:17.266572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.525646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:17.532065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:17.532689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:17.537175 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57e3e251-9a59-4baa-aa9a-fa0de655bf96 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1668 microversion: 2.1 time: 0.322197 Sep 07 10:15:17.538089 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2750/5458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:17 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:17.547586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.550673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.551132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.553628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.554107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.561547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.562853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:17.563726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:17.576119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.576639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.577403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.578130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.578781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.579513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.625252 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-841eeea7-2521-4622-ad4f-1b5dfff61984 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42/ips" status: 200 len: 180 microversion: 2.1 time: 0.068435 Sep 07 10:15:17.626092 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2751/5459] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:15:17 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42/ips => generated 180 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:17.644339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:17.645248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:17.660862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.661524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.661982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.662759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.663233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.663687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.727444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:15:17.844993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:17.856358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79c1b035-66e3-412c-ac71-f214cdfca89d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1374 microversion: 2.1 time: 0.328502 Sep 07 10:15:17.871552 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2709/5460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:17 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1374 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:17.882361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:17.883801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:17.892049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.893498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.894194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.895140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.895802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.896425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.944854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-625b8ab2-d1cd-4c61-8d8a-1408ee8f8455 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 204 len: 0 microversion: 2.1 time: 0.308216 Sep 07 10:15:17.947231 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2752/5461] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:17 2022] DELETE /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:15:17.962058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:17.969342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:17.985834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.987604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.988778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:17.990011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:17.991700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:17.992625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:18.001580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:18.013641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:18.025827 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0895d557-e376-45ba-a5bf-4805390e6036 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1211 microversion: 2.1 time: 0.152878 Sep 07 10:15:18.029535 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2710/5462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:17 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:18.281659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:18.282298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:18.289708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:18.290488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:18.291171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:18.292116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:18.292815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:18.293495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:18.628369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:18.637137 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d8456077-6baa-4cbd-bb82-bce997e778e8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1674 microversion: 2.1 time: 0.685087 Sep 07 10:15:18.641413 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2753/5463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:17 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1674 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:18.675901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:18.686461 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e73acca9-a399-41e4-be59-bfe97df089cb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.408059 Sep 07 10:15:18.687412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2711/5464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:18 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:18.884854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:18.885520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:18.900691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:18.901491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:18.902125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:18.903155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:18.903798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:18.905737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:19.062377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:19.063279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:19.085505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:19.086615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:19.087222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:19.088126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:19.089723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:19.091943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:19.374228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:19.389236 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0a71cab1-b954-4a1e-a74e-3a8fae61d9c2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1285 microversion: 2.1 time: 0.330133 Sep 07 10:15:19.392356 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2712/5465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:19 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:19.451015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:19.466188 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-719d6bb3-8739-4384-ac96-55f5be0c0735 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1545 microversion: 2.1 time: 0.585292 Sep 07 10:15:19.475013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2754/5466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:18 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1545 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:19.498992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:19.499796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:19.508211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:19.508708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:19.509142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:19.517219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:19.517718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:19.518874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:19.672446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:19.673701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:19.681822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:19.682964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:19.683609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:19.684626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:19.690074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:19.690540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.375253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:20.391332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:20.394328 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08f8048b-c3f8-452e-98e1-f7524230ef86 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1545 microversion: 2.1 time: 0.899533 Sep 07 10:15:20.396999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2713/5467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:19 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1545 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:20.410282 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b7d7507a-f8e3-4edc-9a50-ab36483419f1 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1674 microversion: 2.1 time: 0.732845 Sep 07 10:15:20.410282 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2755/5468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:19 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1674 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:20.419548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:20.420186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:20.433721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:20.436677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:20.442722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.443241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.443696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.444417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.445212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.445815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.455808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.456719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.458635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.459991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.462606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.463903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.615586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:20.629376 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a4e4ea3e-b56f-4ed5-9dc7-3978d66e7b9a tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1273 microversion: 2.1 time: 0.208301 Sep 07 10:15:20.632681 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2714/5469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:20 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:20.649331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:20.650016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:20.665919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.668560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.669636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.670535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.672284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.673760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.710527 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 HTTP/1.1 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'cdfde246-fc65-4404-a624-dd8cdf1471b3'} Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:20.714840 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.718994 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.725705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:20.728339 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-add9f3c9-5af8-487f-88d7-a5b30f6550ab tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 404 len: 111 microversion: 2.1 time: 0.094272 Sep 07 10:15:20.730295 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2715/5470] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:20 2022] DELETE /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:20.746932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:20.747877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cdfde246-fc65-4404-a624-dd8cdf1471b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:20.758041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.758913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.759638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.761018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.762218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.763239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.786117 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 HTTP/1.1 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'cdfde246-fc65-4404-a624-dd8cdf1471b3'} Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:20.788478 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. Sep 07 10:15:20.793204 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.795769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance cdfde246-fc65-4404-a624-dd8cdf1471b3 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:20.796992 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08203ef2-81c8-46f5-befd-4fc2441638c7 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3" status: 404 len: 111 microversion: 2.1 time: 0.062427 Sep 07 10:15:20.798444 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2716/5471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:20 2022] GET /compute/v2.1/servers/cdfde246-fc65-4404-a624-dd8cdf1471b3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:20.831776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:20.832335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:20.851138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.853461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.854135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.856016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.858940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.859783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.910079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a HTTP/1.1 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'cb771408-266f-4ef6-b3cd-22d6186ad87a'} Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:20.915453 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:20.919465 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:20.925212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:20.926448 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99ba8274-4eed-4acd-8324-67f22fe68864 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 404 len: 111 microversion: 2.1 time: 0.113853 Sep 07 10:15:20.927623 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2717/5472] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:20 2022] DELETE /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:15:20.946286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:20.946900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: cb771408-266f-4ef6-b3cd-22d6186ad87a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:20.958573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.965657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.966089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:20.966858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:20.967349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:20.967795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:21.015499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a HTTP/1.1 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'cb771408-266f-4ef6-b3cd-22d6186ad87a'} Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:21.018668 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. Sep 07 10:15:21.022610 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:21.025195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance cb771408-266f-4ef6-b3cd-22d6186ad87a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:21.027077 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11b667fe-1c3d-4250-a6e6-c1d5d073c713 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a" status: 404 len: 111 microversion: 2.1 time: 0.084437 Sep 07 10:15:21.031213 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2718/5473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:20 2022] GET /compute/v2.1/servers/cb771408-266f-4ef6-b3cd-22d6186ad87a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:21.105545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:21.131964 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25f5a94d-a4ab-4de7-bd94-8ed000095cf6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.725069 Sep 07 10:15:21.147976 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2756/5474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:20 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:21.432972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:21.434281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:21.464044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:21.465280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:21.467395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:21.468723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:21.473375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:21.474149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:21.660263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:21.661293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:21.692378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:21.693618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:21.696051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:21.697032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:21.700819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:21.701562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:22.050080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:22.066488 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebd3438f-a293-4880-b828-b0bfb0162b39 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1273 microversion: 2.1 time: 0.412052 Sep 07 10:15:22.073422 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2757/5475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:21 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:22.083977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f18fec25-0a6b-4fbd-a138-cea4e2620f58 req-ec935fc2-3123-41f8-be87-4d61e396c13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "name": "network-vif-deleted", "tag": "297f5a51-6d91-471f-a1e6-de9e436b345b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:22.125142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f18fec25-0a6b-4fbd-a138-cea4e2620f58 req-ec935fc2-3123-41f8-be87-4d61e396c13f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:22.130028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f18fec25-0a6b-4fbd-a138-cea4e2620f58 req-ec935fc2-3123-41f8-be87-4d61e396c13f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:22.132126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f18fec25-0a6b-4fbd-a138-cea4e2620f58 req-ec935fc2-3123-41f8-be87-4d61e396c13f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:22.168231 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f18fec25-0a6b-4fbd-a138-cea4e2620f58 req-ec935fc2-3123-41f8-be87-4d61e396c13f service nova] Creating event network-vif-deleted:297f5a51-6d91-471f-a1e6-de9e436b345b for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:15:22.191154 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f18fec25-0a6b-4fbd-a138-cea4e2620f58 req-ec935fc2-3123-41f8-be87-4d61e396c13f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114622 Sep 07 10:15:22.192621 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2758/5476] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:22.200194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:22.205753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:22.233144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:22.234616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:22.235436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:22.237154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:22.237930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:22.238594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:22.276465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:22.291137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ba02fce-d6a9-4b9b-941b-127f7af8f3f7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1653 microversion: 2.1 time: 0.861031 Sep 07 10:15:22.291828 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2719/5477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:21 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1653 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:22.786394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-04a94d01-3bc6-4f8a-9758-0894566dd568 req-58876e31-4704-47eb-a970-d8462b6d33ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "name": "network-vif-unplugged", "status": "completed", "tag": "2d3a8da8-7281-4fec-9c3b-8056a83e7f4a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:22.809903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-04a94d01-3bc6-4f8a-9758-0894566dd568 req-58876e31-4704-47eb-a970-d8462b6d33ea service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:22.817220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-04a94d01-3bc6-4f8a-9758-0894566dd568 req-58876e31-4704-47eb-a970-d8462b6d33ea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:22.818044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-04a94d01-3bc6-4f8a-9758-0894566dd568 req-58876e31-4704-47eb-a970-d8462b6d33ea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:22.851581 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-04a94d01-3bc6-4f8a-9758-0894566dd568 req-58876e31-4704-47eb-a970-d8462b6d33ea service nova] Creating event network-vif-unplugged:2d3a8da8-7281-4fec-9c3b-8056a83e7f4a for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:15:22.868863 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-04a94d01-3bc6-4f8a-9758-0894566dd568 req-58876e31-4704-47eb-a970-d8462b6d33ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087433 Sep 07 10:15:22.875968 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2720/5478] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:15:22.931084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:22.948979 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c8cddaa3-cf9f-4a52-bd8a-c00b26ac26dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.754791 Sep 07 10:15:22.955970 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2759/5479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:22 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:23.099720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:23.100718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:23.115167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:23.127935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:23.133780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:23.135006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:23.136063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:23.136810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:23.328237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:23.329401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:23.338966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:23.343603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:23.344275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:23.345224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:23.349963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:23.352055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:23.698127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695925f2661b4399b48b76c2d57c3a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21db58d08d3548439c5a2426cb3e8cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:23.709812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-efafad9a-95aa-4c5f-98cd-36c82ddbd3c4 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 200 len: 1452 microversion: 2.1 time: 0.390195 Sep 07 10:15:23.723290 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2760/5480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:23 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 1452 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:23.813836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:23.828359 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aaf3e4e3-5b40-4714-be7a-9505d4eb6e03 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.730668 Sep 07 10:15:23.850457 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2721/5481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:23 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:23.982512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:23.983361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:23.992985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:23.993810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:23.994441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:23.995346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:23.995982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:23.996580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:24.256736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-14bd5c59-9585-4ebc-aa00-5b5852b37a85 req-b23d8d3b-1a3b-418e-8f37-6f037c54075e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308252b-bbb8-4622-8ee3-5b07423e8b42", "name": "network-vif-deleted", "tag": "2d3a8da8-7281-4fec-9c3b-8056a83e7f4a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:24.280528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-14bd5c59-9585-4ebc-aa00-5b5852b37a85 req-b23d8d3b-1a3b-418e-8f37-6f037c54075e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:24.291189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-14bd5c59-9585-4ebc-aa00-5b5852b37a85 req-b23d8d3b-1a3b-418e-8f37-6f037c54075e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:24.291736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-14bd5c59-9585-4ebc-aa00-5b5852b37a85 req-b23d8d3b-1a3b-418e-8f37-6f037c54075e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:24.333301 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-14bd5c59-9585-4ebc-aa00-5b5852b37a85 req-b23d8d3b-1a3b-418e-8f37-6f037c54075e service nova] Creating event network-vif-deleted:2d3a8da8-7281-4fec-9c3b-8056a83e7f4a for instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 on n-h2-836830-16 Sep 07 10:15:24.345474 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-14bd5c59-9585-4ebc-aa00-5b5852b37a85 req-b23d8d3b-1a3b-418e-8f37-6f037c54075e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092891 Sep 07 10:15:24.348505 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2722/5482] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:24.528390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:24.539344 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7817c2fa-08cd-4439-9a46-d73e5e45f4d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.562328 Sep 07 10:15:24.545435 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2761/5483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:23 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:24.741362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:24.742293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:24.754891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:24.758686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:24.759776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:24.764435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:24.765081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:24.772143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:24.834130 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] HTTP exception thrown: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Request method failure captured: Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 HTTP/1.1 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG6wY-ZAm3vH3e5enDbEnvqrW0JASB-35PNmvyAd7YC6woCX6QPz-KLrr-t3HpkeEhkHN00gXv6m3xpSDC-RcNPKGSxixXVlcntVKruO81w6HixdXH2hkwvpUWIYqYIgeWCjHkZitWfB9pcqSIXF2IHlCRbvfr5pkw6gNjozPheNE1E Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21db58d08d3548439c5a2426cb3e8cca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 695925f2661b4399b48b76c2d57c3a3c Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1308252b-bbb8-4622-8ee3-5b07423e8b42'} Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:24.842862 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Returning 404 to user: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:24.848618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-50d17e4f-a58f-4e22-a6df-908e5c9c0861 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 404 len: 111 microversion: 2.1 time: 0.108533 Sep 07 10:15:24.852060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:24.852392 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2723/5484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:24 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:24.852859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:24.874026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:24.875797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:24.876301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:24.879487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:24.882890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:24.884030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:25.488312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ed84d0f2-b7fc-49e9-9626-edf30377c717 req-9bdcee7f-6b7e-4c58-86a0-03ad17b74c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f", "tag": "09ee054e-6ccc-42ca-a71f-722587063162"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:25.518285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed84d0f2-b7fc-49e9-9626-edf30377c717 req-9bdcee7f-6b7e-4c58-86a0-03ad17b74c15 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:25.518770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed84d0f2-b7fc-49e9-9626-edf30377c717 req-9bdcee7f-6b7e-4c58-86a0-03ad17b74c15 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:25.519193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed84d0f2-b7fc-49e9-9626-edf30377c717 req-9bdcee7f-6b7e-4c58-86a0-03ad17b74c15 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:25.570128 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ed84d0f2-b7fc-49e9-9626-edf30377c717 req-9bdcee7f-6b7e-4c58-86a0-03ad17b74c15 service nova] Creating event network-changed:09ee054e-6ccc-42ca-a71f-722587063162 for instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f on n-h1-836830-16 Sep 07 10:15:25.587746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ed84d0f2-b7fc-49e9-9626-edf30377c717 req-9bdcee7f-6b7e-4c58-86a0-03ad17b74c15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107480 Sep 07 10:15:25.589266 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2724/5485] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:15:25.602641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:25.603574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:25.621609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:25.622377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:25.623274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:25.624150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:25.626223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:25.626821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:25.865030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:25.886991 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-56f9ea85-7091-4216-b55f-182b1c7db389 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 1.032593 Sep 07 10:15:25.888006 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2762/5486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:24 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:26.229633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:26.289757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:26.450735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:26.460803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf75b0cc-6d74-4175-b0b2-75eb68e2424f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.870106 Sep 07 10:15:26.478205 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2725/5487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:25 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:26.914490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:26.915916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:26.919148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:26.956975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4cde75c7-b044-43bd-a5c6-7f0918773cdc req-237bef35-5090-4f4c-a9d2-b6ffcccb171c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f81ee3-2899-412a-a0e2-7dc4b08abb3b", "name": "network-vif-plugged", "status": "completed", "tag": "97524004-9ab4-4f83-bb05-df6c0fca2b9b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:26.965437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:26.966191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:26.967233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:26.974429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:26.979112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:26.981904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:26.999473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4cde75c7-b044-43bd-a5c6-7f0918773cdc req-237bef35-5090-4f4c-a9d2-b6ffcccb171c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:27.012322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4cde75c7-b044-43bd-a5c6-7f0918773cdc req-237bef35-5090-4f4c-a9d2-b6ffcccb171c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:27.015365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4cde75c7-b044-43bd-a5c6-7f0918773cdc req-237bef35-5090-4f4c-a9d2-b6ffcccb171c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:27.078847 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4cde75c7-b044-43bd-a5c6-7f0918773cdc req-237bef35-5090-4f4c-a9d2-b6ffcccb171c service nova] Creating event network-vif-plugged:97524004-9ab4-4f83-bb05-df6c0fca2b9b for instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b on n-h1-836830-16 Sep 07 10:15:27.098757 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4cde75c7-b044-43bd-a5c6-7f0918773cdc req-237bef35-5090-4f4c-a9d2-b6ffcccb171c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147435 Sep 07 10:15:27.100219 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2726/5488] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:27.513719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:27.515255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:27.543300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:27.543940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:27.544483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:27.545713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:27.545846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:27.556208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:27.871300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:27.882536 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62df27e4-0d52-4791-a81d-e119824aa37f tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.975460 Sep 07 10:15:27.883130 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2763/5489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:26 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:28.083955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:28.090336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:28.101628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:28.105041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.105777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.106407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:28.109010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.109671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.111187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:28.147752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:28.162997 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 HTTP/1.1 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '65605bef-4101-4f64-ad05-fe9dbe2c3f65'} Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:28.164918 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:28.168905 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19ad7439-4a09-4ea9-8d5b-790e9f564570 tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 404 len: 111 microversion: 2.1 time: 0.087149 Sep 07 10:15:28.171920 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca2d6ac6-27f7-4a00-a12a-5cafcd5d8630 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1266 microversion: 2.1 time: 0.670866 Sep 07 10:15:28.176170 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2764/5490] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:28 2022] DELETE /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:28.177842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2727/5491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:27 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1266 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:28.181267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:28.181918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] [instance: 65605bef-4101-4f64-ad05-fe9dbe2c3f65] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:28.199897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.200482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.200938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:28.201697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.202438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.202878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:28.236098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] HTTP exception thrown: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Request method failure captured: Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 HTTP/1.1 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG1myYFFPz6TaS_BjNRtsC3CktDuKinJjNH1UuJkh2oCRLYBoGmK5PwgxEP-aiEImqiVhpwd0zxqKK90EiC0sGfTwOKJ2J6drQz3Rezv4CSUlCWNkAJqPTUybDfH1ZQB3_OSPDI1UfrCR0Ti1TL4pGq6bnba7zeoMsb6lMfOGzVUFSE Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cc5cd65575ed4a498704c266af28f654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cc5cd65575ed4a498704c266af28f654", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: cc5cd65575ed4a498704c266af28f654 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1719018260 Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: e63083ee90514491ac086a7dba0efeff Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-AttachVolumeNegativeTest-1719018260-project Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '65605bef-4101-4f64-ad05-fe9dbe2c3f65'} Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:28.251041 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] Returning 404 to user: Instance 65605bef-4101-4f64-ad05-fe9dbe2c3f65 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aed56cbe-955b-424c-95c0-d3591d228aec tempest-AttachVolumeNegativeTest-1719018260 tempest-AttachVolumeNegativeTest-1719018260-project] 10.222.0.60 "GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65" status: 404 len: 111 microversion: 2.1 time: 0.075341 Sep 07 10:15:28.259078 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2765/5492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:28 2022] GET /compute/v2.1/servers/65605bef-4101-4f64-ad05-fe9dbe2c3f65 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:28.443921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4a91f86c-f082-442e-8d19-4be88de361ae req-d6527a59-c494-4efd-8821-cb73ce0d41f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1b84c6-4311-4121-9cae-35eba7cc8cbb", "tag": "6968700f-3db9-494b-9ae3-5336c59fcaae"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:28.462683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4a91f86c-f082-442e-8d19-4be88de361ae req-d6527a59-c494-4efd-8821-cb73ce0d41f6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.463435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4a91f86c-f082-442e-8d19-4be88de361ae req-d6527a59-c494-4efd-8821-cb73ce0d41f6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.464054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4a91f86c-f082-442e-8d19-4be88de361ae req-d6527a59-c494-4efd-8821-cb73ce0d41f6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:28.492827 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4a91f86c-f082-442e-8d19-4be88de361ae req-d6527a59-c494-4efd-8821-cb73ce0d41f6 service nova] Creating event network-changed:6968700f-3db9-494b-9ae3-5336c59fcaae for instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb on n-h1-836830-16 Sep 07 10:15:28.507234 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4a91f86c-f082-442e-8d19-4be88de361ae req-d6527a59-c494-4efd-8821-cb73ce0d41f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067214 Sep 07 10:15:28.508380 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2728/5493] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:15:28.911889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:28.913681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:28.927657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.929852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.930433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:28.931993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:28.933584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:28.934295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:29.206797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:29.207575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:29.221660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:29.232300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:29.232992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:29.236111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:29.241629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:29.242954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:29.302279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:29.448840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:29.460369 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ea487ed-840a-42ce-a8d3-3e37555eb008 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.553879 Sep 07 10:15:29.478251 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2766/5494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:28 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:30.183729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:30.194974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30636792-f2ce-4ea9-9eaa-ccf31d6f4912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1452 microversion: 2.1 time: 0.996935 Sep 07 10:15:30.198061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2729/5495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:29 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1452 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:30.222501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:30.223280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:30.233929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.234780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.235443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.236540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.237261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.238133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.498856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:30.500751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:30.511417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:30.514147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.515053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.515726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.516750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.519251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.520057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.563999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:30.590424 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15581068-66e3-4ae7-aba4-1ec7609d9516 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1452 microversion: 2.1 time: 0.373085 Sep 07 10:15:30.591504 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2767/5496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:30 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1452 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:30.696623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:30.697154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:30.708412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.709114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.709771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.711862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.712510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.715752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.755169 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] HTTP exception thrown: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Request method failure captured: Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 HTTP/1.1 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG6wY-ZAm3vH3e5enDbEnvqrW0JASB-35PNmvyAd7YC6woCX6QPz-KLrr-t3HpkeEhkHN00gXv6m3xpSDC-RcNPKGSxixXVlcntVKruO81w6HixdXH2hkwvpUWIYqYIgeWCjHkZitWfB9pcqSIXF2IHlCRbvfr5pkw6gNjozPheNE1E Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21db58d08d3548439c5a2426cb3e8cca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 695925f2661b4399b48b76c2d57c3a3c Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1308252b-bbb8-4622-8ee3-5b07423e8b42'} Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:30.756804 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Returning 404 to user: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:30.761252 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2f97d554-aa40-40fc-a3db-fee78208b4b8 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 404 len: 111 microversion: 2.1 time: 0.068544 Sep 07 10:15:30.762714 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2768/5497] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:30 2022] DELETE /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:30.769057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:30.769943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 1308252b-bbb8-4622-8ee3-5b07423e8b42] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:30.776300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.777069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.778276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.779207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.779696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.780189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.797483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] HTTP exception thrown: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Request method failure captured: Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 HTTP/1.1 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG6wY-ZAm3vH3e5enDbEnvqrW0JASB-35PNmvyAd7YC6woCX6QPz-KLrr-t3HpkeEhkHN00gXv6m3xpSDC-RcNPKGSxixXVlcntVKruO81w6HixdXH2hkwvpUWIYqYIgeWCjHkZitWfB9pcqSIXF2IHlCRbvfr5pkw6gNjozPheNE1E Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21db58d08d3548439c5a2426cb3e8cca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 695925f2661b4399b48b76c2d57c3a3c Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '1308252b-bbb8-4622-8ee3-5b07423e8b42'} Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.799179 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Returning 404 to user: Instance 1308252b-bbb8-4622-8ee3-5b07423e8b42 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:30.803779 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-69a86e05-2f7b-44b7-9b83-4bff06e7f81d tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42" status: 404 len: 111 microversion: 2.1 time: 0.036766 Sep 07 10:15:30.805341 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2769/5498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:30 2022] GET /compute/v2.1/servers/1308252b-bbb8-4622-8ee3-5b07423e8b42 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:30.810405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:30.811867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:30.828509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.832992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.833305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:30.836260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.837067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.838189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.838648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.843516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5b6ffdd-1c52-4d58-a559-66d6381b58d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.351393 Sep 07 10:15:30.864866 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2730/5499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:30 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:30.868394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] HTTP exception thrown: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Request method failure captured: Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 HTTP/1.1 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG6wY-ZAm3vH3e5enDbEnvqrW0JASB-35PNmvyAd7YC6woCX6QPz-KLrr-t3HpkeEhkHN00gXv6m3xpSDC-RcNPKGSxixXVlcntVKruO81w6HixdXH2hkwvpUWIYqYIgeWCjHkZitWfB9pcqSIXF2IHlCRbvfr5pkw6gNjozPheNE1E Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21db58d08d3548439c5a2426cb3e8cca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 695925f2661b4399b48b76c2d57c3a3c Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4bf8bcd5-41e5-427c-8ca2-b0418a282535'} Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:30.870114 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Returning 404 to user: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1b64e35c-bb99-4a33-a58f-246c6c7028ff tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 404 len: 111 microversion: 2.1 time: 0.065028 Sep 07 10:15:30.875884 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2770/5500] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:30 2022] DELETE /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:30.881008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:30.883452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] [instance: 4bf8bcd5-41e5-427c-8ca2-b0418a282535] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:30.890771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.892173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.893313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.894064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:30.894597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:30.895043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:30.940920 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] HTTP exception thrown: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Request method failure captured: Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 HTTP/1.1 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG6wY-ZAm3vH3e5enDbEnvqrW0JASB-35PNmvyAd7YC6woCX6QPz-KLrr-t3HpkeEhkHN00gXv6m3xpSDC-RcNPKGSxixXVlcntVKruO81w6HixdXH2hkwvpUWIYqYIgeWCjHkZitWfB9pcqSIXF2IHlCRbvfr5pkw6gNjozPheNE1E Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21db58d08d3548439c5a2426cb3e8cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21db58d08d3548439c5a2426cb3e8cca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 21db58d08d3548439c5a2426cb3e8cca Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestMultiNic-27353088 Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 695925f2661b4399b48b76c2d57c3a3c Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestMultiNic-27353088-project Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4bf8bcd5-41e5-427c-8ca2-b0418a282535'} Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:30.944568 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. Sep 07 10:15:30.949311 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:15:30.951533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] Returning 404 to user: Instance 4bf8bcd5-41e5-427c-8ca2-b0418a282535 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:30.953383 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2b5b87d-0a9b-4076-a883-c1ac37e396a7 tempest-ServersTestMultiNic-27353088 tempest-ServersTestMultiNic-27353088-project] 10.222.0.60 "GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535" status: 404 len: 111 microversion: 2.1 time: 0.075852 Sep 07 10:15:30.954484 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2731/5501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:30 2022] GET /compute/v2.1/servers/4bf8bcd5-41e5-427c-8ca2-b0418a282535 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:31.874430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:31.875064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:31.892575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:31.893717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:31.903055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:31.903847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:31.904676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:31.905135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:32.596478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:32.612930 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d54b6241-2a4a-4a1d-939a-f5fa98e9ee4e tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.743075 Sep 07 10:15:32.613818 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2771/5502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:31 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:33.635937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:33.636572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:33.648137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:33.648540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:33.648994 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:33.649744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:33.650209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:33.650647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:33.866105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1a31f643-6c62-4a87-97c4-337c3f03c4f0 req-2c4161e3-50e2-4455-9013-3e191238b5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f81ee3-2899-412a-a0e2-7dc4b08abb3b", "tag": "97524004-9ab4-4f83-bb05-df6c0fca2b9b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:33.890002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1a31f643-6c62-4a87-97c4-337c3f03c4f0 req-2c4161e3-50e2-4455-9013-3e191238b5fd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:33.892052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1a31f643-6c62-4a87-97c4-337c3f03c4f0 req-2c4161e3-50e2-4455-9013-3e191238b5fd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:33.893908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1a31f643-6c62-4a87-97c4-337c3f03c4f0 req-2c4161e3-50e2-4455-9013-3e191238b5fd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:33.923229 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1a31f643-6c62-4a87-97c4-337c3f03c4f0 req-2c4161e3-50e2-4455-9013-3e191238b5fd service nova] Creating event network-changed:97524004-9ab4-4f83-bb05-df6c0fca2b9b for instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b on n-h1-836830-16 Sep 07 10:15:33.933863 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1a31f643-6c62-4a87-97c4-337c3f03c4f0 req-2c4161e3-50e2-4455-9013-3e191238b5fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072668 Sep 07 10:15:33.966334 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2772/5503] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:34.178138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:34.187626 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d6d5ca15-8be6-4d17-be46-91faea80cab0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.555578 Sep 07 10:15:34.208587 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2732/5504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:33 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:35.216307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:35.217033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:35.242305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:35.243070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:35.245275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:35.247890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:35.258273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:35.258769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:35.433843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-583691a7-c16e-4e5f-b0ef-49af396b078d req-42f2e08f-608a-45af-8904-d467bd2eb73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1b84c6-4311-4121-9cae-35eba7cc8cbb", "name": "network-vif-plugged", "status": "completed", "tag": "6968700f-3db9-494b-9ae3-5336c59fcaae"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:35.462491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-583691a7-c16e-4e5f-b0ef-49af396b078d req-42f2e08f-608a-45af-8904-d467bd2eb73a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:35.463409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-583691a7-c16e-4e5f-b0ef-49af396b078d req-42f2e08f-608a-45af-8904-d467bd2eb73a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:35.464069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-583691a7-c16e-4e5f-b0ef-49af396b078d req-42f2e08f-608a-45af-8904-d467bd2eb73a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:35.487121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-583691a7-c16e-4e5f-b0ef-49af396b078d req-42f2e08f-608a-45af-8904-d467bd2eb73a service nova] Creating event network-vif-plugged:6968700f-3db9-494b-9ae3-5336c59fcaae for instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb on n-h1-836830-16 Sep 07 10:15:35.537387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-583691a7-c16e-4e5f-b0ef-49af396b078d req-42f2e08f-608a-45af-8904-d467bd2eb73a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100268 Sep 07 10:15:35.538518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2733/5505] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:15:35.836406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:35.845366 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8d1f5fdd-9ba0-4324-a412-03568639dfb4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.633175 Sep 07 10:15:35.851734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2773/5506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:35 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:36.878849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:36.879575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:36.922257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:36.927687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:36.928698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:36.929664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:36.931785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:36.932424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:37.540562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:37.551474 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3fb9ab60-eb9f-4a0a-bb0b-0eb1655a4ac2 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1315 microversion: 2.1 time: 0.679139 Sep 07 10:15:37.569627 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2734/5507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:36 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:38.576675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:38.578913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:38.587697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:38.588576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:38.592805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:38.594216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:38.594933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:38.596863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:38.660508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:39.286081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:39.312847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc7b7dcd-024d-4ec5-b062-06a3498509c3 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1504 microversion: 2.1 time: 0.740630 Sep 07 10:15:39.313713 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2774/5508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:38 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1504 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:15:39.340393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:39.341395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:39.356149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:39.359789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:39.360487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:39.362543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:39.369522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:39.370704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:39.584855 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99841232-b842-4eb2-ab8e-2e1e549f2bef tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.249209 Sep 07 10:15:39.585642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2735/5509] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 7 10:15:39 2022] DELETE /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb/os-server-password => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:15:39.599041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:39.600444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:39.617152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:39.617801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:39.619693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:39.622532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:39.623039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:39.623494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:39.688518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dcad1100-86e3-4380-84bf-7829fd6f27a4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.095906 Sep 07 10:15:39.709636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:39.710212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:39.716783 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2775/5510] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 7 10:15:39 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb/os-server-password => generated 16 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:15:39.727576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:39.728341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:39.729267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:39.730311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:39.731520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:39.732479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:39.800246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:15:39.994039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9175a353-af2a-4345-8525-0a84f29c259c tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 204 len: 0 microversion: 2.1 time: 0.290290 Sep 07 10:15:40.008826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:40.011014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:40.012250 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2736/5511] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:15:39 2022] DELETE /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:15:40.047959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:40.050141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:40.050764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:40.056052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:40.058075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:40.059645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:40.593129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:40.604727 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4301c51b-66e6-476a-930e-5f001a79a5e7 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1510 microversion: 2.1 time: 0.603104 Sep 07 10:15:40.606881 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2776/5512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:39 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1510 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:41.635936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:41.637595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:41.652569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:41.654097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:41.654722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:41.655631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:41.656259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:41.657006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:42.420734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:42.443690 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c62812f-4c20-4b86-965e-1947e1af17c4 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1510 microversion: 2.1 time: 0.812971 Sep 07 10:15:42.444549 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2737/5513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:41 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1510 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:42.636501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e0bc17ae-2177-4725-880e-474d276c4a41 req-54ef835a-e31e-491c-a472-65ca790f5a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1b84c6-4311-4121-9cae-35eba7cc8cbb", "name": "network-vif-deleted", "tag": "6968700f-3db9-494b-9ae3-5336c59fcaae"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:42.674634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e0bc17ae-2177-4725-880e-474d276c4a41 req-54ef835a-e31e-491c-a472-65ca790f5a06 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:42.675350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e0bc17ae-2177-4725-880e-474d276c4a41 req-54ef835a-e31e-491c-a472-65ca790f5a06 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:42.678339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e0bc17ae-2177-4725-880e-474d276c4a41 req-54ef835a-e31e-491c-a472-65ca790f5a06 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:42.714241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e0bc17ae-2177-4725-880e-474d276c4a41 req-54ef835a-e31e-491c-a472-65ca790f5a06 service nova] Creating event network-vif-deleted:6968700f-3db9-494b-9ae3-5336c59fcaae for instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb on n-h1-836830-16 Sep 07 10:15:42.731534 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e0bc17ae-2177-4725-880e-474d276c4a41 req-54ef835a-e31e-491c-a472-65ca790f5a06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102197 Sep 07 10:15:42.736813 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2777/5514] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:43.468925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:43.470677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:43.535433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:43.537257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:43.537416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:43.542856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:43.543346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:43.543792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:43.639021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:43.639514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:43.640303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:43.641061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lazy-loading 'fault' on Instance uuid ad1b84c6-4311-4121-9cae-35eba7cc8cbb {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:15:43.844912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf833818f54341f783eb076e636bcbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d716109363147c8bce116dc4e8fb1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:43.858707 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d805a054-9ae4-4139-af40-f0228077cea1 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 200 len: 1305 microversion: 2.1 time: 0.395162 Sep 07 10:15:43.859467 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2738/5515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:43 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 1305 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:44.887452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:44.888856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] [instance: ad1b84c6-4311-4121-9cae-35eba7cc8cbb] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:44.912159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:44.912758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:44.913326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:44.914016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:44.914489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:44.919637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:44.979713 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] HTTP exception thrown: Instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb could not be found. Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Request method failure captured: Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb HTTP/1.1 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG8xyxfwb0nkk0iBs2FIGLMxZfUpPl3F8wMiXV3YaRn07oFpzm1PWrCrj1_Rm_o_XxyeHMbbUojBfSymk92jklZM5tSPiCOHTxZ9uLCtP5qgmiJJtxfl0wbt3NdYFjlthaA_2ILWQBMepji9Hi2wzJ5WTIlixUfPZdKMZhcfnIx5xAs Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 0d716109363147c8bce116dc4e8fb1bb Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerPasswordTestJSON-569122943 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0d716109363147c8bce116dc4e8fb1bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d716109363147c8bce116dc4e8fb1bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d716109363147c8bce116dc4e8fb1bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0d716109363147c8bce116dc4e8fb1bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerPasswordTestJSON-569122943 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 0d716109363147c8bce116dc4e8fb1bb Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerPasswordTestJSON-569122943 Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerPasswordTestJSON-569122943-project Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: cf833818f54341f783eb076e636bcbfe Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerPasswordTestJSON-569122943-project Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb could not be found. Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ad1b84c6-4311-4121-9cae-35eba7cc8cbb'} Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb could not be found. Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb could not be found. Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:15:44.987802 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb could not be found. Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] Returning 404 to user: Instance ad1b84c6-4311-4121-9cae-35eba7cc8cbb could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:15:44.991761 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-544c905d-69ce-4c4e-a8b3-76d7789e14d0 tempest-ServerPasswordTestJSON-569122943 tempest-ServerPasswordTestJSON-569122943-project] 10.222.0.60 "GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb" status: 404 len: 111 microversion: 2.1 time: 0.106615 Sep 07 10:15:44.993416 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2778/5516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:44 2022] GET /compute/v2.1/servers/ad1b84c6-4311-4121-9cae-35eba7cc8cbb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:15:45.245333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:45.249600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:45.270486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:45.270486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:45.270486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:45.270486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:45.270486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:45.270486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:45.402641 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e01a429e-5d70-44ca-8cbc-7828e3fba14f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f/action" status: 200 len: 24539 microversion: 2.1 time: 0.161942 Sep 07 10:15:45.408322 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2739/5517] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:15:45 2022] POST /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f/action => generated 24539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:15:47.981449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1553572188", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "90fdccff-2395-4e33-a13a-c39ba4dfd5c9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-284265718", "security_groups": []}, "os:scheduler_hints": {"different_host": ["6c04ed6c-bc7e-4e72-9f48-cc88ebc18342"]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:48.098052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] validate_networks() for [('90fdccff-2395-4e33-a13a-c39ba4dfd5c9', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:15:50.382156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:15:50.382875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:15:50.383117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:15:50.383796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:15:50.384407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:15:50.411008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:50.413323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:50.413984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:50.421634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:50.422455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:50.423064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:50.511042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Getting quotas for project c25592ca4dca40b49fe664804d13b84a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:15:50.537862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Getting quotas for user dcb05ab7bca64333b3daff1f50e3a8e9 and project c25592ca4dca40b49fe664804d13b84a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:15:50.593367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:15:50.597246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:15:50.723372 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-122247ab-99ed-4082-bff9-3d554a2002b3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.753353 Sep 07 10:15:50.725451 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2779/5518] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:15:47 2022] POST /compute/v2.1/servers => generated 361 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:15:50.736850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-887e1144-ba1b-4693-9746-1477f744e189 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:50.737816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-887e1144-ba1b-4693-9746-1477f744e189 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:51.017280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-887e1144-ba1b-4693-9746-1477f744e189 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:51.027552 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-887e1144-ba1b-4693-9746-1477f744e189 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1241 microversion: 2.1 time: 0.295600 Sep 07 10:15:51.030837 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2740/5519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:50 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1241 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:52.058705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:52.059354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:52.067724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:52.068250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:52.068724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:52.069486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:52.069967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:52.070419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:52.293265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:52.306306 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c11d3bb8-0d78-4e2d-bdff-6609a0a21927 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1293 microversion: 2.1 time: 0.250443 Sep 07 10:15:52.306920 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2780/5520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:52 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:53.347635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:53.348961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:53.364966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:53.365540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:53.366074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:53.366898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:53.367310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:53.367790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:53.686022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:53.699824 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-81ac50cd-79da-457d-9ad3-5b9143a14348 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.358438 Sep 07 10:15:53.706944 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2741/5521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:53 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:54.733592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:54.734343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:54.747650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:54.748533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:54.750456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:54.754199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:54.755336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:54.756495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:54.937077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:54.955282 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54a2737b-85da-4b09-a174-ca7b93bcc484 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.226124 Sep 07 10:15:54.958022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2781/5522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:54 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:55.985481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:55.986897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:56.006903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:56.007865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:56.008498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:56.009489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:56.010286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:56.010873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:57.113981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:57.124497 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21ccf59f-e30f-4eda-bb95-39f60b959cd3 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 1.143207 Sep 07 10:15:57.146771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2742/5523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:55 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:57.491170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c4f21807-4ee6-4cb1-be3a-6caf32c4471f req-497dc2a5-8151-487e-b4c1-5cbdbb6d5cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51c0166-b2c9-4765-91c2-9d40d4058c69", "tag": "62577d4a-af5f-4604-b931-0f7d2c24b2e2"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:15:57.511074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c4f21807-4ee6-4cb1-be3a-6caf32c4471f req-497dc2a5-8151-487e-b4c1-5cbdbb6d5cea service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:57.530751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c4f21807-4ee6-4cb1-be3a-6caf32c4471f req-497dc2a5-8151-487e-b4c1-5cbdbb6d5cea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:57.531612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c4f21807-4ee6-4cb1-be3a-6caf32c4471f req-497dc2a5-8151-487e-b4c1-5cbdbb6d5cea service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:57.561578 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c4f21807-4ee6-4cb1-be3a-6caf32c4471f req-497dc2a5-8151-487e-b4c1-5cbdbb6d5cea service nova] Creating event network-changed:62577d4a-af5f-4604-b931-0f7d2c24b2e2 for instance b51c0166-b2c9-4765-91c2-9d40d4058c69 on n-h1-836830-16 Sep 07 10:15:57.571725 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c4f21807-4ee6-4cb1-be3a-6caf32c4471f req-497dc2a5-8151-487e-b4c1-5cbdbb6d5cea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084639 Sep 07 10:15:57.573483 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2782/5524] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:15:58.162090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:58.163134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:58.184936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:58.186637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:58.188000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:58.189810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:58.191947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:58.192675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:58.383993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:58.396362 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-db020b60-c510-4930-ae98-e693d3c1d9b7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.245352 Sep 07 10:15:58.421784 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2743/5525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:58 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:15:59.431062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:15:59.431890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:15:59.446734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:15:59.452412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:59.453823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:59.456705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:59.460922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:15:59.463042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:15:59.464583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:15:59.786248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:15:59.803668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d9bf2f0-6010-449f-a637-83146bd78b30 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.377424 Sep 07 10:15:59.806921 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2783/5526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:15:59 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:00.831875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:00.836004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:00.861555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:00.865952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:00.866836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:00.867480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:00.870775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:00.872184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:00.873049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:00.956548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:01.026276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:01.203065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:01.217356 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1a211cc-291d-4da3-9cf4-6bd3337d312a tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.390159 Sep 07 10:16:01.223116 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2744/5527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:00 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:02.258040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:02.258892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:02.267844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:02.270078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:02.271980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:02.272752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:02.273493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:02.274506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:02.275206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:02.275869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:02.613813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:02.624660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81d788ef-bf65-43b7-b04d-8dfa97ab1943 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.387746 Sep 07 10:16:02.629002 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2784/5528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:02 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:02.730418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-34439949-89d4-41e9-b7d7-586406bb3649 req-191fe461-75af-459d-b7a0-7452de7f85e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51c0166-b2c9-4765-91c2-9d40d4058c69", "name": "network-vif-plugged", "status": "completed", "tag": "62577d4a-af5f-4604-b931-0f7d2c24b2e2"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:02.754945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-34439949-89d4-41e9-b7d7-586406bb3649 req-191fe461-75af-459d-b7a0-7452de7f85e8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:02.761040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-34439949-89d4-41e9-b7d7-586406bb3649 req-191fe461-75af-459d-b7a0-7452de7f85e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:02.762636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-34439949-89d4-41e9-b7d7-586406bb3649 req-191fe461-75af-459d-b7a0-7452de7f85e8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:02.804457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-34439949-89d4-41e9-b7d7-586406bb3649 req-191fe461-75af-459d-b7a0-7452de7f85e8 service nova] Creating event network-vif-plugged:62577d4a-af5f-4604-b931-0f7d2c24b2e2 for instance b51c0166-b2c9-4765-91c2-9d40d4058c69 on n-h1-836830-16 Sep 07 10:16:02.826796 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-34439949-89d4-41e9-b7d7-586406bb3649 req-191fe461-75af-459d-b7a0-7452de7f85e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093151 Sep 07 10:16:02.827808 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2745/5529] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:03.056779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6e4399a-af0a-4ae5-a393-2c62641a0076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'create', calling method: .version_select at 0x7f14b07def70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-478626925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0zlyRC8N4SDG0jOW5+Ml/9HtxZ2Kr20MpM7UL2gzbYb1A4lhoDj4/OsHxbdWhJ2wf6uBHRAVILoJSAG1vGNlWR94RVW3UGOo7CYg26LWoRXpdaS3ujvkKNkSthCVhSiQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:03.133501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f6e4399a-af0a-4ae5-a393-2c62641a0076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:03.164526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f6e4399a-af0a-4ae5-a393-2c62641a0076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for user f569c9d96f2045ba979a4fb85fa3acb2 and project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:03.231595 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6e4399a-af0a-4ae5-a393-2c62641a0076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.181355 Sep 07 10:16:03.235312 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2785/5530] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:16:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:03.654385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:03.661695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:03.679559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:03.680084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:03.680546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:03.681308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:03.681788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:03.682234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:03.991830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-254702007", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "711b35a7-b575-4856-bc4b-f45b95b93f92"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:04.037723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:04.065556 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-159aa0e3-9a38-488f-bae8-b66c19e8c853 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1299 microversion: 2.1 time: 0.414801 Sep 07 10:16:04.066265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2786/5531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:03 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1299 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:04.101174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] validate_networks() for [('711b35a7-b575-4856-bc4b-f45b95b93f92', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:16:05.091909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:05.093329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:05.122608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:05.123134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:05.123593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:05.124329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:05.124804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:05.125305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:06.324772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:06.343768 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc21bb5e-6644-487e-8d96-aa36e27ecaae tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1472 microversion: 2.1 time: 1.254195 Sep 07 10:16:06.347563 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2787/5532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:05 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1472 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:06.372624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:06.373407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:06.388002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:06.388773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:06.390430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:06.393593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:06.394331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:06.395058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:06.472145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:16:06.474427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:16:06.475723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:16:06.476696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:16:06.478032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:16:06.495675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:06.496793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:06.497446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:06.498396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:06.501672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:06.502664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:06.537620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Getting quotas for project ef23d42476644c53a897bf4d3e2510cd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:06.544733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Getting quotas for user 1ac8a7a2db4f4028abdaebfe62cefc29 and project ef23d42476644c53a897bf4d3e2510cd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:06.624693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Going to run 2 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:16:06.633546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: d442b292-6457-44c4-b65c-a96dca18c8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:06.742253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=d442b292-6457-44c4-b65c-a96dca18c8e6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:06.932679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:06.951537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e6a05c1-563e-48b8-bf74-29e80673ab37 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1472 microversion: 2.1 time: 0.579275 Sep 07 10:16:06.953765 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2788/5533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:06 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1472 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:06.982418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:06.983459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:06.999089 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-555f8521-92b3-4e77-ace0-b515fcd28404 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.658400 Sep 07 10:16:07.003144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:07.004058 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2746/5534] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:16:07.007259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:07.009002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:07.010649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:07.022650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:07.025118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:07.030269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:07.037686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:07.049649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Searching by: {'deleted': False, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:16:07.092385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:07.096395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:07.097009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:07.100081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:07.101740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:07.104513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:07.173269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d0eeba4e-b4f0-447d-b624-d1b4ecbba65d tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.159712 Sep 07 10:16:07.177938 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2747/5535] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:16:07 2022] GET /compute/v2.1/servers => generated 675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:07.187584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-171796b0-0cda-4fc9-a46e-7b346db19925 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:07.193315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-171796b0-0cda-4fc9-a46e-7b346db19925 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:07.445235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-171796b0-0cda-4fc9-a46e-7b346db19925 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:07.463049 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-171796b0-0cda-4fc9-a46e-7b346db19925 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1219 microversion: 2.1 time: 0.281062 Sep 07 10:16:07.475466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2748/5536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:07 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1219 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:07.567649 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15542ab3-aa3a-400e-8a00-8131bae3823f tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1625 microversion: 2.1 time: 0.588969 Sep 07 10:16:07.569025 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2789/5537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:06 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1625 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:07.595541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:07.596183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:07.609890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:07.610944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:07.616373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:07.627445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:07.627971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:07.628432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:08.306888 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e40fdd50-8d06-4a24-a181-4789bb87d464 tempest-TestSecurityGroupsBasicOps-2091932175 tempest-TestSecurityGroupsBasicOps-2091932175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1916 microversion: 2.1 time: 0.702877 Sep 07 10:16:08.309995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2749/5538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:07 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1916 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:08.499339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bf8e47d3-9ef7-4e82-8875-b019d99acbd6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:08.500089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bf8e47d3-9ef7-4e82-8875-b019d99acbd6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:09.332237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bf8e47d3-9ef7-4e82-8875-b019d99acbd6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:09.361269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1597942391", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "0ab67032-33a2-473d-a9f5-58fcdf1e7438"}], "key_name": "tempest-TestNetworkBasicOps-478626925", "security_groups": [{"name": "tempest-secgroup-smoke-248232912"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:09.364513 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bf8e47d3-9ef7-4e82-8875-b019d99acbd6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1219 microversion: 2.1 time: 0.866261 Sep 07 10:16:09.367822 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2790/5539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:08 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1219 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:09.505250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:09.506090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:09.527339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:09.538393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:09.540546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:09.543768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:09.545581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:09.546990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:09.620139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=69 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:09.635550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:16:09.830133 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f8c26fc-4d9e-4064-97d1-757ed3d47a9e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 204 len: 0 microversion: 2.1 time: 0.329053 Sep 07 10:16:09.832922 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2791/5540] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:16:09 2022] DELETE /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:16:09.850860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:09.852149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:09.860055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:09.860953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:09.861659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:09.862726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:09.863639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:09.865052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:10.050268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] validate_networks() for [('0ab67032-33a2-473d-a9f5-58fcdf1e7438', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:16:10.151460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:10.164604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34e88c62-b9f8-4a04-9e20-9b44ef46a98c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1478 microversion: 2.1 time: 0.323039 Sep 07 10:16:10.166985 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2792/5541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:09 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1478 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:10.395242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:10.396286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:10.416152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:10.421146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:10.422239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:10.425941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:10.427452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:10.428076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:10.799501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:10.814444 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23040698-7d0d-4f9e-b673-6f6653fcb467 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1215 microversion: 2.1 time: 0.426305 Sep 07 10:16:10.820097 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2793/5542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:10 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:11.195105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:11.196096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:11.213867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:11.214704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:11.215693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:11.216738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:11.218639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:11.221025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:11.603637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:11.622601 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12085672-8b98-48a9-bc23-e8a2f26769cf tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1478 microversion: 2.1 time: 0.431893 Sep 07 10:16:11.637580 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2794/5543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:11 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1478 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:11.791352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:16:11.792463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:16:11.793155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:16:11.793798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:16:11.794465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:16:11.825672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:11.829560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:11.831864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:11.839961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:11.840783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:11.841502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:11.844447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:11.845871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:11.857774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:11.858579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:11.859266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:11.860503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:11.865055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:11.866328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:11.888741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:11.904388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for user f569c9d96f2045ba979a4fb85fa3acb2 and project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:11.957619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:16:11.962299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:12.046562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:12.067241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93e0dbd0-54dd-4b20-850c-e34ef4fca553 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1277 microversion: 2.1 time: 0.226004 Sep 07 10:16:12.084710 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d054c764-fcf2-46db-b3e3-0027e3a53def tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.725237 Sep 07 10:16:12.088984 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2750/5544] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:16:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:16:12.089731 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2795/5545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:11 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:12.105651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30864b36-713c-47a8-b5c1-08fa0041d84b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:12.106571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-30864b36-713c-47a8-b5c1-08fa0041d84b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:12.647616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:12.649501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:12.666884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:12.667877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:12.671092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:12.672141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:12.672846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:12.675338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:12.864924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30864b36-713c-47a8-b5c1-08fa0041d84b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:12.890569 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30864b36-713c-47a8-b5c1-08fa0041d84b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1248 microversion: 2.1 time: 0.788711 Sep 07 10:16:12.892085 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2751/5546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:12 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1248 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:13.096313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:13.105716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:13.106441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:13.129617 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13cefd19-96f8-475f-81c1-0bf89b50a7d0 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1478 microversion: 2.1 time: 0.481533 Sep 07 10:16:13.132623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:13.135200 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2796/5547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:12 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1478 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:13.136294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:13.136757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:13.137524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:13.137995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:13.138433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:13.383487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:13.393173 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e50a54ba-0011-48fc-8dd5-03c0ec76a3a2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1277 microversion: 2.1 time: 0.291389 Sep 07 10:16:13.401924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2752/5548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:13 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:13.916325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:13.917116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:13.936721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:13.937576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:13.941092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:13.942245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:13.945759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:13.946417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:14.125456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:14.135676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6948108a-186f-4232-8a91-cd0013bace18 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1300 microversion: 2.1 time: 0.223415 Sep 07 10:16:14.144774 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2797/5549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:13 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1300 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:14.165982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:14.167111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:14.186230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:14.187552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:14.190512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:14.195986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:14.196851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:14.200124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:14.418305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:14.419020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:14.435897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:14.438735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:14.440657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:14.443590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:14.444602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:14.446010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:14.840662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:14.855623 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c59707cb-3716-4715-834d-8f3ab106379e tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1478 microversion: 2.1 time: 0.701653 Sep 07 10:16:14.859741 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2753/5550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:14 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1478 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:14.986532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:14.998890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8233520-7cdf-4dc0-9182-59347a6e7790 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1277 microversion: 2.1 time: 0.585167 Sep 07 10:16:15.006076 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2798/5551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:14 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1277 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:15.168785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:15.169971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:15.185868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:15.190623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:15.191090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:15.191833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:15.192294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:15.195187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:15.243963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0f40dafb-b549-40d3-ac0b-15e420effa18 req-b6499dd5-2b64-4114-911a-5ec70b8d3494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51c0166-b2c9-4765-91c2-9d40d4058c69", "name": "network-vif-deleted", "tag": "62577d4a-af5f-4604-b931-0f7d2c24b2e2"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:15.289007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f40dafb-b549-40d3-ac0b-15e420effa18 req-b6499dd5-2b64-4114-911a-5ec70b8d3494 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:15.289529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f40dafb-b549-40d3-ac0b-15e420effa18 req-b6499dd5-2b64-4114-911a-5ec70b8d3494 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:15.289976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f40dafb-b549-40d3-ac0b-15e420effa18 req-b6499dd5-2b64-4114-911a-5ec70b8d3494 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:15.333948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0f40dafb-b549-40d3-ac0b-15e420effa18 req-b6499dd5-2b64-4114-911a-5ec70b8d3494 service nova] Creating event network-vif-deleted:62577d4a-af5f-4604-b931-0f7d2c24b2e2 for instance b51c0166-b2c9-4765-91c2-9d40d4058c69 on n-h1-836830-16 Sep 07 10:16:15.356141 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0f40dafb-b549-40d3-ac0b-15e420effa18 req-b6499dd5-2b64-4114-911a-5ec70b8d3494 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116977 Sep 07 10:16:15.357654 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2799/5552] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:15.905263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:15.907728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:15.939442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:15.940246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:15.943071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:15.944072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:15.944718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:15.955495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:16.015491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:16.016046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:16.017028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:16.024993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lazy-loading 'fault' on Instance uuid b51c0166-b2c9-4765-91c2-9d40d4058c69 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:16:16.078192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:16.093886 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61e46705-f679-48ba-9682-556035d6c6da tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1306 microversion: 2.1 time: 0.929713 Sep 07 10:16:16.095492 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2754/5553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:15 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1306 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:16.101087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:16.101991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:16.108848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:16.109918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:16.111957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:16.112937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:16.113711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:16.115711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:16.224633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:16.240150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ce7c9ee-9dd2-4abd-a589-39495204a597 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 200 len: 1331 microversion: 2.1 time: 0.346868 Sep 07 10:16:16.253705 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2800/5554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:15 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 1331 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:16.490869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:16.502308 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f5d8407-798e-4e6f-90e6-e7ce0dfcf54f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1277 microversion: 2.1 time: 0.405372 Sep 07 10:16:16.507952 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2755/5555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:16 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1277 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:17.132358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:17.134195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:17.158527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.159420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.161794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.164238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.165114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.168483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.269683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:17.270302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: b51c0166-b2c9-4765-91c2-9d40d4058c69] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:17.278135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.285157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.287981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.291278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.291636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.294970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.351917 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] HTTP exception thrown: Instance b51c0166-b2c9-4765-91c2-9d40d4058c69 could not be found. Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Request method failure captured: Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 HTTP/1.1 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG7tW8c4L5oQiVyo5iWqbO4PyAQp4Jtb4q1TGzdFFAHnqc0VA91hwTHNvk6kzug7fJua5ohg4l1j6-VHTdw-7I4kzwLCBH9gwJFHkAqGMLlZ2fRfYhDoVjnRgZhe7un_11q4WN2CE6RDp8CFNWXvWL3EpQ2jcKB1ZdWLsLKCJoCXVh4 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c25592ca4dca40b49fe664804d13b84a Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1752326549 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25592ca4dca40b49fe664804d13b84a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25592ca4dca40b49fe664804d13b84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25592ca4dca40b49fe664804d13b84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25592ca4dca40b49fe664804d13b84a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1752326549 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c25592ca4dca40b49fe664804d13b84a Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1752326549 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestSecurityGroupsBasicOps-1752326549-project Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: dcb05ab7bca64333b3daff1f50e3a8e9 Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1752326549-project Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance b51c0166-b2c9-4765-91c2-9d40d4058c69 could not be found. Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'b51c0166-b2c9-4765-91c2-9d40d4058c69'} Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51c0166-b2c9-4765-91c2-9d40d4058c69 could not be found. Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51c0166-b2c9-4765-91c2-9d40d4058c69 could not be found. Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:17.353720 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51c0166-b2c9-4765-91c2-9d40d4058c69 could not be found. Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:17.357866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Returning 404 to user: Instance b51c0166-b2c9-4765-91c2-9d40d4058c69 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:16:17.358560 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e03577b8-bbdb-44a2-abe3-d779beb0d100 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69" status: 404 len: 111 microversion: 2.1 time: 0.094318 Sep 07 10:16:17.359915 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2756/5556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:17 2022] GET /compute/v2.1/servers/b51c0166-b2c9-4765-91c2-9d40d4058c69 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:16:17.512008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:17.525890 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3697412a-a787-4ebf-acd9-2de2f1ce0180 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1306 microversion: 2.1 time: 0.401737 Sep 07 10:16:17.533419 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2801/5557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:17 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1306 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:17.534206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:17.534878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:17.559451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.561078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.561563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.567633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.571892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.576302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.868058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5f29af83-20fe-4ee4-89aa-970fd0afc50e req-9babb515-93ef-48fe-bab0-4f1b78933d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d442b292-6457-44c4-b65c-a96dca18c8e6", "tag": "39316e54-8a84-410d-b631-6fe6f72e619e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:17.923024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5f29af83-20fe-4ee4-89aa-970fd0afc50e req-9babb515-93ef-48fe-bab0-4f1b78933d42 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:17.923905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5f29af83-20fe-4ee4-89aa-970fd0afc50e req-9babb515-93ef-48fe-bab0-4f1b78933d42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:17.924591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5f29af83-20fe-4ee4-89aa-970fd0afc50e req-9babb515-93ef-48fe-bab0-4f1b78933d42 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:17.951532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5f29af83-20fe-4ee4-89aa-970fd0afc50e req-9babb515-93ef-48fe-bab0-4f1b78933d42 service nova] Creating event network-changed:39316e54-8a84-410d-b631-6fe6f72e619e for instance d442b292-6457-44c4-b65c-a96dca18c8e6 on n-h2-836830-16 Sep 07 10:16:17.964903 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5f29af83-20fe-4ee4-89aa-970fd0afc50e req-9babb515-93ef-48fe-bab0-4f1b78933d42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102452 Sep 07 10:16:17.967224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2802/5558] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:18.556220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:18.557273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:18.564547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:18.585320 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21268175-19ca-4a2f-927f-7ada9d6c4d5e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 1.054874 Sep 07 10:16:18.605143 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2757/5559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:17 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:18.616042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:18.619565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:18.621695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:18.622473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:18.622964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:18.623420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:19.085330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:19.101142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8dc2bc12-ce2d-40a7-a338-6d4fbd105195 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1306 microversion: 2.1 time: 0.551702 Sep 07 10:16:19.107776 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2803/5560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:18 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1306 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:19.231075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-947438275", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:19.333433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:16:19.618764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:19.627545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:19.628247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:19.651813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:19.652332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:19.652787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:19.668588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:19.668997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:19.680480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:20.322125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:20.346916 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c9f6ba09-5b46-4ba0-bde6-569948f2d023 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 0.728815 Sep 07 10:16:20.354044 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2804/5561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:19 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:20.375193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:20.378522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:20.386314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:20.387716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:20.396284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:20.400141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:20.401025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:20.401832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:21.029486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:21.048044 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-481c29f6-0ed1-4064-acff-634fa56a9175 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.690569 Sep 07 10:16:21.060846 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2805/5562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:20 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:21.372471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:21.373416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:21.390428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:21.391371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:21.392291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:21.393684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:21.401069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:21.401736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:21.638333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:16:21.638850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:16:21.639419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:16:21.639853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:16:21.640279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:16:21.656955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:21.661784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:21.664297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:21.665480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:21.667222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:21.669815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:21.737990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:21.754830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:21.785977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:16:21.792067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:21.940281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-db884504-2593-41d9-a321-eece9198bcd3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.312894 Sep 07 10:16:21.941752 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2758/5563] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:16:21.955858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84f2498f-8d57-4043-9ca2-a508172b3cd4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:21.956491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-84f2498f-8d57-4043-9ca2-a508172b3cd4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:22.330866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-84f2498f-8d57-4043-9ca2-a508172b3cd4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:22.341975 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84f2498f-8d57-4043-9ca2-a508172b3cd4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1192 microversion: 2.1 time: 0.390320 Sep 07 10:16:22.347485 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2759/5564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:21 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1192 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:22.363511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:22.364426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:22.410171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:22.411695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:22.415500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:22.417969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:22.422857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:22.423383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:22.513153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:22.530677 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1f93ec64-0a35-4f16-998b-cab4472b98c2 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 1.163095 Sep 07 10:16:22.534523 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2806/5565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:21 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:22.559449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-233f8b20-f1fc-40d9-a6ff-9a9f8c8a1bf8 req-be2c0291-5ee9-4f43-8ef1-6812859665ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5deaad39-1ad1-4650-8a5b-1f7240aea9ec", "tag": "7f7b28e8-61bf-4837-93e3-24851ec46790"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:22.590765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-233f8b20-f1fc-40d9-a6ff-9a9f8c8a1bf8 req-be2c0291-5ee9-4f43-8ef1-6812859665ff service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:22.592543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-233f8b20-f1fc-40d9-a6ff-9a9f8c8a1bf8 req-be2c0291-5ee9-4f43-8ef1-6812859665ff service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:22.595017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-233f8b20-f1fc-40d9-a6ff-9a9f8c8a1bf8 req-be2c0291-5ee9-4f43-8ef1-6812859665ff service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:22.624960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:22.667148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-233f8b20-f1fc-40d9-a6ff-9a9f8c8a1bf8 req-be2c0291-5ee9-4f43-8ef1-6812859665ff service nova] Creating event network-changed:7f7b28e8-61bf-4837-93e3-24851ec46790 for instance 5deaad39-1ad1-4650-8a5b-1f7240aea9ec on n-h2-836830-16 Sep 07 10:16:22.708276 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-233f8b20-f1fc-40d9-a6ff-9a9f8c8a1bf8 req-be2c0291-5ee9-4f43-8ef1-6812859665ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154436 Sep 07 10:16:22.712043 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2807/5566] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:23.327840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:23.342459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d531f76-80a3-45ad-8a34-9cb09058a09e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.989053 Sep 07 10:16:23.351360 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2760/5567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:22 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:23.379283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:23.380733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:23.408882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:23.412733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:23.416117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:23.417451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:23.418309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:23.421277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:23.559780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:23.560800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:23.581554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:23.584159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:23.585451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:23.589399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:23.593680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:23.597434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:23.819047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:23.831329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0aff81e0-fa52-4940-a204-527918c03186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1188 microversion: 2.1 time: 0.460397 Sep 07 10:16:23.835050 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2808/5568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:23 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1188 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:24.378007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:24.379819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:24.406416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:24.407740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:24.408935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:24.428232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:24.428759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:24.434691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:24.971243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:24.987848 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a3004814-4628-4728-94cd-9f1934c004b0 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 1.432432 Sep 07 10:16:25.006017 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2761/5569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:23 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:25.017925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:25.018765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:25.028062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:25.031039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:25.032026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:25.033373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:25.036104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:25.038029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:25.092312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:25.108416 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a1bf51b-5d35-4779-a8f7-ef5529194490 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.735438 Sep 07 10:16:25.113515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2809/5570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:24 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:25.470071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:25.488367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cb8276d-f584-46d5-8b28-e19d2c8e0be7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1250 microversion: 2.1 time: 0.476806 Sep 07 10:16:25.505606 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2762/5571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:25 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1250 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:26.022415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:26.023097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:26.044877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.051239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.051780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:26.055684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.056212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.060786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:26.083965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fef9aedf-1606-476e-a0af-703ecf350000 req-cca69aa8-437c-45b6-b6ba-55e5066922ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6901633e-3cdc-42b4-9213-19d98bf94bcf", "tag": "ba7835ed-dde2-4c29-88cd-403c95b6b6f9"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:26.119007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fef9aedf-1606-476e-a0af-703ecf350000 req-cca69aa8-437c-45b6-b6ba-55e5066922ce service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.126229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fef9aedf-1606-476e-a0af-703ecf350000 req-cca69aa8-437c-45b6-b6ba-55e5066922ce service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.135619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fef9aedf-1606-476e-a0af-703ecf350000 req-cca69aa8-437c-45b6-b6ba-55e5066922ce service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:26.169318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fef9aedf-1606-476e-a0af-703ecf350000 req-cca69aa8-437c-45b6-b6ba-55e5066922ce service nova] Creating event network-changed:ba7835ed-dde2-4c29-88cd-403c95b6b6f9 for instance 6901633e-3cdc-42b4-9213-19d98bf94bcf on n-h2-836830-16 Sep 07 10:16:26.197126 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fef9aedf-1606-476e-a0af-703ecf350000 req-cca69aa8-437c-45b6-b6ba-55e5066922ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125402 Sep 07 10:16:26.201645 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2763/5572] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:26.223697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:26.224478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:26.243539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.244092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.244581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:26.245429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.245893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.251829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:26.755871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:26.783375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0299a11c-6629-4974-b994-993caa81671f tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 0.765804 Sep 07 10:16:26.785141 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2810/5573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:26 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:26.810072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:26.811388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:26.826551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.827584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.828220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:26.829269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:26.829916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:26.830513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:27.014834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:27.023251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:27.035751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2a1f45e-c36e-43c7-92ae-2fee725293e6 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.832445 Sep 07 10:16:27.036292 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2764/5574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:26 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:27.036689 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a81d1da1-f036-4387-97fe-acd88ada1b97 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1250 microversion: 2.1 time: 0.237212 Sep 07 10:16:27.038491 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2811/5575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:26 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1250 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:27.813508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:27.814759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:27.833740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:27.836806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:27.840705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:27.841751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:27.845548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:27.846210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:28.069906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:28.070558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:28.085126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:28.087485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:28.090033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:28.091414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:28.093495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:28.094148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:29.219535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:29.223749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:29.237566 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41310a92-9393-465c-b38c-2cae380cf9d7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 1.428306 Sep 07 10:16:29.242088 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2765/5576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:27 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:29.246222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb7f253f-8a50-4973-8889-fae0ecfe16af tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 1.182593 Sep 07 10:16:29.251387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:29.259510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:29.264285 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2812/5577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:28 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:29.270333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:29.270847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:29.271296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:29.272017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:29.272481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:29.272912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:29.936935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ca69d746-cf8a-46b0-8ef1-835ee655bb9d req-31d03447-d570-461e-838d-82664736faab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d442b292-6457-44c4-b65c-a96dca18c8e6", "name": "network-vif-plugged", "status": "completed", "tag": "39316e54-8a84-410d-b631-6fe6f72e619e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:29.952079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:29.970944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ca69d746-cf8a-46b0-8ef1-835ee655bb9d req-31d03447-d570-461e-838d-82664736faab service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:29.971884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ca69d746-cf8a-46b0-8ef1-835ee655bb9d req-31d03447-d570-461e-838d-82664736faab service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:29.972359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ca69d746-cf8a-46b0-8ef1-835ee655bb9d req-31d03447-d570-461e-838d-82664736faab service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:30.014998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ca69d746-cf8a-46b0-8ef1-835ee655bb9d req-31d03447-d570-461e-838d-82664736faab service nova] Creating event network-vif-plugged:39316e54-8a84-410d-b631-6fe6f72e619e for instance d442b292-6457-44c4-b65c-a96dca18c8e6 on n-h2-836830-16 Sep 07 10:16:30.024591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ca69d746-cf8a-46b0-8ef1-835ee655bb9d req-31d03447-d570-461e-838d-82664736faab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409470 Sep 07 10:16:30.025722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2813/5578] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:30.272990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:30.274108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:30.295295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:30.296205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:30.296760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:30.298343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:30.298886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:30.302652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:30.701159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:30.713522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06f42855-4317-434f-81cb-d74c2f441a93 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1292 microversion: 2.1 time: 1.468621 Sep 07 10:16:30.714468 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2766/5579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:29 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1292 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:30.735565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:30.738788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:30.741703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:30.747841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:30.748487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:30.749227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:30.750732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:30.751979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:30.752637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:31.267979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:31.284546 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de855608-64d4-4921-b9ee-c0acc5328068 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 1.020225 Sep 07 10:16:31.308173 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2814/5580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:30 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:31.315588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-12095ceb-e6a5-42ad-8c4e-9f1bc44df624 req-9748c284-6c48-4d03-9083-8cb7f0446b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2683eaa8-666b-4de2-9cb3-08274baa8a8a", "tag": "2f46a2b5-955f-4699-b0a6-d0131d5ab3c4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:31.333700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-12095ceb-e6a5-42ad-8c4e-9f1bc44df624 req-9748c284-6c48-4d03-9083-8cb7f0446b2b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:31.334196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-12095ceb-e6a5-42ad-8c4e-9f1bc44df624 req-9748c284-6c48-4d03-9083-8cb7f0446b2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:31.334660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-12095ceb-e6a5-42ad-8c4e-9f1bc44df624 req-9748c284-6c48-4d03-9083-8cb7f0446b2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:31.359888 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-12095ceb-e6a5-42ad-8c4e-9f1bc44df624 req-9748c284-6c48-4d03-9083-8cb7f0446b2b service nova] Creating event network-changed:2f46a2b5-955f-4699-b0a6-d0131d5ab3c4 for instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a on n-h1-836830-16 Sep 07 10:16:31.380841 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-12095ceb-e6a5-42ad-8c4e-9f1bc44df624 req-9748c284-6c48-4d03-9083-8cb7f0446b2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071002 Sep 07 10:16:31.382428 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2815/5581] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:31.498533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:31.507397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:31.515516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88398ab9-7a37-4122-8d59-62d7befb5d78 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.799513 Sep 07 10:16:31.518106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2767/5582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:30 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:31.741794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:31.742517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:31.752407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:31.758070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:31.758707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:31.759645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:31.760206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:31.760657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:32.017908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:32.032876 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0777407-8c11-4e7b-a5c6-97eeb7130c36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1292 microversion: 2.1 time: 0.290611 Sep 07 10:16:32.034222 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2816/5583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:31 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:32.096095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-029f373b-b9ba-4492-b590-43362be08812 req-26703b9a-8f7a-45db-95db-25387f0c1781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5deaad39-1ad1-4650-8a5b-1f7240aea9ec", "name": "network-vif-plugged", "status": "completed", "tag": "7f7b28e8-61bf-4837-93e3-24851ec46790"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:32.113511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:32.142898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-029f373b-b9ba-4492-b590-43362be08812 req-26703b9a-8f7a-45db-95db-25387f0c1781 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:32.143476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-029f373b-b9ba-4492-b590-43362be08812 req-26703b9a-8f7a-45db-95db-25387f0c1781 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:32.143818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-029f373b-b9ba-4492-b590-43362be08812 req-26703b9a-8f7a-45db-95db-25387f0c1781 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:32.186809 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-029f373b-b9ba-4492-b590-43362be08812 req-26703b9a-8f7a-45db-95db-25387f0c1781 service nova] Creating event network-vif-plugged:7f7b28e8-61bf-4837-93e3-24851ec46790 for instance 5deaad39-1ad1-4650-8a5b-1f7240aea9ec on n-h2-836830-16 Sep 07 10:16:32.200405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-029f373b-b9ba-4492-b590-43362be08812 req-26703b9a-8f7a-45db-95db-25387f0c1781 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104895 Sep 07 10:16:32.200405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2768/5584] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:16:32.317373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:32.318574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:32.342096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:32.342504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:32.343073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:32.343798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:32.344806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:32.344806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:32.543532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=24 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:32.557933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:32.558671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:32.570460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:32.571460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:32.572068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:32.573815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:32.574866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:32.575758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:33.222057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:33.232925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-260f7b5e-138c-4f4a-8e2d-ed57460a5e1e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1319 microversion: 2.1 time: 0.922736 Sep 07 10:16:33.234515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2817/5585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:32 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1319 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:33.247280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:33.255228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:33.283957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:33.284571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:33.285044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:33.286253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:33.286822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:33.291569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:33.470101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:33.488461 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5fe7743-3949-4e7b-880f-cf7738593ccd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.944769 Sep 07 10:16:33.489809 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2769/5586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:32 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:33.627538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:33.639920 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c7e4dbf4-818e-4737-bb19-03c14ec3b1dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1292 microversion: 2.1 time: 0.403416 Sep 07 10:16:33.641739 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2818/5587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:33 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:34.261551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:34.262463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:34.278875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:34.280833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:34.282445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:34.285449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:34.287115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:34.288639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:34.518396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:34.519510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:34.534113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:34.536001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:34.538969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:34.540288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:34.542093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:34.544102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.092064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:35.108211 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-966bf1c0-e449-4c9a-a21e-5399bd8c62bc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 200 len: 1507 microversion: 2.1 time: 0.851937 Sep 07 10:16:35.111533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2770/5588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:34 2022] GET /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 1507 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:35.122801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:35.127316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:35.153373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.154851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.155521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.157765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.158435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.159046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.230027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:35.248347 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4ee1f5f3-939f-48cf-93ad-c60be0797d2d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.735862 Sep 07 10:16:35.250449 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2819/5589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:34 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:35.256572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:35.257398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:35.264395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.265280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.266552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.267536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.268224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.270563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.355721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:16:35.612818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:35.627698 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00091be3-83eb-4d46-92a1-af0e877c2232 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1292 microversion: 2.1 time: 0.515059 Sep 07 10:16:35.631251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2771/5590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:35 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1292 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:35.640348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fa225e14-54dc-4fe9-9a07-b0e8cab8d15e req-fd1f195e-ab07-4715-95d3-7999ba42bbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c04ed6c-bc7e-4e72-9f48-cc88ebc18342", "tag": "703c3eb9-a941-4729-b1c1-3f6874b67ff8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:35.646011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3f03cc86-bfad-4d04-94ab-265806763d0c tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 204 len: 0 microversion: 2.1 time: 0.392955 Sep 07 10:16:35.647383 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2820/5591] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:16:35 2022] DELETE /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:16:35.661396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:35.662636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: d442b292-6457-44c4-b65c-a96dca18c8e6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:35.674573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fa225e14-54dc-4fe9-9a07-b0e8cab8d15e req-fd1f195e-ab07-4715-95d3-7999ba42bbd4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.683166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fa225e14-54dc-4fe9-9a07-b0e8cab8d15e req-fd1f195e-ab07-4715-95d3-7999ba42bbd4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.683653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fa225e14-54dc-4fe9-9a07-b0e8cab8d15e req-fd1f195e-ab07-4715-95d3-7999ba42bbd4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.693865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.695055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.695747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.706020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.708669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.710276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.723721 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fa225e14-54dc-4fe9-9a07-b0e8cab8d15e req-fd1f195e-ab07-4715-95d3-7999ba42bbd4 service nova] Creating event network-changed:703c3eb9-a941-4729-b1c1-3f6874b67ff8 for instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 on n-h2-836830-16 Sep 07 10:16:35.755032 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fa225e14-54dc-4fe9-9a07-b0e8cab8d15e req-fd1f195e-ab07-4715-95d3-7999ba42bbd4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121651 Sep 07 10:16:35.757764 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2772/5592] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:35.776018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-60a25026-ae17-4eb0-a3b8-c92e6f108aea req-914dfc03-1c01-44cd-a018-3ad8b2efd8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2683eaa8-666b-4de2-9cb3-08274baa8a8a", "name": "network-vif-plugged", "status": "completed", "tag": "2f46a2b5-955f-4699-b0a6-d0131d5ab3c4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:35.805048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-60a25026-ae17-4eb0-a3b8-c92e6f108aea req-914dfc03-1c01-44cd-a018-3ad8b2efd8b8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.805817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-60a25026-ae17-4eb0-a3b8-c92e6f108aea req-914dfc03-1c01-44cd-a018-3ad8b2efd8b8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.806422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-60a25026-ae17-4eb0-a3b8-c92e6f108aea req-914dfc03-1c01-44cd-a018-3ad8b2efd8b8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.819277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-60a25026-ae17-4eb0-a3b8-c92e6f108aea req-914dfc03-1c01-44cd-a018-3ad8b2efd8b8 service nova] Creating event network-vif-plugged:2f46a2b5-955f-4699-b0a6-d0131d5ab3c4 for instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a on n-h1-836830-16 Sep 07 10:16:35.824956 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-60a25026-ae17-4eb0-a3b8-c92e6f108aea req-914dfc03-1c01-44cd-a018-3ad8b2efd8b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061274 Sep 07 10:16:35.826116 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2773/5593] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:35.832224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:35.833241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:35.840124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.840848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.841480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:35.843193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:35.843818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:35.844941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:36.229216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:36.242508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d04aa42-8b8b-438a-b770-3eb52fe22f8b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/d442b292-6457-44c4-b65c-a96dca18c8e6" status: 200 len: 1507 microversion: 2.1 time: 0.590059 Sep 07 10:16:36.247801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2821/5594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:35 2022] GET /compute/v2.1/servers/d442b292-6457-44c4-b65c-a96dca18c8e6 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:36.275343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:36.276224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: d442b292-6457-44c4-b65c-a96dca18c8e6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:36.293660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:36.300806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:36.302268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:36.309370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:36.310746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:36.312230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:36.361637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:36.377216 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc6f2dc9-bdab-4114-8c55-bfa7f065bbf2 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1769 microversion: 2.1 time: 0.546996 Sep 07 10:16:36.378122 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2774/5595] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:35 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1769 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:36.392609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: d442b292-6457-44c4-b65c-a96dca18c8e6] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:16:36.397101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:36.401667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:36.433415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:36.440241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:36.443066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:36.443846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:36.444333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:36.444772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:36.527591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:36.658869 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-07178558-23eb-4d12-99f1-aeeb00bacb69 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d442b292-6457-44c4-b65c-a96dca18c8e6" status: 204 len: 0 microversion: 2.1 time: 0.385405 Sep 07 10:16:36.661048 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2822/5596] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:16:36 2022] DELETE /compute/v2.1/servers/d442b292-6457-44c4-b65c-a96dca18c8e6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:16:36.686472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:36.695040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:36.721902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:36.728532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:36.729197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:36.732283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:36.733707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:36.734388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:37.107091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:37.136750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3c36b67-a7a6-4744-b891-dd1063ec51dd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.756549 Sep 07 10:16:37.136921 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2775/5597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:36 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:37.155336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:37.155863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:37.171404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:37.172450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:37.173447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:37.175166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:37.177084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:37.180947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:37.207831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:37.217077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28dedcbd-d8d8-4f99-875e-f209c1241625 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1292 microversion: 2.1 time: 0.552479 Sep 07 10:16:37.235134 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2823/5598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:36 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1292 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:37.263203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 5deaad39-1ad1-4650-8a5b-1f7240aea9ec] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:16:37.385364 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bdbd9b6c-f4da-4a5c-a4cc-920c65fd4116 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec" status: 204 len: 0 microversion: 2.1 time: 0.244024 Sep 07 10:16:37.386967 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2776/5599] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:16:37 2022] DELETE /compute/v2.1/servers/5deaad39-1ad1-4650-8a5b-1f7240aea9ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:16:37.413652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:37.428612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:37.454496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:37.459774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:37.460363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:37.461149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:37.461675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:37.465689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:37.658456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2033799318", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "711b35a7-b575-4856-bc4b-f45b95b93f92"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:37.800886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] validate_networks() for [('711b35a7-b575-4856-bc4b-f45b95b93f92', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:16:38.042120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:38.057895 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5125a119-528a-4871-adab-ca8394d39574 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1769 microversion: 2.1 time: 0.657171 Sep 07 10:16:38.079063 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2824/5600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:37 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1769 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:38.086634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fc2444b8-2fa6-41c2-b536-1e86f1d5814b req-c4b6d43a-3b4f-40f6-b0a0-aff46103cc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6901633e-3cdc-42b4-9213-19d98bf94bcf", "name": "network-vif-plugged", "status": "completed", "tag": "ba7835ed-dde2-4c29-88cd-403c95b6b6f9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:38.105736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fc2444b8-2fa6-41c2-b536-1e86f1d5814b req-c4b6d43a-3b4f-40f6-b0a0-aff46103cc57 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.106617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fc2444b8-2fa6-41c2-b536-1e86f1d5814b req-c4b6d43a-3b4f-40f6-b0a0-aff46103cc57 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.107328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fc2444b8-2fa6-41c2-b536-1e86f1d5814b req-c4b6d43a-3b4f-40f6-b0a0-aff46103cc57 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.143222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fc2444b8-2fa6-41c2-b536-1e86f1d5814b req-c4b6d43a-3b4f-40f6-b0a0-aff46103cc57 service nova] Creating event network-vif-plugged:ba7835ed-dde2-4c29-88cd-403c95b6b6f9 for instance 6901633e-3cdc-42b4-9213-19d98bf94bcf on n-h2-836830-16 Sep 07 10:16:38.151318 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fc2444b8-2fa6-41c2-b536-1e86f1d5814b req-c4b6d43a-3b4f-40f6-b0a0-aff46103cc57 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070772 Sep 07 10:16:38.152432 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2825/5601] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:38.162507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:38.164099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:38.176749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.177652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.178509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.181031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.182924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.183608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.529010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:38.540317 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98622741-d62f-4a04-9412-cbc2921cc1d7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.383847 Sep 07 10:16:38.559480 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2826/5602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:38 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:38.565511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:38.566253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:38.581030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.583320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.584227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.586085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.586912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.587606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.880126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:16:38.880612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:16:38.881031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:16:38.881470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:16:38.881888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:16:38.899717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.900223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.902732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.903537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:38.904015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:38.904474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:38.926257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:38.935139 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62c5246e-2d3f-450e-89d9-5451525df80b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1472 microversion: 2.1 time: 0.374240 Sep 07 10:16:38.949007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Getting quotas for project ef23d42476644c53a897bf4d3e2510cd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:38.955619 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2827/5603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:38 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:38.972037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Getting quotas for user 1ac8a7a2db4f4028abdaebfe62cefc29 and project ef23d42476644c53a897bf4d3e2510cd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:39.001798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Going to run 2 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:16:39.006612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:39.089287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:39.090219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:39.102959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:39.103668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:39.106308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:39.108805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:39.110962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:39.112839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:39.166968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=6deeb30e-cd57-4894-832e-0ffb65d65389,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:39.346471 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9db039fe-02cf-4183-8d1d-95d856622269 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.690392 Sep 07 10:16:39.349437 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2777/5604] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:16:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 07 10:16:39.362804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-312492832", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:39.506910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:16:40.951232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:40.977049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba33fd17-eba4-47ef-995c-89cf9dfbd2a7 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1769 microversion: 2.1 time: 1.887530 Sep 07 10:16:40.977878 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2828/5605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:39 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1769 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:41.005214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:16:41.006035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:16:41.006723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:16:41.007461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:16:41.008208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:16:41.022136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:41.028852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:41.030282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.030680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Searching by: {'deleted': False, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:16:41.033141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.040876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.041673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.042302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.043370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.043997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.045278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.045597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.048948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.049706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.050315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.088352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:16:41.133394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3cb6def7-b316-4de7-aa37-3ad8379e6495 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.133337 Sep 07 10:16:41.134788 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2829/5606] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:16:40 2022] GET /compute/v2.1/servers => generated 1335 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:41.136173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:41.150902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:41.159295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:41.185569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:16:41.189158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:41.197460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:41.222912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.225035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.226302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.232433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.233669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.236171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.277476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cc52484-197b-480e-acb9-e1d9a6bd1201 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925470 Sep 07 10:16:41.278141 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2778/5607] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:16:41.301923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-40978c02-0774-4db9-b583-69cd70bedb71 req-9ce0a0d3-376d-4c8b-9e6f-18ec61a7cde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d442b292-6457-44c4-b65c-a96dca18c8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "39316e54-8a84-410d-b631-6fe6f72e619e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:41.333087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-40978c02-0774-4db9-b583-69cd70bedb71 req-9ce0a0d3-376d-4c8b-9e6f-18ec61a7cde4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.333626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-40978c02-0774-4db9-b583-69cd70bedb71 req-9ce0a0d3-376d-4c8b-9e6f-18ec61a7cde4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.334057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-40978c02-0774-4db9-b583-69cd70bedb71 req-9ce0a0d3-376d-4c8b-9e6f-18ec61a7cde4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.365755 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-40978c02-0774-4db9-b583-69cd70bedb71 req-9ce0a0d3-376d-4c8b-9e6f-18ec61a7cde4 service nova] Creating event network-vif-unplugged:39316e54-8a84-410d-b631-6fe6f72e619e for instance d442b292-6457-44c4-b65c-a96dca18c8e6 on n-h2-836830-16 Sep 07 10:16:41.380983 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-40978c02-0774-4db9-b583-69cd70bedb71 req-9ce0a0d3-376d-4c8b-9e6f-18ec61a7cde4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092130 Sep 07 10:16:41.382100 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2779/5608] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:41.392236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:41.393023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:41.405055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.405820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.406640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.407821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:41.408394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:41.409650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:41.635111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:41.649209 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9a1edea8-fb1c-44c7-8502-fc99a62f385b tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1270 microversion: 2.1 time: 0.264423 Sep 07 10:16:41.671990 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2780/5609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:41 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:41.689273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77342a26-c0ee-48c7-bf4e-f26f19316859 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:41.694959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77342a26-c0ee-48c7-bf4e-f26f19316859 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:41.738830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:41.748059 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b1428ec-cf72-4578-808f-b545e8f16da2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1373 microversion: 2.1 time: 0.609190 Sep 07 10:16:41.751247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2830/5610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:41 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1373 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:41.782959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77342a26-c0ee-48c7-bf4e-f26f19316859 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:16:42.006924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:42.007546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:42.019848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.020364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.027279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.032670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.034709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.036799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.457590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:42.473254 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a639f72-b88c-4787-9404-7476fb811bd4 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1769 microversion: 2.1 time: 0.471337 Sep 07 10:16:42.490972 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2831/5611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:42 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1769 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:42.532805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fcf52dc7-4889-468e-9f6a-998f71e868a2 req-514fa3f6-f968-4b35-973c-5533358bc3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d442b292-6457-44c4-b65c-a96dca18c8e6", "name": "network-vif-deleted", "tag": "39316e54-8a84-410d-b631-6fe6f72e619e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:42.537371 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.scheduler.client.report [None req-77342a26-c0ee-48c7-bf4e-f26f19316859 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Deleted allocations for instance a264f589-b16b-4591-840e-d4e4e31b7b11 Sep 07 10:16:42.543585 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.api [None req-77342a26-c0ee-48c7-bf4e-f26f19316859 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] Instance Mapping does not exist while attempting local delete cleanup. Sep 07 10:16:42.545090 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77342a26-c0ee-48c7-bf4e-f26f19316859 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11" status: 204 len: 0 microversion: 2.1 time: 0.869341 Sep 07 10:16:42.553605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fcf52dc7-4889-468e-9f6a-998f71e868a2 req-514fa3f6-f968-4b35-973c-5533358bc3b8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.554135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fcf52dc7-4889-468e-9f6a-998f71e868a2 req-514fa3f6-f968-4b35-973c-5533358bc3b8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.555993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fcf52dc7-4889-468e-9f6a-998f71e868a2 req-514fa3f6-f968-4b35-973c-5533358bc3b8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.562129 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2781/5612] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:16:41 2022] DELETE /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:16:42.585041 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fcf52dc7-4889-468e-9f6a-998f71e868a2 req-514fa3f6-f968-4b35-973c-5533358bc3b8 service nova] Creating event network-vif-deleted:39316e54-8a84-410d-b631-6fe6f72e619e for instance d442b292-6457-44c4-b65c-a96dca18c8e6 on n-h2-836830-16 Sep 07 10:16:42.586644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-929bc91b-719b-41dd-bfd8-f4ce58300603 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:42.590324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-929bc91b-719b-41dd-bfd8-f4ce58300603 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:42.612753 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fcf52dc7-4889-468e-9f6a-998f71e868a2 req-514fa3f6-f968-4b35-973c-5533358bc3b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083467 Sep 07 10:16:42.612905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-929bc91b-719b-41dd-bfd8-f4ce58300603 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-929bc91b-719b-41dd-bfd8-f4ce58300603 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 HTTP/1.1 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'a264f589-b16b-4591-840e-d4e4e31b7b11'} Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:42.619287 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:16:42.624431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:16:42.624431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:16:42.624431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:16:42.624431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:16:42.624431 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:42.624843 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2832/5613] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:16:42.626937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-929bc91b-719b-41dd-bfd8-f4ce58300603 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:16:42.628905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-929bc91b-719b-41dd-bfd8-f4ce58300603 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11" status: 404 len: 111 microversion: 2.1 time: 0.063352 Sep 07 10:16:42.633563 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2782/5614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:42 2022] GET /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:16:42.678455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:42.679254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:42.701990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.703661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.712576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.713617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.716899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.717489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.778741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:42.779806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:42.792040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.793139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.798335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.799464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:42.801858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:42.802992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:42.845426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:42.861224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee9d1148-01d3-4716-b84b-ed5d4131b414 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1276 microversion: 2.1 time: 0.188760 Sep 07 10:16:42.864130 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2833/5615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:42 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:43.071962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-497304634", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:43.264903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:16:44.008295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:44.020553 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d08461a-92e0-421d-8043-33b1535f7754 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1546 microversion: 2.1 time: 1.246230 Sep 07 10:16:44.022328 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2783/5616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:42 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1546 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:44.041749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e3bc7117-4e21-40e1-abd3-42e4b5ab9d50 req-ee1834ac-cb28-4351-a78f-ac2ce8877b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5deaad39-1ad1-4650-8a5b-1f7240aea9ec", "name": "network-vif-deleted", "tag": "7f7b28e8-61bf-4837-93e3-24851ec46790"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:44.080798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e3bc7117-4e21-40e1-abd3-42e4b5ab9d50 req-ee1834ac-cb28-4351-a78f-ac2ce8877b00 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.083056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e3bc7117-4e21-40e1-abd3-42e4b5ab9d50 req-ee1834ac-cb28-4351-a78f-ac2ce8877b00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.084965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e3bc7117-4e21-40e1-abd3-42e4b5ab9d50 req-ee1834ac-cb28-4351-a78f-ac2ce8877b00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:44.121344 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e3bc7117-4e21-40e1-abd3-42e4b5ab9d50 req-ee1834ac-cb28-4351-a78f-ac2ce8877b00 service nova] Creating event network-vif-deleted:7f7b28e8-61bf-4837-93e3-24851ec46790 for instance 5deaad39-1ad1-4650-8a5b-1f7240aea9ec on n-h2-836830-16 Sep 07 10:16:44.128377 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e3bc7117-4e21-40e1-abd3-42e4b5ab9d50 req-ee1834ac-cb28-4351-a78f-ac2ce8877b00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103198 Sep 07 10:16:44.129669 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2784/5617] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:44.135930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e7a625f2-21ae-4dd1-a2da-8741817fc3b9 req-720b6079-36d2-4e49-b500-c9e23d98e488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c04ed6c-bc7e-4e72-9f48-cc88ebc18342", "name": "network-vif-unplugged", "status": "completed", "tag": "703c3eb9-a941-4729-b1c1-3f6874b67ff8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:44.177344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e7a625f2-21ae-4dd1-a2da-8741817fc3b9 req-720b6079-36d2-4e49-b500-c9e23d98e488 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.181603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e7a625f2-21ae-4dd1-a2da-8741817fc3b9 req-720b6079-36d2-4e49-b500-c9e23d98e488 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.182489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e7a625f2-21ae-4dd1-a2da-8741817fc3b9 req-720b6079-36d2-4e49-b500-c9e23d98e488 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:44.206123 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e7a625f2-21ae-4dd1-a2da-8741817fc3b9 req-720b6079-36d2-4e49-b500-c9e23d98e488 service nova] Creating event network-vif-unplugged:703c3eb9-a941-4729-b1c1-3f6874b67ff8 for instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 on n-h2-836830-16 Sep 07 10:16:44.213920 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e7a625f2-21ae-4dd1-a2da-8741817fc3b9 req-720b6079-36d2-4e49-b500-c9e23d98e488 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082132 Sep 07 10:16:44.214768 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2785/5618] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:44.220876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:44.231981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:44.258745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.259179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.259627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:44.260354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.260813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.261270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:44.360289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.361100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.361779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:44.362439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lazy-loading 'fault' on Instance uuid 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:16:44.836139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb05ab7bca64333b3daff1f50e3a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c25592ca4dca40b49fe664804d13b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:44.865308 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-63f71e30-4535-4d0e-9dfb-b56e5b475701 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 200 len: 1384 microversion: 2.1 time: 0.647569 Sep 07 10:16:44.869340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2786/5619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:44 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 1384 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:44.878863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:44.879701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:44.895375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.896134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.898728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:44.899652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:44.900283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:44.901726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:45.484549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:45.502465 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-514b0cb6-5230-473c-a4b2-e19c03c43649 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1318 microversion: 2.1 time: 0.630453 Sep 07 10:16:45.518438 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2787/5620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:44 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:45.534473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:45.535309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:45.543774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:45.544618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:45.545329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:45.546315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:45.547168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:45.548440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.541350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:46.549972 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36e3c13d-2ae8-4744-8b7b-123d620fa268 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1546 microversion: 2.1 time: 1.029703 Sep 07 10:16:46.550352 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2788/5621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:45 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1546 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:46.556427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:46.557840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] [instance: 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:46.564736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.565597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.566292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.567248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.569588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.570297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.589171 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] HTTP exception thrown: Instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 could not be found. Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Request method failure captured: Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 HTTP/1.1 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG7tW8c4L5oQiVyo5iWqbO4PyAQp4Jtb4q1TGzdFFAHnqc0VA91hwTHNvk6kzug7fJua5ohg4l1j6-VHTdw-7I4kzwLCBH9gwJFHkAqGMLlZ2fRfYhDoVjnRgZhe7un_11q4WN2CE6RDp8CFNWXvWL3EpQ2jcKB1ZdWLsLKCJoCXVh4 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: c25592ca4dca40b49fe664804d13b84a Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1752326549 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25592ca4dca40b49fe664804d13b84a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25592ca4dca40b49fe664804d13b84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25592ca4dca40b49fe664804d13b84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25592ca4dca40b49fe664804d13b84a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1752326549 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: c25592ca4dca40b49fe664804d13b84a Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1752326549 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestSecurityGroupsBasicOps-1752326549-project Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: dcb05ab7bca64333b3daff1f50e3a8e9 Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1752326549-project Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 could not be found. Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6c04ed6c-bc7e-4e72-9f48-cc88ebc18342'} Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 could not be found. Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 could not be found. Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:46.590878 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 could not be found. Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Returning 404 to user: Instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65793b12-f559-4fb1-9ffd-cc9d19f287ce tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342" status: 404 len: 111 microversion: 2.1 time: 0.040405 Sep 07 10:16:46.595252 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2789/5622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:46 2022] GET /compute/v2.1/servers/6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:16:46.602649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c04ed6c-bc7e-4e72-9f48-cc88ebc18342", "name": "network-vif-deleted", "tag": "703c3eb9-a941-4729-b1c1-3f6874b67ff8"}, {"name": "network-changed", "server_uuid": "6deeb30e-cd57-4894-832e-0ffb65d65389", "tag": "a9d6dec6-d1c3-43df-a256-f47b3786d7e8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:46.623225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.626602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.629780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.651016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] Creating event network-vif-deleted:703c3eb9-a941-4729-b1c1-3f6874b67ff8 for instance 6c04ed6c-bc7e-4e72-9f48-cc88ebc18342 on n-h2-836830-16 Sep 07 10:16:46.651694 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] Creating event network-changed:a9d6dec6-d1c3-43df-a256-f47b3786d7e8 for instance 6deeb30e-cd57-4894-832e-0ffb65d65389 on n-h1-836830-16 Sep 07 10:16:46.663254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c8569f25-9d6d-4940-9422-e8a80ba022c3 req-cc6593a2-116f-4b1a-85ea-3f594ed8a404 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068517 Sep 07 10:16:46.665072 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2790/5623] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:46.674262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:46.676256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:46.695315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.697292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.710964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.713833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.714976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.715709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.726455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:46.817672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:16:46.819065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:16:46.819955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:16:46.820855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:16:46.822597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:16:46.838513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.839368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.840111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.841114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:46.842443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:46.843482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:46.894613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:16:46.902540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:16:46.919089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:16:46.923060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:16:47.019133 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c460eabe-1bb2-4647-93c0-5b430580f116 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.951573 Sep 07 10:16:47.025037 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2834/5624] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 10:16:47.038438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7145d67d-fac1-42a4-8931-dc0a26810738 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:47.039279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7145d67d-fac1-42a4-8931-dc0a26810738 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:47.308565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7145d67d-fac1-42a4-8931-dc0a26810738 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:47.321713 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7145d67d-fac1-42a4-8931-dc0a26810738 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1220 microversion: 2.1 time: 0.287660 Sep 07 10:16:47.323683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2835/5625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:47 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1220 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:47.414050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:47.433079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bbd62ec6-1269-43cb-aeed-433015c2c735 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1318 microversion: 2.1 time: 0.766196 Sep 07 10:16:47.433900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2791/5626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:46 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:48.348697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:48.350832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:48.363016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:48.364569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:48.367216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:48.368547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:48.369807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:48.371985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:48.459124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:48.460648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:48.472777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:48.528667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:48.534497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:48.537038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:48.539577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:48.542840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:48.546452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:48.644540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:48.662525 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1487ef1-e070-418a-a581-77818d0b076c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1216 microversion: 2.1 time: 0.318091 Sep 07 10:16:48.663880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2836/5627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:48 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1216 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:49.067442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:49.080237 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88069bc7-ff4b-445c-8c55-726fa58b77a6 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1318 microversion: 2.1 time: 0.625732 Sep 07 10:16:49.082206 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2792/5628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:48 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:49.690343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:49.691852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:49.713251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:49.714028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:49.714756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:49.717534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:49.718246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:49.719054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:49.970933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:50.003676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9946423b-1027-4a3f-9109-e594a2512624 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1278 microversion: 2.1 time: 0.316698 Sep 07 10:16:50.019891 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2837/5629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:49 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:50.113256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:50.115108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:50.128108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:50.129762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:50.131081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:50.135266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:50.137569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:50.138751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:50.504625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:50.522828 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c160bfd9-2817-4a27-b00f-d83e800a71e4 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1318 microversion: 2.1 time: 0.418558 Sep 07 10:16:50.524500 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2793/5630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:50 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:50.636829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-bfa3756e-c0c1-4dc3-9ed9-ce8d89c11f36 req-aca311d2-bcb3-4844-ade7-bc7f631e1119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff", "tag": "7c56d807-881a-4711-950c-51f59bf6c00e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:50.658075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfa3756e-c0c1-4dc3-9ed9-ce8d89c11f36 req-aca311d2-bcb3-4844-ade7-bc7f631e1119 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:50.658678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfa3756e-c0c1-4dc3-9ed9-ce8d89c11f36 req-aca311d2-bcb3-4844-ade7-bc7f631e1119 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:50.659139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-bfa3756e-c0c1-4dc3-9ed9-ce8d89c11f36 req-aca311d2-bcb3-4844-ade7-bc7f631e1119 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:50.675851 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-bfa3756e-c0c1-4dc3-9ed9-ce8d89c11f36 req-aca311d2-bcb3-4844-ade7-bc7f631e1119 service nova] Creating event network-changed:7c56d807-881a-4711-950c-51f59bf6c00e for instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff on n-h1-836830-16 Sep 07 10:16:50.685668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-bfa3756e-c0c1-4dc3-9ed9-ce8d89c11f36 req-aca311d2-bcb3-4844-ade7-bc7f631e1119 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065216 Sep 07 10:16:50.688938 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2838/5631] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:51.032911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:51.034745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:51.048352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:51.052885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:51.054685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:51.058088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:51.059016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:51.060691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:51.108558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:51.287390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9c4ada5f-3374-4ce1-a7a5-c6b40513ac47 req-0fa23229-0dbe-446c-9413-af943e8782cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6deeb30e-cd57-4894-832e-0ffb65d65389", "name": "network-vif-plugged", "status": "completed", "tag": "a9d6dec6-d1c3-43df-a256-f47b3786d7e8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:51.309158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9c4ada5f-3374-4ce1-a7a5-c6b40513ac47 req-0fa23229-0dbe-446c-9413-af943e8782cb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:51.313009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9c4ada5f-3374-4ce1-a7a5-c6b40513ac47 req-0fa23229-0dbe-446c-9413-af943e8782cb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:51.316453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9c4ada5f-3374-4ce1-a7a5-c6b40513ac47 req-0fa23229-0dbe-446c-9413-af943e8782cb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:51.341754 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9c4ada5f-3374-4ce1-a7a5-c6b40513ac47 req-0fa23229-0dbe-446c-9413-af943e8782cb service nova] Creating event network-vif-plugged:a9d6dec6-d1c3-43df-a256-f47b3786d7e8 for instance 6deeb30e-cd57-4894-832e-0ffb65d65389 on n-h1-836830-16 Sep 07 10:16:51.353109 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9c4ada5f-3374-4ce1-a7a5-c6b40513ac47 req-0fa23229-0dbe-446c-9413-af943e8782cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071391 Sep 07 10:16:51.354311 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2839/5632] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:51.549222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:51.553542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:51.565552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:51.569057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:51.569596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:51.570316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:51.570805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:51.571255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:51.991327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:52.006702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:52.028431 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2a619a33-eabf-41e8-91dd-20e06d469850 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 1.002935 Sep 07 10:16:52.037567 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2794/5633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:51 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:52.238474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:52.274473 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6b2f930d-1929-469a-b676-aeb69cc02920 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1318 microversion: 2.1 time: 0.722304 Sep 07 10:16:52.275748 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2840/5634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:51 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:53.077698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:53.079066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:53.099997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:53.100830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:53.102857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:53.107594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:53.109691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:53.115278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:53.300515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:53.303894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:53.318902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:53.319806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:53.337835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:53.340379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:53.341008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:53.341614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:53.693045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:53.707836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5441e37-d289-4822-8cf4-088c2246a356 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.640387 Sep 07 10:16:53.708763 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2795/5635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:53 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:53.856023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:53.870051 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf72034d-b0c1-468b-a151-811c21f2c7be tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1318 microversion: 2.1 time: 0.574895 Sep 07 10:16:53.871203 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2841/5636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:53 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:53.896112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-866bacd0-f2f7-4935-b2a2-b8ac0f64dff6 req-5d9e9495-d483-403c-8b6d-49d8c2553f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022fcca4-c72e-4ee5-8c8e-b1f06da757ee", "tag": "4d212a9c-5bf0-4c87-b945-204ed9c7dd81"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:53.923142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-866bacd0-f2f7-4935-b2a2-b8ac0f64dff6 req-5d9e9495-d483-403c-8b6d-49d8c2553f16 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:53.923631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-866bacd0-f2f7-4935-b2a2-b8ac0f64dff6 req-5d9e9495-d483-403c-8b6d-49d8c2553f16 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:53.924064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-866bacd0-f2f7-4935-b2a2-b8ac0f64dff6 req-5d9e9495-d483-403c-8b6d-49d8c2553f16 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:53.988724 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-866bacd0-f2f7-4935-b2a2-b8ac0f64dff6 req-5d9e9495-d483-403c-8b6d-49d8c2553f16 service nova] Creating event network-changed:4d212a9c-5bf0-4c87-b945-204ed9c7dd81 for instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee on n-h2-836830-16 Sep 07 10:16:54.015490 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-866bacd0-f2f7-4935-b2a2-b8ac0f64dff6 req-5d9e9495-d483-403c-8b6d-49d8c2553f16 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123318 Sep 07 10:16:54.016114 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2796/5637] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:54.733752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:54.735906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:54.752098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:54.752919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:54.754339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:54.758624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:54.762250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:54.764819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:54.896244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:54.896962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:54.930906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:54.934042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:54.935319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:54.938213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:54.938694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:54.939126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:55.309712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:55.319774 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc919b6a-0c7d-47e0-ae19-7d61ae3e79b2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.590272 Sep 07 10:16:55.322463 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2842/5638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:54 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:55.481952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:55.496358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f9cc997-d367-4161-8c80-562a47f65df1 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 200 len: 1506 microversion: 2.1 time: 0.603739 Sep 07 10:16:55.496971 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2797/5639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:54 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:55.522859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:55.525160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:55.542141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:55.543690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:55.545119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:55.550907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:55.556714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:55.557906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:55.570084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:55.860885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:55.880829 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab467b03-4719-4669-b5a2-db419936686e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1318 microversion: 2.1 time: 0.363864 Sep 07 10:16:55.882790 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2843/5640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:55 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:56.345540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:56.346300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:56.362169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:56.364421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:56.365491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:56.366266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:56.370103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:56.370567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:56.901995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:56.910276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:56.912184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:56.940000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:56.941378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:56.942326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:56.943583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:56.945033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:56.945768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:57.660767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:16:57.854169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:57.869012 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce0e5762-0ed0-4866-ad8a-e857ee2a483a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 1.528857 Sep 07 10:16:57.869647 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2798/5641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:56 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:57.889599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-249b3599-f8e1-44ed-aaec-b61dc8ccb23b req-158f2c00-2bf9-469a-8320-0a3130def2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff", "name": "network-vif-plugged", "status": "completed", "tag": "7c56d807-881a-4711-950c-51f59bf6c00e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:16:57.919633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-249b3599-f8e1-44ed-aaec-b61dc8ccb23b req-158f2c00-2bf9-469a-8320-0a3130def2d3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:57.920114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-249b3599-f8e1-44ed-aaec-b61dc8ccb23b req-158f2c00-2bf9-469a-8320-0a3130def2d3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:57.920568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-249b3599-f8e1-44ed-aaec-b61dc8ccb23b req-158f2c00-2bf9-469a-8320-0a3130def2d3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:57.952098 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-249b3599-f8e1-44ed-aaec-b61dc8ccb23b req-158f2c00-2bf9-469a-8320-0a3130def2d3 service nova] Creating event network-vif-plugged:7c56d807-881a-4711-950c-51f59bf6c00e for instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff on n-h1-836830-16 Sep 07 10:16:57.970256 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-249b3599-f8e1-44ed-aaec-b61dc8ccb23b req-158f2c00-2bf9-469a-8320-0a3130def2d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097625 Sep 07 10:16:57.973138 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2799/5642] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:16:58.790378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:58.804807 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb681e1c-4ad3-4274-8044-9b3992336862 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1318 microversion: 2.1 time: 1.900144 Sep 07 10:16:58.805922 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2844/5643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:56 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1318 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:16:58.897443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:58.898168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:58.916769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:58.917384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:58.918366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:58.921845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:58.922408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:58.923729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:59.291032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:16:59.307345 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1e87aaee-6c8b-4e31-a08f-73d3312a8d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.413679 Sep 07 10:16:59.309504 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2800/5644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:58 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:16:59.860205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:16:59.861779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:16:59.892795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:59.895444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:59.898823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:16:59.901000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:16:59.902301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:16:59.905000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:00.335522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:00.336155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:00.347973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:00.348652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:00.349101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:00.349853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:00.350327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:00.350751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:00.610427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:00.636345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb3c566b-a688-40af-8170-50137923d314 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1318 microversion: 2.1 time: 0.805399 Sep 07 10:17:00.668391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2845/5645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:16:59 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:00.782695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:00.798988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5b803f64-ef94-41e7-a03b-524d8d10f7e3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.467675 Sep 07 10:17:00.799601 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2801/5646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:00 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:01.382584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81ba04dd-8096-4bc3-bcda-84abe9a88779 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] Calling method '.version_select at 0x7f14b07be940>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:01.398292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:01.430843 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81ba04dd-8096-4bc3-bcda-84abe9a88779 tempest-TestSecurityGroupsBasicOps-1752326549 tempest-TestSecurityGroupsBasicOps-1752326549-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-284265718" status: 202 len: 0 microversion: 2.1 time: 0.052899 Sep 07 10:17:01.434392 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2846/5647] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-284265718 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:17:01.676874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:01.681391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:01.707705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:01.708605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:01.709272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:01.712220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:01.712888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:01.714542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:01.822706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:01.823395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:01.836764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:01.837316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:01.838600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:01.839395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:01.839834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:01.840270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:02.235582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:02.261470 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-50d3057a-ea48-440f-8969-09faff6ad911 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1507 microversion: 2.1 time: 0.595738 Sep 07 10:17:02.262744 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2802/5648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:01 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:02.299681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:02.300733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:02.313595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:02.314104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:02.315324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:02.315458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:02.316108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:02.316575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:02.317064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:02.336446 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a291e07d-b7c6-46fa-886d-a751b1ebd930 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.508721 Sep 07 10:17:02.350652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2847/5649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:01 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:02.419741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:02.616671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b28fa46-96c9-4114-8000-908f2fa06507 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 204 len: 0 microversion: 2.1 time: 0.321659 Sep 07 10:17:02.618796 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2803/5650] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:02 2022] DELETE /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:17:02.628621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:02.629790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:02.649004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:02.649639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:02.650311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:02.651872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:02.652531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:02.653423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:02.718449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:02.870301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac63e83c-dc16-42fc-83ca-b3df3f2edd7e tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 204 len: 0 microversion: 2.1 time: 0.246283 Sep 07 10:17:02.878352 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2848/5651] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:02 2022] DELETE /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:17:02.888238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:02.889666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:02.918841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:02.926232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:02.928405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:02.930552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:02.931229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:02.932264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:03.349619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:03.365736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:03.367384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:03.380700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:03.385976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:03.392251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:03.393779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:03.394543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:03.395269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:03.409962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f211867-fadb-471f-a06f-621880dd39fb tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1513 microversion: 2.1 time: 0.530020 Sep 07 10:17:03.447480 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2804/5652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:02 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:03.458979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e29e4580-cc25-4668-a116-07817aa708d6 req-bc8c02dd-863f-4492-b055-faf7cca6a720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022fcca4-c72e-4ee5-8c8e-b1f06da757ee", "name": "network-vif-plugged", "status": "completed", "tag": "4d212a9c-5bf0-4c87-b945-204ed9c7dd81"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:03.484089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e29e4580-cc25-4668-a116-07817aa708d6 req-bc8c02dd-863f-4492-b055-faf7cca6a720 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:03.490487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e29e4580-cc25-4668-a116-07817aa708d6 req-bc8c02dd-863f-4492-b055-faf7cca6a720 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:03.491181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e29e4580-cc25-4668-a116-07817aa708d6 req-bc8c02dd-863f-4492-b055-faf7cca6a720 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:03.525303 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e29e4580-cc25-4668-a116-07817aa708d6 req-bc8c02dd-863f-4492-b055-faf7cca6a720 service nova] Creating event network-vif-plugged:4d212a9c-5bf0-4c87-b945-204ed9c7dd81 for instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee on n-h2-836830-16 Sep 07 10:17:03.546120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e29e4580-cc25-4668-a116-07817aa708d6 req-bc8c02dd-863f-4492-b055-faf7cca6a720 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098845 Sep 07 10:17:03.550015 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2805/5653] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:03.916744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:03.934375 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c958c3ef-6522-499a-a27b-5c451b1c4687 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.573745 Sep 07 10:17:03.935567 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2849/5654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:03 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:04.458717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:04.462052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:04.485260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:04.486341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:04.487969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:04.489469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:04.490740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:04.491358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:04.825941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:04.845387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f8860ac-706c-4deb-9804-28c68693ff22 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1513 microversion: 2.1 time: 0.397794 Sep 07 10:17:04.847753 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2806/5655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:04 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:04.960042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:04.960701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:04.982375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:04.986653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:04.989842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:04.990978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:04.995739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:05.000236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:05.496583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:05.517008 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4fda4027-4cee-457f-9e91-e37d7dfa9634 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1320 microversion: 2.1 time: 0.552983 Sep 07 10:17:05.517724 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2850/5656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:04 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:05.874166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:05.875076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:05.886719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:05.887584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:05.888143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:05.889019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:05.889884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:05.890866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:06.494524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-504d326e-f78f-4871-802c-faf33eed717c req-bf4ac7a8-3b43-40b8-bb44-2acaf7e341c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6deeb30e-cd57-4894-832e-0ffb65d65389", "name": "network-vif-deleted", "tag": "a9d6dec6-d1c3-43df-a256-f47b3786d7e8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:06.528864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-504d326e-f78f-4871-802c-faf33eed717c req-bf4ac7a8-3b43-40b8-bb44-2acaf7e341c4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:06.548586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-504d326e-f78f-4871-802c-faf33eed717c req-bf4ac7a8-3b43-40b8-bb44-2acaf7e341c4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:06.550222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-504d326e-f78f-4871-802c-faf33eed717c req-bf4ac7a8-3b43-40b8-bb44-2acaf7e341c4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:06.579153 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-504d326e-f78f-4871-802c-faf33eed717c req-bf4ac7a8-3b43-40b8-bb44-2acaf7e341c4 service nova] Creating event network-vif-deleted:a9d6dec6-d1c3-43df-a256-f47b3786d7e8 for instance 6deeb30e-cd57-4894-832e-0ffb65d65389 on n-h1-836830-16 Sep 07 10:17:06.602787 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-504d326e-f78f-4871-802c-faf33eed717c req-bf4ac7a8-3b43-40b8-bb44-2acaf7e341c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112395 Sep 07 10:17:06.610546 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2851/5657] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:06.619047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:06.636335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:06.643202 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e34cee0-6faf-4079-bcfd-5b78adf319b7 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1513 microversion: 2.1 time: 0.779098 Sep 07 10:17:06.644027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:06.648053 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2807/5658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:05 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1513 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:06.660490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:06.662009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:06.663830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:06.675168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:06.678146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:06.680079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.583464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:07.593483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-622cf16d-1dd9-48cd-bc70-ef0d1e16694f req-ec91f488-c8b5-4703-b0f4-8787c58e3914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff", "name": "network-vif-deleted", "tag": "7c56d807-881a-4711-950c-51f59bf6c00e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:07.594874 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d07fd940-89e3-4314-87a7-fa820b9b463e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1501 microversion: 2.1 time: 0.982546 Sep 07 10:17:07.595485 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2852/5659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:06 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1501 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:07.626468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:07.627114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:07.639532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-622cf16d-1dd9-48cd-bc70-ef0d1e16694f req-ec91f488-c8b5-4703-b0f4-8787c58e3914 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:07.641759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-622cf16d-1dd9-48cd-bc70-ef0d1e16694f req-ec91f488-c8b5-4703-b0f4-8787c58e3914 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:07.642475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-622cf16d-1dd9-48cd-bc70-ef0d1e16694f req-ec91f488-c8b5-4703-b0f4-8787c58e3914 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.645112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:07.645938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:07.650611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.652671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:07.661670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:07.662353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.683789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:07.686589 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-622cf16d-1dd9-48cd-bc70-ef0d1e16694f req-ec91f488-c8b5-4703-b0f4-8787c58e3914 service nova] Creating event network-vif-deleted:7c56d807-881a-4711-950c-51f59bf6c00e for instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff on n-h1-836830-16 Sep 07 10:17:07.695487 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-622cf16d-1dd9-48cd-bc70-ef0d1e16694f req-ec91f488-c8b5-4703-b0f4-8787c58e3914 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.611882 Sep 07 10:17:07.696672 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2808/5660] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:07.707677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:07.708589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:07.720707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:07.721782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:07.723582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.724773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:07.725723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:07.726478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.800693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:07.807959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:07.808645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:07.813348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lazy-loading 'fault' on Instance uuid e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:17:07.967330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8a7a2db4f4028abdaebfe62cefc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef23d42476644c53a897bf4d3e2510cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:07.977712 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-864c3026-5a45-4a16-9cd7-64bd4fda1265 tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 200 len: 1308 microversion: 2.1 time: 0.279143 Sep 07 10:17:07.991153 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2809/5661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:07 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:08.055029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:08.070647 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8279f8c4-40b3-4586-afce-2a55ba4ac9d3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1501 microversion: 2.1 time: 0.447359 Sep 07 10:17:08.071263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2853/5662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:07 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1501 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:08.098403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:08.101565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:08.109303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:08.110237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:08.111833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:08.112679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:08.114096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:08.115415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:08.162045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:08.344509 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37282f67-d778-48fc-952a-5c4155f2db76 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 204 len: 0 microversion: 2.1 time: 0.250551 Sep 07 10:17:08.346496 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2810/5663] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:08 2022] DELETE /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:17:08.356926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:08.357746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:08.367077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:08.368180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:08.369811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:08.372803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:08.374043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:08.376751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:08.725513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:08.735214 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-85ccf2b4-53b8-4f56-b909-cea1d160a087 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1507 microversion: 2.1 time: 0.382833 Sep 07 10:17:08.736199 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2854/5664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:08 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:09.012756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:09.016583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:09.039728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:09.040613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:09.041468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:09.042814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:09.043680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:09.044463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:09.121942 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] HTTP exception thrown: Instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff could not be found. Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Request method failure captured: Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff HTTP/1.1 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9j2Ath_WWdVDHpHUMP88voMJj5TFEdd1UXGpkA6IJyxK5lbLrbvNfJ5So9ID7hX2AJ2WccdB7zt-9jaeJXBLxtoKcV0l4ivlaAAZyXMbRVUbmbbXf-RVNfMBFHoqtHebtGZAC8efj3dRfABlbQHBOdtLKm8VF8_HDV6bXzkQ8mDCU Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ef23d42476644c53a897bf4d3e2510cd Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-MultipleCreateTestJSON-1980987051 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ef23d42476644c53a897bf4d3e2510cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ef23d42476644c53a897bf4d3e2510cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ef23d42476644c53a897bf4d3e2510cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ef23d42476644c53a897bf4d3e2510cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-MultipleCreateTestJSON-1980987051 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ef23d42476644c53a897bf4d3e2510cd Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1980987051 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-MultipleCreateTestJSON-1980987051-project Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 1ac8a7a2db4f4028abdaebfe62cefc29 Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-MultipleCreateTestJSON-1980987051-project Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff could not be found. Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff'} Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff could not be found. Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff could not be found. Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:09.123604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff could not be found. Sep 07 10:17:09.129745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.132412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Returning 404 to user: Instance e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:09.134656 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f672bf22-d4bb-4279-a08b-6a1b6c20f8dc tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff" status: 404 len: 111 microversion: 2.1 time: 0.131684 Sep 07 10:17:09.138156 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2811/5665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:09 2022] GET /compute/v2.1/servers/e6dacc2a-460c-4ebf-bcf3-05d8ff9962ff => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:09.155468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:09.157553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] [instance: 6deeb30e-cd57-4894-832e-0ffb65d65389] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:09.167417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:09.168468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:09.168975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:09.170173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:09.171023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:09.172252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:09.193905 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] HTTP exception thrown: Instance 6deeb30e-cd57-4894-832e-0ffb65d65389 could not be found. Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Request method failure captured: Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 HTTP/1.1 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9j2Ath_WWdVDHpHUMP88voMJj5TFEdd1UXGpkA6IJyxK5lbLrbvNfJ5So9ID7hX2AJ2WccdB7zt-9jaeJXBLxtoKcV0l4ivlaAAZyXMbRVUbmbbXf-RVNfMBFHoqtHebtGZAC8efj3dRfABlbQHBOdtLKm8VF8_HDV6bXzkQ8mDCU Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: ef23d42476644c53a897bf4d3e2510cd Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-MultipleCreateTestJSON-1980987051 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ef23d42476644c53a897bf4d3e2510cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ef23d42476644c53a897bf4d3e2510cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ef23d42476644c53a897bf4d3e2510cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ef23d42476644c53a897bf4d3e2510cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-MultipleCreateTestJSON-1980987051 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: ef23d42476644c53a897bf4d3e2510cd Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1980987051 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-MultipleCreateTestJSON-1980987051-project Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 1ac8a7a2db4f4028abdaebfe62cefc29 Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-MultipleCreateTestJSON-1980987051-project Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6deeb30e-cd57-4894-832e-0ffb65d65389 could not be found. Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6deeb30e-cd57-4894-832e-0ffb65d65389'} Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6deeb30e-cd57-4894-832e-0ffb65d65389 could not be found. Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6deeb30e-cd57-4894-832e-0ffb65d65389 could not be found. Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:09.196241 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6deeb30e-cd57-4894-832e-0ffb65d65389 could not be found. Sep 07 10:17:09.202183 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:09.205887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] Returning 404 to user: Instance 6deeb30e-cd57-4894-832e-0ffb65d65389 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:09.207895 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82d0067a-2f09-4a9a-a4a6-d38192bb027c tempest-MultipleCreateTestJSON-1980987051 tempest-MultipleCreateTestJSON-1980987051-project] 10.222.0.60 "GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389" status: 404 len: 111 microversion: 2.1 time: 0.064105 Sep 07 10:17:09.209167 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2855/5666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:09 2022] GET /compute/v2.1/servers/6deeb30e-cd57-4894-832e-0ffb65d65389 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:09.770194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:09.770816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:09.779308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:09.779801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:09.783582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:09.785443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:09.787283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:09.788671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:10.770135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:10.785228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c1cc9f21-7921-46a8-a170-669f6b73340f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1507 microversion: 2.1 time: 1.025002 Sep 07 10:17:10.785500 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2812/5667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:09 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1507 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:11.677568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4d74ed9a-2159-4366-8cc5-0c58aa1009ca req-0f2a5be4-e6ea-4236-8db8-aeebf1831ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022fcca4-c72e-4ee5-8c8e-b1f06da757ee", "name": "network-vif-deleted", "tag": "4d212a9c-5bf0-4c87-b945-204ed9c7dd81"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:11.732979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d74ed9a-2159-4366-8cc5-0c58aa1009ca req-0f2a5be4-e6ea-4236-8db8-aeebf1831ba9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:11.733534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d74ed9a-2159-4366-8cc5-0c58aa1009ca req-0f2a5be4-e6ea-4236-8db8-aeebf1831ba9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:11.736362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d74ed9a-2159-4366-8cc5-0c58aa1009ca req-0f2a5be4-e6ea-4236-8db8-aeebf1831ba9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:11.758990 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d74ed9a-2159-4366-8cc5-0c58aa1009ca req-0f2a5be4-e6ea-4236-8db8-aeebf1831ba9 service nova] Creating event network-vif-deleted:4d212a9c-5bf0-4c87-b945-204ed9c7dd81 for instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee on n-h2-836830-16 Sep 07 10:17:11.770030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4d74ed9a-2159-4366-8cc5-0c58aa1009ca req-0f2a5be4-e6ea-4236-8db8-aeebf1831ba9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098956 Sep 07 10:17:11.773648 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2856/5668] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:11.811125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:11.811733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:11.829547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:11.830186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:11.833448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:11.834251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:11.837936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:11.838476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:11.934868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:11.939231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:11.957862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:11.959767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lazy-loading 'fault' on Instance uuid 022fcca4-c72e-4ee5-8c8e-b1f06da757ee {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:17:12.393319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:12.411604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc0cc627-51d5-4720-92a9-8dbe984de9a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 200 len: 1310 microversion: 2.1 time: 0.604311 Sep 07 10:17:12.417075 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2813/5669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:11 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 1310 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:12.623483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:12.625140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:12.646136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:12.646646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:12.647111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:12.647857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:12.648361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:12.648804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:12.727744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:12.895982 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcc999df-e3fb-4762-bca5-05616546be6a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 204 len: 0 microversion: 2.1 time: 0.295209 Sep 07 10:17:12.902256 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2857/5670] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:12 2022] DELETE /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:17:12.912102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:12.912823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:12.934451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:12.937835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:12.940789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:12.945253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:12.945970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:12.949309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:13.439592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:13.440358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:13.455457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:13.455998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:13.456476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:13.457284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:13.457723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:13.458169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:13.516413 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee HTTP/1.1 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '022fcca4-c72e-4ee5-8c8e-b1f06da757ee'} Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:13.519016 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:17:13.524139 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:13.527152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:13.528332 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-64c3460c-4667-464b-855a-128768625a9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 404 len: 111 microversion: 2.1 time: 0.094565 Sep 07 10:17:13.539030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2858/5671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:13 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:13.549824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e6cafac-c742-4d8e-9f8d-bf3ae03b49a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: .version_select at 0x7f14b09d6c10>, body: {"keypair": {"name": "tempest-key-789785631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELHnzAebkUk4S6Wo6xNHPhA5R26MeqEWVHAE72G7kj87QaTBCh8Cb5RqvHqsxrZYhAQXtcLAsGsDh9JEJAZKXP8rfJXSPU4BNQ6qMzz1TwsR34w8dkuA03oq6sDFaSB5g=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:13.596044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4e6cafac-c742-4d8e-9f8d-bf3ae03b49a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:17:13.605527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4e6cafac-c742-4d8e-9f8d-bf3ae03b49a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:17:13.665682 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e6cafac-c742-4d8e-9f8d-bf3ae03b49a9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.124662 Sep 07 10:17:13.666315 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2859/5672] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:13.683200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-654cf551-c90a-452e-9ee2-8a891e84f65f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '.version_select at 0x7f14b0928040>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:13.694995 n-d-836830-16 devstack@n-api.service[128832]: WARNING oslo_db.sqlalchemy.utils [None req-654cf551-c90a-452e-9ee2-8a891e84f65f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 10:17:13.708075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:13.717776 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-654cf551-c90a-452e-9ee2-8a891e84f65f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.040187 Sep 07 10:17:13.719049 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2860/5673] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 7 10:17:13 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:13.727005 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0bc24120-5557-4b1e-a271-6b62a4c08910 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1552 microversion: 2.1 time: 0.819748 Sep 07 10:17:13.728007 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2814/5674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:12 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1552 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:13.922263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1743651051", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-key-789785631", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:14.036626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:17:14.758137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:14.758771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:14.775243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:14.775946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:14.776580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:14.785508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:14.786315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:14.787619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:15.935830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:15.947513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-38ec4255-4558-49f2-a860-2ae200e3f34c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1552 microversion: 2.1 time: 1.194757 Sep 07 10:17:15.951638 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2815/5675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:14 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1552 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:16.268492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:17:16.271141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:17:16.272370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:17:16.272915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:17:16.273679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:17:16.308770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:16.311234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:16.316443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:16.317785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:16.322779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:16.325285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:16.426636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:17:16.454896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:17:16.509143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:17:16.514393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:17:16.668602 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8610973c-3a5d-4981-8a38-060cf1e22da9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.756107 Sep 07 10:17:16.670242 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2861/5676] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:17:16.682182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f5bfffc8-2051-4d8d-8363-4be0b88ccd0c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:16.683036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f5bfffc8-2051-4d8d-8363-4be0b88ccd0c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:16.814984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f5bfffc8-2051-4d8d-8363-4be0b88ccd0c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:16.826771 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f5bfffc8-2051-4d8d-8363-4be0b88ccd0c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1228 microversion: 2.1 time: 0.148485 Sep 07 10:17:16.848070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2816/5677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:16 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1228 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:16.878551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-02ccce1b-ae03-4a9e-adcc-54cde8591c93 req-f1bd3b8b-992b-4a26-a717-4e6cec22fb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6901633e-3cdc-42b4-9213-19d98bf94bcf", "name": "network-vif-deleted", "tag": "ba7835ed-dde2-4c29-88cd-403c95b6b6f9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:16.903702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-02ccce1b-ae03-4a9e-adcc-54cde8591c93 req-f1bd3b8b-992b-4a26-a717-4e6cec22fb9c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:16.906334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-02ccce1b-ae03-4a9e-adcc-54cde8591c93 req-f1bd3b8b-992b-4a26-a717-4e6cec22fb9c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:16.909223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-02ccce1b-ae03-4a9e-adcc-54cde8591c93 req-f1bd3b8b-992b-4a26-a717-4e6cec22fb9c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:16.949896 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-02ccce1b-ae03-4a9e-adcc-54cde8591c93 req-f1bd3b8b-992b-4a26-a717-4e6cec22fb9c service nova] Creating event network-vif-deleted:ba7835ed-dde2-4c29-88cd-403c95b6b6f9 for instance 6901633e-3cdc-42b4-9213-19d98bf94bcf on n-h2-836830-16 Sep 07 10:17:16.956931 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-02ccce1b-ae03-4a9e-adcc-54cde8591c93 req-f1bd3b8b-992b-4a26-a717-4e6cec22fb9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082808 Sep 07 10:17:16.958061 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2862/5678] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:16.978644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:16.981330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:16.990799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:16.991597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:16.992633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:16.993613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:16.994315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:16.994949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:17.804063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:17.816627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51b2a318-aaca-4f20-a859-a7ad80b57f3e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 200 len: 1333 microversion: 2.1 time: 0.842252 Sep 07 10:17:17.833500 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2817/5679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:16 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 1333 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:17.865349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:17.866861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:17.885814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:17.886740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:17.887610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:17.888696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:17.889376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:17.891602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:17.943001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:18.142744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:18.161274 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e949e35d-08f2-419d-b162-cc6cca6dbba3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1224 microversion: 2.1 time: 0.299848 Sep 07 10:17:18.164901 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2863/5680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:17 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1224 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:18.840419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:18.841225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 6901633e-3cdc-42b4-9213-19d98bf94bcf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:18.844356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:18.877802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:18.878265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:18.878714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:18.886354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:18.886946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:18.887408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:18.945890 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] HTTP exception thrown: Instance 6901633e-3cdc-42b4-9213-19d98bf94bcf could not be found. Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Request method failure captured: Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf HTTP/1.1 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG70_liRTjspc89uoNLZuxJg4ExPgkMEnf60Iz3WhQDHRKn8awQL2jzlw4l0zzD5phCHMRfErHbeu4umALm860rgN0VjFE38769eFzjC-LKkcKKLq3ElVXJ5rKyhAypRoKZNzPkT7gtWBeLdFuYybMJGVX1b9kH2UJbe06Czha4R9vQ Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ed2d100f006c423cb7ff20ba6e00b1ee Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed2d100f006c423cb7ff20ba6e00b1ee", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ed2d100f006c423cb7ff20ba6e00b1ee Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkBasicOps-1298611205-project Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f569c9d96f2045ba979a4fb85fa3acb2 Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkBasicOps-1298611205-project Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 6901633e-3cdc-42b4-9213-19d98bf94bcf could not be found. Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6901633e-3cdc-42b4-9213-19d98bf94bcf'} Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6901633e-3cdc-42b4-9213-19d98bf94bcf could not be found. Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6901633e-3cdc-42b4-9213-19d98bf94bcf could not be found. Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:18.948646 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6901633e-3cdc-42b4-9213-19d98bf94bcf could not be found. Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Returning 404 to user: Instance 6901633e-3cdc-42b4-9213-19d98bf94bcf could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:18.954154 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6131bb23-5241-44bf-a21f-6925223eff0b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf" status: 404 len: 111 microversion: 2.1 time: 0.114124 Sep 07 10:17:18.960923 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2818/5681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:18 2022] GET /compute/v2.1/servers/6901633e-3cdc-42b4-9213-19d98bf94bcf => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:17:19.193548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:19.194524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:19.214499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:19.219797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:19.220502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:19.221470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:19.222151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:19.222764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:19.451369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:19.460639 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3f55f9d5-e98e-4146-a211-136897d909b8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1286 microversion: 2.1 time: 0.272516 Sep 07 10:17:19.464693 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2864/5682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:19 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:19.919810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82b6228f-0b41-4de7-90a9-740fff9e9dcc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '.version_select at 0x7f14b06c01f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:19.966439 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82b6228f-0b41-4de7-90a9-740fff9e9dcc tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-478626925" status: 202 len: 0 microversion: 2.1 time: 0.050815 Sep 07 10:17:19.967043 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2819/5683] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 7 10:17:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-478626925 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:17:20.488535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:20.489232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:20.508364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:20.508996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:20.510105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:20.511135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:20.511787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:20.512593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:20.855648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:20.871981 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19cf122b-9ff6-4fe5-9faf-f7b98308a617 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1286 microversion: 2.1 time: 0.387563 Sep 07 10:17:20.894099 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2865/5684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:20 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1286 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:21.904260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:21.905937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:21.927462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:21.930076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:21.931158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:21.934645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:21.935637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:21.936318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:23.253614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:23.263892 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-47d03ac4-44ab-4b84-a5ef-a05ee7c9b473 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 1.368297 Sep 07 10:17:23.268906 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2820/5685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:21 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:23.592834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d631ebb-184b-4778-a02a-c4559335f17d tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-503797783", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:23.596967 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-5d631ebb-184b-4778-a02a-c4559335f17d tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] HTTP exception thrown: min_count must be <= max_count Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d631ebb-184b-4778-a02a-c4559335f17d tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Request method failure captured: Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 183 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG-zQQUhG6D8YXT9TMqX07QWGKc4yHxfg1mIdyvajENwOicwOJLOT1asVHybOzjNdIEAA-bvn3hUj48RY4eoo2Feqw8HNIvgz-s1P-hR60b2zNvQJluylTpxytJxCoGlz6DDvMAaCv9s88IdK5MNGPfKO4WdZBh1fpNgMSq0FRlNs4w Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39e1819fc2e945a9901dd007c1499e64", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 298608b562454089a19d1c5155b77e02 Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-503797783", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: exception: min_count must be <= max_count Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-503797783', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 07 10:17:23.598594 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.604035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d631ebb-184b-4778-a02a-c4559335f17d tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Returning 400 to user: min_count must be <= max_count {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:23.604035 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d631ebb-184b-4778-a02a-c4559335f17d tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.232372 Sep 07 10:17:23.609809 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2866/5686] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:23 2022] POST /compute/v2.1/servers => generated 74 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 10:17:23.705586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e85cc7b0-b190-4618-bdd1-3b3bf0c3f9db tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1063738743", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "max_count": 0}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e85cc7b0-b190-4618-bdd1-3b3bf0c3f9db tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Request method failure captured: Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 168 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG-zQQUhG6D8YXT9TMqX07QWGKc4yHxfg1mIdyvajENwOicwOJLOT1asVHybOzjNdIEAA-bvn3hUj48RY4eoo2Feqw8HNIvgz-s1P-hR60b2zNvQJluylTpxytJxCoGlz6DDvMAaCv9s88IdK5MNGPfKO4WdZBh1fpNgMSq0FRlNs4w Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39e1819fc2e945a9901dd007c1499e64", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 298608b562454089a19d1c5155b77e02 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1063738743", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "max_count": 0}} Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1063738743', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'max_count': 0}}} Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 0 Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:17:23.709746 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 07 10:17:23.714930 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.720912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e85cc7b0-b190-4618-bdd1-3b3bf0c3f9db tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:23.721835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e85cc7b0-b190-4618-bdd1-3b3bf0c3f9db tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021212 Sep 07 10:17:23.729695 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2821/5687] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:17:23.834366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-938f422d-fe2b-450f-b3e0-106fc6d67718 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1676233030", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "max_count": 2.5}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-938f422d-fe2b-450f-b3e0-106fc6d67718 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Request method failure captured: Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 170 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG-zQQUhG6D8YXT9TMqX07QWGKc4yHxfg1mIdyvajENwOicwOJLOT1asVHybOzjNdIEAA-bvn3hUj48RY4eoo2Feqw8HNIvgz-s1P-hR60b2zNvQJluylTpxytJxCoGlz6DDvMAaCv9s88IdK5MNGPfKO4WdZBh1fpNgMSq0FRlNs4w Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39e1819fc2e945a9901dd007c1499e64", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 298608b562454089a19d1c5155b77e02 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1676233030", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "max_count": 2.5}} Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1676233030', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'max_count': 2.5}}} Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 2.5 Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:17:23.847934 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 10:17:23.853489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.860014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-938f422d-fe2b-450f-b3e0-106fc6d67718 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:23.860014 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-938f422d-fe2b-450f-b3e0-106fc6d67718 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032710 Sep 07 10:17:23.873034 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2867/5688] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:17:23.940625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d927519e-1ed8-47ee-9625-6e89869cf766 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1741654622", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 0}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d927519e-1ed8-47ee-9625-6e89869cf766 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Request method failure captured: Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 168 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG-zQQUhG6D8YXT9TMqX07QWGKc4yHxfg1mIdyvajENwOicwOJLOT1asVHybOzjNdIEAA-bvn3hUj48RY4eoo2Feqw8HNIvgz-s1P-hR60b2zNvQJluylTpxytJxCoGlz6DDvMAaCv9s88IdK5MNGPfKO4WdZBh1fpNgMSq0FRlNs4w Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39e1819fc2e945a9901dd007c1499e64", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 298608b562454089a19d1c5155b77e02 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1741654622", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 0}} Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1741654622', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'min_count': 0}}} Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi 0 Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:17:23.953882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d927519e-1ed8-47ee-9625-6e89869cf766 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:23.959413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d927519e-1ed8-47ee-9625-6e89869cf766 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027476 Sep 07 10:17:23.961168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2822/5689] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:17:24.078970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae7d33b8-a3ad-4d35-bfd9-af61ac6407d8 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1483573749", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 2.5}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae7d33b8-a3ad-4d35-bfd9-af61ac6407d8 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Request method failure captured: Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 170 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG-zQQUhG6D8YXT9TMqX07QWGKc4yHxfg1mIdyvajENwOicwOJLOT1asVHybOzjNdIEAA-bvn3hUj48RY4eoo2Feqw8HNIvgz-s1P-hR60b2zNvQJluylTpxytJxCoGlz6DDvMAaCv9s88IdK5MNGPfKO4WdZBh1fpNgMSq0FRlNs4w Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39e1819fc2e945a9901dd007c1499e64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39e1819fc2e945a9901dd007c1499e64", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 39e1819fc2e945a9901dd007c1499e64 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1414777980 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 298608b562454089a19d1c5155b77e02 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1414777980-project Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1483573749", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "min_count": 2.5}} Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1483573749', 'imageRef': '8aa3194e-7f8e-4ddc-8419-88dfe300e0f7', 'flavorRef': '452', 'min_count': 2.5}}} Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi 2.5 Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:17:24.089886 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 10:17:24.095536 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:24.102093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ae7d33b8-a3ad-4d35-bfd9-af61ac6407d8 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:24.105571 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ae7d33b8-a3ad-4d35-bfd9-af61ac6407d8 tempest-MultipleCreateNegativeTestJSON-1414777980 tempest-MultipleCreateNegativeTestJSON-1414777980-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.049463 Sep 07 10:17:24.125209 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2868/5690] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:17:24.175005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:24.176424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:24.178390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-348a36dd-710a-4919-87e4-ac0424734b41 req-d24ff355-b07d-4bb1-874c-7f7d08694be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f", "tag": "09ee054e-6ccc-42ca-a71f-722587063162"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:24.184242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.185127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.185866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:24.187693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.188645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.189878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:24.198293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-348a36dd-710a-4919-87e4-ac0424734b41 req-d24ff355-b07d-4bb1-874c-7f7d08694be5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.203037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-348a36dd-710a-4919-87e4-ac0424734b41 req-d24ff355-b07d-4bb1-874c-7f7d08694be5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.203707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-348a36dd-710a-4919-87e4-ac0424734b41 req-d24ff355-b07d-4bb1-874c-7f7d08694be5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:24.227221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:24.239425 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-348a36dd-710a-4919-87e4-ac0424734b41 req-d24ff355-b07d-4bb1-874c-7f7d08694be5 service nova] Creating event network-changed:09ee054e-6ccc-42ca-a71f-722587063162 for instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f on n-h1-836830-16 Sep 07 10:17:24.258797 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-348a36dd-710a-4919-87e4-ac0424734b41 req-d24ff355-b07d-4bb1-874c-7f7d08694be5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087858 Sep 07 10:17:24.259436 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2869/5691] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:24.301697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:24.303046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:24.321594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.330090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.331333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:24.332299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.339023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.340649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:24.417008 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a6d815d1-2965-4165-afc0-66075e4832c1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 204 len: 0 microversion: 2.1 time: 0.249457 Sep 07 10:17:24.421900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2823/5692] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:24 2022] DELETE /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:17:24.430749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:24.431457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:24.467133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.467618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.468319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:24.469334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:24.469914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:24.470347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:25.391023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:25.398222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:25.400618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0508895b-c0ea-401e-aaf7-0bc706e98ec8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 1.109332 Sep 07 10:17:25.408081 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2870/5693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:24 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:25.413752 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bafddcc7-11d5-42d8-b4cb-cb6d352d07b7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1669 microversion: 2.1 time: 0.986995 Sep 07 10:17:25.414939 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2824/5694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:24 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1669 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:25.601677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e6312e55-e35a-4b5a-a342-b57b28371400 req-b6a29f62-3dc7-4da4-b314-ef4e46c21039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b", "tag": "a463cdaf-05a8-496c-bfa0-1f1a832f14ee"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:25.632868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e6312e55-e35a-4b5a-a342-b57b28371400 req-b6a29f62-3dc7-4da4-b314-ef4e46c21039 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:25.633705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e6312e55-e35a-4b5a-a342-b57b28371400 req-b6a29f62-3dc7-4da4-b314-ef4e46c21039 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:25.634342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e6312e55-e35a-4b5a-a342-b57b28371400 req-b6a29f62-3dc7-4da4-b314-ef4e46c21039 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:25.664746 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e6312e55-e35a-4b5a-a342-b57b28371400 req-b6a29f62-3dc7-4da4-b314-ef4e46c21039 service nova] Creating event network-changed:a463cdaf-05a8-496c-bfa0-1f1a832f14ee for instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b on n-h2-836830-16 Sep 07 10:17:25.691346 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e6312e55-e35a-4b5a-a342-b57b28371400 req-b6a29f62-3dc7-4da4-b314-ef4e46c21039 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090864 Sep 07 10:17:25.693627 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2871/5695] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:26.434533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:26.435830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:26.448822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:26.454502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:26.457649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:26.479770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:26.485815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:26.489912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:26.490997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:26.491726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:26.492452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:26.493815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:26.494560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:26.498282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:26.500088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:26.506239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:26.509220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:26.512350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:26.819198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:27.242843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:27.258331 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3855cd87-c753-410a-8f8a-c864dd9b5bf2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 0.829752 Sep 07 10:17:27.262716 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2825/5696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:26 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:27.291874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:27.302949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d66742c-86d2-4936-8085-deb4668c547e tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1669 microversion: 2.1 time: 0.858213 Sep 07 10:17:27.306462 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2872/5697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:26 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1669 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:27.797348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-30479610-e7ff-42e1-92e3-2610fd596079 req-56a2510f-1faa-4797-a60f-c2b876d8a612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f", "name": "network-vif-deleted", "tag": "09ee054e-6ccc-42ca-a71f-722587063162"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:27.817211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45a418da-de8a-4264-8cbf-190de3e59711 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] Calling method '.version_select at 0x7f14b0a815e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:27.822733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-30479610-e7ff-42e1-92e3-2610fd596079 req-56a2510f-1faa-4797-a60f-c2b876d8a612 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:27.823246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-30479610-e7ff-42e1-92e3-2610fd596079 req-56a2510f-1faa-4797-a60f-c2b876d8a612 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:27.823702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-30479610-e7ff-42e1-92e3-2610fd596079 req-56a2510f-1faa-4797-a60f-c2b876d8a612 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:27.844853 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-30479610-e7ff-42e1-92e3-2610fd596079 req-56a2510f-1faa-4797-a60f-c2b876d8a612 service nova] Creating event network-vif-deleted:09ee054e-6ccc-42ca-a71f-722587063162 for instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f on n-h1-836830-16 Sep 07 10:17:27.855261 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-30479610-e7ff-42e1-92e3-2610fd596079 req-56a2510f-1faa-4797-a60f-c2b876d8a612 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064311 Sep 07 10:17:27.860442 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2873/5698] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:27.901415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45a418da-de8a-4264-8cbf-190de3e59711 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.294561 Sep 07 10:17:27.902520 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2826/5699] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:17:27 2022] GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4/defaults => generated 371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:27.916188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b7f229cb-468e-44b8-8896-5a23119f2055 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] Calling method '.version_select at 0x7f14b08035e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:28.068799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b7f229cb-468e-44b8-8896-5a23119f2055 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4" status: 200 len: 371 microversion: 2.1 time: 0.156546 Sep 07 10:17:28.069681 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2874/5700] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 10:17:27 2022] GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4 => generated 371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:28.091758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-537a96bc-64c8-4ba6-a201-c7a7783ec666 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] Calling method '.version_select at 0x7f14b0a814c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:28.207185 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-537a96bc-64c8-4ba6-a201-c7a7783ec666 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.120213 Sep 07 10:17:28.208240 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2827/5701] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:17:28 2022] GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4/defaults => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:28.226479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-171b9278-acf7-427d-bf61-f34ad2c088d1 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] Calling method '.version_select at 0x7f14b07ee310>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:28.290918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:28.295278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:28.319509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:28.320986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:28.322533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:28.323313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:28.323796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:28.324239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:28.420191 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-171b9278-acf7-427d-bf61-f34ad2c088d1 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4" status: 200 len: 371 microversion: 2.1 time: 0.199434 Sep 07 10:17:28.423596 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2875/5702] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 10:17:28 2022] GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4 => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:28.440230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:28.446271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:28.486043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:28.488011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:28.492705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:28.498472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:28.499561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:28.500219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:28.595257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:28.604635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:28.605556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:28.615978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:28.616750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lazy-loading 'fault' on Instance uuid 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:17:28.830397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:28.852140 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-379cf649-8547-4f40-92e1-ffdf6659902b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 200 len: 1338 microversion: 2.1 time: 0.424030 Sep 07 10:17:28.857459 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2876/5703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:28 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 1338 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:28.886675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c7b956b-5d64-49d2-b3ea-c8b83112db33 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] Calling method '.version_select at 0x7f14b0928ee0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:29.038669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:29.048107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:29.053274 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-346ef65c-a40d-41b0-8f19-95e88fef3b41 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 0.770974 Sep 07 10:17:29.054409 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2828/5704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:28 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:29.122969 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c7b956b-5d64-49d2-b3ea-c8b83112db33 tempest-QuotasTestJSON-211081889 tempest-QuotasTestJSON-211081889-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4?user_id=b4f5ef6ba4ec43aba4c8e9d0c441ab78" status: 200 len: 371 microversion: 2.1 time: 0.259912 Sep 07 10:17:29.136481 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2877/5705] 10.222.0.60 () {58 vars in 1323 bytes} [Wed Sep 7 10:17:28 2022] GET /compute/v2.1/os-quota-sets/29971582bfcf4dfaadbd74883466f3c4?user_id=b4f5ef6ba4ec43aba4c8e9d0c441ab78 => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:29.915732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:29.916867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:29.951501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:29.952180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:29.953098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:29.954074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:29.954753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:29.955487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:29.991955 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] HTTP exception thrown: Instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f could not be found. Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Request method failure captured: Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f HTTP/1.1 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG70_liRTjspc89uoNLZuxJg4ExPgkMEnf60Iz3WhQDHRKn8awQL2jzlw4l0zzD5phCHMRfErHbeu4umALm860rgN0VjFE38769eFzjC-LKkcKKLq3ElVXJ5rKyhAypRoKZNzPkT7gtWBeLdFuYybMJGVX1b9kH2UJbe06Czha4R9vQ Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: ed2d100f006c423cb7ff20ba6e00b1ee Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed2d100f006c423cb7ff20ba6e00b1ee", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: ed2d100f006c423cb7ff20ba6e00b1ee Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkBasicOps-1298611205-project Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: f569c9d96f2045ba979a4fb85fa3acb2 Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkBasicOps-1298611205-project Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f could not be found. Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f'} Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f could not be found. Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f could not be found. Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:29.995769 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f could not be found. Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Returning 404 to user: Instance 1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53759165-c1ca-4d8b-b9a6-5c92e2358a8b tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f" status: 404 len: 111 microversion: 2.1 time: 0.102376 Sep 07 10:17:30.006984 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2829/5706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:29 2022] GET /compute/v2.1/servers/1a056cd7-3f4a-43ba-8c7e-550ef9c6ba3f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:30.090253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:30.091154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:30.115463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:30.116445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:30.117449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:30.120855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:30.124267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:30.125196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:30.609439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:30.634479 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7dfd2bf4-cec4-4bd9-ab33-b41f4d50e788 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 0.552796 Sep 07 10:17:30.639191 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2878/5707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:30 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:30.865606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:30.866131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:30.904669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:30.905851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:30.906623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:30.907929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:30.910298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:30.911019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:30.975748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:31.133527 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b48cb194-a792-43ac-b933-a20110a3b313 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 204 len: 0 microversion: 2.1 time: 0.683054 Sep 07 10:17:31.134864 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2830/5708] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:30 2022] DELETE /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:17:31.145487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:31.146747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:31.154724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:31.155685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:31.156327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:31.157285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:31.157940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:31.158550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:31.193465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cf77bee-ac61-49d3-a399-fc98112950c2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '.version_select at 0x7f14b06c0ee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:31.237518 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cf77bee-ac61-49d3-a399-fc98112950c2 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1477628023" status: 202 len: 0 microversion: 2.1 time: 0.048612 Sep 07 10:17:31.246597 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2831/5709] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 7 10:17:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1477628023 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:17:31.663876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:31.665102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:31.675568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:31.676618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:31.677352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:31.678465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:31.678970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:31.679439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:31.680102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:31.695241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3859693d-ea20-4774-bf0c-75c14ff2b5a4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1577 microversion: 2.1 time: 0.548100 Sep 07 10:17:31.713913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2879/5710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:31 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1577 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:32.766325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:32.767277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:32.775700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:32.776231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:32.776682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:32.789388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:32.790042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:32.791086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:33.197998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:33.215677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0cfee828-725d-4ec7-a1b7-1961bb1af506 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 1.555505 Sep 07 10:17:33.216570 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2832/5711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:31 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:33.575269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:33.587794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc20df39-03f5-43e2-a51a-48132ed90b1b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1577 microversion: 2.1 time: 0.832029 Sep 07 10:17:33.589785 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2880/5712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:32 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1577 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:33.717109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ced4cc6-685b-42a0-a86a-29cb47ed2c02 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Action: 'create', calling method: .version_select at 0x7f14b0a810d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-108332166", "metadata": {"Type": "work"}}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:34.243332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:34.244727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:34.257810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:34.258746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:34.259522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:34.260651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:34.261402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:34.262011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:34.657261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ced4cc6-685b-42a0-a86a-29cb47ed2c02 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.174146 Sep 07 10:17:34.659244 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2833/5713] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 7 10:17:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1183 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 07 10:17:34.672827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:34.673740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:34.716235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:34.717426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:34.721035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:34.727094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:34.729770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:34.732687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:35.292173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:35.343900 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-20e0d185-ade1-48f7-8b97-92e04790a71e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 1.107095 Sep 07 10:17:35.359297 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2881/5714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:34 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:35.401371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f181ac72-7d8c-4247-b986-0569c9c6789c tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b07ee4c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:35.540287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:35.563278 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31bbfa7e-a682-4be4-bdd9-8f1086b48d4f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1577 microversion: 2.1 time: 0.901796 Sep 07 10:17:35.586018 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2834/5715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:34 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1577 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:35.621190 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f181ac72-7d8c-4247-b986-0569c9c6789c tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 352 microversion: 2.1 time: 0.251323 Sep 07 10:17:35.626519 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2882/5716] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:35 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:36.398707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:36.399954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:36.412346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:36.437275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:36.437941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:36.438715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:36.439332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:36.439766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:36.587126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:36.588730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:36.609479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:36.610219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:36.610691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:36.611438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:36.612243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:36.613445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:37.026482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:37.049650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:37.059039 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be64a147-8e66-4209-a737-33b0d444119c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 0.664612 Sep 07 10:17:37.063508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e086ee82-1ecf-422f-8ff6-46cd0013c7d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1509 microversion: 2.1 time: 0.478664 Sep 07 10:17:37.068373 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2883/5717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:36 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:37.071771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2835/5718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:36 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:37.086093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d07eaaa6-9949-4012-b2eb-a14deff8436e req-8870046a-6f7e-4407-a046-52d4c9b49f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b", "name": "network-vif-plugged", "status": "completed", "tag": "a463cdaf-05a8-496c-bfa0-1f1a832f14ee"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:37.096147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d914fc59-9004-4cd4-8a64-2c780196b9a9 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b07eed30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:37.152611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d07eaaa6-9949-4012-b2eb-a14deff8436e req-8870046a-6f7e-4407-a046-52d4c9b49f11 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:37.155201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d07eaaa6-9949-4012-b2eb-a14deff8436e req-8870046a-6f7e-4407-a046-52d4c9b49f11 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:37.157693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d07eaaa6-9949-4012-b2eb-a14deff8436e req-8870046a-6f7e-4407-a046-52d4c9b49f11 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:37.194503 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d07eaaa6-9949-4012-b2eb-a14deff8436e req-8870046a-6f7e-4407-a046-52d4c9b49f11 service nova] Creating event network-vif-plugged:a463cdaf-05a8-496c-bfa0-1f1a832f14ee for instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b on n-h2-836830-16 Sep 07 10:17:37.197625 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d914fc59-9004-4cd4-8a64-2c780196b9a9 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 353 microversion: 2.1 time: 0.126147 Sep 07 10:17:37.208598 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2884/5719] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:37 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:37.211201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d07eaaa6-9949-4012-b2eb-a14deff8436e req-8870046a-6f7e-4407-a046-52d4c9b49f11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135989 Sep 07 10:17:37.213859 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2836/5720] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:37.218912 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78152e16-58d5-48c4-9c0f-f351c92c70f7 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b095c5e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:37.289368 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78152e16-58d5-48c4-9c0f-f351c92c70f7 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 353 microversion: 2.1 time: 0.077927 Sep 07 10:17:37.299498 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2885/5721] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:37 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:37.304927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-361b2201-eae3-4da8-a28e-7b25c3b7810b tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b069f670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:37.439760 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-361b2201-eae3-4da8-a28e-7b25c3b7810b tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 202 len: 0 microversion: 2.1 time: 0.139095 Sep 07 10:17:37.448816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2b0534b4-fc17-4853-a58f-568ac8a31e17 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b08439d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:37.450548 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2837/5722] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 10:17:37 2022] DELETE /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:17:37.611242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2b0534b4-fc17-4853-a58f-568ac8a31e17 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 352 microversion: 2.1 time: 0.166714 Sep 07 10:17:37.612667 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2886/5723] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:37 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:38.103522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:38.105151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:38.105996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:38.111328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:38.126630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:38.129433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:38.139759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:38.141570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:38.142466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:38.143832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:38.145048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:38.163045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:38.163945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:38.168506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:38.172281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:38.173579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:38.520128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:38.528827 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9f3b617-80ce-40b6-8cff-e98a5fbe9cdc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.437068 Sep 07 10:17:38.533684 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2838/5724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:38 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:38.557885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d2447d6a-2ac6-4d78-b793-d5ede7e1f456 req-a7b9e824-ff60-4d53-a74e-08ce0c5cfba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f81ee3-2899-412a-a0e2-7dc4b08abb3b", "name": "network-vif-deleted", "tag": "97524004-9ab4-4f83-bb05-df6c0fca2b9b"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:38.581418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d2447d6a-2ac6-4d78-b793-d5ede7e1f456 req-a7b9e824-ff60-4d53-a74e-08ce0c5cfba3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:38.587007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d2447d6a-2ac6-4d78-b793-d5ede7e1f456 req-a7b9e824-ff60-4d53-a74e-08ce0c5cfba3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:38.587636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d2447d6a-2ac6-4d78-b793-d5ede7e1f456 req-a7b9e824-ff60-4d53-a74e-08ce0c5cfba3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:38.617681 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d2447d6a-2ac6-4d78-b793-d5ede7e1f456 req-a7b9e824-ff60-4d53-a74e-08ce0c5cfba3 service nova] Creating event network-vif-deleted:97524004-9ab4-4f83-bb05-df6c0fca2b9b for instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b on n-h1-836830-16 Sep 07 10:17:38.638022 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d2447d6a-2ac6-4d78-b793-d5ede7e1f456 req-a7b9e824-ff60-4d53-a74e-08ce0c5cfba3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089030 Sep 07 10:17:38.639432 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2839/5725] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:38.645002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f3f9a88-bfe6-4854-9cbe-c1a03a8a3741 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b0a151f0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:38.840413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f3f9a88-bfe6-4854-9cbe-c1a03a8a3741 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 352 microversion: 2.1 time: 0.199144 Sep 07 10:17:38.841014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2840/5726] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:38 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:38.961605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:38.975185 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bef624bd-6f3a-48fe-a57b-f9820f59bf7d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1328 microversion: 2.1 time: 0.880356 Sep 07 10:17:39.002622 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2887/5727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:38 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1328 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:39.566109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:39.566863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:39.612798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:39.613439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:39.614213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:39.617854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:39.621902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:39.622715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:39.834393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:39.862240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a4372bd5-13ef-471b-885b-db596614505d tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b0c569d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:39.874250 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b4e61b16-7ce9-4a78-8193-bbed83662b6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.314298 Sep 07 10:17:39.876251 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2841/5728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:39 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:39.877866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:40.005854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a4372bd5-13ef-471b-885b-db596614505d tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 352 microversion: 2.1 time: 0.148913 Sep 07 10:17:40.007716 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2888/5729] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:39 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:17:40.019893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:40.020518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:40.050565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:40.060218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:40.063015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:40.065086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:40.069224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:40.069812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:40.903561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:40.904507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:40.928392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:40.928907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:40.929400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:40.930137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:40.930614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:40.931062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:41.252709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:41.266499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-44119214-5358-4c8e-8e45-e599fe04439b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1509 microversion: 2.1 time: 1.251318 Sep 07 10:17:41.267856 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2842/5730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:40 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1509 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:41.280712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c580adf5-797b-4f4b-a0c3-0c0e8e366767 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b0a15dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:41.344002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:41.361763 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e8935c8-7d30-4b5b-96e8-6a9a450f1cf0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.463372 Sep 07 10:17:41.362823 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2889/5731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:40 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:41.379076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:41.388631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:41.434979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:41.435967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:41.439764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:41.440542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:41.441029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:41.441501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:41.960016 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c580adf5-797b-4f4b-a0c3-0c0e8e366767 tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 200 len: 352 microversion: 2.1 time: 0.690794 Sep 07 10:17:41.961142 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2843/5732] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:41 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 352 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:42.119267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:42.128206 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-377b633f-0901-4658-88a8-d0cf27556af6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1509 microversion: 2.1 time: 0.757848 Sep 07 10:17:42.134256 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2890/5733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:41 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1509 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:42.162836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:42.163516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:42.180271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:42.181933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:42.182388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:42.183113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:42.183573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:42.184003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:42.248182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:17:42.392855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:42.393645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:42.409078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:42.411529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:42.415692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:42.417604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:42.419502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:42.421552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:42.445340 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d3926afd-2404-4676-b151-71ae9c6bc8e0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 204 len: 0 microversion: 2.1 time: 0.287544 Sep 07 10:17:42.456900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2844/5734] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:17:42 2022] DELETE /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:17:42.462761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:42.466128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:42.486142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:42.492403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:42.493268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:42.494265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:42.494990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:42.495649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:42.642674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:42.656547 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd835daa-21d4-4a60-9a2c-dfb5f1b3751f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.266481 Sep 07 10:17:42.658411 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2891/5735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:42 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:42.976767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eef43081-f3e4-48c1-80f0-6f1753345d8f tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Calling method '.version_select at 0x7f14b07eed30>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:43.058286 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-eef43081-f3e4-48c1-80f0-6f1753345d8f tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] HTTP exception thrown: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eef43081-f3e4-48c1-80f0-6f1753345d8f tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Request method failure captured: Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd HTTP/1.1 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG-90oQj4mEPnVNr-Z3S6HTkHfOEK2bIySsW29lGdzHgUsWfVqyPxHnR0CO4Vw5T0Ot4ExELqSk4J0BtYmeP8F1HM1kw06qumC3kbW_hi5wkyB4YQMZPqZThrEcSzeeWO5TrRsINFV70SphdxfpYflMmS9qK7872k-7aEHg9eQNrSWQ Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: c19a689cfd3543acba40f64d96e5d052 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesGetTestJSON-741471204 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c19a689cfd3543acba40f64d96e5d052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c19a689cfd3543acba40f64d96e5d052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c19a689cfd3543acba40f64d96e5d052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c19a689cfd3543acba40f64d96e5d052", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesGetTestJSON-741471204 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: c19a689cfd3543acba40f64d96e5d052 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesGetTestJSON-741471204 Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesGetTestJSON-741471204-project Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0a2757bde86346579ba2bdb98fc8d75b Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesGetTestJSON-741471204-project Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: method: Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: exception: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '9b4c74ae-264d-47f5-a926-6e567032becd'} Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. (HTTP 404) (Request-ID: req-3f57ca1a-a909-491d-840b-75b81983886f) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 10:17:43.060660 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. Sep 07 10:17:43.065679 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:17:43.073206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eef43081-f3e4-48c1-80f0-6f1753345d8f tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] Returning 404 to user: Volume 9b4c74ae-264d-47f5-a926-6e567032becd could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:43.073206 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eef43081-f3e4-48c1-80f0-6f1753345d8f tempest-VolumesGetTestJSON-741471204 tempest-VolumesGetTestJSON-741471204-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd" status: 404 len: 109 microversion: 2.1 time: 0.100121 Sep 07 10:17:43.079021 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2892/5736] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 7 10:17:42 2022] GET /compute/v2.1/os-volumes/9b4c74ae-264d-47f5-a926-6e567032becd => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:43.682790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:43.685072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:43.711007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:43.711783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:43.712641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:43.714750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:43.716504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:43.717751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:44.109924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:44.123867 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-523fac1f-c57d-46de-8f7f-38e03fffced2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1515 microversion: 2.1 time: 1.662957 Sep 07 10:17:44.149981 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2845/5737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:42 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1515 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:44.445167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:44.448320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:44.466664 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01823606-a96e-4ac8-8ac4-2fd4d88deb41 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.785718 Sep 07 10:17:44.486770 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2893/5738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:43 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:45.159056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:45.159712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:45.173115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:45.173644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:45.174083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:45.184023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:45.184700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:45.187983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:45.493111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:45.493943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:45.506464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:45.507101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:45.507645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:45.508486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:45.509039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:45.509610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:45.740240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:45.754949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06eee60a-f3d5-4aad-abef-8ed32a287a58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.261277 Sep 07 10:17:45.756844 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2894/5739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:45 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:46.145102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:46.158870 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-64dee857-730b-494f-bc50-e25e90e07186 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1515 microversion: 2.1 time: 1.004724 Sep 07 10:17:46.160043 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2846/5740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:45 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1515 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:46.783494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:46.784140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:46.806650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:46.807270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:46.807750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:46.808502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:46.809426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:46.813210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:47.185467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:47.187257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:47.203412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:47.204162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:47.204780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:47.206142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:47.206781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:47.211623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:47.224480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:47.256224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5725d6de-893d-47c0-a229-d7660f822f55 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.476981 Sep 07 10:17:47.257116 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2895/5741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:46 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:47.292293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c92387f8-f661-43b6-9ecc-7fe6f906062d req-b6a636a8-19ad-44f6-aa70-4fd6f6c151a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b", "name": "network-vif-deleted", "tag": "a463cdaf-05a8-496c-bfa0-1f1a832f14ee"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:47.336972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c92387f8-f661-43b6-9ecc-7fe6f906062d req-b6a636a8-19ad-44f6-aa70-4fd6f6c151a6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:47.339855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c92387f8-f661-43b6-9ecc-7fe6f906062d req-b6a636a8-19ad-44f6-aa70-4fd6f6c151a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:47.341497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c92387f8-f661-43b6-9ecc-7fe6f906062d req-b6a636a8-19ad-44f6-aa70-4fd6f6c151a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:47.383192 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c92387f8-f661-43b6-9ecc-7fe6f906062d req-b6a636a8-19ad-44f6-aa70-4fd6f6c151a6 service nova] Creating event network-vif-deleted:a463cdaf-05a8-496c-bfa0-1f1a832f14ee for instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b on n-h2-836830-16 Sep 07 10:17:47.391600 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c92387f8-f661-43b6-9ecc-7fe6f906062d req-b6a636a8-19ad-44f6-aa70-4fd6f6c151a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130009 Sep 07 10:17:47.392819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2896/5742] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:17:48.286627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:48.287360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:48.312216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:48.312904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:48.321677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:48.322581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:48.323107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:48.323559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:48.942150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:48.962938 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f00872ef-06c7-4724-b121-33093c13e5e4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 200 len: 1313 microversion: 2.1 time: 1.781571 Sep 07 10:17:48.963604 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2847/5743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:47 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 1313 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:49.111861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:49.136078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-661d549b-d378-4098-bf13-5896718e2ffb tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 200 len: 1225 microversion: 2.1 time: 0.854043 Sep 07 10:17:49.136677 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2897/5744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:48 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 1225 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:49.988649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:49.989298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:49.992219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:50.004317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:50.004825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:50.005301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:50.010303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:50.012405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:50.013430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:50.052831 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b HTTP/1.1 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b'} Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:50.061604 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9c32bef-56d2-4ee8-82d6-d9d8f6795990 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 404 len: 111 microversion: 2.1 time: 0.076345 Sep 07 10:17:50.068028 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2848/5745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:49 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:50.073862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b10f797f-5d7e-4e93-8b20-b956fab11007 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '.version_select at 0x7f14b0c46c10>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:50.112483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b10f797f-5d7e-4e93-8b20-b956fab11007 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-key-789785631" status: 202 len: 0 microversion: 2.1 time: 0.044243 Sep 07 10:17:50.113542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2898/5746] 10.222.0.60 () {58 vars in 1206 bytes} [Wed Sep 7 10:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-789785631 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:17:50.162278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:50.163055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:50.176933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:50.180875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:50.181396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:50.182162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:50.184383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:50.184972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:50.226670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b HTTP/1.1 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '20f81ee3-2899-412a-a0e2-7dc4b08abb3b'} Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:17:50.232124 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:17:50.237592 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:17:50.239364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:17:50.244924 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7174702c-ef78-42de-a251-1c7e44bcbd6a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 404 len: 111 microversion: 2.1 time: 0.086767 Sep 07 10:17:50.245751 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2849/5747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:50 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:17:50.342682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1917401135", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:50.486098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:17:50.554228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1398574136", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-161723041", "security_groups": [{"name": "tempest-secgroup-smoke-1648999643"}], "block_device_mapping_v2": [{"uuid": "8506d391-b0fb-405e-8aa9-ba9c77a23160", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:17:50.987474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:17:51.909063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:17:51.909823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:17:51.913592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:17:51.914154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:17:51.914608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:17:51.941099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:51.942154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:51.942858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:51.943711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:51.944192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:51.944634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:51.989146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:17:51.998094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:17:52.031502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:17:52.034513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:17:52.108087 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-850710b3-b8b4-455a-95fe-fdf12f7bfc24 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.771684 Sep 07 10:17:52.109583 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2899/5748] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:17:52.120565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15e68553-d2e5-4d38-805b-b114b700ac6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:52.121125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15e68553-d2e5-4d38-805b-b114b700ac6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:52.239514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-15e68553-d2e5-4d38-805b-b114b700ac6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:52.252698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15e68553-d2e5-4d38-805b-b114b700ac6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1209 microversion: 2.1 time: 0.136016 Sep 07 10:17:52.257253 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2900/5749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:52 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:52.426430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:17:52.426936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:17:52.428627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:17:52.429635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:17:52.430988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:17:52.448788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:52.449631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:52.450243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:52.451158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:52.451855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:52.452481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:52.486592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:17:52.500095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:17:52.648778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:17:52.651742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8506d391-b0fb-405e-8aa9-ba9c77a23160',volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:17:53.124508 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-35abf730-acaa-4b41-af50-9ed549511af0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.574312 Sep 07 10:17:53.125214 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2850/5750] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:17:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:17:53.136721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d65af4c1-7533-435d-aaff-2ded1555f119 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:53.139012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d65af4c1-7533-435d-aaff-2ded1555f119 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:53.281752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:53.282714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:53.292661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:53.296456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:53.299379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:53.300617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:53.302134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:53.303304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:53.362705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d65af4c1-7533-435d-aaff-2ded1555f119 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:53.377980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d65af4c1-7533-435d-aaff-2ded1555f119 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1094 microversion: 2.1 time: 0.245309 Sep 07 10:17:53.383172 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2901/5751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:53 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1094 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:53.386511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:53.619431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:53.637640 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d68e5adf-b538-412c-b62a-5acbe8ca58ec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1213 microversion: 2.1 time: 0.359346 Sep 07 10:17:53.638544 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2851/5752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:53 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1213 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:54.406821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3831d87-3097-4287-b499-e0192d002b37 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:54.407710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3831d87-3097-4287-b499-e0192d002b37 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:54.629714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3831d87-3097-4287-b499-e0192d002b37 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:54.637355 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3831d87-3097-4287-b499-e0192d002b37 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1094 microversion: 2.1 time: 0.234508 Sep 07 10:17:54.637985 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2902/5753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:54 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1094 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:54.664312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:54.665817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:54.683336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:54.689337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:54.690114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:54.693397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:54.694176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:54.695500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:55.621783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:55.631765 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6bfee8a-6948-42cb-aae9-cb451657d701 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1279 microversion: 2.1 time: 0.971753 Sep 07 10:17:55.642367 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2852/5754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:54 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1279 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:55.670206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:55.676812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:55.717658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:55.727503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:55.728449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:55.735055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:55.739416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:55.745402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:56.018548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:56.033713 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0fbe512a-049c-482e-ba1c-a37f0e1b5816 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1210 microversion: 2.1 time: 0.367540 Sep 07 10:17:56.038158 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2903/5755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:55 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1210 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:56.667971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:56.668601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:56.680295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:56.680802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:56.681275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:56.681996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:56.682456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:56.682878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:57.047897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:57.062331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:57.062331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:57.065505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6d01b82b-b312-4d5a-9503-23a117616a36 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1267 microversion: 2.1 time: 0.400260 Sep 07 10:17:57.073636 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2853/5756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:56 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:17:57.079178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:57.079683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:57.080138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:57.093059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:57.093850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:57.094620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:57.715198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:57.740443 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2c077e5-a797-4b5b-93c0-6fef4c604912 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1210 microversion: 2.1 time: 0.678630 Sep 07 10:17:57.752242 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2904/5757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:57 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1210 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:58.091461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:58.096224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:58.125536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:58.126425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:58.128760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:58.131029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:58.132527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:58.136972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:58.775506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:17:58.776143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:17:58.783332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:17:58.806824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:58.807336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:58.808389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:58.809128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:17:58.809651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:17:58.810076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:17:59.172766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:59.188403 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c6c33d6-702d-42dc-8abb-85cabf4ed49d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1210 microversion: 2.1 time: 0.411868 Sep 07 10:17:59.193520 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2905/5758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:58 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1210 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:17:59.344284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:17:59.364671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d7713cf6-da85-4cec-a39c-05976e0ec1a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 1.274087 Sep 07 10:17:59.381453 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2854/5759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:17:58 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:00.263582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:00.266486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:00.325542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:00.327256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:00.328486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:00.331019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:00.331681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:00.334551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:00.396072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:00.397605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:00.406058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:00.420086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:00.422081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:00.425795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:00.427975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:00.433433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:01.470492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:01.483536 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d0e0b9c-472d-4f2f-b02f-5d26dcee0140 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1278 microversion: 2.1 time: 1.270818 Sep 07 10:18:01.490028 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2906/5760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:00 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1278 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:01.542346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:01.570987 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e5475dd-b17a-404d-a178-f99c369d867d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 1.178644 Sep 07 10:18:01.593672 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2855/5761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:00 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:02.102023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3bf3e08b-1eb4-4ef2-b2f8-dcb717e5ea05 req-2d35f407-1bce-4e56-adcb-bbcdaa6228a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2edaa0a5-aaf8-4c90-b243-9a83f01c629f", "tag": "243b22bf-fa63-4200-ab34-df17d731c9e4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:02.107234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:02.126031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3bf3e08b-1eb4-4ef2-b2f8-dcb717e5ea05 req-2d35f407-1bce-4e56-adcb-bbcdaa6228a7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:02.126461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3bf3e08b-1eb4-4ef2-b2f8-dcb717e5ea05 req-2d35f407-1bce-4e56-adcb-bbcdaa6228a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:02.126923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3bf3e08b-1eb4-4ef2-b2f8-dcb717e5ea05 req-2d35f407-1bce-4e56-adcb-bbcdaa6228a7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:02.154053 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3bf3e08b-1eb4-4ef2-b2f8-dcb717e5ea05 req-2d35f407-1bce-4e56-adcb-bbcdaa6228a7 service nova] Creating event network-changed:243b22bf-fa63-4200-ab34-df17d731c9e4 for instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f on n-h2-836830-16 Sep 07 10:18:02.171717 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3bf3e08b-1eb4-4ef2-b2f8-dcb717e5ea05 req-2d35f407-1bce-4e56-adcb-bbcdaa6228a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073390 Sep 07 10:18:02.176002 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2907/5762] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:02.517017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:02.517674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:02.537583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:02.558235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:02.571075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:02.585778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:02.586275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:02.587046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:02.603502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:02.604830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:02.606306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:02.606820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:02.622688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:02.624149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:02.625335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:02.626277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:02.626927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:02.627540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:03.493419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:03.503308 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41130f40-e7e6-478b-93d3-fcd94d19796c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1278 microversion: 2.1 time: 0.992523 Sep 07 10:18:03.503904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2856/5763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:02 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1278 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:03.544122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:03.553699 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9678aff2-fa2f-43a6-872d-72efba1dd6a4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 0.955256 Sep 07 10:18:03.557550 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2908/5764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:02 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:03.979434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e2c3a2d5-8c75-41a4-81b0-4dd9446d4437 req-1bb3540f-b707-4a8d-b8cd-9ae12a5aa04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a456aa9d-930c-4da6-b06a-c8ef17539e41", "tag": "d4f3a536-8b9e-4bd7-9195-a8838baa8a1f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:04.012663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e2c3a2d5-8c75-41a4-81b0-4dd9446d4437 req-1bb3540f-b707-4a8d-b8cd-9ae12a5aa04d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:04.017972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e2c3a2d5-8c75-41a4-81b0-4dd9446d4437 req-1bb3540f-b707-4a8d-b8cd-9ae12a5aa04d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:04.018729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e2c3a2d5-8c75-41a4-81b0-4dd9446d4437 req-1bb3540f-b707-4a8d-b8cd-9ae12a5aa04d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:04.037153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e2c3a2d5-8c75-41a4-81b0-4dd9446d4437 req-1bb3540f-b707-4a8d-b8cd-9ae12a5aa04d service nova] Creating event network-changed:d4f3a536-8b9e-4bd7-9195-a8838baa8a1f for instance a456aa9d-930c-4da6-b06a-c8ef17539e41 on n-h2-836830-16 Sep 07 10:18:04.079645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e2c3a2d5-8c75-41a4-81b0-4dd9446d4437 req-1bb3540f-b707-4a8d-b8cd-9ae12a5aa04d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104052 Sep 07 10:18:04.080275 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2857/5765] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:04.528334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:04.530309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:04.548627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:04.559455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:04.584296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:04.586382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:04.596565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:04.598529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:04.601648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:04.610127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:04.612488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:04.612997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:04.613470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:04.625446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:04.626113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:04.626604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:04.673681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:05.583928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:05.595415 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-485b7222-a4fe-4ef7-9370-78e384cb86d8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1278 microversion: 2.1 time: 1.071253 Sep 07 10:18:05.609992 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2909/5766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:04 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1278 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:05.742639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:05.755177 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9fc02200-64a6-41c0-8a3e-7a3fd7485b81 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 1.175488 Sep 07 10:18:05.772889 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2858/5767] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:04 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:06.640118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:06.641457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:06.660115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:06.660717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:06.661137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:06.664394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:06.664896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:06.665476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:06.778480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:06.779100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:06.797120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:06.797656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:06.798094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:06.798805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:06.799259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:06.799693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:08.385956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:08.421568 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8be59261-b0b5-477e-980a-11802b99ebb4 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1278 microversion: 2.1 time: 1.786560 Sep 07 10:18:08.429375 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2910/5768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:06 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1278 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:08.522702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:08.542296 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dfbd2bf2-4cc8-4f36-af4b-d3314fb3e1f9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 1.767961 Sep 07 10:18:08.542950 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2859/5769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:06 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:09.455173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:09.456868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:09.478671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:09.479296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:09.483221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:09.486091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:09.487619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:09.488113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:09.573842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:09.574573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:09.598604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:09.601637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:09.602131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:09.608604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:09.611249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:09.613666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:10.010838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:10.058141 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a97f609-b22b-4de0-a7ae-13649e3f2fe8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 0.610937 Sep 07 10:18:10.058740 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2911/5770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:09 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:10.086450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:10.096912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b284f7e8-5fd7-4327-8082-50594fd246f1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 0.528825 Sep 07 10:18:10.097159 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2860/5771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:09 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:11.083806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:11.084356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:11.099533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:11.101575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:11.104608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:11.106710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:11.111119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:11.111814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:11.126181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:11.127785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:11.157837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:11.161958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:11.162692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:11.163770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:11.166291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:11.175492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:11.838789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:11.861920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:11.885311 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-929a6fd2-c3e5-4dc4-840a-a0b210d65ac6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 0.805628 Sep 07 10:18:11.886815 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5d6b15d9-8a98-4f11-a4e5-674b46ac63ee tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 0.763377 Sep 07 10:18:11.901209 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2912/5772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:11 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:11.901572 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2861/5773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:11 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:12.207423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a6c14006-545b-4ef0-a1b3-62be0f2ee074 req-d945dd3b-afb7-4e3b-a80f-18d16fac0142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edaa0a5-aaf8-4c90-b243-9a83f01c629f", "name": "network-vif-plugged", "status": "completed", "tag": "243b22bf-fa63-4200-ab34-df17d731c9e4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:12.237008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a6c14006-545b-4ef0-a1b3-62be0f2ee074 req-d945dd3b-afb7-4e3b-a80f-18d16fac0142 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:12.237538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a6c14006-545b-4ef0-a1b3-62be0f2ee074 req-d945dd3b-afb7-4e3b-a80f-18d16fac0142 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:12.243424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a6c14006-545b-4ef0-a1b3-62be0f2ee074 req-d945dd3b-afb7-4e3b-a80f-18d16fac0142 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:12.271848 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a6c14006-545b-4ef0-a1b3-62be0f2ee074 req-d945dd3b-afb7-4e3b-a80f-18d16fac0142 service nova] Creating event network-vif-plugged:243b22bf-fa63-4200-ab34-df17d731c9e4 for instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f on n-h2-836830-16 Sep 07 10:18:12.282964 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a6c14006-545b-4ef0-a1b3-62be0f2ee074 req-d945dd3b-afb7-4e3b-a80f-18d16fac0142 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079077 Sep 07 10:18:12.303191 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2913/5774] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:12.922404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:12.924434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:12.925054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:12.928314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:12.945417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:12.945935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:12.946397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:12.951305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:12.952145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:12.956820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:12.957447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:12.959103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:12.961576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:12.961730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:12.963092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:12.963831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:14.169455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:14.178480 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f9fc10b0-5ea5-4c2d-a79c-239e2505396d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 1.266070 Sep 07 10:18:14.179073 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2914/5775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:12 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:14.232036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:14.261591 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ba7b220-2d68-4640-b9f6-ce4de4fcf773 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1309 microversion: 2.1 time: 1.342432 Sep 07 10:18:14.262591 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2862/5776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:12 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1309 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:15.208871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:15.210622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:15.253996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:15.256590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:15.258156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:15.259176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:15.260267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:15.261854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:15.288379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:15.289041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:15.306949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:15.308704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:15.311788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:15.313376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:15.315252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=88 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:15.317062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:15.318951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:16.776553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:16.786980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7da971a6-2535-4dab-b5b4-e0c2259cb997 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 1.583994 Sep 07 10:18:16.797541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2915/5777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:15 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:16.808677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e50364cc-fa9c-4929-b3bd-c4022b504b39 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'create', calling method: .version_select at 0x7f14b0c56dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-389357526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKNce6qFUIDb7ZOjk04uIbctYoqYflHB4S+0qtFUs91F5Ge4f+J6JHlb4blWdB0N9MfcVkZ1AHbbtkrOHiLfxPQrM+r+XykPcTgDCmBiNRqoNirwgGJfZhne7dK45QKQg=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:16.854473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e50364cc-fa9c-4929-b3bd-c4022b504b39 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:18:16.860703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:16.877544 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-92d49de8-49c5-4205-8231-54a55e5e2a31 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1489 microversion: 2.1 time: 1.593721 Sep 07 10:18:16.883833 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2863/5778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:15 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1489 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:16.896828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e50364cc-fa9c-4929-b3bd-c4022b504b39 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for user f569c9d96f2045ba979a4fb85fa3acb2 and project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:18:16.982079 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e50364cc-fa9c-4929-b3bd-c4022b504b39 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.182610 Sep 07 10:18:16.985502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2916/5779] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:18:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:17.139508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1917401135", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:17.288133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:18:17.827609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:17.829134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:17.875321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:17.877086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:17.877843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:17.882450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:17.884191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:17.886275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:18.589829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:18:18.591160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:18:18.593147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:18:18.594023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:18:18.594671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:18:18.635805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:18.636808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:18.637714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:18.645497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:18.646243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:18.646967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:18.730213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:18:18.746080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:18:18.783961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:18:18.786472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:18:18.847669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:18.863697 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0749d578-04cd-4798-b421-631d9945355e tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 1.044855 Sep 07 10:18:18.865766 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2917/5780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:17 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:18.886616 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ae280f3-f112-4b80-ba76-de81c1cb39dd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758558 Sep 07 10:18:18.893599 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2864/5781] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:18:18.901025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0c381ede-3fc5-4c25-bf60-f6b1af7fb6fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:18.902315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0c381ede-3fc5-4c25-bf60-f6b1af7fb6fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:19.112545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0c381ede-3fc5-4c25-bf60-f6b1af7fb6fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:19.121428 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0c381ede-3fc5-4c25-bf60-f6b1af7fb6fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1209 microversion: 2.1 time: 0.226326 Sep 07 10:18:19.126604 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2918/5782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:18 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:19.892928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:19.894254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:19.907580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:19.908274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:19.910037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:19.912947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:19.916004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:19.916845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:20.149415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:20.151281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:20.181096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:20.183655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:20.184647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:20.186178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:20.187034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:20.187450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:20.436800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:20.448812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-229760e9-a55d-49cc-91ad-bf8b39181523 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1261 microversion: 2.1 time: 0.305129 Sep 07 10:18:20.450128 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2919/5783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:20 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:20.593921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:20.613989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95a6c3fe-263f-4083-9c12-1eb41bf6d370 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 0.723464 Sep 07 10:18:20.615065 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2865/5784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:19 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:21.474478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:21.475369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:21.488547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:21.488547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:21.488547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:21.490717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:21.493552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:21.494153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:21.642349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:21.643731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:21.662923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:21.677025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:21.678834 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1af9f24-ad17-4d0c-b646-df3f73599048 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1267 microversion: 2.1 time: 0.203741 Sep 07 10:18:21.689287 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2920/5785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:21 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:21.699544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:21.704954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:21.710005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:21.711517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:21.712212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:21.712751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:22.132835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:22.148667 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d3fb974-f56b-49e4-b024-0d5845d4bfba tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 0.514034 Sep 07 10:18:22.149310 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2866/5786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:21 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:22.387618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9411cf97-1995-4bfd-968d-8d2f926f9d52 req-e998d252-c6c1-49cc-bcdd-984db92b2a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a456aa9d-930c-4da6-b06a-c8ef17539e41", "name": "network-vif-plugged", "status": "completed", "tag": "d4f3a536-8b9e-4bd7-9195-a8838baa8a1f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:22.440655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9411cf97-1995-4bfd-968d-8d2f926f9d52 req-e998d252-c6c1-49cc-bcdd-984db92b2a44 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:22.441164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9411cf97-1995-4bfd-968d-8d2f926f9d52 req-e998d252-c6c1-49cc-bcdd-984db92b2a44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:22.441668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9411cf97-1995-4bfd-968d-8d2f926f9d52 req-e998d252-c6c1-49cc-bcdd-984db92b2a44 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:22.474285 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9411cf97-1995-4bfd-968d-8d2f926f9d52 req-e998d252-c6c1-49cc-bcdd-984db92b2a44 service nova] Creating event network-vif-plugged:d4f3a536-8b9e-4bd7-9195-a8838baa8a1f for instance a456aa9d-930c-4da6-b06a-c8ef17539e41 on n-h2-836830-16 Sep 07 10:18:22.491982 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9411cf97-1995-4bfd-968d-8d2f926f9d52 req-e998d252-c6c1-49cc-bcdd-984db92b2a44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108177 Sep 07 10:18:22.492735 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2921/5787] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:22.712847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:22.712847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:22.724848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:22.724848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:22.725583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:22.727343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:22.730101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:22.731355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:22.863142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1477590589", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "3e3dbc7a-521a-488e-8330-775b773824c7"}], "key_name": "tempest-TestNetworkBasicOps-389357526", "security_groups": [{"name": "tempest-secgroup-smoke-1635129240"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:23.246228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:23.260698 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69b613e9-e16a-41e1-a856-fa4520b816a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1267 microversion: 2.1 time: 0.555398 Sep 07 10:18:23.281287 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2867/5788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:22 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1267 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:23.292811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:23.299847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:23.315802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:23.324272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:23.324984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:23.327065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:23.330705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:23.334209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:23.589236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] validate_networks() for [('3e3dbc7a-521a-488e-8330-775b773824c7', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:18:24.557450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:24.561663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:24.596697 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e3436eb-e6ef-4ebd-9ea1-a3aa7b77dc58 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1266 microversion: 2.1 time: 1.313834 Sep 07 10:18:24.612953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2868/5789] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:23 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1266 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:24.645915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:24.647168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:24.663343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:24.671607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:24.672916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:24.674607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:24.675645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:24.679249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:24.891179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:24.910340 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e5c78f5-e0fe-4522-ac79-3037516705ad tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1267 microversion: 2.1 time: 0.299419 Sep 07 10:18:24.911328 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2869/5790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:24 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:25.639784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:25.642163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:25.650045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:25.650750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:25.651383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:25.652335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:25.652960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:25.653586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:27.042921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:18:27.043469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:18:27.044608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:18:27.044848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:18:27.045507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:18:27.055215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:27.056204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:27.056866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:27.057853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:27.059330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:27.065051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:27.107480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:18:27.119153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Getting quotas for user f569c9d96f2045ba979a4fb85fa3acb2 and project ed2d100f006c423cb7ff20ba6e00b1ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:18:27.152598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:18:27.158718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:18:27.272101 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c1b93895-f4b4-4108-9706-d6e4812368cd tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.413617 Sep 07 10:18:27.272775 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2922/5791] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:18:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 4417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:18:27.293440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:27.294079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:27.320180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:27.322831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:27.323531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:27.326326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:27.330960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:27.331696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:27.449425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:27.465864 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c49cb72b-4e4e-4e1d-8dad-c45efc92d75a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1453 microversion: 2.1 time: 1.836302 Sep 07 10:18:27.485746 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2870/5792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:25 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1453 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:27.503220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b78936c9-0534-4766-b90e-68c5b9ab112d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:27.505379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b78936c9-0534-4766-b90e-68c5b9ab112d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:27.787071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b78936c9-0534-4766-b90e-68c5b9ab112d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:27.815216 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b78936c9-0534-4766-b90e-68c5b9ab112d tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1248 microversion: 2.1 time: 0.324625 Sep 07 10:18:27.816323 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2871/5793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:27 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1248 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:27.826544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:27.827200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:27.843483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:27.848204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:27.848919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:27.849914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:27.852653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:27.853373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:28.212219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:28.224815 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0742bc1-0731-4fb7-bab7-0db58074acb4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 0.940227 Sep 07 10:18:28.237172 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2923/5794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:27 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:28.687395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:28.800808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:28.829719 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c454ed85-05d0-4f39-a433-9cac849768dc tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1453 microversion: 2.1 time: 1.004627 Sep 07 10:18:28.845446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:28.845446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:28.848574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2872/5795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:27 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1453 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:28.857213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:28.859523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:28.863503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:28.864731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:28.865448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:28.866100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:29.059323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:29.069662 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-40e95eab-f619-444d-95d0-1bb73c05e2a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1300 microversion: 2.1 time: 0.233514 Sep 07 10:18:29.070841 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2924/5796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:28 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:29.262314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:29.262906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:29.277928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:29.280311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:29.283176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:29.284430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:29.284947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:29.285744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:29.774515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5293369b-9fa5-444e-a500-b2131a8edc9e req-e6ae4067-6c2d-4925-a1b7-7f22b19d75bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def9d011-68db-42a1-922f-00d88eeb59a6", "tag": "2b5b26c4-8cd3-4a0c-b306-00fbe0092b2f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:29.792203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:29.801939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5293369b-9fa5-444e-a500-b2131a8edc9e req-e6ae4067-6c2d-4925-a1b7-7f22b19d75bc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:29.802443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5293369b-9fa5-444e-a500-b2131a8edc9e req-e6ae4067-6c2d-4925-a1b7-7f22b19d75bc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:29.802905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5293369b-9fa5-444e-a500-b2131a8edc9e req-e6ae4067-6c2d-4925-a1b7-7f22b19d75bc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:29.830138 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5293369b-9fa5-444e-a500-b2131a8edc9e req-e6ae4067-6c2d-4925-a1b7-7f22b19d75bc service nova] Creating event network-changed:2b5b26c4-8cd3-4a0c-b306-00fbe0092b2f for instance def9d011-68db-42a1-922f-00d88eeb59a6 on n-h1-836830-16 Sep 07 10:18:29.847161 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5293369b-9fa5-444e-a500-b2131a8edc9e req-e6ae4067-6c2d-4925-a1b7-7f22b19d75bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077126 Sep 07 10:18:29.848145 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2925/5797] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:18:30.099828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:30.100566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:30.112915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:30.113463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:30.113930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:30.114670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:30.115153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:30.115603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:30.125213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:30.136685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-78eac815-1f84-4ee5-8e37-7ef28f7215c1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 0.878174 Sep 07 10:18:30.153771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2873/5798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:29 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:30.390718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:30.407282 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99704cd6-b2dd-41fb-87a5-2264c2ed2e92 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1306 microversion: 2.1 time: 0.312920 Sep 07 10:18:30.413610 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2926/5799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:30 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:31.166964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:31.168655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:31.177724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:31.179494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:31.180159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:31.182906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:31.184150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:31.186153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:31.439283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:31.442024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:31.462365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:31.465886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:31.467069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:31.469049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:31.470248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:31.471358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:32.854990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:32.864549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-376af35d-0c4e-42ef-88bf-7e0ce5f38ba8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 1.703781 Sep 07 10:18:32.865152 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2874/5800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:31 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:32.872057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c314183f-3a37-46aa-aaeb-feb077eb736a req-456d1e7d-3178-48fe-a717-d662e355b820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3128af5d-4c55-4671-96ed-fbfaecf3901f", "tag": "97f5c40a-8122-4fe0-acaa-23be5d6baf58"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:32.885280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c314183f-3a37-46aa-aaeb-feb077eb736a req-456d1e7d-3178-48fe-a717-d662e355b820 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:32.890020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c314183f-3a37-46aa-aaeb-feb077eb736a req-456d1e7d-3178-48fe-a717-d662e355b820 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:32.890526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c314183f-3a37-46aa-aaeb-feb077eb736a req-456d1e7d-3178-48fe-a717-d662e355b820 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:32.906194 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c314183f-3a37-46aa-aaeb-feb077eb736a req-456d1e7d-3178-48fe-a717-d662e355b820 service nova] Creating event network-changed:97f5c40a-8122-4fe0-acaa-23be5d6baf58 for instance 3128af5d-4c55-4671-96ed-fbfaecf3901f on n-h1-836830-16 Sep 07 10:18:32.912052 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c314183f-3a37-46aa-aaeb-feb077eb736a req-456d1e7d-3178-48fe-a717-d662e355b820 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045488 Sep 07 10:18:32.915819 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2875/5801] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:33.021348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:33.030037 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f6924c6-7afd-4ba2-abaf-dfb87ca727ec tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1374 microversion: 2.1 time: 1.597293 Sep 07 10:18:33.042131 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2927/5802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:31 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1374 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:33.907647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:33.909262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:33.925148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:33.926036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:33.926720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:33.927667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:33.928697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:33.929497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:34.054673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:34.055389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:34.064578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:34.065103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:34.065753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:34.066676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:34.067520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:34.068048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:35.017154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:35.019395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:35.049579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-baef8a42-e896-4542-9613-9e37d404be9b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 1.151145 Sep 07 10:18:35.050958 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2876/5803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:33 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:35.067583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4281f47-520f-4b67-b717-a50c2b97cd05 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1374 microversion: 2.1 time: 0.998741 Sep 07 10:18:35.070293 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2928/5804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:34 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1374 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:36.100410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:36.110021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:36.110736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:36.114015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:36.136648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:36.136907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:36.137412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:36.144868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:36.145496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:36.145928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:36.149735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:36.152659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:36.154443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:36.160758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:36.164440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:36.168669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:37.085485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:37.136983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:37.370607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:37.389360 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-212b1f53-2f19-4ae5-9280-dd2895c06de7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1374 microversion: 2.1 time: 1.294786 Sep 07 10:18:37.393734 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2929/5805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:36 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1374 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:37.427002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:37.440694 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a21fe279-3d2e-4ae6-9c26-fd193b4a4f11 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 1.362912 Sep 07 10:18:37.441811 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2877/5806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:36 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:37.722441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-917a2557-1df2-48ef-81da-88e9074db98e req-1d098619-60ab-47bc-89fe-1535ac23d8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a456aa9d-930c-4da6-b06a-c8ef17539e41", "tag": "d4f3a536-8b9e-4bd7-9195-a8838baa8a1f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:37.741599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-917a2557-1df2-48ef-81da-88e9074db98e req-1d098619-60ab-47bc-89fe-1535ac23d8af service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:37.742315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-917a2557-1df2-48ef-81da-88e9074db98e req-1d098619-60ab-47bc-89fe-1535ac23d8af service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:37.742935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-917a2557-1df2-48ef-81da-88e9074db98e req-1d098619-60ab-47bc-89fe-1535ac23d8af service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:37.763023 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-917a2557-1df2-48ef-81da-88e9074db98e req-1d098619-60ab-47bc-89fe-1535ac23d8af service nova] Creating event network-changed:d4f3a536-8b9e-4bd7-9195-a8838baa8a1f for instance a456aa9d-930c-4da6-b06a-c8ef17539e41 on n-h2-836830-16 Sep 07 10:18:37.785972 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-917a2557-1df2-48ef-81da-88e9074db98e req-1d098619-60ab-47bc-89fe-1535ac23d8af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067130 Sep 07 10:18:37.786893 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2930/5807] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:18:38.416771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:38.420369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:38.432825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:38.439671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:38.440719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:38.441377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:38.443729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:38.444354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:38.445976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:38.475581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:38.476764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:38.500795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:38.501522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:38.502556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:38.503464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:38.508363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:38.510600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:38.960404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:38.970529 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-930b6a34-7858-4488-83fc-7121c0c66e77 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 0.499288 Sep 07 10:18:38.973530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:38.977368 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2931/5808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:38 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:38.987048 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2abfcfb1-8ad5-4288-ae80-d9beaad253a5 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1374 microversion: 2.1 time: 0.574967 Sep 07 10:18:38.987982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2878/5809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:38 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1374 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:38.990452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b42fa7a6-9deb-4f13-859c-a938f19d6201 req-4b49d0f8-5314-45d7-b4d8-c2144dcc67be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def9d011-68db-42a1-922f-00d88eeb59a6", "name": "network-vif-plugged", "status": "completed", "tag": "2b5b26c4-8cd3-4a0c-b306-00fbe0092b2f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:39.004204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b42fa7a6-9deb-4f13-859c-a938f19d6201 req-4b49d0f8-5314-45d7-b4d8-c2144dcc67be service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:39.004893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b42fa7a6-9deb-4f13-859c-a938f19d6201 req-4b49d0f8-5314-45d7-b4d8-c2144dcc67be service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:39.005871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b42fa7a6-9deb-4f13-859c-a938f19d6201 req-4b49d0f8-5314-45d7-b4d8-c2144dcc67be service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:39.040803 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b42fa7a6-9deb-4f13-859c-a938f19d6201 req-4b49d0f8-5314-45d7-b4d8-c2144dcc67be service nova] Creating event network-vif-plugged:2b5b26c4-8cd3-4a0c-b306-00fbe0092b2f for instance def9d011-68db-42a1-922f-00d88eeb59a6 on n-h1-836830-16 Sep 07 10:18:39.062478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b42fa7a6-9deb-4f13-859c-a938f19d6201 req-4b49d0f8-5314-45d7-b4d8-c2144dcc67be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082916 Sep 07 10:18:39.063884 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2932/5810] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:40.007446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:40.009412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:40.014842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:40.015575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:40.020050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:40.020980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:40.021701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:40.023697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:40.025784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:40.026560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:40.028554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:40.029256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:40.029722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:40.030461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:40.030942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:40.031393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:40.634495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:40.648803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82643218-dac5-44e5-b9cf-349abfaf91fd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1309 microversion: 2.1 time: 0.648878 Sep 07 10:18:40.649430 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2879/5811] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:39 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1309 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:40.676443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:40.688266 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13452956-d108-4a1b-9dce-41aa229b87c7 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1374 microversion: 2.1 time: 0.679733 Sep 07 10:18:40.689481 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2933/5812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:40 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1374 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:41.180785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-28d486ea-ae85-4578-8de7-340013116e44 req-7071a4e9-b1d1-4d17-ad48-b2e5109f83db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3128af5d-4c55-4671-96ed-fbfaecf3901f", "name": "network-vif-plugged", "status": "completed", "tag": "97f5c40a-8122-4fe0-acaa-23be5d6baf58"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:41.213970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-28d486ea-ae85-4578-8de7-340013116e44 req-7071a4e9-b1d1-4d17-ad48-b2e5109f83db service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:41.216353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-28d486ea-ae85-4578-8de7-340013116e44 req-7071a4e9-b1d1-4d17-ad48-b2e5109f83db service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:41.217511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-28d486ea-ae85-4578-8de7-340013116e44 req-7071a4e9-b1d1-4d17-ad48-b2e5109f83db service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:41.252030 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-28d486ea-ae85-4578-8de7-340013116e44 req-7071a4e9-b1d1-4d17-ad48-b2e5109f83db service nova] Creating event network-vif-plugged:97f5c40a-8122-4fe0-acaa-23be5d6baf58 for instance 3128af5d-4c55-4671-96ed-fbfaecf3901f on n-h1-836830-16 Sep 07 10:18:41.269137 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-28d486ea-ae85-4578-8de7-340013116e44 req-7071a4e9-b1d1-4d17-ad48-b2e5109f83db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091944 Sep 07 10:18:41.272751 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2880/5813] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:41.675649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:41.676956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:41.695935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:41.696692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:41.697444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:41.698699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:41.699640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:41.701705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:41.714410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:41.715124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:41.730925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:41.731305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:41.735200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:41.735966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:41.736454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:41.736899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:42.238743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:42.266532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65ae0dc4-c1a6-4933-8682-28fa8203d326 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1489 microversion: 2.1 time: 0.594242 Sep 07 10:18:42.267744 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2934/5814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:41 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1489 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:42.308208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:42.314032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:42.337636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:42.339170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:42.340303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:42.342977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:42.345508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:42.346294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:42.503588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:42.516900 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8250c776-b2eb-4cc8-8c95-01e6f323a544 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1374 microversion: 2.1 time: 0.805071 Sep 07 10:18:42.533422 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2881/5815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:41 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1374 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:42.888089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:42.896888 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3187472-6396-4134-b017-dca70463def7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1489 microversion: 2.1 time: 0.603682 Sep 07 10:18:42.899393 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2935/5816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:42 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1489 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:42.925778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:42.926404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:42.937754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:42.938258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:42.938704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:42.939426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:42.939890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:42.940323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.181029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:43.190354 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-197cb785-3ea6-40f4-8fb8-ec4613dace85 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1489 microversion: 2.1 time: 0.269074 Sep 07 10:18:43.213980 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2882/5817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:42 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1489 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:43.228501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:43.230140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:43.240713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:43.241664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:43.242448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.243414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:43.244143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:43.244814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.279043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:18:43.327331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:43.391476 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e03da75-6b48-4670-970c-a01533ece818 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 204 len: 0 microversion: 2.1 time: 0.163758 Sep 07 10:18:43.408113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:43.409048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:43.417354 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2936/5818] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:18:43 2022] DELETE /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:18:43.433896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:43.437202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:43.437904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.441328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:43.443407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:43.444982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.550131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:43.551188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:43.564632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:43.567010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:43.569475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.571568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:43.572358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:43.574301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:43.923182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:43.941329 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb380dc4-d552-4323-a774-b120264040e4 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1545 microversion: 2.1 time: 0.393212 Sep 07 10:18:43.953919 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2937/5819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:43 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1545 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:43.968367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:43.978428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:43.979073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:43.979756 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cecec47-a932-4716-b2b8-5406645fbfc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1495 microversion: 2.1 time: 0.578154 Sep 07 10:18:43.980674 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2883/5820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:43 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1495 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:44.002276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:44.002798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:44.003757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:44.005128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:44.006901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:44.006901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:44.392102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:44.419406 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d212a32-ba8c-4912-aed0-e930b6795c5c tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1545 microversion: 2.1 time: 0.445929 Sep 07 10:18:44.422084 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2938/5821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:43 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1545 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:18:45.008171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:45.008854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:45.020580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:45.021084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:45.021565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:45.022340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:45.022800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:45.023370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:45.347187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:45.357963 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5018192d-c9d1-460c-b7e0-66ded6a2a61f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1495 microversion: 2.1 time: 0.353801 Sep 07 10:18:45.359315 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2884/5822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:45 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1495 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:46.389000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:46.390436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:46.426073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:46.431618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:46.438217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:46.439875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:46.445864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:46.446797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:47.494878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:47.506320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ccb23924-afb5-45db-ab3e-cc7f5812e4a3 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1495 microversion: 2.1 time: 1.123940 Sep 07 10:18:47.506918 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2939/5823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:46 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1495 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:47.667899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-09b48048-ecf2-4c09-a147-0d8c5318e718 req-1f030510-142b-474d-8353-12439e5aee20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def9d011-68db-42a1-922f-00d88eeb59a6", "name": "network-vif-deleted", "tag": "2b5b26c4-8cd3-4a0c-b306-00fbe0092b2f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:47.710002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-09b48048-ecf2-4c09-a147-0d8c5318e718 req-1f030510-142b-474d-8353-12439e5aee20 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:47.710954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-09b48048-ecf2-4c09-a147-0d8c5318e718 req-1f030510-142b-474d-8353-12439e5aee20 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:47.711572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-09b48048-ecf2-4c09-a147-0d8c5318e718 req-1f030510-142b-474d-8353-12439e5aee20 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:47.749368 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-09b48048-ecf2-4c09-a147-0d8c5318e718 req-1f030510-142b-474d-8353-12439e5aee20 service nova] Creating event network-vif-deleted:2b5b26c4-8cd3-4a0c-b306-00fbe0092b2f for instance def9d011-68db-42a1-922f-00d88eeb59a6 on n-h1-836830-16 Sep 07 10:18:47.755304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-09b48048-ecf2-4c09-a147-0d8c5318e718 req-1f030510-142b-474d-8353-12439e5aee20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096699 Sep 07 10:18:47.757216 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2885/5824] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:48.537469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:48.538165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:48.552610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:48.553121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:48.556277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:48.557086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:48.557752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:48.558341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:48.679543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:48.684966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:48.685734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:48.686225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lazy-loading 'fault' on Instance uuid def9d011-68db-42a1-922f-00d88eeb59a6 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:18:49.325792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:49.341644 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dfee9abf-b22b-4f1e-8175-017380e32414 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 200 len: 1299 microversion: 2.1 time: 0.806115 Sep 07 10:18:49.344700 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2940/5825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:48 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 1299 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:50.370666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:50.373015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:50.381588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:50.382468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:50.383165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:50.384340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:50.385087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:50.385924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:50.422574 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 HTTP/1.1 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'def9d011-68db-42a1-922f-00d88eeb59a6'} Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:18:50.425675 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:18:50.434179 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:50.437587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:18:50.438807 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-657df9bd-5a0a-4faa-a17b-46bb68f1eaec tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 404 len: 111 microversion: 2.1 time: 0.072891 Sep 07 10:18:50.440554 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2886/5826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:50 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:18:50.449634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:50.450364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:50.470848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:50.471611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:50.472244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:50.473146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:50.473807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:50.474414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:50.515564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:18:50.682767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4318af36-e426-4347-b74d-0603077ce802 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 204 len: 0 microversion: 2.1 time: 0.237260 Sep 07 10:18:50.691920 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2941/5827] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:18:50 2022] DELETE /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 10:18:50.694068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:50.694861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:50.712561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:50.713078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:50.717034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:50.717855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:50.718348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:50.718793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:51.417555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:51.435731 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0abc190-5303-4601-b898-430b11325eeb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1495 microversion: 2.1 time: 0.746247 Sep 07 10:18:51.438708 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2887/5828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:50 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1495 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:52.339925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d24a2f50-41d2-4e8f-9d96-fce4706dd417 req-801dc037-61cb-4f96-a662-83fb6291c704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3128af5d-4c55-4671-96ed-fbfaecf3901f", "tag": "97f5c40a-8122-4fe0-acaa-23be5d6baf58"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:52.372091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d24a2f50-41d2-4e8f-9d96-fce4706dd417 req-801dc037-61cb-4f96-a662-83fb6291c704 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:52.373674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d24a2f50-41d2-4e8f-9d96-fce4706dd417 req-801dc037-61cb-4f96-a662-83fb6291c704 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:52.374382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d24a2f50-41d2-4e8f-9d96-fce4706dd417 req-801dc037-61cb-4f96-a662-83fb6291c704 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:52.419872 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d24a2f50-41d2-4e8f-9d96-fce4706dd417 req-801dc037-61cb-4f96-a662-83fb6291c704 service nova] Creating event network-changed:97f5c40a-8122-4fe0-acaa-23be5d6baf58 for instance 3128af5d-4c55-4671-96ed-fbfaecf3901f on n-h1-836830-16 Sep 07 10:18:52.430837 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d24a2f50-41d2-4e8f-9d96-fce4706dd417 req-801dc037-61cb-4f96-a662-83fb6291c704 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094350 Sep 07 10:18:52.439402 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2942/5829] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:52.469027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:52.469524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:52.472407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=46 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:52.488354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:52.488856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:52.489534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:52.490445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:52.490915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:52.491345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:53.115011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:53.147751 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7ea77246-890c-4d66-981e-ea70f0c19200 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1495 microversion: 2.1 time: 0.685097 Sep 07 10:18:53.150692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2888/5830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:52 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1495 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:54.178854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:54.179759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:54.195324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:54.199099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:54.199711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:54.201792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:54.202366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:54.203371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:54.651209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:54.665273 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-551ec315-e641-49d6-9141-5ea8b88d3cc2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1495 microversion: 2.1 time: 0.490655 Sep 07 10:18:54.666606 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2943/5831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:54 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1495 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:55.294833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c8ed1f4c-9f68-429e-9b60-91a67bdff32d req-5282d6b5-a274-4d6b-969e-cb9dbf91a948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edaa0a5-aaf8-4c90-b243-9a83f01c629f", "name": "network-vif-deleted", "tag": "243b22bf-fa63-4200-ab34-df17d731c9e4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:55.308527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c8ed1f4c-9f68-429e-9b60-91a67bdff32d req-5282d6b5-a274-4d6b-969e-cb9dbf91a948 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:55.310470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c8ed1f4c-9f68-429e-9b60-91a67bdff32d req-5282d6b5-a274-4d6b-969e-cb9dbf91a948 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:55.311271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c8ed1f4c-9f68-429e-9b60-91a67bdff32d req-5282d6b5-a274-4d6b-969e-cb9dbf91a948 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:55.324147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:18:55.328407 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c8ed1f4c-9f68-429e-9b60-91a67bdff32d req-5282d6b5-a274-4d6b-969e-cb9dbf91a948 service nova] Creating event network-vif-deleted:243b22bf-fa63-4200-ab34-df17d731c9e4 for instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f on n-h2-836830-16 Sep 07 10:18:55.345347 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c8ed1f4c-9f68-429e-9b60-91a67bdff32d req-5282d6b5-a274-4d6b-969e-cb9dbf91a948 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054155 Sep 07 10:18:55.346661 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2889/5832] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:18:55.692306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:55.693932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:55.740157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:55.743382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:55.744111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:55.747168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:55.748600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:55.753291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:55.847843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:55.848370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:55.848840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:55.849422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lazy-loading 'fault' on Instance uuid 2edaa0a5-aaf8-4c90-b243-9a83f01c629f {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:18:56.087640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:56.098960 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4496502f-6de3-4b8c-8ac7-00b05e7eebc0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 200 len: 1299 microversion: 2.1 time: 0.411402 Sep 07 10:18:56.110600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2944/5833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:55 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 1299 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:57.124247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:57.124968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:57.145078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:57.145685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:57.146234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:57.146881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:57.147335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:57.147793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:57.183161 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f HTTP/1.1 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2edaa0a5-aaf8-4c90-b243-9a83f01c629f'} Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:18:57.187343 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:18:57.191918 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:18:57.193889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:18:57.195026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9d80883-cc5d-4339-9c6d-85abbc4677cd tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 404 len: 111 microversion: 2.1 time: 0.076172 Sep 07 10:18:57.199204 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2890/5834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:57 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:18:57.439747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1711635407", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:18:57.515940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:18:58.613003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:18:58.614671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:18:58.615349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:18:58.616016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:18:58.616933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:18:58.655302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:58.657795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:58.658447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:58.659548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:18:58.660996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:18:58.661700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:18:58.688860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:18:58.701172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:18:58.723809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:18:58.726974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:18:58.817534 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c6828d48-5cad-4bd6-952e-9d60889bc483 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383330 Sep 07 10:18:58.821568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2945/5835] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:18:58.831131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-715dc4fe-418b-4a57-821b-ac82aa2946fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:58.832650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-715dc4fe-418b-4a57-821b-ac82aa2946fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:58.947201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-715dc4fe-418b-4a57-821b-ac82aa2946fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:18:58.958603 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-715dc4fe-418b-4a57-821b-ac82aa2946fb tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1209 microversion: 2.1 time: 0.132700 Sep 07 10:18:58.959705 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2891/5836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:58 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:18:59.984361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:18:59.985781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:18:59.990450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:00.006040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:00.006523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:00.009389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:00.010307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:00.017871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:00.018581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:00.241700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:00.267111 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45f533e3-08f1-48e6-bf5f-dfa2449d5067 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1205 microversion: 2.1 time: 0.277198 Sep 07 10:19:00.273948 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2946/5837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:18:59 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1205 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:01.302444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:01.303838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:01.320266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:01.320987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:01.325139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:01.325971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:01.327084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:01.328342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:01.524461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:01.540270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8863d357-7d4a-4c97-88a2-e5987452b245 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1267 microversion: 2.1 time: 0.241775 Sep 07 10:19:01.540960 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2892/5838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:01 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:02.568923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:02.573475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:02.597804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:02.598404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:02.599053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:02.600026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:02.600632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:02.601104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:02.914424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:02.934470 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7a4c46eb-55c2-4f1b-ae1c-3bd410206e23 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1267 microversion: 2.1 time: 0.370268 Sep 07 10:19:02.958220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2947/5839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:02 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:03.960259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:03.961523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:03.976231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:03.977309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:03.979864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:03.981416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:03.984892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:03.985605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:04.483175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:04.498048 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-55665c85-abd8-481a-a09d-bccf2bb26acf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.541961 Sep 07 10:19:04.498666 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2893/5840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:03 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:05.529068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:05.529897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:05.542995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:05.547705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:05.548164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:05.550385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:05.551812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:05.552279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:05.926351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-532e366a-d180-4803-9ab4-738da98e61f9 req-1bd0e828-38a5-4ccb-a85a-cbaf6e4c3f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05", "tag": "0c21f7a2-9bec-499c-aa8a-cc1c7e9a3fd4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:05.936756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-532e366a-d180-4803-9ab4-738da98e61f9 req-1bd0e828-38a5-4ccb-a85a-cbaf6e4c3f2f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:05.952258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-532e366a-d180-4803-9ab4-738da98e61f9 req-1bd0e828-38a5-4ccb-a85a-cbaf6e4c3f2f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:05.952630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-532e366a-d180-4803-9ab4-738da98e61f9 req-1bd0e828-38a5-4ccb-a85a-cbaf6e4c3f2f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:05.977916 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-532e366a-d180-4803-9ab4-738da98e61f9 req-1bd0e828-38a5-4ccb-a85a-cbaf6e4c3f2f service nova] Creating event network-changed:0c21f7a2-9bec-499c-aa8a-cc1c7e9a3fd4 for instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 on n-h2-836830-16 Sep 07 10:19:05.984994 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-532e366a-d180-4803-9ab4-738da98e61f9 req-1bd0e828-38a5-4ccb-a85a-cbaf6e4c3f2f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061851 Sep 07 10:19:05.986424 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2894/5841] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:19:06.039383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:06.050333 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-312e6f00-7376-42d5-a8c0-2ad7caf9d46d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.528048 Sep 07 10:19:06.051573 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2948/5842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:05 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:07.076821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:07.078545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:07.086367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:07.087200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:07.087829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:07.088707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:07.089463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:07.091196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:07.463161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:07.475833 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7538892f-f6d0-44de-a445-23dda02baf6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.403918 Sep 07 10:19:07.478623 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2895/5843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:07 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:08.509885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:08.511771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:08.534560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:08.535749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:08.537120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:08.539947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:08.540781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:08.542484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:08.672573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:08.711857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:08.876346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:08.925278 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54f117bc-3e88-405f-a7df-ca620094a845 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.407012 Sep 07 10:19:08.925278 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2949/5844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:08 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:09.806235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:09.811098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:09.819687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:09.823391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:09.824139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:09.824943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:09.827138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:09.828023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:09.829405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:09.915364 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-311f5b1d-8441-4bd3-aae4-00151b76366f tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f/action" status: 200 len: 24573 microversion: 2.1 time: 0.113829 Sep 07 10:19:09.916314 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2896/5845] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:19:09 2022] POST /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f/action => generated 24573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:19:09.967613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:09.968319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:09.981075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:09.981724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:09.982197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:09.982966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:09.986004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:09.986602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:10.269032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:10.283367 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e4864ef-1315-402d-8120-4c421fe69260 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.320815 Sep 07 10:19:10.289325 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2950/5846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:09 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:11.348854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:11.349800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:11.385482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:11.386523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:11.387355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:11.388751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:11.390225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:11.391347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:11.692724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:11.703579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc8850e9-43b9-4fbb-9161-3fd23b9a36b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.360635 Sep 07 10:19:11.705573 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2897/5847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:11 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:12.730362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:12.731762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:12.740353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:12.746215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:12.747027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:12.747919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:12.748421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:12.748876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:12.797272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:12.971550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:12.979556 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2dbfb303-e506-475a-89b3-5b41a340769d tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.253224 Sep 07 10:19:12.985564 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2951/5848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:12 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:13.175551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-acb0cded-3fac-4aed-b8e0-7775f113d260 req-b6bd0f3c-8626-41dd-820c-aec8b0833aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05", "name": "network-vif-plugged", "status": "completed", "tag": "0c21f7a2-9bec-499c-aa8a-cc1c7e9a3fd4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:13.198939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-acb0cded-3fac-4aed-b8e0-7775f113d260 req-b6bd0f3c-8626-41dd-820c-aec8b0833aa5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:13.199695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-acb0cded-3fac-4aed-b8e0-7775f113d260 req-b6bd0f3c-8626-41dd-820c-aec8b0833aa5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:13.200307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-acb0cded-3fac-4aed-b8e0-7775f113d260 req-b6bd0f3c-8626-41dd-820c-aec8b0833aa5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:13.233467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-acb0cded-3fac-4aed-b8e0-7775f113d260 req-b6bd0f3c-8626-41dd-820c-aec8b0833aa5 service nova] Creating event network-vif-plugged:0c21f7a2-9bec-499c-aa8a-cc1c7e9a3fd4 for instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 on n-h2-836830-16 Sep 07 10:19:13.248369 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-acb0cded-3fac-4aed-b8e0-7775f113d260 req-b6bd0f3c-8626-41dd-820c-aec8b0833aa5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076053 Sep 07 10:19:13.249164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2898/5849] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:14.004077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:14.004798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:14.023522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:14.024598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:14.026597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:14.028810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:14.029570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:14.031768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:14.733057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:14.746022 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60fe7894-e9b9-4f49-8dc3-8d2153d629ab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1309 microversion: 2.1 time: 0.745851 Sep 07 10:19:14.747695 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2952/5850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:13 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1309 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:15.212405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Calling method '.version_select at 0x7f14b0b2f5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:15.218004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:15.218911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:15.219612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:15.247760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:15.255103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:15.256499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:15.277675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:15.279473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:15.281783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:15.299431 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2773abdf-d6cc-435a-9655-fb58ca3b29aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198 tempest-PortsAdminExtendedAttrsIpV6TestJSON-906238198-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.341597 Sep 07 10:19:15.300414 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2899/5851] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:19:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:15.771247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:15.771954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:15.788928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:15.797733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:15.805410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:15.811879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:15.813978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:15.815546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:16.601377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:16.614178 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e0d96c3-da45-496d-8792-21e224cb00ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1490 microversion: 2.1 time: 0.847334 Sep 07 10:19:16.614786 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2953/5852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:15 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1490 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:16.646786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:16.657670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:16.673002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:16.676586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:16.677359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:16.678348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:16.690085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:16.690835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:16.858832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-37aa14e7-b84a-40a0-b632-5d7f9f581d58 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "PUT /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1085 microversion: 2.1 time: 0.222905 Sep 07 10:19:16.860323 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2900/5853] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:19:16 2022] PUT /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1085 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:16.889049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:16.891418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:16.937946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:16.940179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:16.941975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:16.944644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:16.945752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:16.947575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:17.563701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:17.599114 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d74a3b5-d879-4815-ac8b-a91b08ec8a4b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1511 microversion: 2.1 time: 0.719100 Sep 07 10:19:17.617683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2954/5854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:16 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:17.624118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:17.624835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:17.634959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:17.635475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:17.635925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:17.637420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:17.639811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:17.643063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:17.998193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:18.022198 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79304cd1-01bf-45a9-816a-b3620f334572 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1511 microversion: 2.1 time: 0.398926 Sep 07 10:19:18.026892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2901/5855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:17 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:18.056276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:18.056942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:18.074248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:18.074905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:18.080760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:18.081707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:18.085155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:18.085939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:18.176007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:19:18.442862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-73d83e9f-0703-43e5-9562-6e86edb751f8 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 204 len: 0 microversion: 2.1 time: 0.393416 Sep 07 10:19:18.443773 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2955/5856] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:19:18 2022] DELETE /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:19:18.453774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:18.454776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:18.467811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:18.468748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:18.470147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:18.472321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:18.473601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:18.475270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:18.889567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:18.907044 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fbf90af5-f093-4dbd-8b48-4b02380e561f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1517 microversion: 2.1 time: 0.453974 Sep 07 10:19:18.909725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2902/5857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:18 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1517 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:19.937495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:19.938231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:19.951133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:19.951649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:19.952107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:19.952850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:19.957066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:19.957566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:20.405548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:20.419497 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c304ee4a-167c-4b9a-8cfd-25365eb467dc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1517 microversion: 2.1 time: 0.489926 Sep 07 10:19:20.424639 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2956/5858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:19 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:21.078538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-91c4b32b-72dc-4032-a990-550fa6e0f007 req-39e12f78-c5ba-4871-bc97-120da22ad468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05", "name": "network-vif-deleted", "tag": "0c21f7a2-9bec-499c-aa8a-cc1c7e9a3fd4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:21.129836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-91c4b32b-72dc-4032-a990-550fa6e0f007 req-39e12f78-c5ba-4871-bc97-120da22ad468 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:21.133331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-91c4b32b-72dc-4032-a990-550fa6e0f007 req-39e12f78-c5ba-4871-bc97-120da22ad468 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:21.149753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-91c4b32b-72dc-4032-a990-550fa6e0f007 req-39e12f78-c5ba-4871-bc97-120da22ad468 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:21.205465 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-91c4b32b-72dc-4032-a990-550fa6e0f007 req-39e12f78-c5ba-4871-bc97-120da22ad468 service nova] Creating event network-vif-deleted:0c21f7a2-9bec-499c-aa8a-cc1c7e9a3fd4 for instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 on n-h2-836830-16 Sep 07 10:19:21.223097 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-91c4b32b-72dc-4032-a990-550fa6e0f007 req-39e12f78-c5ba-4871-bc97-120da22ad468 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146719 Sep 07 10:19:21.226058 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2903/5859] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:21.333864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:21.338796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:21.377044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:21.377581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:21.378032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:21.378783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:21.379253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:21.379712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:21.452039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:21.452771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:21.463128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:21.467171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:21.467669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:21.468417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:21.468894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:21.469361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:21.487942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e72e5b8c-2e4e-4857-81a0-27606e921547 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "POST /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f/action" status: 200 len: 32645 microversion: 2.1 time: 0.158047 Sep 07 10:19:21.495512 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2957/5860] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:19:21 2022] POST /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f/action => generated 32645 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 10:19:21.561426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:21.561983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:21.562537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:21.562801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lazy-loading 'fault' on Instance uuid f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:19:22.059752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:22.069679 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb9dd8d8-ef39-42b6-9501-b486abf8e7f7 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 200 len: 1320 microversion: 2.1 time: 0.623390 Sep 07 10:19:22.070962 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2904/5861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:21 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 1320 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:23.099451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:23.100229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:23.118529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:23.119325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:23.121394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:23.122357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:23.129223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:23.130194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:23.178032 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 HTTP/1.1 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05'} Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:19:23.182168 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:19:23.187942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cbd3ea63-3102-4459-a649-76dcb28d8eb1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 404 len: 111 microversion: 2.1 time: 0.089348 Sep 07 10:19:23.189068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2958/5862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:23 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:19:23.431792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1157444292", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "516a1003-7275-46da-8a74-51689ae3fbca"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:23.470681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=40 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:23.566051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] validate_networks() for [('516a1003-7275-46da-8a74-51689ae3fbca', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:19:25.357504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:25.358306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:25.372407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:25.372932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:25.385760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:25.386682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:25.387199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:25.387705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:25.431304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:19:25.614715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0dfbf360-401f-4c5c-97f7-1ad863282643 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 204 len: 0 microversion: 2.1 time: 0.261967 Sep 07 10:19:25.619332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2959/5863] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:19:25 2022] DELETE /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:19:25.630625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0485e613-3f78-4364-bf79-c789e8b08aee req-620042c4-a19c-4146-8a40-a00d11c55d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3128af5d-4c55-4671-96ed-fbfaecf3901f", "tag": "97f5c40a-8122-4fe0-acaa-23be5d6baf58"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:25.664595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0485e613-3f78-4364-bf79-c789e8b08aee req-620042c4-a19c-4146-8a40-a00d11c55d2f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:25.665420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0485e613-3f78-4364-bf79-c789e8b08aee req-620042c4-a19c-4146-8a40-a00d11c55d2f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:25.669645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0485e613-3f78-4364-bf79-c789e8b08aee req-620042c4-a19c-4146-8a40-a00d11c55d2f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:25.699577 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0485e613-3f78-4364-bf79-c789e8b08aee req-620042c4-a19c-4146-8a40-a00d11c55d2f service nova] Creating event network-changed:97f5c40a-8122-4fe0-acaa-23be5d6baf58 for instance 3128af5d-4c55-4671-96ed-fbfaecf3901f on n-h1-836830-16 Sep 07 10:19:25.729618 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0485e613-3f78-4364-bf79-c789e8b08aee req-620042c4-a19c-4146-8a40-a00d11c55d2f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108161 Sep 07 10:19:25.733761 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2960/5864] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:25.760663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:25.761343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:25.783383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:25.784174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:25.784823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:25.785781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:25.786425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:25.787170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:26.005649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:19:26.007455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:19:26.007954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:19:26.009506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:19:26.010191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:19:26.044465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:26.045600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:26.047179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:26.048890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:26.052160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:26.060709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:26.125074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:19:26.139496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Getting quotas for user fb4b1b1fc9e5449cbcc6af6f6502b61a and project 57fda4bcc479418fa2c133598fb53f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:19:26.147896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:26.164723 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d933578e-8559-42db-aa5c-bfc0709865d1 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1670 microversion: 2.1 time: 0.429253 Sep 07 10:19:26.165402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:19:26.178213 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2961/5865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:25 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1670 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:26.196291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:19:26.330310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8fdccc44-deea-42a2-a7ef-d9a890494020 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.903121 Sep 07 10:19:26.331748 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2905/5866] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:19:26.346354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ee6a8b6b-2160-4d0c-bf8b-b2619a245979 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:26.347031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ee6a8b6b-2160-4d0c-bf8b-b2619a245979 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:26.562313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ee6a8b6b-2160-4d0c-bf8b-b2619a245979 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:26.572320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ee6a8b6b-2160-4d0c-bf8b-b2619a245979 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1209 microversion: 2.1 time: 0.231657 Sep 07 10:19:26.576744 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2962/5867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:26 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1209 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:27.198018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:27.200605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:27.219718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:27.230930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:27.232177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:27.233150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:27.234295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:27.234908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:27.283386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:27.603174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:27.604335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:27.622110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:27.622914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:27.623620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:27.624527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:27.626292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:27.627361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:27.873563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:27.883749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:27.895811 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e005e87-5bf3-47b0-a989-8ec1f1d4594a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1205 microversion: 2.1 time: 0.294666 Sep 07 10:19:27.896440 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2963/5868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:27 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1205 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:27.897420 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2d37a85d-ed86-4ad1-bd34-04e3a445b18a tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1670 microversion: 2.1 time: 0.702633 Sep 07 10:19:27.899886 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2906/5869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:27 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1670 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:28.845839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ac6f3e42-ecb3-443c-9aa9-4cc7b8c2b39d req-e6a857c3-22c7-4f28-9d86-a2ac6d088988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3128af5d-4c55-4671-96ed-fbfaecf3901f", "name": "network-vif-deleted", "tag": "97f5c40a-8122-4fe0-acaa-23be5d6baf58"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:28.867639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ac6f3e42-ecb3-443c-9aa9-4cc7b8c2b39d req-e6a857c3-22c7-4f28-9d86-a2ac6d088988 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:28.873840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ac6f3e42-ecb3-443c-9aa9-4cc7b8c2b39d req-e6a857c3-22c7-4f28-9d86-a2ac6d088988 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:28.875429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ac6f3e42-ecb3-443c-9aa9-4cc7b8c2b39d req-e6a857c3-22c7-4f28-9d86-a2ac6d088988 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:28.892462 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ac6f3e42-ecb3-443c-9aa9-4cc7b8c2b39d req-e6a857c3-22c7-4f28-9d86-a2ac6d088988 service nova] Creating event network-vif-deleted:97f5c40a-8122-4fe0-acaa-23be5d6baf58 for instance 3128af5d-4c55-4671-96ed-fbfaecf3901f on n-h1-836830-16 Sep 07 10:19:28.901401 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ac6f3e42-ecb3-443c-9aa9-4cc7b8c2b39d req-e6a857c3-22c7-4f28-9d86-a2ac6d088988 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059376 Sep 07 10:19:28.903487 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2964/5870] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:28.924230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:28.925869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:28.935656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:28.936314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:28.941221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:28.941715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:28.942162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:28.942886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:28.943353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:28.943781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:28.952655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:28.956609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:28.958674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:28.960407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:28.960987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:28.962085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:29.080441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:29.080964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:29.081455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:29.090682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lazy-loading 'fault' on Instance uuid 3128af5d-4c55-4671-96ed-fbfaecf3901f {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:19:29.145756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:29.165645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf100a46-791f-4a68-9298-596dd402affa tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1267 microversion: 2.1 time: 0.245276 Sep 07 10:19:29.166927 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2907/5871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:28 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:29.233633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f569c9d96f2045ba979a4fb85fa3acb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2d100f006c423cb7ff20ba6e00b1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:29.245371 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71f56e08-ea1a-4bae-bbc4-533277b62076 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 200 len: 1338 microversion: 2.1 time: 0.314860 Sep 07 10:19:29.248612 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2965/5872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:28 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 1338 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:30.195805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:30.196573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:30.213674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:30.217054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:30.217689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:30.218531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:30.221580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:30.222140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:30.276135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:30.277440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] [instance: 3128af5d-4c55-4671-96ed-fbfaecf3901f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:30.288432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:30.295459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:30.304437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:30.305150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:30.309779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:30.323014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:30.324508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:30.381489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:30.391998 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d32fed74-18c9-43c3-ac66-345b3aff403a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1267 microversion: 2.1 time: 0.202535 Sep 07 10:19:30.403510 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2908/5873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:30 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:30.425585 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] HTTP exception thrown: Instance 3128af5d-4c55-4671-96ed-fbfaecf3901f could not be found. Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Request method failure captured: Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f HTTP/1.1 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG70_liRTjspc89uoNLZuxJg4ExPgkMEnf60Iz3WhQDHRKn8awQL2jzlw4l0zzD5phCHMRfErHbeu4umALm860rgN0VjFE38769eFzjC-LKkcKKLq3ElVXJ5rKyhAypRoKZNzPkT7gtWBeLdFuYybMJGVX1b9kH2UJbe06Czha4R9vQ Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: ed2d100f006c423cb7ff20ba6e00b1ee Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed2d100f006c423cb7ff20ba6e00b1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed2d100f006c423cb7ff20ba6e00b1ee", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: ed2d100f006c423cb7ff20ba6e00b1ee Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestNetworkBasicOps-1298611205 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestNetworkBasicOps-1298611205-project Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: f569c9d96f2045ba979a4fb85fa3acb2 Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestNetworkBasicOps-1298611205-project Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 3128af5d-4c55-4671-96ed-fbfaecf3901f could not be found. Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '3128af5d-4c55-4671-96ed-fbfaecf3901f'} Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3128af5d-4c55-4671-96ed-fbfaecf3901f could not be found. Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3128af5d-4c55-4671-96ed-fbfaecf3901f could not be found. Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:19:30.427699 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3128af5d-4c55-4671-96ed-fbfaecf3901f could not be found. Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Returning 404 to user: Instance 3128af5d-4c55-4671-96ed-fbfaecf3901f could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4451c5a2-547c-477c-acfe-bb2b298bacb0 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f" status: 404 len: 111 microversion: 2.1 time: 0.157643 Sep 07 10:19:30.432877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2966/5874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:30 2022] GET /compute/v2.1/servers/3128af5d-4c55-4671-96ed-fbfaecf3901f => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:19:30.917535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c64c9c76-7da7-4a46-83de-29cf6ccbf589 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] Calling method '.version_select at 0x7f14b1adb4c0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:30.967645 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c64c9c76-7da7-4a46-83de-29cf6ccbf589 tempest-TestNetworkBasicOps-1298611205 tempest-TestNetworkBasicOps-1298611205-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-389357526" status: 202 len: 0 microversion: 2.1 time: 0.054568 Sep 07 10:19:30.968250 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2909/5875] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 7 10:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-389357526 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:19:31.425112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:31.426133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:31.453793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:31.454591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:31.458121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:31.464938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:31.465958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:31.471355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:31.595924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:31.612469 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c9e7510-8147-4a91-be11-7f93a1b4d679 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1267 microversion: 2.1 time: 0.193952 Sep 07 10:19:31.613520 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2967/5876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:31 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:32.655514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:32.657717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:32.666311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:32.667139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:32.667857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:32.668603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:32.669117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:32.670007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:33.775102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:33.787011 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c4af654-9106-433a-82f2-6bebdc8e5aaf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 1.154713 Sep 07 10:19:33.796640 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2910/5877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:32 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:34.311566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-738423c8-645b-4a75-a04a-12437a3311cc req-904d5927-ea5e-4cf5-8cb8-65295bfe6785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba", "tag": "7d0b6542-2422-4a6d-aed9-64e63fefda36"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:34.336409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-738423c8-645b-4a75-a04a-12437a3311cc req-904d5927-ea5e-4cf5-8cb8-65295bfe6785 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:34.337416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-738423c8-645b-4a75-a04a-12437a3311cc req-904d5927-ea5e-4cf5-8cb8-65295bfe6785 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:34.340658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-738423c8-645b-4a75-a04a-12437a3311cc req-904d5927-ea5e-4cf5-8cb8-65295bfe6785 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:34.353871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:34.373490 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-738423c8-645b-4a75-a04a-12437a3311cc req-904d5927-ea5e-4cf5-8cb8-65295bfe6785 service nova] Creating event network-changed:7d0b6542-2422-4a6d-aed9-64e63fefda36 for instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba on n-h2-836830-16 Sep 07 10:19:34.390510 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-738423c8-645b-4a75-a04a-12437a3311cc req-904d5927-ea5e-4cf5-8cb8-65295bfe6785 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083140 Sep 07 10:19:34.403931 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2968/5878] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:34.825498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:34.826140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:34.849836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:34.850533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:34.850997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:34.852033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:34.852528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:34.852956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:35.181601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:35.194746 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f1c19b63-b6bc-4e5c-84b0-cac848e8c7cc tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.375623 Sep 07 10:19:35.209213 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2911/5879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:34 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:36.228201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:36.229082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:36.245026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:36.247361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:36.248897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:36.249877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:36.252926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:36.254246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:36.570551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:37.169782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:37.182486 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c95145af-71a7-418e-a52c-92d2b186a6c2 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.961845 Sep 07 10:19:37.197230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2969/5880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:36 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:38.208521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:38.208975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:38.223001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:38.224293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:38.226813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:38.227631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:38.228386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:38.229463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:38.236924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:38.237805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:38.593233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:38.606489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-051ff1c3-0ef9-4ca6-8b92-95b21b903013 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.402104 Sep 07 10:19:38.607786 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2912/5881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:38 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:39.630483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:39.631814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:39.652749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:39.653689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:39.654392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:39.655361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:39.656076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:39.656882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:40.365095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:40.383085 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9bc72017-7b55-4b16-9120-bae19d3881e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.754270 Sep 07 10:19:40.383085 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2970/5882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:39 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:41.413286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:41.414662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:41.427037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:41.432843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:41.434306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:41.436675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:41.444518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:41.445065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:41.813300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:41.821657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53fc9193-ea55-4b4f-8f0f-7adcc8f69724 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.412104 Sep 07 10:19:41.841645 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2913/5883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:41 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:42.617330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-91b108d1-692a-4405-ab61-e7f2d9b4ffc7 req-a26270f4-a9dd-4172-b0dd-4a150baa5ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba", "name": "network-vif-plugged", "status": "completed", "tag": "7d0b6542-2422-4a6d-aed9-64e63fefda36"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:42.632866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-91b108d1-692a-4405-ab61-e7f2d9b4ffc7 req-a26270f4-a9dd-4172-b0dd-4a150baa5ef8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:42.637298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-91b108d1-692a-4405-ab61-e7f2d9b4ffc7 req-a26270f4-a9dd-4172-b0dd-4a150baa5ef8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:42.637963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-91b108d1-692a-4405-ab61-e7f2d9b4ffc7 req-a26270f4-a9dd-4172-b0dd-4a150baa5ef8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:42.655172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-91b108d1-692a-4405-ab61-e7f2d9b4ffc7 req-a26270f4-a9dd-4172-b0dd-4a150baa5ef8 service nova] Creating event network-vif-plugged:7d0b6542-2422-4a6d-aed9-64e63fefda36 for instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba on n-h2-836830-16 Sep 07 10:19:42.679092 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-91b108d1-692a-4405-ab61-e7f2d9b4ffc7 req-a26270f4-a9dd-4172-b0dd-4a150baa5ef8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065644 Sep 07 10:19:42.680072 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2971/5884] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:19:42.848355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:42.849028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:42.864735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:42.865268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:42.865937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:42.866661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:42.867154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:42.867614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:43.356593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:43.403337 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8eb39a61-585e-4bd7-b0bf-eb0c7a4d8c3f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.555611 Sep 07 10:19:43.406444 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2914/5885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:42 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:44.441007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:44.442408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:44.461282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:44.461908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:44.462447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:44.468339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:44.468953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:44.469549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:44.997864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:45.007272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eeba964d-edb4-4305-bda0-7dee3b710b9c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1309 microversion: 2.1 time: 0.572655 Sep 07 10:19:45.007583 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2972/5886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:44 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1309 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:46.034629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:46.035263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:46.049098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:46.049859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:46.050482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:46.051384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:46.052024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:46.052630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:46.577525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:46.586740 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77ab3dd7-5dbe-47d8-951f-f429fe5a97de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1490 microversion: 2.1 time: 0.556036 Sep 07 10:19:46.597154 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2915/5887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:46 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1490 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:19:46.626204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-796274622"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:46.629676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:46.640232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:46.641247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:46.641907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:46.643064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:46.644851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:46.645510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:46.779214 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-80823c4f-d8dc-46c0-933c-32f3b320fee0 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "PUT /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1074 microversion: 2.1 time: 0.159191 Sep 07 10:19:46.781020 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2973/5888] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:19:46 2022] PUT /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1074 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:19:46.810274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:46.810274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:46.825013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:46.825543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:46.826233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:46.828798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:46.829552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:46.830306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:47.307272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:47.318510 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84988f5f-3b3a-407b-bc28-70dcb785f103 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1500 microversion: 2.1 time: 0.513477 Sep 07 10:19:47.320084 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2916/5889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:46 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1500 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:47.345546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:47.346644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:47.353117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:47.353917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:47.354374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:47.356261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:47.357091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:47.357928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:47.641899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:47.657388 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c7b6a52-867f-4ba5-a265-5376f1f69478 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1500 microversion: 2.1 time: 0.315892 Sep 07 10:19:47.661394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2974/5890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:47 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1500 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:47.710194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30c5d0e6-42ae-44b4-a086-dd921360ea4c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:19:47.734001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30c5d0e6-42ae-44b4-a086-dd921360ea4c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:47.737856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30c5d0e6-42ae-44b4-a086-dd921360ea4c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:47.738622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30c5d0e6-42ae-44b4-a086-dd921360ea4c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:47.812820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-30c5d0e6-42ae-44b4-a086-dd921360ea4c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Going to try to stop instance {{(pid=128833) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:19:47.998246 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30c5d0e6-42ae-44b4-a086-dd921360ea4c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "POST /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba/action" status: 202 len: 0 microversion: 2.1 time: 0.304829 Sep 07 10:19:47.999660 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2917/5891] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:19:47 2022] POST /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:19:48.008771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:48.009434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:48.029625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:48.030185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:48.031604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:48.032392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:48.035682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:48.036787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:48.516766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:48.525738 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e9445f68-9d06-416d-a15b-d2232c503a30 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.521458 Sep 07 10:19:48.529408 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2975/5892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:48 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:49.551051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:49.551741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:49.576340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:49.576901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:49.577379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:49.583705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:49.585815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:49.586452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:50.071410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:50.101198 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cca283e-ad09-460c-847f-5d0f38aeb054 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.550191 Sep 07 10:19:50.101845 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2918/5893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:49 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:51.135148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:51.137995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:51.148643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:51.150046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:51.150755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:51.151833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:51.152902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:51.153635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:51.414729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:51.428636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-11a836d5-1127-4949-ae92-7c4aa46b13de tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.302871 Sep 07 10:19:51.442696 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2976/5894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:51 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:52.468999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:52.470313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:52.494214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:52.507996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:52.512467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:52.513415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:52.516866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:52.517603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:53.019004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:53.039365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3dcf2e16-230e-4624-96a0-ebf4e9dce619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.574185 Sep 07 10:19:53.052530 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2919/5895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:52 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:54.071507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:54.073673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:54.099441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:54.100144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:54.100610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:54.101602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:54.107882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:54.109491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:54.591335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:54.602858 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70ada0ac-fc0e-4170-8b29-243d7e201196 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.536082 Sep 07 10:19:54.607147 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2977/5896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:54 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:55.630956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:55.631591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:55.635125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:55.658042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:55.670450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:55.671198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:55.672735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:55.675640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:55.676899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:56.086847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:56.107346 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-119c112f-93b7-4494-b319-df4df9c87958 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.482512 Sep 07 10:19:56.114588 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2920/5897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:55 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:57.141405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:57.143537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:57.162983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:57.165109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:57.167877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:57.169072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:57.171359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:57.172467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:57.618971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:57.636934 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a5bfd89-d5fc-47f5-b77b-4052b512188f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.501497 Sep 07 10:19:57.637850 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2978/5898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:57 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:19:58.664867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:19:58.665854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:19:58.694457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:58.694990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:58.695429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:58.696165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:19:58.696634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:19:58.697271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:19:58.778575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:19:59.295636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:19:59.303815 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ac02f08-1338-4c62-8c5f-2c401c8a88ef tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.642960 Sep 07 10:19:59.304421 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2921/5899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:19:58 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:20:00.327134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:00.327776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:00.344358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:00.345397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:00.346095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:00.347047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:00.347732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:00.348398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:00.767223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:00.781834 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4336ad70-eb26-45a5-9a24-215e548b55b6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.458529 Sep 07 10:20:00.787957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2979/5900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:00 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:01.808320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:01.808985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:01.823229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:01.823880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:01.826827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:01.829467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:01.830039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:01.832046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:02.209639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:02.220903 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-090d8634-1c7d-47f4-afc1-31f29368d6c4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.418236 Sep 07 10:20:02.234624 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2922/5901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:01 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:03.250499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:03.251847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:03.255619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=28 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:03.270793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:03.272795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:03.273495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:03.277712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:03.278506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:03.279511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:03.634429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:03.646293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96fba04e-084b-46fd-89ae-17de12974f8a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.399336 Sep 07 10:20:03.647277 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2980/5902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:03 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:04.674451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:04.675093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:04.688856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:04.689746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:04.690892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:04.692226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:04.693646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:04.694618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:05.464812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:05.475157 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-278a3e7e-144a-4e13-8671-9649bff2c49b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.804524 Sep 07 10:20:05.475767 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2923/5903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:04 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:06.502449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:06.503085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:06.522706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:06.523224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:06.523743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:06.524477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:06.525173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:06.525802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:06.588525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:06.920903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:06.949967 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5ac667a4-c875-42c4-ab2f-f60578311707 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.451400 Sep 07 10:20:06.962692 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2981/5904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:06 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:07.976330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:07.976965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:08.002024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:08.005079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:08.005578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:08.006338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:08.008929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:08.012603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:08.480736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:08.497221 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01c936fa-b458-4209-9220-b8877acc6716 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.524801 Sep 07 10:20:08.507301 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2924/5905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:07 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:09.520188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:09.520836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:09.532090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:09.532608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:09.533070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:09.533836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:09.534321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:09.534948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:09.797430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:09.810297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-156b49d8-aa43-4355-8e42-c6a628651f01 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.294207 Sep 07 10:20:09.811277 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2982/5906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:09 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:10.836891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:10.838169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:10.849532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:10.851535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:10.852623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:10.853798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:10.855692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:10.856388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:11.201713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:11.268670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15532740-e06e-4477-a1c0-7efa573184e6 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.436318 Sep 07 10:20:11.280616 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2925/5907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:10 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:12.311404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:12.312730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:12.330100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:12.331421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:12.332092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:12.338397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:12.344177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:12.345317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:12.651358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:12.671151 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b20c3fe-19cd-4737-a536-cbcaa1e86557 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1510 microversion: 2.1 time: 0.369062 Sep 07 10:20:12.702905 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2983/5908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:12 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:13.727110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:13.728417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:13.759386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:13.769943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:13.770778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:13.773448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:13.778650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:13.779360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.306402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:14.332304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf3b41d6-6041-42e7-a4c4-7a6dace033e9 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1487 microversion: 2.1 time: 0.608739 Sep 07 10:20:14.337043 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2926/5909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:13 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1487 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:14.362616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-333845378"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:14.365240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:14.375698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:14.376414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:14.377027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.377945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:14.378640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:14.379088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.493287 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-80f66cae-e574-4d55-a528-d81c4f6c313a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "PUT /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1060 microversion: 2.1 time: 0.137005 Sep 07 10:20:14.495317 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2984/5910] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:20:14 2022] PUT /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1060 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:14.514750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:14.515730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:14.522267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:14.525103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:14.526696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.527609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:14.528290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:14.528914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.708017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:14.716651 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08b12b41-3a64-49ad-81b6-b1a4f27601bf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1487 microversion: 2.1 time: 0.206824 Sep 07 10:20:14.717256 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2927/5911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:14 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1487 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:14.751558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:14.752051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:14.758395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:14.759435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:14.762673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.763646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:14.764337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:14.764981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:14.955779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:14.967591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6be2be5e-e145-47e1-92ab-5684bf6f3ebf tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1487 microversion: 2.1 time: 0.224006 Sep 07 10:20:14.968915 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2985/5912] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:14 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1487 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:14.989852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:14.990925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:15.001274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:15.002056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:15.002742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:15.003684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:15.004772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:15.005661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:15.042353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:20:15.228562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77f1d027-5d9b-4097-952f-58c7b432c253 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 204 len: 0 microversion: 2.1 time: 0.239959 Sep 07 10:20:15.232962 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2928/5913] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:14 2022] DELETE /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:20:15.241837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:15.242542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:15.261038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:15.261038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:15.261038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:15.261038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:15.261038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:15.261038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:15.551101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:15.572532 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ffe4a266-fe32-4404-9b6a-47e31a91ae91 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1493 microversion: 2.1 time: 0.335014 Sep 07 10:20:15.573894 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2986/5914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:15 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:16.609870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:16.619452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:16.633827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:16.636192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:16.636829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:16.642700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:16.643396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:16.644022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:17.083349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:17.093934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07fb9c21-cabc-4aa2-8424-03c642b4457b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1493 microversion: 2.1 time: 0.496353 Sep 07 10:20:17.094765 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2929/5915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:16 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1493 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:18.129323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:18.135855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:18.174304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:18.176509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:18.179836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8c1d6d73-4b44-4113-a4b0-76b1b688771d req-d98e4f77-9342-4d4b-a5a1-e92fc73b643a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba", "name": "network-vif-deleted", "tag": "7d0b6542-2422-4a6d-aed9-64e63fefda36"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:18.182859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:18.191274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:18.194759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:18.200962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:18.226929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c1d6d73-4b44-4113-a4b0-76b1b688771d req-d98e4f77-9342-4d4b-a5a1-e92fc73b643a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:18.234410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c1d6d73-4b44-4113-a4b0-76b1b688771d req-d98e4f77-9342-4d4b-a5a1-e92fc73b643a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:18.247103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c1d6d73-4b44-4113-a4b0-76b1b688771d req-d98e4f77-9342-4d4b-a5a1-e92fc73b643a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:18.329770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8c1d6d73-4b44-4113-a4b0-76b1b688771d req-d98e4f77-9342-4d4b-a5a1-e92fc73b643a service nova] Creating event network-vif-deleted:7d0b6542-2422-4a6d-aed9-64e63fefda36 for instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba on n-h2-836830-16 Sep 07 10:20:18.350937 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8c1d6d73-4b44-4113-a4b0-76b1b688771d req-d98e4f77-9342-4d4b-a5a1-e92fc73b643a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181040 Sep 07 10:20:18.365012 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2930/5916] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:20:18.608683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:18.634012 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f41cc69-b4ff-494d-951b-7ef93e806eab tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 200 len: 1291 microversion: 2.1 time: 0.517303 Sep 07 10:20:18.645963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2987/5917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:18 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 1291 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:19.673605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:19.674419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:19.690659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.692672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.694745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.699087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.699894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.700530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.724281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba HTTP/1.1 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba'} Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:19.725996 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-383ad2b7-a2ef-4447-b230-2402a9b83ab4 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 404 len: 111 microversion: 2.1 time: 0.058273 Sep 07 10:20:19.738307 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2931/5918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:19 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:19.752280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:19.752799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:19.764534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.772396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.774952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.776705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.780131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.780821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.824831 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba HTTP/1.1 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba'} Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:19.827125 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.832056 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.834379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:19.835474 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ec0c5f6-eb24-45ce-bd6f-1b6b39cdca0f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 404 len: 111 microversion: 2.1 time: 0.088739 Sep 07 10:20:19.846387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:19.847340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:19.852480 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2988/5919] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:19 2022] DELETE /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:19.854528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.855322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.855997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.857070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.857789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.858460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.922997 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba HTTP/1.1 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba'} Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:19.924955 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. Sep 07 10:20:19.929811 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:19.932746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:19.939258 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7bc1a4d-2bce-40eb-9641-e7e2216b949c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba" status: 404 len: 111 microversion: 2.1 time: 0.096956 Sep 07 10:20:19.951429 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2932/5920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:19 2022] GET /compute/v2.1/servers/5c5c4933-3f74-48ca-a8d0-09a5e64fa4ba => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:19.958535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:19.959280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:19.976927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.979499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.980196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:19.988082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:19.989737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:19.992739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.043677 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 HTTP/1.1 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05'} Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.046405 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.055107 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.060487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.064309 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15202ff2-fcf8-4de7-b85d-fbea5a500a6c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 404 len: 111 microversion: 2.1 time: 0.111941 Sep 07 10:20:20.067252 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2989/5921] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:19 2022] DELETE /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.076675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.077476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.084837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.085929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.086687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.087432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.087992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.088671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.105862 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 HTTP/1.1 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05'} Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.107813 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. Sep 07 10:20:20.112499 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.114505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.115637 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7b2c1332-3cc6-46b2-83b2-d0bbda628b2f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05" status: 404 len: 111 microversion: 2.1 time: 0.044552 Sep 07 10:20:20.120562 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2933/5922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/f7ceb37f-1a02-4f0a-96dc-ee3a0c4e3e05 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.134590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.137233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.152604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.153117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.163844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.164650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.165329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.165795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.217246 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 HTTP/1.1 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'def9d011-68db-42a1-922f-00d88eeb59a6'} Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.219790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.224790 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.228671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.230714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27ac42c4-692b-41c8-a811-5b6e77dfa619 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 404 len: 111 microversion: 2.1 time: 0.108410 Sep 07 10:20:20.231905 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2990/5923] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:20 2022] DELETE /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.243655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.245942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: def9d011-68db-42a1-922f-00d88eeb59a6] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.255125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.255765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.257105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.258345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.259052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.259758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.277561 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 HTTP/1.1 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'def9d011-68db-42a1-922f-00d88eeb59a6'} Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.279745 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. Sep 07 10:20:20.284791 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.288223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance def9d011-68db-42a1-922f-00d88eeb59a6 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.289418 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3518bc3c-3776-4f34-b07f-3a4872d5275c tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6" status: 404 len: 111 microversion: 2.1 time: 0.051620 Sep 07 10:20:20.290213 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2934/5924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/def9d011-68db-42a1-922f-00d88eeb59a6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.301861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.302378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.320402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.320922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.324717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.326862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.330423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.330948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.338877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2113926512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-161723041", "security_groups": [{"name": "tempest-secgroup-smoke-1648999643"}], "block_device_mapping_v2": [{"uuid": "6053e813-00ba-4533-a78d-361ec0844fd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba6eb02f-5a44-406f-8322-55170f6dfd85"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:20.389594 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f HTTP/1.1 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2edaa0a5-aaf8-4c90-b243-9a83f01c629f'} Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.396230 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.401698 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.407532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.417846 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd77740a-7f82-42fc-bafa-3e6ac7891514 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 404 len: 111 microversion: 2.1 time: 0.122138 Sep 07 10:20:20.422543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2991/5925] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:20 2022] DELETE /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:20:20.428726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.429587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2edaa0a5-aaf8-4c90-b243-9a83f01c629f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.437191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.437817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.438406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.439176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.439702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.440145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.458135 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f HTTP/1.1 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2edaa0a5-aaf8-4c90-b243-9a83f01c629f'} Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.459833 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2edaa0a5-aaf8-4c90-b243-9a83f01c629f could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4191f491-0f88-4881-9f92-cbfc71590d35 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f" status: 404 len: 111 microversion: 2.1 time: 0.038281 Sep 07 10:20:20.469018 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2992/5926] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/2edaa0a5-aaf8-4c90-b243-9a83f01c629f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.471479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.471992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.479516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.480127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.480862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.482609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.483941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.484944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.513825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b HTTP/1.1 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b'} Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.516166 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4719844d-5e71-474e-bebf-7e86343c855f tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 404 len: 111 microversion: 2.1 time: 0.051109 Sep 07 10:20:20.522433 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2993/5927] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:20 2022] DELETE /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.530346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.531060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.539976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.540486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.541159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.542136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.542796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.543249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.563172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b HTTP/1.1 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b'} Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.564894 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.570520 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d19a56de-e93a-424c-98dc-4c9bbe2dc17e tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b" status: 404 len: 111 microversion: 2.1 time: 0.043610 Sep 07 10:20:20.571377 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2994/5928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/2a33e6d4-4ba4-4f52-9a54-ea88d8e4159b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.577228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.577777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.587312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.587953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.589108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.590609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.591100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.591894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.624127 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee HTTP/1.1 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '022fcca4-c72e-4ee5-8c8e-b1f06da757ee'} Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.627903 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-76ef7fa2-ff66-4f7e-8c39-cbb4e20229b1 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 404 len: 111 microversion: 2.1 time: 0.057648 Sep 07 10:20:20.633527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2995/5929] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:20 2022] DELETE /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.640762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.641436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 022fcca4-c72e-4ee5-8c8e-b1f06da757ee] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.650035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.651430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.652153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.652823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.653320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.655425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.683525 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee HTTP/1.1 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '022fcca4-c72e-4ee5-8c8e-b1f06da757ee'} Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.685331 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.691213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 022fcca4-c72e-4ee5-8c8e-b1f06da757ee could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.691994 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09c6d8ec-61dc-4789-851e-ec649b55630a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee" status: 404 len: 111 microversion: 2.1 time: 0.056976 Sep 07 10:20:20.696119 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2996/5930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/022fcca4-c72e-4ee5-8c8e-b1f06da757ee => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.705060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28d6057d-c6cf-44f8-ad0d-c911b52b1fa5 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.706847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28d6057d-c6cf-44f8-ad0d-c911b52b1fa5 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.719645 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-28d6057d-c6cf-44f8-ad0d-c911b52b1fa5 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28d6057d-c6cf-44f8-ad0d-c911b52b1fa5 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 HTTP/1.1 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a264f589-b16b-4591-840e-d4e4e31b7b11'} Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.722817 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28d6057d-c6cf-44f8-ad0d-c911b52b1fa5 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28d6057d-c6cf-44f8-ad0d-c911b52b1fa5 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11" status: 404 len: 111 microversion: 2.1 time: 0.027158 Sep 07 10:20:20.728408 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2997/5931] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:20 2022] DELETE /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.734751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] validate_networks() for [('ba6eb02f-5a44-406f-8322-55170f6dfd85', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:20:20.735328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af8023f5-7203-4e4b-baef-324f70bc4d1b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.735780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-af8023f5-7203-4e4b-baef-324f70bc4d1b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: a264f589-b16b-4591-840e-d4e4e31b7b11] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.744132 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-af8023f5-7203-4e4b-baef-324f70bc4d1b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af8023f5-7203-4e4b-baef-324f70bc4d1b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 HTTP/1.1 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a264f589-b16b-4591-840e-d4e4e31b7b11'} Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:20.745972 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af8023f5-7203-4e4b-baef-324f70bc4d1b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance a264f589-b16b-4591-840e-d4e4e31b7b11 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-af8023f5-7203-4e4b-baef-324f70bc4d1b tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11" status: 404 len: 111 microversion: 2.1 time: 0.018388 Sep 07 10:20:20.752055 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2998/5932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/a264f589-b16b-4591-840e-d4e4e31b7b11 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:20.756471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.756989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.765901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.766406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.766857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.767638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.768113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.768551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.807381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:20:20.923709 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b000d51b-3236-4a9a-866a-94b44175f2ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 204 len: 0 microversion: 2.1 time: 0.168178 Sep 07 10:20:20.924416 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 2999/5933] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:20:20 2022] DELETE /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:20:20.939214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:20.939944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:20.946382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.946891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.947345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:20.949211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:20.949881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:20.950553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:21.528914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:21.540588 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7849191a-53a9-47be-acb9-0fb7618d2d9a tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1478 microversion: 2.1 time: 0.611316 Sep 07 10:20:21.545261 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3000/5934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:20 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1478 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:22.567303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:20:22.568020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:20:22.568852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:20:22.569486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:20:22.570151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:20:22.581555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:22.582790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:22.625407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:22.638338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:22.638924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:22.639716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:22.648448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:22.649114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:22.649615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:22.650448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:22.652016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:22.659293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:22.660313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:22.660791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:22.743328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:20:22.759304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Getting quotas for user 17a9228145d142aa95438bfb3335e3e3 and project e20f1348778f4588b8d56f06238846a1. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:20:22.864367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:20:22.868759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6053e813-00ba-4533-a78d-361ec0844fd3',volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:20:23.218617 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7f661693-f363-405f-88d0-f88caee17df8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.882875 Sep 07 10:20:23.223005 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2935/5935] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:20:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 2890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:20:23.236749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a08f227c-3651-4881-9e44-e3813cd57549 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:23.237888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a08f227c-3651-4881-9e44-e3813cd57549 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:23.437021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a08f227c-3651-4881-9e44-e3813cd57549 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:23.449318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a08f227c-3651-4881-9e44-e3813cd57549 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1094 microversion: 2.1 time: 0.214827 Sep 07 10:20:23.451712 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2936/5936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:23 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1094 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:23.560080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:23.575593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-697929e4-46e4-46ed-88b9-666ce0704d04 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1478 microversion: 2.1 time: 0.998622 Sep 07 10:20:23.577912 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3001/5937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:22 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1478 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:24.474822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:24.475451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:24.497317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:24.498275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:24.499048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:24.502293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:24.502995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:24.504378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:24.605609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:24.606511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:24.642299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:24.643237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:24.644069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:24.645437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:24.651803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:24.658342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:24.662613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:24.678239 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a64f6bbf-ebe2-495c-bd6a-d9e41fe6718c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1136 microversion: 2.1 time: 0.207559 Sep 07 10:20:24.683711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2937/5938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:24 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1136 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:25.266813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:25.292566 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb54e630-e3e0-44fe-91a9-46037148abba tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1478 microversion: 2.1 time: 0.690849 Sep 07 10:20:25.318089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2280cc1f-96d9-4863-b9fc-815065b78315 req-2d438a7b-b776-4b30-be52-727820878e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2683eaa8-666b-4de2-9cb3-08274baa8a8a", "name": "network-vif-deleted", "tag": "2f46a2b5-955f-4699-b0a6-d0131d5ab3c4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:25.322410 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3002/5939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:24 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1478 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:20:25.359956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2280cc1f-96d9-4863-b9fc-815065b78315 req-2d438a7b-b776-4b30-be52-727820878e8e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:25.360459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2280cc1f-96d9-4863-b9fc-815065b78315 req-2d438a7b-b776-4b30-be52-727820878e8e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:25.360959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2280cc1f-96d9-4863-b9fc-815065b78315 req-2d438a7b-b776-4b30-be52-727820878e8e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:25.390261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2280cc1f-96d9-4863-b9fc-815065b78315 req-2d438a7b-b776-4b30-be52-727820878e8e service nova] Creating event network-vif-deleted:2f46a2b5-955f-4699-b0a6-d0131d5ab3c4 for instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a on n-h1-836830-16 Sep 07 10:20:25.409307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2280cc1f-96d9-4863-b9fc-815065b78315 req-2d438a7b-b776-4b30-be52-727820878e8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095680 Sep 07 10:20:25.413630 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2938/5940] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:20:25.709426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:25.710144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:25.736060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:25.741911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:25.742394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:25.745899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:25.749971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:25.751567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:25.799853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:26.117829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:26.130137 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21ccf45c-51e9-46ce-aa64-d0e77fd97bd6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1210 microversion: 2.1 time: 0.428297 Sep 07 10:20:26.131898 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3003/5941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:25 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1210 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:26.326248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:26.331028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:26.354947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:26.363296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:26.368737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:26.370937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:26.377820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:26.380426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:26.383687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:26.567372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:26.568608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:26.569108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:26.573365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lazy-loading 'fault' on Instance uuid 2683eaa8-666b-4de2-9cb3-08274baa8a8a {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:20:26.755469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b1b1fc9e5449cbcc6af6f6502b61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fda4bcc479418fa2c133598fb53f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:26.777915 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77df3021-134b-4d5a-a092-94b7f37ad9ae tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 200 len: 1282 microversion: 2.1 time: 0.459799 Sep 07 10:20:26.781691 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2939/5942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:26 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 1282 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:27.155559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:27.156572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:27.170401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:27.171275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:27.171792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:27.183983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:27.184516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:27.184982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:27.386371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:27.399904 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b5cae04-d9d6-4e75-9056-c96240803681 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1210 microversion: 2.1 time: 0.249301 Sep 07 10:20:27.418105 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3004/5943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:27 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1210 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:27.811602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:27.812763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] [instance: 2683eaa8-666b-4de2-9cb3-08274baa8a8a] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:27.848116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:27.857609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:27.859512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:27.861144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:27.864722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:27.866672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:27.919165 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] HTTP exception thrown: Instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a could not be found. Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Request method failure captured: Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a HTTP/1.1 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGG9y1RgQYYxb6XlSst31-XOgGxjFqxMfZm-rjmuQOPhIF-0HZQmHqbH-wACb4Ov_GMssEdcKIFZslAg52D8y5__WZSLCdP1GOiI1xULyfA3suIR-f8yRYVUm9oGywsRqyonyYjfReULxXJkY4WKKyPCArgoS3_RrP1Iuqfh47s6oz6w Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57fda4bcc479418fa2c133598fb53f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57fda4bcc479418fa2c133598fb53f6c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersTestJSON-1635211933 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 57fda4bcc479418fa2c133598fb53f6c Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersTestJSON-1635211933 Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: fb4b1b1fc9e5449cbcc6af6f6502b61a Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersTestJSON-1635211933-project Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a could not be found. Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '2683eaa8-666b-4de2-9cb3-08274baa8a8a'} Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a could not be found. Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a could not be found. Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:20:27.921246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a could not be found. Sep 07 10:20:27.926737 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:20:27.931166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] Returning 404 to user: Instance 2683eaa8-666b-4de2-9cb3-08274baa8a8a could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:20:27.933465 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4dc45baf-a9df-472d-99b8-9c6048fd2264 tempest-ServersTestJSON-1635211933 tempest-ServersTestJSON-1635211933-project] 10.222.0.60 "GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a" status: 404 len: 111 microversion: 2.1 time: 0.128311 Sep 07 10:20:27.936693 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2940/5944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:27 2022] GET /compute/v2.1/servers/2683eaa8-666b-4de2-9cb3-08274baa8a8a => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:20:28.430130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:28.431490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:28.447113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:28.449631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:28.450133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:28.451503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:28.452000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:28.452447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:28.627964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:28.637449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-68886ec9-bf6d-41c4-a0c8-15a1e89543ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1210 microversion: 2.1 time: 0.211778 Sep 07 10:20:28.638045 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3005/5945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:28 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1210 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:29.662555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:29.664042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:29.673706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:29.674553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:29.675172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:29.677452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:29.678106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:29.678755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:29.707402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:30.189085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:30.201556 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-da69b5e3-2177-493d-b67b-619a6355b916 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1210 microversion: 2.1 time: 0.543386 Sep 07 10:20:30.205267 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2941/5946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:29 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1210 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:31.230063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:31.230982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:31.252956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:31.253560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:31.254761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:31.255560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:31.256045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:31.256496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:31.568919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:31.584292 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a0ea1fa-3ba5-42ac-9963-4e1e9777cf0a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1278 microversion: 2.1 time: 0.361872 Sep 07 10:20:31.585801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3006/5947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:31 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1278 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:32.608891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:32.652871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:32.678624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:32.679781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:32.680433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:32.682322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:32.683424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:32.684161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:32.705503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:32.992590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:33.002422 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f477fdd-0ab5-4c1c-a579-e4ee93ca522b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1278 microversion: 2.1 time: 0.397456 Sep 07 10:20:33.003237 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2942/5948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:32 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1278 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:34.030557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:34.032768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:34.039017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:34.046955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:34.047651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:34.050038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:34.051866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:34.053504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:34.054135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:34.188777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-99243ca3-f338-4027-815c-ddb475e6b47c req-a02a54c9-885e-48a6-b360-374125859b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a254fe1e-7fd1-486a-bc66-a2f2c82bb293", "tag": "17364641-ad36-4c96-9a54-6f08f0349078"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:34.199377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:20:34.228117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-99243ca3-f338-4027-815c-ddb475e6b47c req-a02a54c9-885e-48a6-b360-374125859b0d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:34.229470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-99243ca3-f338-4027-815c-ddb475e6b47c req-a02a54c9-885e-48a6-b360-374125859b0d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:34.229793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-99243ca3-f338-4027-815c-ddb475e6b47c req-a02a54c9-885e-48a6-b360-374125859b0d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:34.255376 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-99243ca3-f338-4027-815c-ddb475e6b47c req-a02a54c9-885e-48a6-b360-374125859b0d service nova] Creating event network-changed:17364641-ad36-4c96-9a54-6f08f0349078 for instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 on n-h2-836830-16 Sep 07 10:20:34.272714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-99243ca3-f338-4027-815c-ddb475e6b47c req-a02a54c9-885e-48a6-b360-374125859b0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087704 Sep 07 10:20:34.275247 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2943/5949] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:20:35.111463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:35.120303 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f348c044-9e3f-41f6-9151-0061b2ec9fe7 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 1.095082 Sep 07 10:20:35.134094 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3007/5950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:34 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:20:36.146711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:36.148063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:36.155647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:36.156359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:36.156979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:36.157908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:36.158515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:36.159164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:36.761784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:36.781057 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-59f2911c-3571-4642-b8ac-7d7faf195f85 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.634997 Sep 07 10:20:36.782659 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2944/5951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:36 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:37.807894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:37.808524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:37.821086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:37.821922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:37.823188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:37.824365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:37.825031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:37.825691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:38.216730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:38.243936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7a326780-0e50-4d83-a3a8-76f766b834cf tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.439760 Sep 07 10:20:38.269341 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3008/5952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:37 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:39.275575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:39.276513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:39.286476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:39.287478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:39.287932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:39.288943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:39.289557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:39.290381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:39.705945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:39.724065 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-155acb48-f40e-4dd1-895d-d342e5cd9c6f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.452447 Sep 07 10:20:39.728135 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2945/5953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:39 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:40.764445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:40.765092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:40.778489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:40.779418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:40.780173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:40.781547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:40.782286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:40.783157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:41.402960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:41.423862 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b41e0b3-ae51-4870-8038-c2c0dee7c6e3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.666445 Sep 07 10:20:41.424791 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3009/5954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:40 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:42.449601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:42.450272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:42.465360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:42.466965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:42.471083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:42.472085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:42.473170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:42.473905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:42.914497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:42.931410 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-19e62735-e3a5-439d-bcef-e44f8a46ff84 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.486935 Sep 07 10:20:42.933168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2946/5955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:42 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:43.965069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:43.966331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:43.999538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:44.000096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:44.000506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:44.001303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:44.001783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:44.002230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:44.356872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:44.364018 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7430a6d5-2660-4d8a-8fb1-2f5b35fd1e9c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.408763 Sep 07 10:20:44.377684 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3010/5956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:43 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:44.854582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-873fe6e9-ba99-4b99-8ea0-701014952fd2 req-a3368a71-12b3-44d7-8a15-b88a466d891c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a254fe1e-7fd1-486a-bc66-a2f2c82bb293", "name": "network-vif-plugged", "status": "completed", "tag": "17364641-ad36-4c96-9a54-6f08f0349078"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:44.881765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-873fe6e9-ba99-4b99-8ea0-701014952fd2 req-a3368a71-12b3-44d7-8a15-b88a466d891c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:44.883115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-873fe6e9-ba99-4b99-8ea0-701014952fd2 req-a3368a71-12b3-44d7-8a15-b88a466d891c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:44.884075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-873fe6e9-ba99-4b99-8ea0-701014952fd2 req-a3368a71-12b3-44d7-8a15-b88a466d891c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:44.922102 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-873fe6e9-ba99-4b99-8ea0-701014952fd2 req-a3368a71-12b3-44d7-8a15-b88a466d891c service nova] Creating event network-vif-plugged:17364641-ad36-4c96-9a54-6f08f0349078 for instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 on n-h2-836830-16 Sep 07 10:20:44.936297 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-873fe6e9-ba99-4b99-8ea0-701014952fd2 req-a3368a71-12b3-44d7-8a15-b88a466d891c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087378 Sep 07 10:20:44.940352 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2947/5957] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:20:45.392611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:45.397896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:45.408841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:45.418771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:45.419432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:45.420377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:45.421440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:45.422785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:46.132594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:46.144453 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bf3a79f2-2dd3-46d7-95b0-b0416cee4358 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1266 microversion: 2.1 time: 0.761229 Sep 07 10:20:46.146035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3011/5958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:45 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1266 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:47.174316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:47.175899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:47.189376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:47.191476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:47.192355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:47.194340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:47.194886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:47.195338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:47.632762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:47.642785 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc4d5dcd-f95d-487b-a083-89f3101794d6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1452 microversion: 2.1 time: 0.475778 Sep 07 10:20:47.650636 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2948/5959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:47 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1452 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:47.672184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:20:47.672746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:20:47.682474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:47.687354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:47.689317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:47.690542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:47.691442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:47.695287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:48.121880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:20:48.132933 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-709902ec-3649-4dbd-906e-b58579df627a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1452 microversion: 2.1 time: 0.464922 Sep 07 10:20:48.145461 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3012/5960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:20:47 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1452 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:20:54.224791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d4c2b3b1-9bfd-4a01-8276-0c23a506a1d1 req-111c845b-dd3a-4725-aba0-7b9c6e145479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a254fe1e-7fd1-486a-bc66-a2f2c82bb293", "tag": "17364641-ad36-4c96-9a54-6f08f0349078"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:20:54.250324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d4c2b3b1-9bfd-4a01-8276-0c23a506a1d1 req-111c845b-dd3a-4725-aba0-7b9c6e145479 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:20:54.251109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d4c2b3b1-9bfd-4a01-8276-0c23a506a1d1 req-111c845b-dd3a-4725-aba0-7b9c6e145479 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:20:54.253029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d4c2b3b1-9bfd-4a01-8276-0c23a506a1d1 req-111c845b-dd3a-4725-aba0-7b9c6e145479 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:20:54.291322 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d4c2b3b1-9bfd-4a01-8276-0c23a506a1d1 req-111c845b-dd3a-4725-aba0-7b9c6e145479 service nova] Creating event network-changed:17364641-ad36-4c96-9a54-6f08f0349078 for instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 on n-h2-836830-16 Sep 07 10:20:54.310526 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d4c2b3b1-9bfd-4a01-8276-0c23a506a1d1 req-111c845b-dd3a-4725-aba0-7b9c6e145479 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.524733 Sep 07 10:20:54.314533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2949/5961] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:21:56.124967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=11 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:21:56.126314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=57 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:21:56.127921 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:21:56.128216 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-hypervisors (ip 10.222.0.60) !!! Sep 07 10:21:56.129641 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:21:56.130911 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-hypervisors (ip 10.222.0.60) !!! Sep 07 10:21:56.459034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Calling method '.version_select at 0x7f14b5d7fb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:21:56.461749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:21:56.462260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:21:56.462844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:21:56.479230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:21:56.479729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:21:56.480347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:21:56.493001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:21:56.493781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:21:56.494383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:21:56.501611 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc94724c-d997-4b01-b285-251e9d145536 tempest-PortsAdminExtendedAttrsTestJSON-1860593859 tempest-PortsAdminExtendedAttrsTestJSON-1860593859-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.379570 Sep 07 10:21:56.502300 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3013/5962] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:21:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:22:24.673173 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 10:22:24.674166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=23 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:24.674921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=41 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:24.677125 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 10:22:24.677522 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:22:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 (ip 10.222.0.60) !!! Sep 07 10:22:24.684781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-381d5270-f7a6-4b3a-aff4-1d155056f0a1 req-414a805b-5315-4f2a-81ae-055262142a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a254fe1e-7fd1-486a-bc66-a2f2c82bb293", "tag": "17364641-ad36-4c96-9a54-6f08f0349078"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:22:24.691004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:24.691805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:24.696294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:24.697004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:24.714384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:24.720861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:24.721594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:24.721843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-381d5270-f7a6-4b3a-aff4-1d155056f0a1 req-414a805b-5315-4f2a-81ae-055262142a4d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:24.722722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-381d5270-f7a6-4b3a-aff4-1d155056f0a1 req-414a805b-5315-4f2a-81ae-055262142a4d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:24.723250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:24.723875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:24.724458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:24.727012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-381d5270-f7a6-4b3a-aff4-1d155056f0a1 req-414a805b-5315-4f2a-81ae-055262142a4d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:24.759256 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-381d5270-f7a6-4b3a-aff4-1d155056f0a1 req-414a805b-5315-4f2a-81ae-055262142a4d service nova] Creating event network-changed:17364641-ad36-4c96-9a54-6f08f0349078 for instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 on n-h2-836830-16 Sep 07 10:22:24.779778 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-381d5270-f7a6-4b3a-aff4-1d155056f0a1 req-414a805b-5315-4f2a-81ae-055262142a4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103543 Sep 07 10:22:24.784683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3014/5963] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:22:24.792493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:22:24.971924 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c7de5bcf-b8f3-4abe-94a9-b421dd6448f3 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 204 len: 0 microversion: 2.1 time: 0.302053 Sep 07 10:22:24.973506 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2950/5964] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:22:24 2022] DELETE /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:22:24.983436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:24.984417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:24.995524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:24.997015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:24.997744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:24.998663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:24.999409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:25.001449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:25.201081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:25.213498 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb353335-b84e-410d-b1d8-614c26a56420 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1576 microversion: 2.1 time: 0.235092 Sep 07 10:22:25.231825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3015/5965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:24 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:26.247278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:26.248015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:26.286848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:26.287367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:26.287857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:26.295729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:26.296677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:26.299122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:26.425437 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48326. Sep 07 10:22:26.754131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:26.775222 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7507346c-7f6a-4048-a4f3-59b56d453b1a tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1576 microversion: 2.1 time: 0.539916 Sep 07 10:22:26.776409 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2951/5966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:26 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1576 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:27.730233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9e728187-65f2-4733-afb8-718863f175eb req-28cc258f-06b6-4331-b3ec-5e22e9e83f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a254fe1e-7fd1-486a-bc66-a2f2c82bb293", "name": "network-vif-deleted", "tag": "17364641-ad36-4c96-9a54-6f08f0349078"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:22:27.756459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9e728187-65f2-4733-afb8-718863f175eb req-28cc258f-06b6-4331-b3ec-5e22e9e83f65 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:27.775700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9e728187-65f2-4733-afb8-718863f175eb req-28cc258f-06b6-4331-b3ec-5e22e9e83f65 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:27.776561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9e728187-65f2-4733-afb8-718863f175eb req-28cc258f-06b6-4331-b3ec-5e22e9e83f65 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:27.800219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:27.801587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:27.814607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:27.815452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:27.816160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:27.817040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:27.819302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:27.820585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:27.825854 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9e728187-65f2-4733-afb8-718863f175eb req-28cc258f-06b6-4331-b3ec-5e22e9e83f65 service nova] Creating event network-vif-deleted:17364641-ad36-4c96-9a54-6f08f0349078 for instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 on n-h2-836830-16 Sep 07 10:22:27.852608 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9e728187-65f2-4733-afb8-718863f175eb req-28cc258f-06b6-4331-b3ec-5e22e9e83f65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116468 Sep 07 10:22:27.853322 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3016/5967] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:22:27.961708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:27.982274 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc410ccc-ee7c-4a6e-a4b4-05b189682806 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.185931 Sep 07 10:22:27.986593 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2952/5968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:27 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:29.012745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:29.013578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:29.031746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:29.034731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:29.035388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:29.036352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:29.036835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:29.037315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:29.182366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:29.203925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb596c12-69b7-40cc-a6ea-b7c4bac3af30 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.195813 Sep 07 10:22:29.206586 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3017/5969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:29 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:22:30.653790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:30.654416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:30.668324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:30.669695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:30.670157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:30.670895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:30.671362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:30.671796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:30.823114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:30.847819 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c83e7f5b-f251-429e-96b4-d471af4eef15 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.614152 Sep 07 10:22:30.853758 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2953/5970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:30 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:31.877666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:31.878310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:31.891955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:31.892745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:31.895354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:31.896886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:31.898297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:31.901290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:32.170940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:32.185733 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-35218046-5f4c-47a8-bff6-f1ece52db3c6 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.307701 Sep 07 10:22:32.203842 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3018/5971] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:31 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:33.214764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:33.216299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:33.228893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:33.241798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:33.242397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:33.243169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:33.244841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:33.247442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:33.500324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:33.531722 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5d75117a-8509-4e72-bffa-7e0c936bd1a8 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.318898 Sep 07 10:22:33.535431 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2954/5972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:33 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:22:34.573457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:34.574108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:34.586006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:34.593955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:34.594841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:34.595618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:34.596104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:34.596564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:34.787256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:34.800338 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0544bbce-c6b8-4745-8db4-0e722f3276ae tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.235530 Sep 07 10:22:34.821595 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3019/5973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:34 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:35.832177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:35.833401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:35.842598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:35.843403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:35.844221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:35.845221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:35.845785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:35.846580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:36.020196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:36.036665 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6e3893c7-e4ae-47a1-b544-307173eca9b1 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 200 len: 1225 microversion: 2.1 time: 0.209904 Sep 07 10:22:36.043739 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2955/5974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:35 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 1225 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:37.064910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:37.065605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a254fe1e-7fd1-486a-bc66-a2f2c82bb293] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:37.076379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:37.076379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:37.080753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:37.080877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:37.081425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:37.081887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:37.097015 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 could not be found. Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 HTTP/1.1 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 could not be found. Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a254fe1e-7fd1-486a-bc66-a2f2c82bb293'} Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 could not be found. Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 could not be found. Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:22:37.098702 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 could not be found. Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance a254fe1e-7fd1-486a-bc66-a2f2c82bb293 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:22:37.103876 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8247c49e-d9fa-4724-944c-4fe5e77ae44b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293" status: 404 len: 111 microversion: 2.1 time: 0.040852 Sep 07 10:22:37.105829 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3020/5975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:37 2022] GET /compute/v2.1/servers/a254fe1e-7fd1-486a-bc66-a2f2c82bb293 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:22:51.561740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:51.562298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:51.566093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:51.566779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:51.581376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8f9c9c5a-a907-4574-b0b8-f97a0b1ac1f7 req-71288cf9-ad99-4ab6-8066-805b46064cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a456aa9d-930c-4da6-b06a-c8ef17539e41", "tag": "d4f3a536-8b9e-4bd7-9195-a8838baa8a1f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:22:51.604928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:51.605467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:51.605916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:51.610566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:51.611257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:51.612013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=30 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:22:51.612276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:51.613063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:51.615060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8f9c9c5a-a907-4574-b0b8-f97a0b1ac1f7 req-71288cf9-ad99-4ab6-8066-805b46064cac service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:51.618045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8f9c9c5a-a907-4574-b0b8-f97a0b1ac1f7 req-71288cf9-ad99-4ab6-8066-805b46064cac service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:51.621030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8f9c9c5a-a907-4574-b0b8-f97a0b1ac1f7 req-71288cf9-ad99-4ab6-8066-805b46064cac service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:51.658020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8f9c9c5a-a907-4574-b0b8-f97a0b1ac1f7 req-71288cf9-ad99-4ab6-8066-805b46064cac service nova] Creating event network-changed:d4f3a536-8b9e-4bd7-9195-a8838baa8a1f for instance a456aa9d-930c-4da6-b06a-c8ef17539e41 on n-h2-836830-16 Sep 07 10:22:51.670340 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8f9c9c5a-a907-4574-b0b8-f97a0b1ac1f7 req-71288cf9-ad99-4ab6-8066-805b46064cac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095871 Sep 07 10:22:51.674350 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3021/5976] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:22:51.692578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:22:51.905401 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f07629a7-a622-4a3a-9f31-9b753b9b7343 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 204 len: 0 microversion: 2.1 time: 0.349181 Sep 07 10:22:51.910887 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2956/5977] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:22:51 2022] DELETE /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:22:51.920977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:51.922587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:51.937093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:51.940555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:51.942828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:51.944675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:51.947426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:51.949632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:52.315173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:52.328242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8be5896c-edf8-40bb-b448-c8d0d398f854 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1577 microversion: 2.1 time: 0.412080 Sep 07 10:22:52.335022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3022/5978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:51 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1577 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:53.365212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:53.366642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:53.380239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:53.380745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:53.384240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:53.385145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:53.389548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:53.390020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:53.782396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:53.796880 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e3148e3d-c8d7-4be0-8b9a-1bb2e49f9de2 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1459 microversion: 2.1 time: 0.443652 Sep 07 10:22:53.798290 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2957/5979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:53 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1459 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:54.823084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:54.824394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:54.835066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:54.840465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:54.841280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:54.842266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:54.844220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:54.844916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:55.368571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:55.381319 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-986f8b81-6a96-407f-802e-31da8d3f9796 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1459 microversion: 2.1 time: 0.562456 Sep 07 10:22:55.384225 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3023/5980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:54 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1459 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:56.087447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fad21c7f-9f64-4c39-b0e5-751a263fa649 req-74352e16-9f29-4fa5-9cb1-b18f51a2e8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a456aa9d-930c-4da6-b06a-c8ef17539e41", "name": "network-vif-deleted", "tag": "d4f3a536-8b9e-4bd7-9195-a8838baa8a1f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:22:56.115493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fad21c7f-9f64-4c39-b0e5-751a263fa649 req-74352e16-9f29-4fa5-9cb1-b18f51a2e8dd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:56.116518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fad21c7f-9f64-4c39-b0e5-751a263fa649 req-74352e16-9f29-4fa5-9cb1-b18f51a2e8dd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:56.116962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fad21c7f-9f64-4c39-b0e5-751a263fa649 req-74352e16-9f29-4fa5-9cb1-b18f51a2e8dd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:56.141744 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fad21c7f-9f64-4c39-b0e5-751a263fa649 req-74352e16-9f29-4fa5-9cb1-b18f51a2e8dd service nova] Creating event network-vif-deleted:d4f3a536-8b9e-4bd7-9195-a8838baa8a1f for instance a456aa9d-930c-4da6-b06a-c8ef17539e41 on n-h2-836830-16 Sep 07 10:22:56.151184 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fad21c7f-9f64-4c39-b0e5-751a263fa649 req-74352e16-9f29-4fa5-9cb1-b18f51a2e8dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395679 Sep 07 10:22:56.154300 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2958/5981] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:22:56.409389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:56.409989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:56.420650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:56.421163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:56.421650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:56.422373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:56.422853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:56.423300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:56.568238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:56.577717 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-024a63c1-869f-4ffc-9553-9341a9293766 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1225 microversion: 2.1 time: 0.172667 Sep 07 10:22:56.578304 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3024/5982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:56 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:57.606290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:57.608116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:57.625926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:57.626543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:57.627304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:57.628103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:57.632217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:57.632815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:57.863183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:57.908948 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-50d7e9e9-cc9f-4b06-868f-1969f32bb72d tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1225 microversion: 2.1 time: 0.297292 Sep 07 10:22:57.915838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2959/5983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:57 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1225 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:22:58.937607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:22:58.938420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:22:58.949104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:58.950016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:58.950667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:58.951921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:22:58.952591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:22:58.953280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:22:59.050421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:22:59.064382 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e8e3effc-3a27-402b-a513-664603e0979c tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1225 microversion: 2.1 time: 0.130166 Sep 07 10:22:59.065445 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3025/5984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:22:58 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:00.090108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:00.090729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:00.117755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:00.125113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:00.127563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:00.129685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:00.130682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:00.144906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:00.507973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:00.581217 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aab86692-25a4-471b-bd6a-6d079d684468 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1225 microversion: 2.1 time: 0.438497 Sep 07 10:23:00.593213 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2960/5985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:00 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1225 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:01.610166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:01.610735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:01.625707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:01.631422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:01.632388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:01.637920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:01.638457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:01.638924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:01.925835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:01.938218 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-095f69db-b074-45e7-a456-f6d434c0776f tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1225 microversion: 2.1 time: 0.330635 Sep 07 10:23:01.961837 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3026/5986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:01 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1225 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:02.974339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:02.977159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:02.994648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:03.001928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:03.007106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:03.008517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:03.009154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:03.009859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:03.166826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:03.181045 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-107c8d85-3846-4f74-982a-77d280d950a9 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1225 microversion: 2.1 time: 0.215391 Sep 07 10:23:03.187535 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2961/5987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:02 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:03.528090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-73340296", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "416105ae-4d47-4c89-b3ed-280ea29c7872"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:03.610070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] validate_networks() for [('416105ae-4d47-4c89-b3ed-280ea29c7872', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:23:04.212136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:04.214124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:04.231926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:04.234756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:04.235601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:04.239810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:04.241288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:04.243455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:04.358986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:04.379803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:04.380356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:04.386341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lazy-loading 'fault' on Instance uuid a456aa9d-930c-4da6-b06a-c8ef17539e41 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:23:04.628471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a9228145d142aa95438bfb3335e3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20f1348778f4588b8d56f06238846a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:04.645404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-963c0934-3537-44ef-b910-dc47e5d4337b tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 200 len: 1230 microversion: 2.1 time: 0.437415 Sep 07 10:23:04.650479 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2962/5988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:04 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 1230 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:23:04.881654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:23:04.883220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:23:04.884054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:23:04.884638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:23:04.885295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:23:04.900041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:04.900555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:04.901010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:04.901818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:04.902295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:04.902738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:04.931169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Getting quotas for project d531f20b78c941259747bc8d19341b1c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:23:04.938354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Getting quotas for user bde3539a692b4c2b80b0e0054ca7003e and project d531f20b78c941259747bc8d19341b1c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:23:04.953397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:23:04.957073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:23:05.112439 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-611feabd-87f4-4462-a8ef-25db4fe6d0b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590932 Sep 07 10:23:05.123664 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3027/5989] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:23:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:23:05.127271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-169febd4-3789-49b8-9700-dd9505fa4047 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:05.128204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-169febd4-3789-49b8-9700-dd9505fa4047 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:05.345362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-169febd4-3789-49b8-9700-dd9505fa4047 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:05.357194 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-169febd4-3789-49b8-9700-dd9505fa4047 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1217 microversion: 2.1 time: 0.235018 Sep 07 10:23:05.360410 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2963/5990] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:05 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:05.680493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:05.681828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: a456aa9d-930c-4da6-b06a-c8ef17539e41] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:05.696402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:05.697156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:05.697805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:05.699123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:05.699887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:05.700528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:05.724385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance a456aa9d-930c-4da6-b06a-c8ef17539e41 could not be found. Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 HTTP/1.1 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance a456aa9d-930c-4da6-b06a-c8ef17539e41 could not be found. Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'a456aa9d-930c-4da6-b06a-c8ef17539e41'} Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a456aa9d-930c-4da6-b06a-c8ef17539e41 could not be found. Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a456aa9d-930c-4da6-b06a-c8ef17539e41 could not be found. Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:23:05.727018 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a456aa9d-930c-4da6-b06a-c8ef17539e41 could not be found. Sep 07 10:23:05.731489 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:05.733275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance a456aa9d-930c-4da6-b06a-c8ef17539e41 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:23:05.734425 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e319ad78-0b20-44c1-ae2f-5014ffdaec51 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41" status: 404 len: 111 microversion: 2.1 time: 0.058883 Sep 07 10:23:05.735220 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3028/5991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:05 2022] GET /compute/v2.1/servers/a456aa9d-930c-4da6-b06a-c8ef17539e41 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:23:06.388964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8827d94a-946c-49c6-b93f-e74269f51dd3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:06.390404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8827d94a-946c-49c6-b93f-e74269f51dd3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:06.725581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:06.726170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:06.768236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:06.768743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:06.773986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:06.774994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:06.775491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:06.775935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:06.826715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b HTTP/1.1 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '20f81ee3-2899-412a-a0e2-7dc4b08abb3b'} Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:23:06.831244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.835506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.840252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:23:06.842430 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-659a49e3-9dae-4994-aafa-558406c21fd0 tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 404 len: 111 microversion: 2.1 time: 0.121270 Sep 07 10:23:06.844883 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3029/5992] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:23:06 2022] DELETE /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:23:06.859839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:06.861693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] [instance: 20f81ee3-2899-412a-a0e2-7dc4b08abb3b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:06.881408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:06.882699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:06.884355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:06.885847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:06.887939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:06.888479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:06.928477 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] HTTP exception thrown: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Request method failure captured: Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b HTTP/1.1 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGGzfgSV5JFRpRqOlVQw1-ipSTbqyVfoqIHGaCsW6ObQKwj1pLxtT6bkVfN6IP8KzLKeG4iPrpPdO33Yd7MvZtOEqVgIYaeZt3nRahhjaUSMi9XbuOFubx_IDbcWagk2pK1HH8ejyNHN9qQnpbV-ggD5GW9aZ5zW4_A3d7MaMUwdJI0o Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e20f1348778f4588b8d56f06238846a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e20f1348778f4588b8d56f06238846a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e20f1348778f4588b8d56f06238846a1 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBootPattern-648087928 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 17a9228145d142aa95438bfb3335e3e3 Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBootPattern-648087928-project Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '20f81ee3-2899-412a-a0e2-7dc4b08abb3b'} Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:23:06.932953 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. Sep 07 10:23:06.938044 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:23:06.942067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Returning 404 to user: Instance 20f81ee3-2899-412a-a0e2-7dc4b08abb3b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:23:06.945627 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3fb06694-fbe0-4ec1-9e1e-7c6532cca8fe tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b" status: 404 len: 111 microversion: 2.1 time: 0.094887 Sep 07 10:23:06.946865 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3030/5993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:06 2022] GET /compute/v2.1/servers/20f81ee3-2899-412a-a0e2-7dc4b08abb3b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:23:07.330068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8827d94a-946c-49c6-b93f-e74269f51dd3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:07.340898 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8827d94a-946c-49c6-b93f-e74269f51dd3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1217 microversion: 2.1 time: 0.957389 Sep 07 10:23:07.341437 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2964/5994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:06 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1217 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:08.364164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:08.366125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:08.378610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:08.382342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:08.383048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:08.383954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:08.385802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:08.386423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:08.597029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:08.608888 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb0d07c9-57cf-42f5-a5e0-b01ddbbe9a8e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1275 microversion: 2.1 time: 0.248504 Sep 07 10:23:08.611800 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3031/5995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:08 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1275 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:09.637396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:09.637848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:09.651251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:09.652183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:09.652808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:09.654839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:09.657122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:09.658909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:09.788436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:09.805360 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c6aaf392-e77a-4b76-8622-1b6e9772b474 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1275 microversion: 2.1 time: 0.172737 Sep 07 10:23:09.806686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2965/5996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:09 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:10.832850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:10.834822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:10.851517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:10.852333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:10.853014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:10.853962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:10.854641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:10.855282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:11.418651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:11.430856 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb34a6ae-b10c-472d-8208-9fa208ba1dc8 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.601846 Sep 07 10:23:11.433637 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3032/5997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:10 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:12.286352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7c0bc84e-2490-4f56-a9e1-6c328eb707f7 req-d906160b-1cb1-4256-a0d4-0228e0f24778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7896581-95f7-4df4-9040-bf90c7fef7b4", "tag": "2835e1e9-557b-47c6-b044-96e23f8627ba"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:12.309788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7c0bc84e-2490-4f56-a9e1-6c328eb707f7 req-d906160b-1cb1-4256-a0d4-0228e0f24778 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:12.310822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7c0bc84e-2490-4f56-a9e1-6c328eb707f7 req-d906160b-1cb1-4256-a0d4-0228e0f24778 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:12.311534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7c0bc84e-2490-4f56-a9e1-6c328eb707f7 req-d906160b-1cb1-4256-a0d4-0228e0f24778 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:12.347389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7c0bc84e-2490-4f56-a9e1-6c328eb707f7 req-d906160b-1cb1-4256-a0d4-0228e0f24778 service nova] Creating event network-changed:2835e1e9-557b-47c6-b044-96e23f8627ba for instance c7896581-95f7-4df4-9040-bf90c7fef7b4 on n-h1-836830-16 Sep 07 10:23:12.367307 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7c0bc84e-2490-4f56-a9e1-6c328eb707f7 req-d906160b-1cb1-4256-a0d4-0228e0f24778 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089921 Sep 07 10:23:12.368402 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2966/5998] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:23:12.455673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:12.457204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:12.467300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:12.468656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:12.469862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:12.470943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:12.471700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:12.472348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:12.860309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:12.872400 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-536d8763-dd53-48d5-a234-f6adb9bd3909 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.421483 Sep 07 10:23:12.887672 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3033/5999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:12 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:13.053502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aa5f753f-be95-4098-a655-9cd7f3da8fed tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] Calling method '.version_select at 0x7f14b25ef5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:13.105813 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aa5f753f-be95-4098-a655-9cd7f3da8fed tempest-TestVolumeBootPattern-648087928 tempest-TestVolumeBootPattern-648087928-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-161723041" status: 202 len: 0 microversion: 2.1 time: 0.056905 Sep 07 10:23:13.106419 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2967/6000] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 7 10:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-161723041 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:23:13.904172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:13.904800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:13.921214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:13.922010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:13.922647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:13.924070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:13.924735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:13.925391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:14.346913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:14.360701 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4c38f56f-f8cc-4a1e-b5ec-a915285fb10e tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.459981 Sep 07 10:23:14.362167 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3034/6001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:13 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:15.392419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:15.393776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:15.429948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:15.430464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:15.430909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:15.431653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:15.432123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:15.432560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:15.990121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:15.999703 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51fe8f84-9373-4f6e-b20b-cba39d2eb49b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.612550 Sep 07 10:23:16.014788 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2968/6002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:15 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:17.026851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:17.027959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:17.042247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:17.047667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:17.052734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:17.053826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:17.054463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:17.055393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:17.057887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:17.058667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:17.426453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:17.446179 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba002157-8944-4e69-8a56-b12111754596 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.424675 Sep 07 10:23:17.461662 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3035/6003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:17 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:18.472223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:18.472971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:18.487104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:18.506004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:18.506569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:18.507122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:18.508033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:18.508660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:18.509283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:18.789479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:18.798718 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b5d4533-84b5-45c6-8de9-27f0e86f4697 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.330422 Sep 07 10:23:18.836421 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2969/6004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:18 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:19.663008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-06d917a8-41c0-4ee7-a7bf-dc3098e7fe9f req-9b50449d-9081-45c7-9905-b433b57e32c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7896581-95f7-4df4-9040-bf90c7fef7b4", "name": "network-vif-plugged", "status": "completed", "tag": "2835e1e9-557b-47c6-b044-96e23f8627ba"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:19.695392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06d917a8-41c0-4ee7-a7bf-dc3098e7fe9f req-9b50449d-9081-45c7-9905-b433b57e32c8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:19.696754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06d917a8-41c0-4ee7-a7bf-dc3098e7fe9f req-9b50449d-9081-45c7-9905-b433b57e32c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:19.697884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06d917a8-41c0-4ee7-a7bf-dc3098e7fe9f req-9b50449d-9081-45c7-9905-b433b57e32c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:19.727882 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-06d917a8-41c0-4ee7-a7bf-dc3098e7fe9f req-9b50449d-9081-45c7-9905-b433b57e32c8 service nova] Creating event network-vif-plugged:2835e1e9-557b-47c6-b044-96e23f8627ba for instance c7896581-95f7-4df4-9040-bf90c7fef7b4 on n-h1-836830-16 Sep 07 10:23:19.734258 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-06d917a8-41c0-4ee7-a7bf-dc3098e7fe9f req-9b50449d-9081-45c7-9905-b433b57e32c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.562787 Sep 07 10:23:19.735623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3036/6005] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:23:19.849596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:19.850801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:19.863739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:19.876469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:19.877273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:19.878228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:19.879016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:19.879612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:20.188324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:20.202519 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-01f68ad0-3d09-4783-b663-8cb8ac1144af tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.354678 Sep 07 10:23:20.203263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2970/6006] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:19 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:21.238919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:21.241318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:21.261538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:21.262404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:21.263195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:21.266889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:21.270118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:21.273914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:21.609504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:21.625816 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63de8b81-1c8e-4242-bd2c-15ebe2a35dca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1317 microversion: 2.1 time: 0.398761 Sep 07 10:23:21.631925 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3037/6007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:21 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:22.657341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:22.659025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:22.663159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:22.677999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:22.681244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:22.681867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:22.684922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:22.689941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:22.696725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:22.713870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:23.198303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:23.207776 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b5dd513-1ebe-4e2e-bea4-3ead370370fb tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1506 microversion: 2.1 time: 0.555625 Sep 07 10:23:23.226117 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2971/6008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:22 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:34.628326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:34.630286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=78 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:34.871342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-343dfd57-00c5-4761-99d8-ca95cadacf45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: .version_select at 0x7f14b22c6550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-590044544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ3iyiceeQz359W1ymZqUOv+i9wdfmC5jXzw1KrBJWp4Yp7VJG75Y/JK/26tA3G+kWGvxeNVq/N5OFWF00ED5sXcMSExpafDh42RVo0TyEWmZa2U2VYiUepa7rOCV/lvw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:34.889450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-343dfd57-00c5-4761-99d8-ca95cadacf45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:23:34.895221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-343dfd57-00c5-4761-99d8-ca95cadacf45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:23:34.955819 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-343dfd57-00c5-4761-99d8-ca95cadacf45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.334168 Sep 07 10:23:34.956706 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3038/6009] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:23:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:23:47.165806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2092487687", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "1ca70c4d-6c44-442f-8a04-77dcbaa93da8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-590044544", "security_groups": [{"name": "tempest-secgroup-smoke-595370546"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:47.200999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:47.202343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=5 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:47.508884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] validate_networks() for [('1ca70c4d-6c44-442f-8a04-77dcbaa93da8', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:23:48.106591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:23:48.108071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:23:48.108879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:23:48.109586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:23:48.110259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:23:48.128027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:48.129050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:48.130415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:48.132206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:48.137139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:48.138481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:48.172009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:23:48.179726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:23:48.198546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:23:48.202383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:23:48.273858 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [d83ae7e1-32cc-4e2e-a334-4704a23f7214] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 10:23:49.285544 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [d83ae7e1-32cc-4e2e-a334-4704a23f7214] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50558. Sep 07 10:23:49.291286 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4aa80443-3ba9-4ab4-bab5-94c945382eb1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.131844 Sep 07 10:23:49.292081 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2972/6010] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:23:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:23:49.304014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:49.306041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:49.315974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ead2cb2e-5196-4d80-9ccc-7a7a5f4d68c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:49.316652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ead2cb2e-5196-4d80-9ccc-7a7a5f4d68c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:49.466437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ead2cb2e-5196-4d80-9ccc-7a7a5f4d68c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:49.474006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ead2cb2e-5196-4d80-9ccc-7a7a5f4d68c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1266 microversion: 2.1 time: 0.173657 Sep 07 10:23:49.474611 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3039/6011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:49 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:50.510059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:50.511315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:50.551032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:50.559299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:50.562161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:50.570528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:50.571410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:50.573610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:50.806513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:50.819832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be6977c4-220a-4847-8cb2-54008c462b9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1270 microversion: 2.1 time: 0.315764 Sep 07 10:23:50.822298 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2973/6012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:50 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1270 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:51.852046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:51.853944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:51.872255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:51.873231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:51.875874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:51.877919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:51.878627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:51.881801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:52.293296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:52.315915 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c71411cb-7d4f-4e50-aa65-a4a0f60c6078 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1336 microversion: 2.1 time: 0.467649 Sep 07 10:23:52.338170 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3040/6013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:51 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1336 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:53.344883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:53.346193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:53.368949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:53.374620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:53.376598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:53.385549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:53.388199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:53.388880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:53.908930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:53.929425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d50ce170-6f2e-437c-bfdb-f274bfb7a79b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.588519 Sep 07 10:23:53.949966 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2974/6014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:53 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:54.100270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7e6aa51-0eaa-4368-934a-d4a114140b01", "device": "/dev/sdb"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:54.103010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:54.122365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:54.134479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:54.135208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:54.136173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:54.140676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:54.141534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:54.721931 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6cdcf002-03ad-477c-97b4-f545e2e226db tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "POST /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626170 Sep 07 10:23:54.722909 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3041/6015] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:23:54 2022] POST /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:23:54.963509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:54.964330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:54.986947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:54.987472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:54.990170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:54.996311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:54.997774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:54.998242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:55.448414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-589d05ca-51c0-45b1-903e-5e121afa2c6b req-a3f1f8d2-d8cf-4792-b498-1e090e003db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:23:55.460007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-589d05ca-51c0-45b1-903e-5e121afa2c6b req-a3f1f8d2-d8cf-4792-b498-1e090e003db7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:55.460504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-589d05ca-51c0-45b1-903e-5e121afa2c6b req-a3f1f8d2-d8cf-4792-b498-1e090e003db7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:55.460950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-589d05ca-51c0-45b1-903e-5e121afa2c6b req-a3f1f8d2-d8cf-4792-b498-1e090e003db7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:55.493232 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-589d05ca-51c0-45b1-903e-5e121afa2c6b req-a3f1f8d2-d8cf-4792-b498-1e090e003db7 service nova] Creating event network-changed:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h2-836830-16 Sep 07 10:23:55.504345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-589d05ca-51c0-45b1-903e-5e121afa2c6b req-a3f1f8d2-d8cf-4792-b498-1e090e003db7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061734 Sep 07 10:23:55.505496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3042/6016] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:23:55.541383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:55.552266 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75b3ea05-9bb1-4524-aa2e-9140621b40aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.598494 Sep 07 10:23:55.552891 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2975/6017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:54 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:56.580091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:56.581932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:56.589886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:56.590396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:56.590850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:56.591562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:56.592030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:56.592474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:56.980621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:56.994291 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e5f74834-e7df-4b7e-8627-827350c1900d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.421869 Sep 07 10:23:56.996686 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3043/6018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:56 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:58.022414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:58.023043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:58.047073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:58.047970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:58.048589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:58.049502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:58.050133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:58.050750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:58.154216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:58.193799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:58.435403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:58.445334 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-95d29f7c-9c63-4f27-9a05-c829d1ea5fc7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.426872 Sep 07 10:23:58.449532 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2976/6019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:58 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:59.474426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:23:59.475947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:23:59.499165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:23:59.522304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:59.524266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:59.524906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:59.526037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:23:59.528040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:23:59.528696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:23:59.756617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:23:59.766743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1df5bd6-3216-43f6-8a18-8f9d1303d756 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.296386 Sep 07 10:23:59.768158 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3044/6020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:23:59 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:23:59.988844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-513396803", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "efa3c096-c1c1-49cb-b4ec-2e6026b9802f"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:00.054490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] validate_networks() for [('efa3c096-c1c1-49cb-b4ec-2e6026b9802f', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:24:00.506513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:24:00.507393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:24:00.508242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:24:00.508657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:24:00.509072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:24:00.518573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:00.519111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:00.519556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:00.520848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:00.521367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:00.521852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:00.542848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Getting quotas for project 42871c17a2354d5bbfd97f24021f86bc. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:24:00.548557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Getting quotas for user 4446cb077a36403e930c853ce9a98379 and project 42871c17a2354d5bbfd97f24021f86bc. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:24:00.561835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:24:00.564100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:24:00.615958 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c14bbbe2-a8bd-4c91-9efe-54a733e602ce tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828039 Sep 07 10:24:00.623336 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2977/6021] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:24:00.630762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26cb4aba-f205-493b-bee8-89293992d986 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:00.631527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26cb4aba-f205-493b-bee8-89293992d986 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:00.793085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26cb4aba-f205-493b-bee8-89293992d986 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:00.803127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:00.803757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:00.809591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26cb4aba-f205-493b-bee8-89293992d986 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1213 microversion: 2.1 time: 0.185129 Sep 07 10:24:00.823174 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3045/6022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:00 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:00.835627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:00.838165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:00.842426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:00.844791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:00.846951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:00.847905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:01.088465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:01.112121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-168200d4-7c4c-4a0a-a161-9f6497558d9a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.313718 Sep 07 10:24:01.113834 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2978/6023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:00 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:01.839498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:01.842022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:01.854704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:01.855678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:01.856882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:01.859151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:01.859890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:01.861129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:01.962300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:01.972698 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-362d18c9-4630-42f7-9e00-e0dc6e4a3b8f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1265 microversion: 2.1 time: 0.140189 Sep 07 10:24:01.974607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3046/6024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:01 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:02.137332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:02.138571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:02.146980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:02.147463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:02.148211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:02.149093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:02.149735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:02.150913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:02.361715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:02.371449 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e68a87d9-5be9-4b06-a13c-35aaa85836f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.238149 Sep 07 10:24:02.372931 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2979/6025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:02 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:02.999511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:03.000568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:03.021447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:03.022044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:03.022521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:03.023432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:03.023987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:03.024439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:03.197260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:03.212000 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-523fb89f-f865-443b-bd03-4169e5d8afda tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1271 microversion: 2.1 time: 0.217496 Sep 07 10:24:03.237241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3047/6026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:02 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:03.406589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:03.417488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:03.429050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:03.432374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:03.432838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:03.443687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:03.444637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:03.449807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:03.982891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:03.997831 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6131b092-e681-43f8-a648-e0716a28c153 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.605624 Sep 07 10:24:03.998768 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2980/6027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:03 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:04.257798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:04.258758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:04.279321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:04.283723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:04.286468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:04.289168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:04.291106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:04.291798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:04.445730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8c14c83d-95d4-4bfa-95c9-82f93eacb127 req-ea9911a7-4770-4e30-adf9-bfaa72367160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "name": "network-vif-plugged", "status": "completed", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:04.479791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c14c83d-95d4-4bfa-95c9-82f93eacb127 req-ea9911a7-4770-4e30-adf9-bfaa72367160 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:04.481875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c14c83d-95d4-4bfa-95c9-82f93eacb127 req-ea9911a7-4770-4e30-adf9-bfaa72367160 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:04.485289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8c14c83d-95d4-4bfa-95c9-82f93eacb127 req-ea9911a7-4770-4e30-adf9-bfaa72367160 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:04.521670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8c14c83d-95d4-4bfa-95c9-82f93eacb127 req-ea9911a7-4770-4e30-adf9-bfaa72367160 service nova] Creating event network-vif-plugged:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h2-836830-16 Sep 07 10:24:04.533318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8c14c83d-95d4-4bfa-95c9-82f93eacb127 req-ea9911a7-4770-4e30-adf9-bfaa72367160 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090733 Sep 07 10:24:04.534057 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2981/6028] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:24:04.828737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:04.852635 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebdbe0cc-e0f5-4af0-82e6-1c223e0c00c7 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1313 microversion: 2.1 time: 0.604923 Sep 07 10:24:04.856323 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3048/6029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:04 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:05.032244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:05.033661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:05.049742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:05.053636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:05.054326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:05.056178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:05.057681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:05.060518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:05.600547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:05.611003 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8bf27117-9dfb-4faa-996e-2072f6e3a554 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1391 microversion: 2.1 time: 0.592149 Sep 07 10:24:05.629051 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2982/6030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:05 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1391 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:05.881966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:05.883008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:05.914582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:05.919716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:05.920692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:05.921737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:05.924317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:05.925711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:06.000613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-7f7c9fac-2b57-472d-9972-4d544f673f82 req-a6aef2c7-35b9-4674-a8ed-305e0f239a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b2a619-0adf-4be4-ae04-50622c826708", "tag": "91047aac-e5a6-4169-bcbb-018f72c73975"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:06.042625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7f7c9fac-2b57-472d-9972-4d544f673f82 req-a6aef2c7-35b9-4674-a8ed-305e0f239a55 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:06.043640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7f7c9fac-2b57-472d-9972-4d544f673f82 req-a6aef2c7-35b9-4674-a8ed-305e0f239a55 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:06.048971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-7f7c9fac-2b57-472d-9972-4d544f673f82 req-a6aef2c7-35b9-4674-a8ed-305e0f239a55 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:06.104040 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-7f7c9fac-2b57-472d-9972-4d544f673f82 req-a6aef2c7-35b9-4674-a8ed-305e0f239a55 service nova] Creating event network-changed:91047aac-e5a6-4169-bcbb-018f72c73975 for instance e3b2a619-0adf-4be4-ae04-50622c826708 on n-h1-836830-16 Sep 07 10:24:06.109791 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-7f7c9fac-2b57-472d-9972-4d544f673f82 req-a6aef2c7-35b9-4674-a8ed-305e0f239a55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114504 Sep 07 10:24:06.111028 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2983/6031] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:06.603520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:06.618580 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-605741e6-fa99-416a-a2f1-8243f55f13a0 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1313 microversion: 2.1 time: 0.742654 Sep 07 10:24:06.619449 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3049/6032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:05 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:06.638467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:06.639456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:06.651862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:06.662588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:06.668764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:06.694012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:06.694995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:06.695999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:07.080544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:07.092221 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7047ea1-a711-4e85-9d26-50266ef887de tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1562 microversion: 2.1 time: 0.459373 Sep 07 10:24:07.093977 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2984/6033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:06 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1562 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:07.122039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:07.122985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:07.130331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:07.130860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:07.131443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:07.132302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:07.133165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:07.133726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:07.387086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:07.417983 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6eb67b7-bf27-4a4f-bb34-765aceca7f0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1562 microversion: 2.1 time: 0.299871 Sep 07 10:24:07.418715 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3050/6034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:07 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1562 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:07.643214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:07.643833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:07.657927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:07.659100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:07.664401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:07.666681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:07.667446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:07.673023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:08.031658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:08.046172 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-513ec29b-c216-4df8-a49e-d8977392338c tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1313 microversion: 2.1 time: 0.406774 Sep 07 10:24:08.065961 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2985/6035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:07 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:09.072264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:09.073660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:09.090292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:09.091207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:09.091880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:09.093208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:09.093923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:09.094686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:09.606133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:09.618342 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12735d9d-ff63-4482-8eb7-2ccd7bc6e1de tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1313 microversion: 2.1 time: 0.549350 Sep 07 10:24:09.636517 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3051/6036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:09 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:10.657120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:10.658304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:10.672821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:10.676619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:10.694176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:10.695726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:10.697301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:10.706142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:10.712694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:10.713214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:10.867623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:10.869271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:10.872447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:10.887265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:10.900891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:10.901722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:10.903253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:10.905162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:10.907942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:11.073694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:11.085267 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b76f1f24-be6a-4ca1-98c8-c14f76ad725d tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1313 microversion: 2.1 time: 0.443279 Sep 07 10:24:11.090137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2986/6037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:10 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:11.097571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f931b45e-3569-4af4-9b53-5bf088064092 req-e634d2e1-ac23-4313-892a-61485c4f1e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:11.121532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f931b45e-3569-4af4-9b53-5bf088064092 req-e634d2e1-ac23-4313-892a-61485c4f1e4a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:11.124093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f931b45e-3569-4af4-9b53-5bf088064092 req-e634d2e1-ac23-4313-892a-61485c4f1e4a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:11.126766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f931b45e-3569-4af4-9b53-5bf088064092 req-e634d2e1-ac23-4313-892a-61485c4f1e4a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:11.149260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f931b45e-3569-4af4-9b53-5bf088064092 req-e634d2e1-ac23-4313-892a-61485c4f1e4a service nova] Creating event network-changed:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h2-836830-16 Sep 07 10:24:11.166997 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f931b45e-3569-4af4-9b53-5bf088064092 req-e634d2e1-ac23-4313-892a-61485c4f1e4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073943 Sep 07 10:24:11.167811 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2987/6038] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:11.184036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:11.197027 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2d6ec96d-cc71-462e-8f7b-00bdeb934e38 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1562 microversion: 2.1 time: 0.334742 Sep 07 10:24:11.198265 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3052/6039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:10 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1562 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:12.023222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-af041606-6700-4cf6-af82-417e5c27cd45 req-bb8fa1d4-6f69-41b1-ac57-420ab77f102e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b2a619-0adf-4be4-ae04-50622c826708", "name": "network-vif-plugged", "status": "completed", "tag": "91047aac-e5a6-4169-bcbb-018f72c73975"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:12.044586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-af041606-6700-4cf6-af82-417e5c27cd45 req-bb8fa1d4-6f69-41b1-ac57-420ab77f102e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:12.046425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-af041606-6700-4cf6-af82-417e5c27cd45 req-bb8fa1d4-6f69-41b1-ac57-420ab77f102e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:12.047698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-af041606-6700-4cf6-af82-417e5c27cd45 req-bb8fa1d4-6f69-41b1-ac57-420ab77f102e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:12.072451 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-af041606-6700-4cf6-af82-417e5c27cd45 req-bb8fa1d4-6f69-41b1-ac57-420ab77f102e service nova] Creating event network-vif-plugged:91047aac-e5a6-4169-bcbb-018f72c73975 for instance e3b2a619-0adf-4be4-ae04-50622c826708 on n-h1-836830-16 Sep 07 10:24:12.082624 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-af041606-6700-4cf6-af82-417e5c27cd45 req-bb8fa1d4-6f69-41b1-ac57-420ab77f102e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063356 Sep 07 10:24:12.084168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2988/6040] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:12.112108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:12.112739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:12.137518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:12.138429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:12.139056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:12.140119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:12.140600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:12.149207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:12.575188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:12.583900 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-abaefc88-48fe-4411-964e-6a4fe89fa1cc tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1313 microversion: 2.1 time: 0.475596 Sep 07 10:24:12.584832 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3053/6041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:12 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:13.609554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:13.610448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:13.624151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:13.624724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:13.626695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:13.632289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:13.633020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:13.633571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:13.856028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:13.864062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b83ac31-e716-485b-a13a-d34c24c39691 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1497 microversion: 2.1 time: 0.259519 Sep 07 10:24:13.864903 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2989/6042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:13 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:17.776015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:17.777869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:17.786766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:17.788414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:17.789131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:17.790380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:17.791078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:17.791724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:17.824060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:24:17.929283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-af0f8ce2-c0de-4e82-9dd2-2c446ab0b492 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 204 len: 0 microversion: 2.1 time: 0.157727 Sep 07 10:24:17.929862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3054/6043] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:24:17 2022] DELETE /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:24:17.942722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:17.944167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:17.951820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:17.953858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:17.958245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:17.959055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:17.960099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:17.960702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:17.961280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:17.967675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=85 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:18.251688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:18.260969 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-66b7e550-92c8-4049-9f47-a3f9ab80d1e1 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1503 microversion: 2.1 time: 0.326726 Sep 07 10:24:18.261818 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2990/6044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:17 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:19.288768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:19.289875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:19.298409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:19.299071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:19.299875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:19.300701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:19.301358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:19.302171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:19.307518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:19.547310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:19.556616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5abda9f5-8460-4b44-8e2a-8341d89128e3 tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1503 microversion: 2.1 time: 0.272798 Sep 07 10:24:19.567904 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3055/6045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:19 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:19.974778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1e671a5b-9f44-44e8-8a9b-e64c601e37f4 req-9c6fa09a-c960-4c82-a981-e3f0386f377c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b2a619-0adf-4be4-ae04-50622c826708", "name": "network-vif-deleted", "tag": "91047aac-e5a6-4169-bcbb-018f72c73975"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:19.992212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1e671a5b-9f44-44e8-8a9b-e64c601e37f4 req-9c6fa09a-c960-4c82-a981-e3f0386f377c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:19.993012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1e671a5b-9f44-44e8-8a9b-e64c601e37f4 req-9c6fa09a-c960-4c82-a981-e3f0386f377c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:19.993876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1e671a5b-9f44-44e8-8a9b-e64c601e37f4 req-9c6fa09a-c960-4c82-a981-e3f0386f377c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:20.012671 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1e671a5b-9f44-44e8-8a9b-e64c601e37f4 req-9c6fa09a-c960-4c82-a981-e3f0386f377c service nova] Creating event network-vif-deleted:91047aac-e5a6-4169-bcbb-018f72c73975 for instance e3b2a619-0adf-4be4-ae04-50622c826708 on n-h1-836830-16 Sep 07 10:24:20.020551 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1e671a5b-9f44-44e8-8a9b-e64c601e37f4 req-9c6fa09a-c960-4c82-a981-e3f0386f377c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049908 Sep 07 10:24:20.026789 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2991/6046] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:20.594996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:20.596410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:20.602398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:20.611036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:20.611888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:20.612623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:20.614567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:20.614567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:20.614775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:20.660348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:20.661147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:20.662062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:20.662756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lazy-loading 'fault' on Instance uuid e3b2a619-0adf-4be4-ae04-50622c826708 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:24:20.723887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4446cb077a36403e930c853ce9a98379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42871c17a2354d5bbfd97f24021f86bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:20.736879 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5bf02d12-ef44-4979-852e-0308f790cb4f tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 200 len: 1303 microversion: 2.1 time: 0.146659 Sep 07 10:24:20.740086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3056/6047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:20 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:20.965802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:20.966407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:20.974681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:20.975140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:20.980861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:20.981901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:20.982538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:20.983171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:21.107208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lazy-loading 'services' on Instance uuid c7896581-95f7-4df4-9040-bf90c7fef7b4 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:24:21.194248 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-42286351-b7a9-49d0-96a2-013ca3881c8c tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4/os-volume_attachments/f7e6aa51-0eaa-4368-934a-d4a114140b01" status: 202 len: 0 microversion: 2.1 time: 0.232582 Sep 07 10:24:21.195176 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2992/6048] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:24:20 2022] DELETE /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4/os-volume_attachments/f7e6aa51-0eaa-4368-934a-d4a114140b01 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:24:21.761878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:21.762910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] [instance: e3b2a619-0adf-4be4-ae04-50622c826708] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:21.771791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:21.772618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:21.772836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:21.773843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:21.774512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:21.774960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:21.790712 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] HTTP exception thrown: Instance e3b2a619-0adf-4be4-ae04-50622c826708 could not be found. Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Request method failure captured: Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 HTTP/1.1 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHE9SgZMKBm3hgICQSYbgdkMbzebTnG3W2ZP-LyzSP6CpyeMkpPzPoptZa0eAdVcVonDqkJGFOx8fW7jur8VisTQgmTFQ9mDb3ChXGYLok16QQmJleYcxJSc6lmmQFIE4kEbckLMxRqKRtDdtNy6sq1IQiU9SpSxWDl_YVhAWe7e8XY Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 42871c17a2354d5bbfd97f24021f86bc Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesActionsTest-393387781 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/42871c17a2354d5bbfd97f24021f86bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42871c17a2354d5bbfd97f24021f86bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42871c17a2354d5bbfd97f24021f86bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_42871c17a2354d5bbfd97f24021f86bc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesActionsTest-393387781 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 42871c17a2354d5bbfd97f24021f86bc Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesActionsTest-393387781 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesActionsTest-393387781-project Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 4446cb077a36403e930c853ce9a98379 Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesActionsTest-393387781-project Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance e3b2a619-0adf-4be4-ae04-50622c826708 could not be found. Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'e3b2a619-0adf-4be4-ae04-50622c826708'} Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b2a619-0adf-4be4-ae04-50622c826708 could not be found. Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b2a619-0adf-4be4-ae04-50622c826708 could not be found. Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:24:21.792415 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b2a619-0adf-4be4-ae04-50622c826708 could not be found. Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] Returning 404 to user: Instance e3b2a619-0adf-4be4-ae04-50622c826708 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6fe2678a-d96e-445e-96dd-18d6d51de1ba tempest-VolumesActionsTest-393387781 tempest-VolumesActionsTest-393387781-project] 10.222.0.60 "GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708" status: 404 len: 111 microversion: 2.1 time: 0.035986 Sep 07 10:24:21.802942 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3057/6049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:21 2022] GET /compute/v2.1/servers/e3b2a619-0adf-4be4-ae04-50622c826708 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:24:26.818133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:26.819294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:26.833065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:26.833951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:26.834572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:26.839126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:26.839876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:26.840483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:26.889420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:24:26.991936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e9bcd2b-ee08-43dc-a34f-fe3ef6622ec0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 204 len: 0 microversion: 2.1 time: 0.178916 Sep 07 10:24:26.992857 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2993/6050] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:24:26 2022] DELETE /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:24:27.001107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:27.001891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:27.011836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:27.012632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:27.013336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:27.014337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:27.014936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:27.015456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:27.183481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:27.194089 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d11316c5-1df0-456f-8d62-13afa10b2d2b tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1512 microversion: 2.1 time: 0.196852 Sep 07 10:24:27.194881 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3058/6051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:26 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:28.219736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:28.220467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:28.241725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:28.241725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:28.241725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:28.241725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:28.241725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:28.241725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:28.603979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:28.613446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6fa4052-6fb4-4c17-bd6d-7ae3ca2ea488 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1512 microversion: 2.1 time: 0.398643 Sep 07 10:24:28.614528 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2994/6052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:28 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:29.314032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0d476e83-7ec1-4a91-b911-b347a4f59179 req-6e26ba4f-4581-48ac-ad30-ecd66669164f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7896581-95f7-4df4-9040-bf90c7fef7b4", "name": "network-vif-deleted", "tag": "2835e1e9-557b-47c6-b044-96e23f8627ba"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:29.332468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d476e83-7ec1-4a91-b911-b347a4f59179 req-6e26ba4f-4581-48ac-ad30-ecd66669164f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:29.332971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d476e83-7ec1-4a91-b911-b347a4f59179 req-6e26ba4f-4581-48ac-ad30-ecd66669164f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:29.333456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0d476e83-7ec1-4a91-b911-b347a4f59179 req-6e26ba4f-4581-48ac-ad30-ecd66669164f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:29.348247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0d476e83-7ec1-4a91-b911-b347a4f59179 req-6e26ba4f-4581-48ac-ad30-ecd66669164f service nova] Creating event network-vif-deleted:2835e1e9-557b-47c6-b044-96e23f8627ba for instance c7896581-95f7-4df4-9040-bf90c7fef7b4 on n-h1-836830-16 Sep 07 10:24:29.354200 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0d476e83-7ec1-4a91-b911-b347a4f59179 req-6e26ba4f-4581-48ac-ad30-ecd66669164f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050713 Sep 07 10:24:29.354812 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3059/6053] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:29.638267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:29.638906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:29.646959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:29.647679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:29.648278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:29.649234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:29.649931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:29.650581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:29.686032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:29.686520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:29.686966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:29.687468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lazy-loading 'fault' on Instance uuid c7896581-95f7-4df4-9040-bf90c7fef7b4 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:24:29.741622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:29.751139 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-767296fe-7e29-4fce-886b-41e3f6874986 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 200 len: 1307 microversion: 2.1 time: 0.116686 Sep 07 10:24:29.752002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2995/6054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:29 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 1307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:30.776943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:30.777809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: c7896581-95f7-4df4-9040-bf90c7fef7b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:30.784106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:30.785079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:30.785638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:30.786367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:30.786838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:30.787448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:30.803758 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] HTTP exception thrown: Instance c7896581-95f7-4df4-9040-bf90c7fef7b4 could not be found. Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Request method failure captured: Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 HTTP/1.1 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHCyMw198LZ0qskO5dY3EHbJT9D4mkqKrOUOkc9dZqpAHYHKGzO9yb7RUW8cBK71qZRYNXjnH4ZbL2P_Y3C_DWD51D5rg9VivAfZ--cpdowjoUQC_cylrNdxBdYSnNN_bC9oBoUW3gRGibWHxyMkRmGtKB7UyxewIGxaEBefxGzauVE Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d531f20b78c941259747bc8d19341b1c Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1216639656 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d531f20b78c941259747bc8d19341b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d531f20b78c941259747bc8d19341b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d531f20b78c941259747bc8d19341b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d531f20b78c941259747bc8d19341b1c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesSnapshotTestJSON-1216639656 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d531f20b78c941259747bc8d19341b1c Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1216639656 Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesSnapshotTestJSON-1216639656-project Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: bde3539a692b4c2b80b0e0054ca7003e Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesSnapshotTestJSON-1216639656-project Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance c7896581-95f7-4df4-9040-bf90c7fef7b4 could not be found. Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'c7896581-95f7-4df4-9040-bf90c7fef7b4'} Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7896581-95f7-4df4-9040-bf90c7fef7b4 could not be found. Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7896581-95f7-4df4-9040-bf90c7fef7b4 could not be found. Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:24:30.805857 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7896581-95f7-4df4-9040-bf90c7fef7b4 could not be found. Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Returning 404 to user: Instance c7896581-95f7-4df4-9040-bf90c7fef7b4 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:24:30.811110 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bfaaa776-beed-4fe8-abbb-d1f90e5c6fd0 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4" status: 404 len: 111 microversion: 2.1 time: 0.036026 Sep 07 10:24:30.813526 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3060/6055] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:30 2022] GET /compute/v2.1/servers/c7896581-95f7-4df4-9040-bf90c7fef7b4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:24:31.783637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:31.788481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:31.798754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:31.799253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:31.799941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:31.801337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:31.802641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:31.803348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:31.893513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61e7b60a-db58-416d-9b10-d689dc3dcde5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action" status: 200 len: 24574 microversion: 2.1 time: 0.114842 Sep 07 10:24:31.903919 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2996/6056] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:24:31 2022] POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action => generated 24574 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:24:37.883801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1546538496", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "416105ae-4d47-4c89-b3ed-280ea29c7872"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:38.322531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:38.323484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:38.328992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] validate_networks() for [('416105ae-4d47-4c89-b3ed-280ea29c7872', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:24:38.332104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:38.332831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:38.333421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:38.334244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:38.334818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:38.335360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:38.920393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:24:38.921053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:24:38.921637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:24:38.922127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:24:38.922675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:24:38.938593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:38.939440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:38.940075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:38.941724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:38.942513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:38.943100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:38.974133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Getting quotas for project d531f20b78c941259747bc8d19341b1c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:24:38.984830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Getting quotas for user bde3539a692b4c2b80b0e0054ca7003e and project d531f20b78c941259747bc8d19341b1c. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:24:39.004319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:24:39.007613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:24:39.025849 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ffbfede8-b9be-4ce2-81ac-7ea26718e0ee tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1833 microversion: 2.1 time: 0.712555 Sep 07 10:24:39.028473 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2997/6057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:38 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1833 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:39.062984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:39.064052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:39.078176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:39.079331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:39.080238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:39.081249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:39.082352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:39.083152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:39.135527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a72ebe6f-9c3a-465d-be9b-4f97f560a688 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255538 Sep 07 10:24:39.143618 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3061/6058] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:24:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:24:39.163711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-50a72032-3e85-4070-8ac9-e8f3efab8951 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:39.173824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-50a72032-3e85-4070-8ac9-e8f3efab8951 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:39.278110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-50a72032-3e85-4070-8ac9-e8f3efab8951 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:39.295948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-50a72032-3e85-4070-8ac9-e8f3efab8951 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1219 microversion: 2.1 time: 0.142138 Sep 07 10:24:39.299026 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3062/6059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:39 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:39.432271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:39.446474 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99aa7161-5a39-4dc7-a92a-5661aa1a50ff tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1680 microversion: 2.1 time: 0.390802 Sep 07 10:24:39.453306 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2998/6060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:39 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1680 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:39.565296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:39.570485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:39.583485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:39.584262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:39.585477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:39.587148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:39.587840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:39.588501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:39.679156 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0ee340d-8d84-4c05-adfc-2ddd746fa7cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action" status: 200 len: 32644 microversion: 2.1 time: 0.123757 Sep 07 10:24:39.687325 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3063/6061] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:24:39 2022] POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action => generated 32644 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:24:39.884155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:39.884680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:39.891241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:39.891806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:39.892155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:39.892885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:39.893374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:39.893799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:40.156754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '133d7ae6f3cf44328884eb440c3a2d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f919730f06ae4904acc7f84b608ef32a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:40.157536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] flavor_id is None. Assuming migration. {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 10:24:40.157981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:24:40.323165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:40.323997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:40.337276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:40.337855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:40.338653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:40.339466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:40.339989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:40.340384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:40.460418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:40.470621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3a4fffc-4782-46fe-a51b-bf496abf5b51 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1271 microversion: 2.1 time: 0.154422 Sep 07 10:24:40.486410 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3064/6062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:40 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:40.575374 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aedfeaca-f290-4a4b-8206-edf132cb198b tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action" status: 202 len: 0 microversion: 2.1 time: 0.695050 Sep 07 10:24:40.576360 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 2999/6063] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:24:39 2022] POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:24:40.585799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:40.586527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:40.599955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:40.601721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:40.603322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:40.604165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:40.621195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:40.622227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:40.856427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:40.869519 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc09368d-8979-44cc-90d0-b98226d024b8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1689 microversion: 2.1 time: 0.288574 Sep 07 10:24:40.870678 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3065/6064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:40 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1689 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:41.496767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:41.497579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:41.515605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:41.516128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:41.516581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:41.517346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:41.517806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:41.518238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:41.655964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:41.669489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d780316-7a60-455d-aa66-5cb9f0386456 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1277 microversion: 2.1 time: 0.177062 Sep 07 10:24:41.670428 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3000/6065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:41 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:41.896052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:41.897399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:41.912376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:41.912965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:41.914550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:41.915405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:41.916710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:41.918303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:42.100070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:42.111642 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-108d7ee6-bf80-40d7-b358-3e9259d1464e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1689 microversion: 2.1 time: 0.220033 Sep 07 10:24:42.112340 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3066/6066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:41 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:42.697207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:42.697859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:42.705344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:42.706036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:42.707174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:42.708647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:42.709332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:42.709922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:42.821822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-23503d3a-fc67-4d79-8c0b-c4cb3e85e533 req-6645c44b-6abc-43b0-9964-2d1de9a937f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9", "tag": "55cf6c85-8388-4744-8283-56e3253f4b74"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:42.838694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-23503d3a-fc67-4d79-8c0b-c4cb3e85e533 req-6645c44b-6abc-43b0-9964-2d1de9a937f4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:42.839588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-23503d3a-fc67-4d79-8c0b-c4cb3e85e533 req-6645c44b-6abc-43b0-9964-2d1de9a937f4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:42.840204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-23503d3a-fc67-4d79-8c0b-c4cb3e85e533 req-6645c44b-6abc-43b0-9964-2d1de9a937f4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:42.854199 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-23503d3a-fc67-4d79-8c0b-c4cb3e85e533 req-6645c44b-6abc-43b0-9964-2d1de9a937f4 service nova] Creating event network-changed:55cf6c85-8388-4744-8283-56e3253f4b74 for instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 on n-h1-836830-16 Sep 07 10:24:42.859948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-23503d3a-fc67-4d79-8c0b-c4cb3e85e533 req-6645c44b-6abc-43b0-9964-2d1de9a937f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046737 Sep 07 10:24:42.860787 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3067/6067] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:42.944240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:42.963860 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d70e8bee-65f0-445c-a4e0-a1a04c6f53b3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.270461 Sep 07 10:24:42.964469 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3001/6068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:42 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:43.142009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:43.143731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:43.160437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:43.161716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:43.162452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:43.164880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:43.165751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:43.166296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:43.339688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:43.348917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-020607a4-32d5-4d87-a607-876d870cee05 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1689 microversion: 2.1 time: 0.213084 Sep 07 10:24:43.366196 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3068/6069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:43 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:24:43.988641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:43.989352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:44.007226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:44.008247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:44.008929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:44.010167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:44.011153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:44.011977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:44.261980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:44.273117 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8ab408ac-016d-45b1-88fe-0c3fb394318d tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.289648 Sep 07 10:24:44.274537 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3002/6070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:43 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:44.377878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:44.378586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:44.392392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:44.392896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:44.393386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:44.394168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:44.394643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:44.395084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:44.677977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:44.696722 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab497cf6-703c-4dda-a94e-1b9d4dca0110 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1689 microversion: 2.1 time: 0.325596 Sep 07 10:24:44.698028 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3069/6071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:44 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1689 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:45.297506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:45.298139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:45.306459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:45.306899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:45.307349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:45.308054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:45.308557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:45.309112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:45.325999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:45.463553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:45.471358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9518972-d5ae-44e6-a053-236f52e420e9 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.178016 Sep 07 10:24:45.471933 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3003/6072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:45 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:45.721495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:45.723407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:45.730599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:45.731226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:45.731787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:45.732874 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:45.733494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:45.734041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:45.891529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:45.899900 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9f7bcd37-bff1-4bec-9a9b-b8ce6d99aa0f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.182888 Sep 07 10:24:45.900486 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3070/6073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:45 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:46.496549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:46.498195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:46.508264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:46.509516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:46.510172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:46.511071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:46.511680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:46.512353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:46.658032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:46.667592 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d847664f-c0ca-43d5-acd2-489849e1a8e3 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.176615 Sep 07 10:24:46.668787 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3004/6074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:46 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:46.924674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:46.926291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:46.934104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:46.934689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:46.935558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:46.936878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:46.937621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:46.938247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:47.135367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:47.144266 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7adc09fe-a194-4b15-beae-32499cd2f8a8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.223728 Sep 07 10:24:47.145216 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3071/6075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:46 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:47.692276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:47.693019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:47.700500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:47.701255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:47.701897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:47.702686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:47.703158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:47.703594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:47.901832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:47.912434 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a0b29145-a8ba-455e-a80a-c26cceb29138 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.224206 Sep 07 10:24:47.913570 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3005/6076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:47 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:48.171657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:48.173085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:48.180111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:48.180612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:48.181056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:48.181827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:48.182294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:48.182742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:48.334425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:48.342451 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4203f662-9290-4364-bd51-b861edfe1a86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.175286 Sep 07 10:24:48.343267 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3072/6077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:48 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:48.938277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:48.938923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:48.947213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:48.952974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:48.953497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:48.953938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:48.954641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:48.955587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:48.956182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:49.135594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:49.163784 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd37bef2-4806-4b65-b2ab-9d74f79059fa tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.231129 Sep 07 10:24:49.164427 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3006/6078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:48 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:49.368301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:49.370616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:49.387512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:49.390046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:49.400067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:49.406957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:49.411532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:49.412723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:49.416560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:49.417300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:49.431320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=82 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:49.623104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fcf18b2c-a32b-437b-abc3-da6621fbfc47 req-b92f824b-b0a7-4325-a3c4-5e6ffd01f1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "55cf6c85-8388-4744-8283-56e3253f4b74"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:49.647272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fcf18b2c-a32b-437b-abc3-da6621fbfc47 req-b92f824b-b0a7-4325-a3c4-5e6ffd01f1ef service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:49.647784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fcf18b2c-a32b-437b-abc3-da6621fbfc47 req-b92f824b-b0a7-4325-a3c4-5e6ffd01f1ef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:49.653155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fcf18b2c-a32b-437b-abc3-da6621fbfc47 req-b92f824b-b0a7-4325-a3c4-5e6ffd01f1ef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:49.685015 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fcf18b2c-a32b-437b-abc3-da6621fbfc47 req-b92f824b-b0a7-4325-a3c4-5e6ffd01f1ef service nova] Creating event network-vif-plugged:55cf6c85-8388-4744-8283-56e3253f4b74 for instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 on n-h1-836830-16 Sep 07 10:24:49.696421 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fcf18b2c-a32b-437b-abc3-da6621fbfc47 req-b92f824b-b0a7-4325-a3c4-5e6ffd01f1ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077094 Sep 07 10:24:49.700278 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3007/6079] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:24:49.717392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:49.728373 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bccbf991-2537-4dbf-b218-fa661537280d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.364193 Sep 07 10:24:49.744940 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3073/6080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:49 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:50.188399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:50.189957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:50.198974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:50.199732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:50.200349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:50.201317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:50.201953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:50.202545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:50.385884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:50.399106 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c1842ffd-960a-4a97-932d-8133e273d70f tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.214743 Sep 07 10:24:50.400435 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3008/6081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:50 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:50.759845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:50.760690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:50.765023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:24:50.769147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:50.769879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:50.770555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:50.771281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:50.771756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:50.772202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:50.927255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:50.938467 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26d9a1a7-db9a-4bfc-b04d-2f21ff761eec tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.183051 Sep 07 10:24:50.939138 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3074/6082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:50 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:51.424242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:51.425743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:51.433789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:51.434373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:51.434909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:51.435851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:51.436468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:51.437049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:51.614304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:51.624592 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-795f0f40-e816-4be8-8ee1-533804b217ab tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1508 microversion: 2.1 time: 0.204529 Sep 07 10:24:51.625201 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3009/6083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:51 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:51.649380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "517d1cc1-6cc9-4a1d-9f0c-1e939dab6762", "device": "/dev/sdb"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:24:51.651933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:51.658567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:51.659443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:51.660630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:51.662184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:51.663660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:51.664782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:51.965302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:51.966187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:51.970908 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b5c1bee-bcd3-4fa0-83e2-71db2ea1a4ca tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "POST /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325549 Sep 07 10:24:51.977521 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3075/6084] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:24:51 2022] POST /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:24:51.981840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:51.982528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:51.983589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:51.984674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:51.986106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:51.986716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:52.162800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:52.171459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-92a09895-9acf-4a56-b40f-10eca8eee81d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.211098 Sep 07 10:24:52.172851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3010/6085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:51 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:53.200968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:53.201871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:53.215377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:53.215902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:53.216373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:53.217118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:53.222700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:53.223319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:53.524720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:53.535677 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf5630eb-d08a-4a14-a105-c93ad798fb9b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.340553 Sep 07 10:24:53.536779 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3076/6086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:53 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:54.562157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:54.570805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:54.579018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:54.580043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:54.580738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:54.582747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:54.583462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:54.584142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:54.796977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:54.805598 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be0fdb08-4aa0-474a-912b-51d7876501fa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.248544 Sep 07 10:24:54.806239 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3011/6087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:54 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:55.832956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:55.834737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:55.845610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:55.846643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:55.848752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:55.849999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:55.850681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:55.851424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:56.035146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:56.045712 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8de23076-2882-4433-ac99-5d076b9451d5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.219579 Sep 07 10:24:56.046823 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3077/6088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:55 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:57.070184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:57.071624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:57.079161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:57.080237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:57.080918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:57.082259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:57.082951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:57.083606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:57.288741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:57.308329 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bcc61b0c-4a96-4072-adfa-81f2eb328c34 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.242068 Sep 07 10:24:57.308926 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3012/6089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:57 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:58.333146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:58.334627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:58.342186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:58.342722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:58.343175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:58.344073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:58.344716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:58.345160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:58.508335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:58.517004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5e41c952-5841-4495-970f-e95e27822c96 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.188284 Sep 07 10:24:58.517683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3078/6090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:58 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:24:59.544880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:24:59.554112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:24:59.566943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:59.567769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:59.568656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:59.569649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:24:59.570268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:24:59.570858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:24:59.768014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:24:59.776798 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-00b7da96-0a44-46cd-8e01-b4677e225a3b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.239580 Sep 07 10:24:59.777405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3013/6091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:24:59 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:00.803438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:00.804000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:00.822087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:00.823146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:00.824750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:00.826008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:00.826585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:00.827118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:01.001108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:01.011901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9131878-e303-4e08-b67c-96dc267245dc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1694 microversion: 2.1 time: 0.213342 Sep 07 10:25:01.012513 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3079/6092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:00 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:02.041111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:02.041844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:02.058449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:02.059204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:02.059507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:02.060253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:02.060721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:02.061155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:02.251439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:02.260405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e98720fe-cff4-49ec-b51a-91847f255066 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1693 microversion: 2.1 time: 0.226553 Sep 07 10:25:02.260996 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3014/6093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:02 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1693 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:02.264916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "name": "network-vif-unplugged", "status": "completed", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:02.278005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:02.278562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:02.279254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:02.294587 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] Creating event network-vif-unplugged:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h1-836830-16 Sep 07 10:25:02.302066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:25:02.314303 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4c3f060f-5fc9-4d2b-9326-a83cfb81a040 req-8c3f4df9-c83d-45ce-bfb7-cca71319fef0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053554 Sep 07 10:25:02.314851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3080/6094] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:03.286532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:03.287165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:03.294397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:03.294896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:03.295443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:03.296246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:03.296604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:03.297034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:03.474224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:03.496446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-151ef287-7b12-4cd7-b277-12ef843a90a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1693 microversion: 2.1 time: 0.214312 Sep 07 10:25:03.498155 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3015/6095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:03 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:04.354707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:04.367981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:04.368885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:04.369741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:04.410540 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] Creating event network-changed:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h1-836830-16 Sep 07 10:25:04.417584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:25:04.433078 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b71c3f34-4694-4b03-ba6f-f855e525d574 req-68f96c3b-6231-44c6-a326-e3ff4811868b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083053 Sep 07 10:25:04.435046 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3081/6096] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:04.525798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:04.527141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:04.536201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:04.537079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:04.537996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:04.539004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:04.540371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:04.541432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:04.769235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:04.783512 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a7139d83-7ede-4b3b-b09e-a3406b6fe1a2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1691 microversion: 2.1 time: 0.262895 Sep 07 10:25:04.788487 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3016/6097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:04 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1691 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:05.820064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:05.821083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:05.840585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:05.841811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:05.847204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:05.851087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:05.854581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:05.855269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:06.127690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:06.145503 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6a5006c-0dac-41be-bf0e-77620d566cc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1688 microversion: 2.1 time: 0.330363 Sep 07 10:25:06.146764 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3082/6098] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:05 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1688 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:06.172207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:06.173565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:06.182820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:06.183675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:06.184471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:06.185372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:06.185978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:06.186558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:06.338877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b8752d6f-5ee0-498c-a343-d171e97e7b86 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action" status: 204 len: 0 microversion: 2.1 time: 0.173125 Sep 07 10:25:06.339562 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3017/6099] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:25:06 2022] POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:25:06.349780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:06.350798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:06.361334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:06.362706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:06.363495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:06.364419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:06.364931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:06.365404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:06.558209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:06.565627 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05f61eaf-b597-4b0f-8d2d-40d1379d2829 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1688 microversion: 2.1 time: 0.220258 Sep 07 10:25:06.566412 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3083/6100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:06 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:07.596562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:07.599880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:07.638931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:07.640000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:07.643189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:07.646882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:07.647580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:07.651026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:07.865911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:07.889459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1cfbc28-b243-4c09-a43b-5292d3a2fdc2 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1688 microversion: 2.1 time: 0.300568 Sep 07 10:25:07.891288 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3018/6101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:07 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1688 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:08.915715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:08.916659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:08.925412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:08.926190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:08.926642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:08.927782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:08.929264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:08.930029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:09.101539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:09.109745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab70a3d5-9c86-43da-8267-b6dfe8285ef8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1680 microversion: 2.1 time: 0.198303 Sep 07 10:25:09.110410 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3084/6102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:08 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:09.832145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2e9e7a8e-2d1d-46f0-bafa-64f90d33fbc6 req-53e960f3-0598-4df1-9a22-9e840f014402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "name": "network-vif-plugged", "status": "completed", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:09.851202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2e9e7a8e-2d1d-46f0-bafa-64f90d33fbc6 req-53e960f3-0598-4df1-9a22-9e840f014402 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:09.852601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2e9e7a8e-2d1d-46f0-bafa-64f90d33fbc6 req-53e960f3-0598-4df1-9a22-9e840f014402 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:09.853425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2e9e7a8e-2d1d-46f0-bafa-64f90d33fbc6 req-53e960f3-0598-4df1-9a22-9e840f014402 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:09.870462 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2e9e7a8e-2d1d-46f0-bafa-64f90d33fbc6 req-53e960f3-0598-4df1-9a22-9e840f014402 service nova] Creating event network-vif-plugged:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h1-836830-16 Sep 07 10:25:09.877261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2e9e7a8e-2d1d-46f0-bafa-64f90d33fbc6 req-53e960f3-0598-4df1-9a22-9e840f014402 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050261 Sep 07 10:25:09.879052 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3019/6103] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:15.406395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:15.406950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:15.415502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:15.416006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:15.416458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:15.417263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:15.417669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:15.418107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:15.505872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lazy-loading 'services' on Instance uuid ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:25:15.590473 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4be751dd-c628-4519-abdc-8bccbbb1c637 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9/os-volume_attachments/517d1cc1-6cc9-4a1d-9f0c-1e939dab6762" status: 202 len: 0 microversion: 2.1 time: 0.187609 Sep 07 10:25:15.591333 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3085/6104] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:25:15 2022] DELETE /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9/os-volume_attachments/517d1cc1-6cc9-4a1d-9f0c-1e939dab6762 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:25:21.109771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=27 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:21.111853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:21.117311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:21.119115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:21.129413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:21.130268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:21.130975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:21.132079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:21.132935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:21.133915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:21.186728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:25:21.335353 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6ac8479d-4790-4789-83dd-90ae472e02b2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 204 len: 0 microversion: 2.1 time: 0.227172 Sep 07 10:25:21.336789 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3020/6105] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:25:21 2022] DELETE /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:25:21.347458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:21.349027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:21.357451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=24 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:21.360026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:21.361160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:21.362031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:21.363216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:21.363901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:21.364567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:21.368715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:21.542655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:21.551376 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-17d31c8e-b3df-4503-ac0f-794a42dc1ad2 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1514 microversion: 2.1 time: 0.208937 Sep 07 10:25:21.552480 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3086/6106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:21 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:22.130352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-393684111", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:22.186242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:25:22.504085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:25:22.504514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:25:22.505002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:25:22.505443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:25:22.505984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:25:22.515426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:22.516194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:22.516857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:22.517852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:22.518952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:22.519631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:22.543513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Getting quotas for project 4dbc78b722b744429fcdba973bc539c2. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:25:22.548981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Getting quotas for user 8731e951e8fa463d87a9dc7e9da69403 and project 4dbc78b722b744429fcdba973bc539c2. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:25:22.563145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:25:22.566480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:25:22.575207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:22.576381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:22.584741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:22.585485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:22.586084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:22.586932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:22.587579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:22.588303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:22.624627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18416594-217a-4663-ba53-719394c3c932 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498403 Sep 07 10:25:22.625448 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3021/6107] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:25:22.636522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be7c5f79-da3f-4f63-9b54-601cc1b2e1ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:22.637286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be7c5f79-da3f-4f63-9b54-601cc1b2e1ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:22.713774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be7c5f79-da3f-4f63-9b54-601cc1b2e1ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:22.730678 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be7c5f79-da3f-4f63-9b54-601cc1b2e1ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1213 microversion: 2.1 time: 0.097800 Sep 07 10:25:22.741647 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3022/6108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:22 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:22.827679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:22.847466 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a2808cb1-0cb9-4bbe-a33c-991800e50c66 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1514 microversion: 2.1 time: 0.276043 Sep 07 10:25:22.848533 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3087/6109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:22 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:23.477034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-70fdc59c-dfda-436c-80af-e95ecadf5382 req-a036aeaf-2ddc-4570-a6c0-4b5df53df385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9", "name": "network-vif-deleted", "tag": "55cf6c85-8388-4744-8283-56e3253f4b74"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:23.503540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-70fdc59c-dfda-436c-80af-e95ecadf5382 req-a036aeaf-2ddc-4570-a6c0-4b5df53df385 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:23.504143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-70fdc59c-dfda-436c-80af-e95ecadf5382 req-a036aeaf-2ddc-4570-a6c0-4b5df53df385 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:23.504688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-70fdc59c-dfda-436c-80af-e95ecadf5382 req-a036aeaf-2ddc-4570-a6c0-4b5df53df385 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:23.533444 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-70fdc59c-dfda-436c-80af-e95ecadf5382 req-a036aeaf-2ddc-4570-a6c0-4b5df53df385 service nova] Creating event network-vif-deleted:55cf6c85-8388-4744-8283-56e3253f4b74 for instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 on n-h1-836830-16 Sep 07 10:25:23.542241 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-70fdc59c-dfda-436c-80af-e95ecadf5382 req-a036aeaf-2ddc-4570-a6c0-4b5df53df385 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074045 Sep 07 10:25:23.543317 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3023/6110] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:23.754603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:23.755358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:23.763816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:23.764414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:23.765083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:23.765841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:23.766321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:23.767310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:23.835700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:23.844905 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94d37fc6-d58e-47c8-a52a-0f0f4f04e594 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1265 microversion: 2.1 time: 0.094429 Sep 07 10:25:23.845744 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3088/6111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:23 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:23.872703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:23.873399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:23.880520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:23.881021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:23.881700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:23.882584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:23.883264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:23.883849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:23.938794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:23.939497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:23.940145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:23.940766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lazy-loading 'fault' on Instance uuid ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:25:24.023606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde3539a692b4c2b80b0e0054ca7003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd531f20b78c941259747bc8d19341b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:24.034134 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-980e30a3-d0f2-4b75-9cbc-46e5d3e65070 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 200 len: 1309 microversion: 2.1 time: 0.165763 Sep 07 10:25:24.035692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3024/6112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:23 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:24.870438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:24.871655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:24.879847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:24.880366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:24.880830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:24.881578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:24.882057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:24.882505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:25.038393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:25.052002 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6d8c25f7-d58f-48d6-bcdd-779459c1f095 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.186499 Sep 07 10:25:25.052913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3089/6113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:24 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:25.065816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:25.067423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] [instance: ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:25.074528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:25.075206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:25.075764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:25.076594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:25.077166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:25.077736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:25.098085 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] HTTP exception thrown: Instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 could not be found. Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Request method failure captured: Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 HTTP/1.1 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHCyMw198LZ0qskO5dY3EHbJT9D4mkqKrOUOkc9dZqpAHYHKGzO9yb7RUW8cBK71qZRYNXjnH4ZbL2P_Y3C_DWD51D5rg9VivAfZ--cpdowjoUQC_cylrNdxBdYSnNN_bC9oBoUW3gRGibWHxyMkRmGtKB7UyxewIGxaEBefxGzauVE Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d531f20b78c941259747bc8d19341b1c Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1216639656 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d531f20b78c941259747bc8d19341b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d531f20b78c941259747bc8d19341b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d531f20b78c941259747bc8d19341b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d531f20b78c941259747bc8d19341b1c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesSnapshotTestJSON-1216639656 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d531f20b78c941259747bc8d19341b1c Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1216639656 Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesSnapshotTestJSON-1216639656-project Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: bde3539a692b4c2b80b0e0054ca7003e Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesSnapshotTestJSON-1216639656-project Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 could not be found. Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9'} Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 could not be found. Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 could not be found. Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:25:25.100889 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 could not be found. Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] Returning 404 to user: Instance ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:25:25.105881 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e88bc131-b5bb-4882-bf28-97b28f94fe12 tempest-VolumesSnapshotTestJSON-1216639656 tempest-VolumesSnapshotTestJSON-1216639656-project] 10.222.0.60 "GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9" status: 404 len: 111 microversion: 2.1 time: 0.049725 Sep 07 10:25:25.107391 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3025/6114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:25 2022] GET /compute/v2.1/servers/ab66d23e-2f65-43e7-aa6d-d3b12b83dcf9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:25:26.076062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:26.077548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:26.085817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:26.086663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:26.087481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:26.088451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:26.089150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:26.089841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:26.152133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1384f7a7-4055-478d-95c9-8a101b2d1271 req-0002959b-88a2-4f47-af8e-6feef7442e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589a7af1-5dc7-464d-84f4-b2e5a0f945f3", "tag": "67bb1230-fb85-4597-8e56-989abf4c2ace"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:26.201952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1384f7a7-4055-478d-95c9-8a101b2d1271 req-0002959b-88a2-4f47-af8e-6feef7442e1f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:26.203333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1384f7a7-4055-478d-95c9-8a101b2d1271 req-0002959b-88a2-4f47-af8e-6feef7442e1f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:26.203971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1384f7a7-4055-478d-95c9-8a101b2d1271 req-0002959b-88a2-4f47-af8e-6feef7442e1f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:26.226621 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1384f7a7-4055-478d-95c9-8a101b2d1271 req-0002959b-88a2-4f47-af8e-6feef7442e1f service nova] Creating event network-changed:67bb1230-fb85-4597-8e56-989abf4c2ace for instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 on n-h2-836830-16 Sep 07 10:25:26.234522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1384f7a7-4055-478d-95c9-8a101b2d1271 req-0002959b-88a2-4f47-af8e-6feef7442e1f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092889 Sep 07 10:25:26.235751 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3026/6115] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:26.298111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:26.307446 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-119c749d-278a-487b-a53e-6b2af8f904ae tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.235260 Sep 07 10:25:26.311411 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3090/6116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:26 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:27.339836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:27.340708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:27.348500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:27.348991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:27.349666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:27.350412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:27.351026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:27.351461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:27.499206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:27.517814 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f9024339-8caa-4845-9d86-d62e05751495 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.183168 Sep 07 10:25:27.519137 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3027/6117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:27 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:28.541561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:28.542102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:28.550125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:28.550771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:28.551199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:28.551927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:28.552419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:28.552826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:28.967157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:28.978941 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-339cc898-701b-43cc-abc4-ccf5e4a72165 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.441524 Sep 07 10:25:28.979869 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3091/6118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:28 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:30.004545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:30.006039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:30.015992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:30.017544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:30.018833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:30.020436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:30.021172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:30.021800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:30.187016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:30.202004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cc5e850-e9ef-4a3f-893a-98b0b33023fa tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.201854 Sep 07 10:25:30.219462 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3028/6119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:29 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:31.243078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:31.244389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:31.256822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:31.264694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:31.266039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:31.267452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:31.270097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:31.270931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:31.478743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:31.489016 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-343a5a53-fe16-4a6e-b666-e951379ace13 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.262308 Sep 07 10:25:31.489868 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3092/6120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:31 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:32.041250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-05349977-6cd6-4fdb-8324-8fc80d02a6b8 req-549cdaaf-e7a5-48df-b966-370ee941f3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589a7af1-5dc7-464d-84f4-b2e5a0f945f3", "name": "network-vif-plugged", "status": "completed", "tag": "67bb1230-fb85-4597-8e56-989abf4c2ace"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:32.053248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-05349977-6cd6-4fdb-8324-8fc80d02a6b8 req-549cdaaf-e7a5-48df-b966-370ee941f3c3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:32.054051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-05349977-6cd6-4fdb-8324-8fc80d02a6b8 req-549cdaaf-e7a5-48df-b966-370ee941f3c3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:32.054791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-05349977-6cd6-4fdb-8324-8fc80d02a6b8 req-549cdaaf-e7a5-48df-b966-370ee941f3c3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:32.068943 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-05349977-6cd6-4fdb-8324-8fc80d02a6b8 req-549cdaaf-e7a5-48df-b966-370ee941f3c3 service nova] Creating event network-vif-plugged:67bb1230-fb85-4597-8e56-989abf4c2ace for instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 on n-h2-836830-16 Sep 07 10:25:32.076898 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-05349977-6cd6-4fdb-8324-8fc80d02a6b8 req-549cdaaf-e7a5-48df-b966-370ee941f3c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050402 Sep 07 10:25:32.077975 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3029/6121] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:25:32.513506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:32.514321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:32.521548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:32.522052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:32.522646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:32.523385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:32.523839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:32.524310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:32.680132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:32.689783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-24bcea29-8695-4c29-ba9d-0735bad7e362 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1313 microversion: 2.1 time: 0.179762 Sep 07 10:25:32.693793 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3093/6122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:32 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:25:33.365931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:33.369580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:33.372562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:33.374843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:33.383561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:33.384370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:33.385070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:33.386353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:33.386745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:33.387340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:33.477465 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c61730ad-1768-4c40-b60e-60a442fb06a7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action" status: 200 len: 24580 microversion: 2.1 time: 0.116786 Sep 07 10:25:33.478482 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3030/6123] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:25:33 2022] POST /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4/action => generated 24580 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:25:33.714544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:33.715255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:33.723982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:33.724711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:33.725494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:33.725842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:33.726435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:33.726887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:33.874276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:33.884347 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e4e284f-f9ce-40c3-9a95-23f6f943490d tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1463 microversion: 2.1 time: 0.173943 Sep 07 10:25:33.897986 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3094/6124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:33 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1463 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:33.909379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0ac6e54-b9be-4e06-86a1-c2a9f2359319", "device": "/dev/sdb"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:33.912335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:33.924899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:33.925416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:33.926016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:33.926867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:33.927654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:33.928900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:34.254547 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-888c0db3-dce1-4c7e-824d-2d5f99296ddc tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "POST /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349861 Sep 07 10:25:34.256225 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3031/6125] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:25:33 2022] POST /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:39.692117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:39.695522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:39.704716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:39.706529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:39.707317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:39.708766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:39.713397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:39.715074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:40.024824 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96df3220-e89c-4b32-b09e-13ac409879cd tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1833 microversion: 2.1 time: 0.342024 Sep 07 10:25:40.045272 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3095/6126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:39 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1833 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:41.234284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:41.234878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:41.238104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-234fb6c9-ec52-4839-90cf-eb9cb9bff8d1 req-8796e9b1-5d68-4cb9-92c5-5aa8c1233ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:41.253913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-234fb6c9-ec52-4839-90cf-eb9cb9bff8d1 req-8796e9b1-5d68-4cb9-92c5-5aa8c1233ed1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:41.261819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:41.262319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:41.262768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:41.263496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:41.263965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:41.264412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:41.274805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-234fb6c9-ec52-4839-90cf-eb9cb9bff8d1 req-8796e9b1-5d68-4cb9-92c5-5aa8c1233ed1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:41.276002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-234fb6c9-ec52-4839-90cf-eb9cb9bff8d1 req-8796e9b1-5d68-4cb9-92c5-5aa8c1233ed1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:41.293512 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-234fb6c9-ec52-4839-90cf-eb9cb9bff8d1 req-8796e9b1-5d68-4cb9-92c5-5aa8c1233ed1 service nova] Creating event network-changed:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h1-836830-16 Sep 07 10:25:41.302481 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-234fb6c9-ec52-4839-90cf-eb9cb9bff8d1 req-8796e9b1-5d68-4cb9-92c5-5aa8c1233ed1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069636 Sep 07 10:25:41.303266 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3096/6127] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:41.340882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:25:41.514046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5bbf6820-1c15-48e7-8d9c-21bb3e2ef35e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 204 len: 0 microversion: 2.1 time: 0.284626 Sep 07 10:25:41.516827 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3032/6128] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:25:41 2022] DELETE /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:25:41.525923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:41.527321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:41.539128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:41.539935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:41.545086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:41.546293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:41.547477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:41.548208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:41.837951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:41.860639 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e47cbef-043c-421e-828d-5f0235eaf522 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1686 microversion: 2.1 time: 0.328012 Sep 07 10:25:41.860855 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3097/6129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:41 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1686 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:42.875357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:42.876221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:42.899463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:42.915775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:42.916368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:42.917150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:42.917662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:42.918102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:43.421298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:43.442407 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f0e034b5-8cf6-4b1a-b733-737ae01a7065 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1686 microversion: 2.1 time: 0.571221 Sep 07 10:25:43.443869 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3033/6130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:42 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1686 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:25:44.425007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6cdecd08-9342-4f23-af58-70ae8e2679ea req-0c939466-fe71-450e-b0fc-ca33f42f8743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86dce66-693d-4b12-8eff-a2d4686d35b4", "name": "network-vif-deleted", "tag": "006612ed-3b49-43d0-861a-f4fb5759ccae"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:44.443458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6cdecd08-9342-4f23-af58-70ae8e2679ea req-0c939466-fe71-450e-b0fc-ca33f42f8743 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:44.451481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6cdecd08-9342-4f23-af58-70ae8e2679ea req-0c939466-fe71-450e-b0fc-ca33f42f8743 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:44.452065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6cdecd08-9342-4f23-af58-70ae8e2679ea req-0c939466-fe71-450e-b0fc-ca33f42f8743 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:44.477507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:44.478136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:44.478418 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6cdecd08-9342-4f23-af58-70ae8e2679ea req-0c939466-fe71-450e-b0fc-ca33f42f8743 service nova] Creating event network-vif-deleted:006612ed-3b49-43d0-861a-f4fb5759ccae for instance d86dce66-693d-4b12-8eff-a2d4686d35b4 on n-h1-836830-16 Sep 07 10:25:44.485289 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6cdecd08-9342-4f23-af58-70ae8e2679ea req-0c939466-fe71-450e-b0fc-ca33f42f8743 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063705 Sep 07 10:25:44.487203 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3098/6131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:44.509912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:44.510425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:44.510872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:44.511705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:44.512171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:44.512601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:44.629746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:25:44.643774 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d75cdd1-ac58-43b8-9b68-7ccd0dcac633 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 200 len: 1351 microversion: 2.1 time: 0.169775 Sep 07 10:25:44.645266 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3034/6132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:44 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 1351 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:25:45.669162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:45.669885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: d86dce66-693d-4b12-8eff-a2d4686d35b4] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:25:45.684790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:45.686859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:45.687253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:45.688976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:45.689724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:45.695729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:45.719810 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] HTTP exception thrown: Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 could not be found. Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Request method failure captured: Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 HTTP/1.1 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHElr-jtfg9tkZJQQRdOTu1MqVoIYXmKHjhqLwL9kI-prM3QLbxBlJDpY07lu25jnAnxlL7eUMv7rphaYeyr1U2lFwkv-rUdcDMU5kFU3xxRawRDh1cYbYdp51k9s29J_0UlWMe85FQHR6PrKI9fw00G1HM7mtzRIBdjePXMYHSDqZA Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_050638dd54d14d079b14d398e5ef9210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 821845320a8347e69590343607357785 Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 could not be found. Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'd86dce66-693d-4b12-8eff-a2d4686d35b4'} Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 could not be found. Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 could not be found. Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:25:45.722598 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 could not be found. Sep 07 10:25:45.727367 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:25:45.729334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Returning 404 to user: Instance d86dce66-693d-4b12-8eff-a2d4686d35b4 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:25:45.730404 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1dadaf3b-5568-4fd9-9ddf-3a1a47bb7fc0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4" status: 404 len: 111 microversion: 2.1 time: 0.067530 Sep 07 10:25:45.731153 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3099/6133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:25:45 2022] GET /compute/v2.1/servers/d86dce66-693d-4b12-8eff-a2d4686d35b4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:25:54.710756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-035417a8-59d8-4133-986e-be80ca94cdd5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '.version_select at 0x7f14b1de7a60>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:54.737143 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [None req-035417a8-59d8-4133-986e-be80ca94cdd5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [9c25c8ee-494d-4c83-b69c-d6d37d7ab592] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 10:25:54.746171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:54.746989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:55.749398 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [None req-035417a8-59d8-4133-986e-be80ca94cdd5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [9c25c8ee-494d-4c83-b69c-d6d37d7ab592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52506. Sep 07 10:25:55.814937 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-035417a8-59d8-4133-986e-be80ca94cdd5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-590044544" status: 202 len: 0 microversion: 2.1 time: 1.116082 Sep 07 10:25:55.817406 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3035/6134] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 10:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-590044544 => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:25:55.874046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82ee22f0-27c8-478d-9499-66f8dde36bc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: .version_select at 0x7f14b1367040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1771878040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpOQ53IZHUreJw7FUD8Qg/VblNNlpcPXre+QSqWUF07rpRtm+/OkYNemNw1Cm0SeyF8XXXAhMcP5nwVyc7bhLiLaLew7zK0C6Ldne5t1qbB4pcl0lO3NYNstQmiuzoWow=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:55.888129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=27 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:55.906558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=71 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:25:55.934652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-82ee22f0-27c8-478d-9499-66f8dde36bc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:25:55.950287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-82ee22f0-27c8-478d-9499-66f8dde36bc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:25:56.033415 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82ee22f0-27c8-478d-9499-66f8dde36bc4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.175124 Sep 07 10:25:56.064377 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3100/6135] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:25:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:57.853544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f14dcbd-e42b-4601-8d06-cecd489b4d39 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-533369735", "availability_zone": "foo_zone"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:57.890719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.aggregate [None req-2f14dcbd-e42b-4601-8d06-cecd489b4d39 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Generated uuid db8c79bb-803d-4f87-aaae-7229e26a33a0 for aggregate {{(pid=128833) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 10:25:57.978301 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f14dcbd-e42b-4601-8d06-cecd489b4d39 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.471047 Sep 07 10:25:57.989867 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3036/6136] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 7 10:25:57 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.005255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0e51b4e6-57ba-4f95-a605-3293e7abe3cf tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:58.050501 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0e51b4e6-57ba-4f95-a605-3293e7abe3cf tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.053611 Sep 07 10:25:58.065518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:58.069702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:58.073174 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3101/6137] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 10:25:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.073818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:58.076017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:58.078589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:58.079376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:58.082575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:58.127381 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5c6bf9b-23ae-4b1e-9c56-0854dcc810b1 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.066736 Sep 07 10:25:58.128028 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3037/6138] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 7 10:25:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.140483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eeec40e1-37c6-4d32-aceb-8c984a52c484 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:58.157391 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eeec40e1-37c6-4d32-aceb-8c984a52c484 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.020874 Sep 07 10:25:58.165492 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3102/6139] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 7 10:25:58 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.176034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b49c3570-ee0b-4e9e-a021-ec03076b158d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-16"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:58.195287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b49c3570-ee0b-4e9e-a021-ec03076b158d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:58.195885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b49c3570-ee0b-4e9e-a021-ec03076b158d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:58.196506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b49c3570-ee0b-4e9e-a021-ec03076b158d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:58.459411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b49c3570-ee0b-4e9e-a021-ec03076b158d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.291295 Sep 07 10:25:58.460773 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3038/6140] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 10:25:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.474892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4d4cc4f3-12b1-4ea0-8b51-d8559c876a6d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:58.490584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4d4cc4f3-12b1-4ea0-8b51-d8559c876a6d tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.022242 Sep 07 10:25:58.497495 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3103/6141] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:25:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.509155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-754dfc8b-2cba-4dfc-bcc2-edc3a689c708 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2127603097", "availability_zone": "foo_zone"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:58.610316 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-754dfc8b-2cba-4dfc-bcc2-edc3a689c708 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.104839 Sep 07 10:25:58.611576 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3039/6142] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 7 10:25:58 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:25:58.631182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-449f35b3-ea53-4278-b4ea-fb0ecdfbd9df tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:58.688667 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-449f35b3-ea53-4278-b4ea-fb0ecdfbd9df tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.063508 Sep 07 10:25:58.698212 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3104/6143] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 10:25:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.707285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e38a702-1533-4878-984c-54bd139e0ba4 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:58.737086 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e38a702-1533-4878-984c-54bd139e0ba4 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.036068 Sep 07 10:25:58.748606 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3040/6144] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 7 10:25:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:25:58.755939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad87f10b-ce58-41ac-b32e-fc8f1cdf869b tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-16"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:25:58.786070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad87f10b-ce58-41ac-b32e-fc8f1cdf869b tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:25:58.786579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad87f10b-ce58-41ac-b32e-fc8f1cdf869b tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:25:58.787036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad87f10b-ce58-41ac-b32e-fc8f1cdf869b tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:25:59.322223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad87f10b-ce58-41ac-b32e-fc8f1cdf869b tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.572193 Sep 07 10:25:59.331429 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3105/6145] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 7 10:25:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:25:59.356504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ede64eb-d894-43e2-a4b1-395400b858a8 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:25:59.443974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ede64eb-d894-43e2-a4b1-395400b858a8 tempest-TestAggregatesBasicOps-1372392816 tempest-TestAggregatesBasicOps-1372392816-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.099179 Sep 07 10:25:59.448083 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3041/6146] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 7 10:25:59 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 07 10:26:09.488640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1095081168", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "c9f22ffa-05eb-4d79-b05a-8ce483335a5d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1771878040", "security_groups": [{"name": "tempest-secgroup-smoke-879168825"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:09.524982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:09.531704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:09.531816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:09.825880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] validate_networks() for [('c9f22ffa-05eb-4d79-b05a-8ce483335a5d', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:26:11.178653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:26:11.179229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:26:11.179575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:26:11.180001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:26:11.180431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:26:11.191513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:11.192029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:11.199151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:11.200025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:11.201892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:11.205678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:11.265847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:26:11.274458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:26:11.296568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:26:11.301222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:26:11.396818 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5868164b-95bb-40ec-9b36-79857ad0e803 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.912896 Sep 07 10:26:11.398529 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3106/6147] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:26:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:26:11.410998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d375f8e-39a1-4bcc-8573-6e85dfca72ad tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:11.412303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d375f8e-39a1-4bcc-8573-6e85dfca72ad tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:11.415276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:11.435676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:11.436713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:11.574466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7d375f8e-39a1-4bcc-8573-6e85dfca72ad tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:11.584582 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d375f8e-39a1-4bcc-8573-6e85dfca72ad tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1267 microversion: 2.1 time: 0.178670 Sep 07 10:26:11.585995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3042/6148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:11 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:12.611891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:12.612699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:12.631463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:12.640172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:12.642898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:12.643880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:12.645737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:12.647643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:12.769452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:12.781149 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8614e317-d9ad-42b6-b4d0-2e168a93918a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1263 microversion: 2.1 time: 0.173084 Sep 07 10:26:12.784420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3107/6149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:12 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:13.813415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:13.816927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:13.829825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:13.830602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:13.831049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:13.831775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:13.832237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:13.832666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:13.948510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:13.959327 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-715b30ec-30c8-4ede-8132-8383eab41dbb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1325 microversion: 2.1 time: 0.149168 Sep 07 10:26:13.960600 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3043/6150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:13 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:14.985876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:14.986601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:14.999608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:15.000362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:15.000767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:15.002384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:15.002867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:15.003313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:15.378320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:15.389311 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d23dd566-f040-45e1-b3da-c9e8ad131bc3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.405709 Sep 07 10:26:15.402845 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3108/6151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:14 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:16.419969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:16.420540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:16.437845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:16.440158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:16.440841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:16.441853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:16.445605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:16.446295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:16.826396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:16.845366 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6582fb50-106a-4fc4-8df0-f728ecc01e73 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.429273 Sep 07 10:26:16.848744 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3044/6152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:16 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:17.038164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ecca8b74-45ac-4aea-8782-5e415c615c83 req-a02e9202-0682-4c0a-84c9-30569688f3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:17.064051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ecca8b74-45ac-4aea-8782-5e415c615c83 req-a02e9202-0682-4c0a-84c9-30569688f3be service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:17.064956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ecca8b74-45ac-4aea-8782-5e415c615c83 req-a02e9202-0682-4c0a-84c9-30569688f3be service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:17.065650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ecca8b74-45ac-4aea-8782-5e415c615c83 req-a02e9202-0682-4c0a-84c9-30569688f3be service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:17.090951 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ecca8b74-45ac-4aea-8782-5e415c615c83 req-a02e9202-0682-4c0a-84c9-30569688f3be service nova] Creating event network-changed:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:26:17.102651 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ecca8b74-45ac-4aea-8782-5e415c615c83 req-a02e9202-0682-4c0a-84c9-30569688f3be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.468399 Sep 07 10:26:17.105003 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3109/6153] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:26:17.873614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:17.874772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:17.886141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:17.890355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:17.890355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:17.890355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:17.890355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:17.890355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:18.107856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:18.119482 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96389dc8-8062-4fed-8a27-6ccca6f53e45 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.250838 Sep 07 10:26:18.135992 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3045/6154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:17 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:19.149819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:19.151803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:19.164515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:19.180523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:19.181438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:19.183653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:19.185946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:19.186466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:19.477561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:19.492798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebf58445-8ec0-496e-b9f8-4941653ca3ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.348138 Sep 07 10:26:19.506993 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3110/6155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:19 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:20.520089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:20.520831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:20.539441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:20.540610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:20.541448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:20.545315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:20.545891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:20.546448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:20.797681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:20.807551 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5fec326e-7bd9-4a5b-b874-ab8bbf4730bc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.292578 Sep 07 10:26:20.808718 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3046/6156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:20 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:21.830941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:21.831572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:21.834466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:21.841956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:21.864266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:21.864801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:21.865311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:21.866195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:21.866555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:21.867001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:22.367079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:22.378653 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2bfb8e4-74f7-4f76-93d0-5b34900d6c2f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.551782 Sep 07 10:26:22.405301 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3111/6157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:21 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:22.496967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4688576f-f156-4df0-82df-7be0966d0836 req-f1210d89-a3d8-48b5-bc1e-24e5e5b44257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "name": "network-vif-plugged", "status": "completed", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:22.509486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:22.525162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4688576f-f156-4df0-82df-7be0966d0836 req-f1210d89-a3d8-48b5-bc1e-24e5e5b44257 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:22.528242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4688576f-f156-4df0-82df-7be0966d0836 req-f1210d89-a3d8-48b5-bc1e-24e5e5b44257 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:22.529403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4688576f-f156-4df0-82df-7be0966d0836 req-f1210d89-a3d8-48b5-bc1e-24e5e5b44257 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:22.550505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4688576f-f156-4df0-82df-7be0966d0836 req-f1210d89-a3d8-48b5-bc1e-24e5e5b44257 service nova] Creating event network-vif-plugged:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:26:22.589885 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4688576f-f156-4df0-82df-7be0966d0836 req-f1210d89-a3d8-48b5-bc1e-24e5e5b44257 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093997 Sep 07 10:26:22.591236 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3047/6158] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:26:23.406443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:23.407636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:23.424161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:23.425790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:23.426862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:23.428011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:23.428872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:23.429597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:24.052444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:24.067394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a5a17222-9696-4684-9640-7c9b560eb6c8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1392 microversion: 2.1 time: 0.663761 Sep 07 10:26:24.086802 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3112/6159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:23 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1392 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:25.108899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:25.109830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:25.120609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:25.121127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:25.121606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:25.125647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:25.125647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:25.125647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:25.375491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:25.391004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c75bdba3-8be3-41a7-8954-21a378d990b7 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1565 microversion: 2.1 time: 0.295805 Sep 07 10:26:25.392432 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3048/6160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:25 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1565 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:25.419864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:25.437501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:25.592459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:25.607203 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5dc19b3-0af6-415b-a205-a2b8012c50c5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1565 microversion: 2.1 time: 0.191127 Sep 07 10:26:25.627038 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3113/6161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:25 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1565 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:28.487435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8acd2411-e922-4597-92f0-18e12e08cfe7 req-bec84762-3747-4316-9d0e-985d11e84221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:28.489735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:28.490794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:28.530777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:28.531529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:28.532735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:28.533942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:28.534431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:28.534863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:28.537696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8acd2411-e922-4597-92f0-18e12e08cfe7 req-bec84762-3747-4316-9d0e-985d11e84221 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:28.538273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8acd2411-e922-4597-92f0-18e12e08cfe7 req-bec84762-3747-4316-9d0e-985d11e84221 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:28.538724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8acd2411-e922-4597-92f0-18e12e08cfe7 req-bec84762-3747-4316-9d0e-985d11e84221 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:28.585729 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8acd2411-e922-4597-92f0-18e12e08cfe7 req-bec84762-3747-4316-9d0e-985d11e84221 service nova] Creating event network-changed:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:26:28.597745 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8acd2411-e922-4597-92f0-18e12e08cfe7 req-bec84762-3747-4316-9d0e-985d11e84221 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114593 Sep 07 10:26:28.601532 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3114/6162] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:26:29.059963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:29.079358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ee84ba05-6eed-4ff2-aaf0-190e5747a55b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1565 microversion: 2.1 time: 0.599981 Sep 07 10:26:29.082897 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3049/6163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:28 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1565 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:38.617880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:38.619317 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=42 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:38.777500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-386884468", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "4a1c2e04-a2f2-4386-8551-96708f2223a0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:38.869217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] validate_networks() for [('4a1c2e04-a2f2-4386-8551-96708f2223a0', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:26:39.396410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:26:39.397296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:26:39.398022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:26:39.398465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:26:39.398935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:26:39.420314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:39.420963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:39.421560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:39.422722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:39.423435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:39.424092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:39.446865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Getting quotas for project 6e7cdbc8a1e54cad9dbfd838859395ab. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:26:39.454564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Getting quotas for user 258b646303244fe19e6a8ec1153604fb and project 6e7cdbc8a1e54cad9dbfd838859395ab. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:26:39.472141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:26:39.475686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:26:39.542077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c48ff436-c622-47bf-aaa1-b4b929c805d4 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929717 Sep 07 10:26:39.543153 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3115/6164] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:26:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:26:39.564115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6b4b1f4e-1dd4-4f41-a285-02cbc82024b9 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:39.564634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6b4b1f4e-1dd4-4f41-a285-02cbc82024b9 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:39.595349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=18 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:39.596422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=38 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:39.697926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6b4b1f4e-1dd4-4f41-a285-02cbc82024b9 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:39.712976 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6b4b1f4e-1dd4-4f41-a285-02cbc82024b9 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1214 microversion: 2.1 time: 0.157043 Sep 07 10:26:39.719814 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3050/6165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:39 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:40.739455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:40.740807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:40.765059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:40.767521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:40.769875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:40.770863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:40.772178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:40.772998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:40.913523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:40.923775 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e69bea25-d367-4bf6-b7a6-8bb4ca85deab tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1266 microversion: 2.1 time: 0.190072 Sep 07 10:26:40.924394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3116/6166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:40 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:41.957524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:41.958159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:41.977955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:41.978477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:41.978914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:41.980776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:41.981254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:41.983206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:42.085905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:42.095371 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c2f14f6-9b79-4b11-baab-7c390a891925 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1272 microversion: 2.1 time: 0.142089 Sep 07 10:26:42.096536 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3051/6167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:41 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:43.034077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1deffdaf-ca0d-48f5-8c08-819a3f2bd9d3 req-ac7f4947-17be-4b8a-a95a-adcd7ff40a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9eab84-44c7-468c-b8b4-53b1b228c76b", "tag": "f14916b7-8af0-49ff-b28f-94a9700944f8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:43.053166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1deffdaf-ca0d-48f5-8c08-819a3f2bd9d3 req-ac7f4947-17be-4b8a-a95a-adcd7ff40a67 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:43.053707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1deffdaf-ca0d-48f5-8c08-819a3f2bd9d3 req-ac7f4947-17be-4b8a-a95a-adcd7ff40a67 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:43.054166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1deffdaf-ca0d-48f5-8c08-819a3f2bd9d3 req-ac7f4947-17be-4b8a-a95a-adcd7ff40a67 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:43.066879 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1deffdaf-ca0d-48f5-8c08-819a3f2bd9d3 req-ac7f4947-17be-4b8a-a95a-adcd7ff40a67 service nova] Creating event network-changed:f14916b7-8af0-49ff-b28f-94a9700944f8 for instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b on n-h2-836830-16 Sep 07 10:26:43.078280 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1deffdaf-ca0d-48f5-8c08-819a3f2bd9d3 req-ac7f4947-17be-4b8a-a95a-adcd7ff40a67 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050826 Sep 07 10:26:43.078969 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3117/6168] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:26:43.147131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:43.148671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:43.157489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:43.158017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:43.158461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:43.159179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:43.159642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:43.160072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:43.351782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:43.360463 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20784041-45e2-4ad8-bbf9-5650dd1db2fa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1314 microversion: 2.1 time: 0.236971 Sep 07 10:26:43.361412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3052/6169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:43 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:44.386594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:44.388063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:44.395586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:44.396476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:44.396929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:44.397849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:44.398419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:44.398867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:44.561785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:44.573507 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a24479c-ae82-4d45-ad78-785d66e8bb9a tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1314 microversion: 2.1 time: 0.193410 Sep 07 10:26:44.574126 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3118/6170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:44 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:45.597906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:45.598499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:45.605422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:45.605914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:45.606352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:45.607090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:45.607839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:45.608541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:45.780997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:45.791186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-26d54658-93e7-443e-a767-0c852fd730e0 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1314 microversion: 2.1 time: 0.197322 Sep 07 10:26:45.791899 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3053/6171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:45 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:46.818980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:46.819565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:46.827056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:46.827564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:46.828030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:46.829557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:46.830086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:46.830791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:46.995108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:47.009952 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-654b21e4-28bd-411c-8ce5-0b696ac87742 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1314 microversion: 2.1 time: 0.194926 Sep 07 10:26:47.010542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3119/6172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:46 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:48.034895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:48.036160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:48.045390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:48.046115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:48.046558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:48.047717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:48.048182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:48.048608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:48.214847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:48.223798 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a36b2995-18b0-46f5-9478-07aebf135d52 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1314 microversion: 2.1 time: 0.193872 Sep 07 10:26:48.226088 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3054/6173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:48 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:48.451062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c571fc7a-82c0-4352-af33-4bc161583283 req-5cfc25ad-7f40-4637-b569-1bfce922a274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9eab84-44c7-468c-b8b4-53b1b228c76b", "name": "network-vif-plugged", "status": "completed", "tag": "f14916b7-8af0-49ff-b28f-94a9700944f8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:48.478795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c571fc7a-82c0-4352-af33-4bc161583283 req-5cfc25ad-7f40-4637-b569-1bfce922a274 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:48.479293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c571fc7a-82c0-4352-af33-4bc161583283 req-5cfc25ad-7f40-4637-b569-1bfce922a274 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:48.479748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c571fc7a-82c0-4352-af33-4bc161583283 req-5cfc25ad-7f40-4637-b569-1bfce922a274 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:48.545638 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c571fc7a-82c0-4352-af33-4bc161583283 req-5cfc25ad-7f40-4637-b569-1bfce922a274 service nova] Creating event network-vif-plugged:f14916b7-8af0-49ff-b28f-94a9700944f8 for instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b on n-h2-836830-16 Sep 07 10:26:48.551780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c571fc7a-82c0-4352-af33-4bc161583283 req-5cfc25ad-7f40-4637-b569-1bfce922a274 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104940 Sep 07 10:26:48.552950 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3120/6174] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:26:49.248791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:49.249580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:49.266025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:49.266549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:49.267091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:49.267843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:49.268582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:49.269024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:49.427164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:49.435425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1172297a-aef3-4238-b99e-d9e2c8a77b73 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1314 microversion: 2.1 time: 0.190933 Sep 07 10:26:49.436188 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3055/6175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:49 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:50.462248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:50.463622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:50.465761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:50.467072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:50.475250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:50.475754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:50.476214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:50.476930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:50.477422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:50.477866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:50.639734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:50.648954 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9d0d5f29-cb32-46b1-87bf-9faea771244b tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1502 microversion: 2.1 time: 0.192104 Sep 07 10:26:50.649604 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3121/6176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:50 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:26:50.671819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:50.673785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:50.679362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:50.682340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:50.682755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:50.683190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:50.683918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:50.684371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:50.684795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:50.856808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:50.865843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5450a3b8-feb8-49e0-8ca4-e4461a6eebca tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1502 microversion: 2.1 time: 0.198020 Sep 07 10:26:50.866435 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3056/6177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:50 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:50.888557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:50.889418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:50.896636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:50.897383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:50.897838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:50.898722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:50.899199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:50.899737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:50.924508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lazy-loading 'flavor' on Instance uuid 0d9eab84-44c7-468c-b8b4-53b1b228c76b {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:26:51.002285 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-20bfcd1e-41cc-42cb-847c-2a8de97117bd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action" status: 202 len: 0 microversion: 2.1 time: 0.117496 Sep 07 10:26:51.003381 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3122/6178] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:26:50 2022] POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:26:51.011108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:51.011941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:51.018480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:51.019392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:51.020162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:51.021094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:51.022954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:51.023558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:51.199272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:51.208289 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd604445-8c00-4d27-acbf-a5d77b6615aa tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1510 microversion: 2.1 time: 0.200900 Sep 07 10:26:51.209441 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3057/6179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:51 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:51.695123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:51.697574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:51.706188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:51.706700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:51.707159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:51.708041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:51.708527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:51.708975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:51.782643 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bccaba45-7963-440b-b7f6-1a0bb73141aa tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action" status: 200 len: 24571 microversion: 2.1 time: 0.091698 Sep 07 10:26:51.783347 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3123/6180] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:26:51 2022] POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action => generated 24571 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:26:52.231895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:52.232626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:52.240894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:52.241419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:52.242126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:52.242980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:52.243531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:52.243965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:52.393342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:52.405544 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-24d318d8-8cb2-4519-8f23-fc59e47211ef tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1493 microversion: 2.1 time: 0.177417 Sep 07 10:26:52.412632 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3058/6181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:52 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:52.429432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:52.430147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:52.437365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:52.438221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:52.438941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:52.439854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:52.440499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:52.441134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:52.540867 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13290846-b2c7-4946-944e-adf9958d15c2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action" status: 202 len: 0 microversion: 2.1 time: 0.115493 Sep 07 10:26:52.542022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3124/6182] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:26:52 2022] POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:26:52.551556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:52.552621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:52.560173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:52.560914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:52.561515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:52.563224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:52.568606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:52.569582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:52.829404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:52.842121 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e2b35abb-5c66-43b4-b7ea-47abb481f5cd tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1499 microversion: 2.1 time: 0.295563 Sep 07 10:26:52.843696 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3059/6183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:52 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1499 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:53.876067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:53.877586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:53.884665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:53.885641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:53.886340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:53.887295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:53.887989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:53.888652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:54.100360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:54.117700 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5234aa51-3958-410a-af4b-7deb1b836781 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1499 microversion: 2.1 time: 0.247353 Sep 07 10:26:54.118537 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3125/6184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:53 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1499 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:55.141495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:55.142203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:55.149629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:55.150284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:55.150836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:55.151654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:55.152238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:55.152781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:55.312151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:55.323104 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3688ac33-70b1-4cd5-af8a-76d1ae97068c tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1502 microversion: 2.1 time: 0.186329 Sep 07 10:26:55.323710 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3060/6185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:55 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:55.346942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:55.347797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:55.355314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:55.355948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:55.356499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:55.357487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:55.358060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:55.358620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:55.386228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lazy-loading 'flavor' on Instance uuid 0d9eab84-44c7-468c-b8b4-53b1b228c76b {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:26:55.471007 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-371749be-1411-4874-8d28-7a17f2952a61 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action" status: 202 len: 0 microversion: 2.1 time: 0.128313 Sep 07 10:26:55.471964 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3126/6186] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:26:55 2022] POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:26:55.480169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:55.481057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:55.487675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:55.488509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:55.488725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:55.489649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:55.490355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:55.490947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:55.634807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:55.644053 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-629b8475-f971-475c-a7bc-a35c9e77a6b1 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1510 microversion: 2.1 time: 0.167918 Sep 07 10:26:55.644861 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3061/6187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:55 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:56.669276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:56.670036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:56.677171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:56.677782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:56.678307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:56.679089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:56.679655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:56.680193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:56.820993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:56.828878 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d26d624-27cb-450e-aa59-e27dbd30a898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1493 microversion: 2.1 time: 0.164790 Sep 07 10:26:56.829494 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3127/6188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:56 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1493 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:56.851808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:26:56.852488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:56.859890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:56.860977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:56.861497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:56.862209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:56.862673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:56.863106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:56.931528 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-82349d90-5a57-4913-a157-1d611a87f0d2 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action" status: 202 len: 0 microversion: 2.1 time: 0.083605 Sep 07 10:26:56.935047 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3062/6189] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:26:56 2022] POST /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:26:56.944072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:56.945328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:56.956273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:56.956717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:56.957427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:56.958328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:56.958803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:56.959272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:57.108829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:57.118483 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84868584-05b2-4458-bc14-8ca1823bf097 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1499 microversion: 2.1 time: 0.180624 Sep 07 10:26:57.129240 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3128/6190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:56 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:58.144443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:58.145353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:58.152348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:58.152844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:58.153920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:58.154847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:58.155003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:58.155613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:58.317481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:58.326311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cf701901-4349-4852-81f7-8671372b30a8 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1499 microversion: 2.1 time: 0.188019 Sep 07 10:26:58.327027 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3063/6191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:58 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1499 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:59.350223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:59.351574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:59.358972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:59.359561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:59.360048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:59.360750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:59.361378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:59.361831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:59.381416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:59.500619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:59.508812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8dc5440e-039a-4975-b2a0-f15fc6376898 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1502 microversion: 2.1 time: 0.162645 Sep 07 10:26:59.509797 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3129/6192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:59 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:26:59.531944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:59.532454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:59.543210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:59.544076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:59.544616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:59.545361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:59.545830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:59.546266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:59.574966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:26:59.627034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:26:59.657841 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fee91a64-435b-48dd-80a4-30f0a367fc4f tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 204 len: 0 microversion: 2.1 time: 0.129409 Sep 07 10:26:59.658420 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3064/6193] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:26:59 2022] DELETE /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:26:59.666699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:26:59.667332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:26:59.674454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:59.674963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:59.675422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:59.676136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:26:59.676641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:26:59.677085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:26:59.822829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:26:59.832525 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-857a1fc0-5751-43a5-94f0-37540c96536e tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1508 microversion: 2.1 time: 0.169593 Sep 07 10:26:59.833607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3130/6194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:26:59 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:00.856655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:00.857776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:00.865042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:00.865574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:00.866020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:00.866724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:00.867187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:00.867768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:01.001015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:01.008948 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69444e36-e2ab-4d31-ba6a-df4eb327d445 tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1508 microversion: 2.1 time: 0.156674 Sep 07 10:27:01.009561 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3065/6195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:00 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:02.032434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:02.034378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:02.050436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:02.051285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:02.051996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:02.052959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:02.053712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:02.054393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:02.142938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258b646303244fe19e6a8ec1153604fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7cdbc8a1e54cad9dbfd838859395ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:02.153900 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-84f3c772-11d7-4e0e-8e71-01f45a6918ac tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 200 len: 1466 microversion: 2.1 time: 0.125564 Sep 07 10:27:02.172750 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3131/6196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:02 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:02.389310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cf861936-316b-4b15-9fdf-7e5aff5248ab req-498490e8-f70d-44b5-8515-872a4bfc764f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9eab84-44c7-468c-b8b4-53b1b228c76b", "name": "network-vif-deleted", "tag": "f14916b7-8af0-49ff-b28f-94a9700944f8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:02.422347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf861936-316b-4b15-9fdf-7e5aff5248ab req-498490e8-f70d-44b5-8515-872a4bfc764f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:02.423054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf861936-316b-4b15-9fdf-7e5aff5248ab req-498490e8-f70d-44b5-8515-872a4bfc764f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:02.423657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cf861936-316b-4b15-9fdf-7e5aff5248ab req-498490e8-f70d-44b5-8515-872a4bfc764f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:02.445835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cf861936-316b-4b15-9fdf-7e5aff5248ab req-498490e8-f70d-44b5-8515-872a4bfc764f service nova] Creating event network-vif-deleted:f14916b7-8af0-49ff-b28f-94a9700944f8 for instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b on n-h2-836830-16 Sep 07 10:27:02.458206 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cf861936-316b-4b15-9fdf-7e5aff5248ab req-498490e8-f70d-44b5-8515-872a4bfc764f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072228 Sep 07 10:27:02.458917 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3066/6197] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:02.818885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:02.819636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:02.826715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:02.827171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:02.827765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:02.829677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:02.830209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:02.830915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:02.998429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-16e4dabc-11bb-46a1-ba57-47562e91174e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1836 microversion: 2.1 time: 0.183213 Sep 07 10:27:02.999289 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3132/6198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:02 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1836 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:03.027406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:03.028351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:03.035859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.036606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.037580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.038453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.039115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.039753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.185610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:03.186540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] [instance: 0d9eab84-44c7-468c-b8b4-53b1b228c76b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:03.199195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.201568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.202326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.203396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.204124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.204739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.209018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:03.222310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9804823f-7b5e-4a9e-86f5-f44fd4a90f4e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1683 microversion: 2.1 time: 0.195082 Sep 07 10:27:03.223120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3067/6199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:03 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:03.228939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] HTTP exception thrown: Instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b could not be found. Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Request method failure captured: Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b HTTP/1.1 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHHc1Bu2GPGrbbUcE_xdtt3xsfOv43nf4VZtqR5Y62bWpYHrVE3j69EnYxbhD0IeazXRpWS3qpKtY3e3B37N3sLvvyWmuC3cJomUDdnSCn0AgrXhHNIQUmalY6amvyqAEHlNt-uk6UsMBRibcZTtjCmbUqf7TCLVrbZNWbZr2dd1YSs Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 6e7cdbc8a1e54cad9dbfd838859395ab Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestServerAdvancedOps-229154386 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e7cdbc8a1e54cad9dbfd838859395ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e7cdbc8a1e54cad9dbfd838859395ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e7cdbc8a1e54cad9dbfd838859395ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e7cdbc8a1e54cad9dbfd838859395ab", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestServerAdvancedOps-229154386 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 6e7cdbc8a1e54cad9dbfd838859395ab Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestServerAdvancedOps-229154386 Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestServerAdvancedOps-229154386-project Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 258b646303244fe19e6a8ec1153604fb Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestServerAdvancedOps-229154386-project Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b could not be found. Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '0d9eab84-44c7-468c-b8b4-53b1b228c76b'} Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b could not be found. Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b could not be found. Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:03.230757 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b could not be found. Sep 07 10:27:03.236296 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:27:03.237707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] Returning 404 to user: Instance 0d9eab84-44c7-468c-b8b4-53b1b228c76b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:27:03.238775 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be5f604c-7c0b-4750-acc9-29c01c318aee tempest-TestServerAdvancedOps-229154386 tempest-TestServerAdvancedOps-229154386-project] 10.222.0.60 "GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b" status: 404 len: 111 microversion: 2.1 time: 0.060425 Sep 07 10:27:03.239845 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3133/6200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:03 2022] GET /compute/v2.1/servers/0d9eab84-44c7-468c-b8b4-53b1b228c76b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:27:03.358108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:03.362674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:03.370093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.370676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.371203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.372840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.372972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.373646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.472308 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-414b70fa-3402-4dea-b37b-35ec19396f08 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action" status: 200 len: 32643 microversion: 2.1 time: 0.121938 Sep 07 10:27:03.480164 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3068/6201] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:27:03 2022] POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action => generated 32643 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:27:03.643223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:03.643875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:03.654388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.654903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.655453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.656191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:03.657306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:03.657847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:03.725883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '133d7ae6f3cf44328884eb440c3a2d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f919730f06ae4904acc7f84b608ef32a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:03.726915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] flavor_id is None. Assuming migration. {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 10:27:03.727634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:27:03.970586 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96e8c2c4-f7ca-41cb-93e6-773a4c950bb2 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action" status: 202 len: 0 microversion: 2.1 time: 0.332912 Sep 07 10:27:03.974520 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3134/6202] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:27:03 2022] POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:27:03.989136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:03.989906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:04.005367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:04.005922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:04.006325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:04.007042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:04.007513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:04.008119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:04.306771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:04.317940 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e76cdff-e027-40c0-bfc7-c8bb3ea90586 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1692 microversion: 2.1 time: 0.338802 Sep 07 10:27:04.319098 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3069/6203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:03 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1692 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:05.346557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:05.347887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:05.365869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:05.366299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:05.366952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:05.368122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:05.368739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:05.369048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:05.673580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:05.688796 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d6dc5c31-b378-4c67-bbc0-a61a7a4b0e06 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1692 microversion: 2.1 time: 0.343274 Sep 07 10:27:05.691247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3135/6204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:05 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1692 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:06.506887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:06.508356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:06.517073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:06.518015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:06.518746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:06.519732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:06.520655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:06.521846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:06.720270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:06.724008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lazy-loading 'services' on Instance uuid 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:27:06.724448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:06.735694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:06.745889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:06.746668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:06.747629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:06.748311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:06.748983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:06.919456 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5f4caf3-5227-45ef-a6f9-28914e1535c5 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "DELETE /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3/os-volume_attachments/e0ac6e54-b9be-4e06-86a1-c2a9f2359319" status: 202 len: 0 microversion: 2.1 time: 0.419009 Sep 07 10:27:06.923651 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3070/6205] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:27:06 2022] DELETE /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3/os-volume_attachments/e0ac6e54-b9be-4e06-86a1-c2a9f2359319 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:27:07.040527 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:07.092247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ff76c3d-41a5-4f0a-a559-627a77932eb0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1692 microversion: 2.1 time: 0.368248 Sep 07 10:27:07.114386 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3136/6206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:06 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1692 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:08.132069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:08.133666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:08.151321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:08.153148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:08.154972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:08.157687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:08.159878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:08.160472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:08.496526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:08.510483 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5e71ac18-cb28-42e2-9f47-d793b6061fe3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.384244 Sep 07 10:27:08.511904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3071/6207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:08 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:09.540003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:09.540645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:09.546643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:09.552036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:09.553022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:09.553849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:09.554947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:09.555687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:09.556253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:10.225607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:10.234941 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e70b5db5-5b4b-45c9-a1a6-5222a02bd9fb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.699492 Sep 07 10:27:10.249375 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3137/6208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:09 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:11.259735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:11.260918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:11.276358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:11.277479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:11.278155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:11.278975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:11.279857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:11.281020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:11.281757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:11.679521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:11.697144 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dad23566-516f-4c87-99ea-6207662da21e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.436307 Sep 07 10:27:11.698936 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3072/6209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:11 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:12.730455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:12.731673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:12.796206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:12.797672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:12.799308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:12.801946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:12.802545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:12.803599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:13.099578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:13.111638 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f48aa9b-7924-46eb-87c8-bb1ca5f41172 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.390158 Sep 07 10:27:13.112527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3138/6210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:12 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:13.871481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:13.872565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:13.886285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:13.886783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:13.887223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:13.888500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:13.888500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:13.888793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:13.924426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:27:14.037498 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5012e6ed-2b7d-4eb1-bbc1-6eff8c5b3738 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "DELETE /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 204 len: 0 microversion: 2.1 time: 0.169848 Sep 07 10:27:14.038305 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3073/6211] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:27:13 2022] DELETE /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:27:14.046917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:14.048808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:14.056859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:14.057654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:14.058382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:14.059284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:14.060128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:14.060675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:14.137044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:14.137942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:14.155968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:14.156817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:14.158510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:14.161980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:14.162621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:14.163175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:14.337928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:14.353544 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1257fe54-ae8e-479c-8559-57f87b329e96 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1469 microversion: 2.1 time: 0.310391 Sep 07 10:27:14.355506 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3139/6212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:14 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:14.427899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:14.441099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-46a7ecc9-d83b-4f28-9ded-340921bf57b0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.308605 Sep 07 10:27:14.442268 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3074/6213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:14 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:15.381404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:15.382699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:15.391196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:15.391950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:15.392573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:15.393496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:15.394179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:15.394978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:15.474175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:15.478148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:15.509031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:15.511392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:15.512067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:15.512991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:15.516993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:15.518829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:15.762116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:15.774004 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b847e1c-54a5-46ec-9f5b-202fd5b4563b tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1469 microversion: 2.1 time: 0.398035 Sep 07 10:27:15.775592 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3140/6214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:15 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:15.814313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:15.827513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c9a6bd3-e201-44cc-9d2f-4dbe697b3c9c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.364013 Sep 07 10:27:15.830021 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3075/6215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:15 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:16.800634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:16.801876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:16.809992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:16.810736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:16.811357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:16.812840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:16.814027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:16.814686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:16.855393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:16.856079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:16.867670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:16.875943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:16.876663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:16.877670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:16.878375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:16.879191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:17.164566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e951e8fa463d87a9dc7e9da69403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbc78b722b744429fcdba973bc539c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:17.198676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b0a8247-a253-41bd-a430-02a773ecbab0 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 200 len: 1469 microversion: 2.1 time: 0.400388 Sep 07 10:27:17.199353 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3141/6216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:16 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:17.220476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:17.222517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1582feb1-b856-4bf4-ab77-7e4876d5a30f req-ac5b4d23-0311-41a3-8d9a-7fa5401c7043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589a7af1-5dc7-464d-84f4-b2e5a0f945f3", "name": "network-vif-deleted", "tag": "67bb1230-fb85-4597-8e56-989abf4c2ace"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:17.228513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05debaca-46b8-4491-bf37-1fe80cfdc99b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.378561 Sep 07 10:27:17.229106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3076/6217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:16 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:17.250277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1582feb1-b856-4bf4-ab77-7e4876d5a30f req-ac5b4d23-0311-41a3-8d9a-7fa5401c7043 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:17.251142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1582feb1-b856-4bf4-ab77-7e4876d5a30f req-ac5b4d23-0311-41a3-8d9a-7fa5401c7043 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:17.251614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1582feb1-b856-4bf4-ab77-7e4876d5a30f req-ac5b4d23-0311-41a3-8d9a-7fa5401c7043 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:17.279788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1582feb1-b856-4bf4-ab77-7e4876d5a30f req-ac5b4d23-0311-41a3-8d9a-7fa5401c7043 service nova] Creating event network-vif-deleted:67bb1230-fb85-4597-8e56-989abf4c2ace for instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 on n-h2-836830-16 Sep 07 10:27:17.287608 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1582feb1-b856-4bf4-ab77-7e4876d5a30f req-ac5b4d23-0311-41a3-8d9a-7fa5401c7043 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081799 Sep 07 10:27:17.288225 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3142/6218] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:18.230151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:18.230771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] [instance: 589a7af1-5dc7-464d-84f4-b2e5a0f945f3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:18.241907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:18.242707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:18.248666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:18.249767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:18.250448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:18.251108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:18.255719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:18.256448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:18.268599 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] HTTP exception thrown: Instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 could not be found. Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Request method failure captured: Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 HTTP/1.1 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHGQKyNQ_oMndl3LcMClD01YQe1JKtMCWQjHGlDIv5EQ13VMDyE6GyhBg_fSEsDP63U_n9c9XN59a5fhB_qToXjoyZW8LG-1GQyIZaVgkstxanT89ZnjmFXCepkBaLz4h3xMwLQMeoT1fYPKH8qffIZG-5VtONlhipIPKTMfg6oVy6A Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 4dbc78b722b744429fcdba973bc539c2 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-VolumesBackupsTest-1912197201 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dbc78b722b744429fcdba973bc539c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dbc78b722b744429fcdba973bc539c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dbc78b722b744429fcdba973bc539c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dbc78b722b744429fcdba973bc539c2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-VolumesBackupsTest-1912197201 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 4dbc78b722b744429fcdba973bc539c2 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-VolumesBackupsTest-1912197201 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-VolumesBackupsTest-1912197201-project Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 8731e951e8fa463d87a9dc7e9da69403 Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-VolumesBackupsTest-1912197201-project Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 could not be found. Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '589a7af1-5dc7-464d-84f4-b2e5a0f945f3'} Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 could not be found. Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 could not be found. Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:18.272546 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 could not be found. Sep 07 10:27:18.277836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:18.278401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:18.278401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:18.278401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:18.278401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:18.278783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:18.281157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:18.282520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] Returning 404 to user: Instance 589a7af1-5dc7-464d-84f4-b2e5a0f945f3 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:27:18.283603 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80ca5e22-4f7a-4d80-8c91-265838a3ed00 tempest-VolumesBackupsTest-1912197201 tempest-VolumesBackupsTest-1912197201-project] 10.222.0.60 "GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3" status: 404 len: 111 microversion: 2.1 time: 0.057555 Sep 07 10:27:18.303824 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3077/6219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:18 2022] GET /compute/v2.1/servers/589a7af1-5dc7-464d-84f4-b2e5a0f945f3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:27:19.011221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:19.025527 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf4099dc-ef5d-440b-b43e-7dc404496385 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.775114 Sep 07 10:27:19.045051 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3143/6220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:18 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:20.050242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:20.050981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:20.071285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:20.076868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:20.077498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:20.079107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:20.079757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:20.080235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:20.451085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:20.468456 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-548f8c49-c1a4-43e2-ad93-476cd1ba6b10 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.424181 Sep 07 10:27:20.469938 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3078/6221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:20 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:21.492896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:21.494465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:21.504891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:21.510166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:21.510274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:21.510941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:21.511595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:21.512227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:21.577006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:21.580226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:21.581286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:21.581995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:21.583656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:21.587091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:21.602568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:21.641844 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31b86e5e-ca8d-46cc-882c-0dd88a8e5995 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.278718 Sep 07 10:27:21.642864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3144/6222] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 7 10:27:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:21.831505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:21.840613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1867687073", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "availability_zone": "nova:n-h1-836830-16", "networks": [{"uuid": "621c6f04-4de6-40ad-b1bc-ae0c5f776dd9"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:21.864108 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c368bde5-b9c2-4862-a3c8-0304bce13edb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.375027 Sep 07 10:27:21.864890 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3079/6223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:21 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:21.954377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] validate_networks() for [('621c6f04-4de6-40ad-b1bc-ae0c5f776dd9', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:27:22.498286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:27:22.498917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:27:22.500600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:27:22.501239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:27:22.501858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:27:22.511760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:22.512267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:22.512724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:22.513753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:22.514187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:22.514635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:22.541670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Getting quotas for project 0efcf643e6c14af6870f59edb136214f. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:27:22.547374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Getting quotas for user 771e289e0852494b898069715b6e9d8a and project 0efcf643e6c14af6870f59edb136214f. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:27:22.561451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:27:22.564379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:27:22.624177 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ccd075da-f866-4478-8499-3a50ff31fef3 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787203 Sep 07 10:27:22.631273 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3145/6224] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:27:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:27:22.636312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4882701c-4992-48ca-8859-ee3ac952d2ee tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:22.637083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4882701c-4992-48ca-8859-ee3ac952d2ee tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:22.720357 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4882701c-4992-48ca-8859-ee3ac952d2ee tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1329 microversion: 2.1 time: 0.087656 Sep 07 10:27:22.741846 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3080/6225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:22 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:22.891422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:22.892585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:22.907070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:22.907715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:22.908251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:22.909794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:22.911413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:22.913884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:23.102391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:23.114640 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7141b480-5b1d-4c31-aa27-c707b9a3074f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.228147 Sep 07 10:27:23.135451 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3146/6226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:22 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:23.743874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:23.744741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:23.760061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:23.760555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:23.760992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:23.761722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:23.765452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:23.766010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:23.861487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:23.867344 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2bca679a-c61b-475c-b256-3a5d5d9dab21 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1346 microversion: 2.1 time: 0.127176 Sep 07 10:27:23.867933 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3081/6227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:23 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:24.138765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:24.139544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:24.159012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:24.160130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:24.161127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:24.162506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:24.163451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:24.166252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:24.177820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:24.472420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:24.484223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a9a46214-614b-49aa-be60-421bce334ce9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1697 microversion: 2.1 time: 0.349025 Sep 07 10:27:24.487913 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3147/6228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:24 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1697 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:24.895079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:24.895642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:24.912371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:24.912858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:24.926569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:24.931097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:24.931647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:24.932105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:25.052062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58141d26-1744-45ea-9502-3b6ba23a985a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1418 microversion: 2.1 time: 0.161976 Sep 07 10:27:25.052664 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3082/6229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:24 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1418 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:25.329776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "name": "network-vif-unplugged", "status": "completed", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:25.361228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:25.361733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:25.362188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:25.408906 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] Creating event network-vif-unplugged:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h2-836830-16 Sep 07 10:27:25.417339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] Instance 420813e4-33fc-4533-b12e-f5c9a39e12de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:27:25.461446 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c3767fe8-0a0f-4f24-8f7f-cd22c7092522 req-ab5a7f17-fa7b-401a-aa92-3e59923f4ec3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131093 Sep 07 10:27:25.462964 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3148/6230] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:25.532253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:25.533148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:25.552267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:25.552984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:25.553632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:25.554793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:25.556579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:25.557230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:25.988009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:26.003755 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a5378529-54b3-4f66-a57f-09813d66c8b1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1696 microversion: 2.1 time: 0.490500 Sep 07 10:27:26.004619 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3083/6231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:25 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1696 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:26.079665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:26.086623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:26.096023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:26.096943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:26.098351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:26.099372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:26.100099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:26.100755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:26.265609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b039c86-eed8-4c40-838e-c0d800d323e1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1424 microversion: 2.1 time: 0.193791 Sep 07 10:27:26.266795 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3149/6232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:26 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1424 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:27.036046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:27.037282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:27.048305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:27.052214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:27.053708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:27.055987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:27.056649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:27.058707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:27.289501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:27.290203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:27.306157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:27.307427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:27.308667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:27.311198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:27.312269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:27.312732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:27.924061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:27.941323 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85b81c51-a773-4be7-9d2c-3dadfee3b7fc tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1696 microversion: 2.1 time: 0.904643 Sep 07 10:27:27.957061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3084/6233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:27 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1696 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:27.963352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:27.976355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:27.977117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:27.977609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:27.991123 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] Creating event network-changed:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h2-836830-16 Sep 07 10:27:27.997442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] Instance 420813e4-33fc-4533-b12e-f5c9a39e12de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:27:28.016442 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8540106a-33fa-4628-966f-44ac863ad57d req-52d07ae0-e116-4a27-9a8b-b2e8d3eb86ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056857 Sep 07 10:27:28.017460 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3085/6234] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:28.071602 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-15cdfd56-15b9-4201-8057-25523c26f7da tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.785990 Sep 07 10:27:28.072518 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3150/6235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:27 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:28.609276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-65ef1d32-edc3-4431-9690-67adb367b7c8 req-397d18f6-8a79-4a53-9ea0-20b39cd9e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c93d18-9ebf-4787-aba1-0f596207c2c8", "tag": "d4276183-2a74-4111-acb3-385e1506b31f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:28.630418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-65ef1d32-edc3-4431-9690-67adb367b7c8 req-397d18f6-8a79-4a53-9ea0-20b39cd9e1fb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:28.632011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-65ef1d32-edc3-4431-9690-67adb367b7c8 req-397d18f6-8a79-4a53-9ea0-20b39cd9e1fb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:28.633038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-65ef1d32-edc3-4431-9690-67adb367b7c8 req-397d18f6-8a79-4a53-9ea0-20b39cd9e1fb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:28.663899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-65ef1d32-edc3-4431-9690-67adb367b7c8 req-397d18f6-8a79-4a53-9ea0-20b39cd9e1fb service nova] Creating event network-changed:d4276183-2a74-4111-acb3-385e1506b31f for instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 on n-h1-836830-16 Sep 07 10:27:28.674186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-65ef1d32-edc3-4431-9690-67adb367b7c8 req-397d18f6-8a79-4a53-9ea0-20b39cd9e1fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071746 Sep 07 10:27:28.679270 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3086/6236] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:28.965949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:28.967358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:28.978058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:28.998008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:28.999180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:29.005665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:29.006425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:29.008323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:29.101890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:29.103708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:29.113494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:29.114727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:29.115348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:29.116222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:29.116988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:29.117702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:29.429986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:29.444975 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-90d7027b-d027-4d0d-a9f4-c6da776829a0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1694 microversion: 2.1 time: 0.482913 Sep 07 10:27:29.446778 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3151/6237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:28 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1694 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:29.549670 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-caf1f9b0-32c7-4153-8bb4-149e0804e8a0 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.458230 Sep 07 10:27:29.550741 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3087/6238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:29 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:30.472832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:30.473808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:30.485814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:30.486260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:30.486932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:30.487855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:30.488517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:30.490000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:30.574169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:30.575312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:30.605992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:30.606909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:30.607544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:30.609140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:30.612259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:30.612892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:30.846371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:30.862998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71a0ec3a-28e6-46f1-b6e8-57c3e60b18e6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1691 microversion: 2.1 time: 0.391593 Sep 07 10:27:30.864695 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3152/6239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:30 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1691 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:30.894682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:30.895461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:30.906113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:30.910504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:30.912094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:30.914726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:30.916166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:30.917498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:30.965795 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8b3bbc4f-8515-4b55-9583-fbf8132e0ef1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.396314 Sep 07 10:27:30.981283 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3088/6240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:30 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:31.112042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89ac8717-ddd1-438c-a681-f91cc4210005 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action" status: 202 len: 0 microversion: 2.1 time: 0.223808 Sep 07 10:27:31.117937 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3153/6241] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:27:30 2022] POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:27:31.122261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:31.123543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:31.131875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:31.132377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:31.133326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:31.134356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:31.134857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:31.135300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:31.431822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:31.445399 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bafe2829-d350-4e37-91f5-bf7307a1cfa1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1690 microversion: 2.1 time: 0.327005 Sep 07 10:27:31.446523 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3089/6242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:31 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1690 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:31.997424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:31.998676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:32.009046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:32.010307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:32.010771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:32.011502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:32.011980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:32.012430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:32.194001 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7228ba1d-46cd-4023-ae52-929215e00fef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.201260 Sep 07 10:27:32.195113 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3154/6243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:31 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:32.472232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:32.472826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:32.481173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:32.482596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:32.484526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:32.486044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:32.486519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:32.486954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:32.684881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:32.694834 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45f8d048-3637-4d53-98b3-35e7ea10638d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1690 microversion: 2.1 time: 0.227979 Sep 07 10:27:32.712582 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3090/6244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:32 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1690 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:32.807864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "name": "network-vif-plugged", "status": "completed", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:32.819458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:32.821241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:32.824457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:32.825710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:32.826213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:32.840906 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] Creating event network-vif-plugged:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h2-836830-16 Sep 07 10:27:32.849580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] Instance 420813e4-33fc-4533-b12e-f5c9a39e12de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:27:32.861742 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-946880ee-6550-4108-9c1c-3ee3f18dd8ac req-396ee1c8-92da-4c21-a0f4-8fe0fa9ce229 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058204 Sep 07 10:27:32.862923 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3155/6245] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:33.227386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:33.228750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:33.235031 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:33.243650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:33.244139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:33.244590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:33.245325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:33.245787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:33.246218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:33.438164 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5554af93-285c-449b-ada1-1cb62877e551 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.215080 Sep 07 10:27:33.453214 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3091/6246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:33 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:33.724139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:33.724868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:33.732674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:33.733633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:33.734024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:33.735305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:33.736192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:33.737096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:33.915176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:33.927247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70a2c415-6f0b-4d08-97d3-ac03cd4f7884 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1690 microversion: 2.1 time: 0.207262 Sep 07 10:27:33.927842 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3156/6247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:33 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:34.470664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:34.473733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:34.481912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:34.482630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:34.484198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:34.485099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:34.485743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:34.486378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:34.762549 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc420c5a-841d-4440-a6ea-12bcc290cf71 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.300463 Sep 07 10:27:34.763327 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3092/6248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:34 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:34.881465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b2c396d3-fe91-407f-b1e7-89fa80b8b6ed req-c5ca436c-286c-471d-b72d-256734331922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c93d18-9ebf-4787-aba1-0f596207c2c8", "name": "network-vif-plugged", "status": "completed", "tag": "d4276183-2a74-4111-acb3-385e1506b31f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:34.893639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b2c396d3-fe91-407f-b1e7-89fa80b8b6ed req-c5ca436c-286c-471d-b72d-256734331922 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:34.894422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b2c396d3-fe91-407f-b1e7-89fa80b8b6ed req-c5ca436c-286c-471d-b72d-256734331922 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:34.895119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b2c396d3-fe91-407f-b1e7-89fa80b8b6ed req-c5ca436c-286c-471d-b72d-256734331922 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:34.910248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b2c396d3-fe91-407f-b1e7-89fa80b8b6ed req-c5ca436c-286c-471d-b72d-256734331922 service nova] Creating event network-vif-plugged:d4276183-2a74-4111-acb3-385e1506b31f for instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 on n-h1-836830-16 Sep 07 10:27:34.916181 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b2c396d3-fe91-407f-b1e7-89fa80b8b6ed req-c5ca436c-286c-471d-b72d-256734331922 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038341 Sep 07 10:27:34.917491 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3157/6249] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:34.956450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:34.958490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:34.971438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:34.974358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:34.975050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:34.977964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:34.980655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:34.984379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:35.239082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:35.251605 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e06bae8c-9b1d-4d09-8565-2cf1515c1329 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1690 microversion: 2.1 time: 0.301146 Sep 07 10:27:35.253148 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3093/6250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:34 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1690 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:35.306444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "name": "network-vif-unplugged", "status": "completed", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:35.317259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:35.317721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:35.318505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:35.332231 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] Creating event network-vif-unplugged:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:27:35.338569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] Instance 420813e4-33fc-4533-b12e-f5c9a39e12de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:27:35.351005 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3ec0f6a0-52dc-4dcf-a46f-da8d0538e59c req-2f67ef39-b165-4604-a443-6ac05e9c61be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048960 Sep 07 10:27:35.351893 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3158/6251] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:35.787721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:35.789426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:35.800446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:35.801306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:35.801927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:35.802830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:35.803448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:35.804033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:36.068031 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3d8d43b0-5cad-4f44-81b3-3c86d5d6d970 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1466 microversion: 2.1 time: 0.285639 Sep 07 10:27:36.083412 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3094/6252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:35 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1466 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:36.278339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:36.280225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:36.290778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:36.291294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:36.293168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:36.294597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:36.295242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:36.295791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:36.550735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:36.558788 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-703426f5-c741-40fc-b4fb-3c08243874a4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1690 microversion: 2.1 time: 0.286163 Sep 07 10:27:36.559592 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3159/6253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:36 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1690 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:37.091681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:37.092314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:37.099976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.100468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.100915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.101649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.104536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.105237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.254750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2069d18-a1b9-4242-bcc3-9f6b29663ea1 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1651 microversion: 2.1 time: 0.166919 Sep 07 10:27:37.255518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3095/6254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:37 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:37.277208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:37.278147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:37.285068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.286316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.286952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.288077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.288732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.289388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.372049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:37.386018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.388421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.393682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.414076 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] Creating event network-changed:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:27:37.420809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] Instance 420813e4-33fc-4533-b12e-f5c9a39e12de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:27:37.432818 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-74d66dba-33f1-4f6c-a528-4fc0ac33d5d9 req-2a0e32c4-d9fa-4b51-ada2-c12c79274e2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064236 Sep 07 10:27:37.434144 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3096/6255] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:27:37.484036 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e9a7f209-0363-4680-9a0e-2e0b4c82ef1d tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1651 microversion: 2.1 time: 0.210483 Sep 07 10:27:37.497464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3160/6256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:37 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1651 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:37.509242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:37.513821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:37.525635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.526233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.527307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.528848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.529603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.530634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.585556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:37.586100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:37.598114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.603076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.603743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.607694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:37.608211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:37.608721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:37.755397 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d324671-ee8d-49b9-a3a9-85c4a159f4c2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1651 microversion: 2.1 time: 0.252566 Sep 07 10:27:37.756903 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3097/6257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:37 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1651 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:37.844759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:37.858090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-702095120", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "availability_zone": "nova:n-h2-836830-16", "networks": [{"uuid": "621c6f04-4de6-40ad-b1bc-ae0c5f776dd9"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:37.862600 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b5265f1d-eea3-445a-acd6-789644ea4004 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1690 microversion: 2.1 time: 0.279700 Sep 07 10:27:37.874705 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3161/6258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:37 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1690 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:37.944065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] validate_networks() for [('621c6f04-4de6-40ad-b1bc-ae0c5f776dd9', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:27:38.893163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:38.893887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:38.911252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:38.912099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:38.912951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:38.913929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:38.914599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:38.915237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:39.185201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:27:39.187567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:27:39.188430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:27:39.189359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:27:39.190160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:27:39.208094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:39.208983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:39.209814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:39.211986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:39.213352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:39.214495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:39.262145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Getting quotas for project 0efcf643e6c14af6870f59edb136214f. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:27:39.274313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Getting quotas for user 771e289e0852494b898069715b6e9d8a and project 0efcf643e6c14af6870f59edb136214f. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:27:39.300113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:27:39.303202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:27:39.368379 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6a3758df-16f7-4884-84f8-80e96d266588 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513935 Sep 07 10:27:39.369656 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3098/6259] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 10:27:39.373728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:27:39.382982 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4934cbcc-d2e9-4daf-8e32-3936084d9271 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1683 microversion: 2.1 time: 0.495464 Sep 07 10:27:39.398690 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3162/6260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:38 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1683 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:39.410334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0711d3cd-79a1-4421-b58d-17d641c932ff tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:39.411130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0711d3cd-79a1-4421-b58d-17d641c932ff tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:39.549661 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0711d3cd-79a1-4421-b58d-17d641c932ff tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1328 microversion: 2.1 time: 0.165239 Sep 07 10:27:39.551806 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3099/6261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:39 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:40.575423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:40.576672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:40.584513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:40.586335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:40.587099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:40.587728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:40.588641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:40.589314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:40.589921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:40.690805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:40.706614 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6a6b4c3-f8c6-4e8e-af9c-1025c9fa2a3a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1417 microversion: 2.1 time: 0.135068 Sep 07 10:27:40.708644 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3163/6262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:40 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1417 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:41.732308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:41.732945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:41.749760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:41.765858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:41.766529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:41.767081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:41.767916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:41.768484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:41.769022 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:41.990711 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b676701-1f4a-4d1e-991e-1b5be1322e47 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.262639 Sep 07 10:27:41.991996 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3100/6263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:41 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:42.338630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a0747f9f-9def-47b9-84f4-e91046b16cd2 req-ce3be257-658e-4e60-951c-4614e3855f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "name": "network-vif-plugged", "status": "completed", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:42.365763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a0747f9f-9def-47b9-84f4-e91046b16cd2 req-ce3be257-658e-4e60-951c-4614e3855f81 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:42.367138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a0747f9f-9def-47b9-84f4-e91046b16cd2 req-ce3be257-658e-4e60-951c-4614e3855f81 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:42.367818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a0747f9f-9def-47b9-84f4-e91046b16cd2 req-ce3be257-658e-4e60-951c-4614e3855f81 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:42.394462 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a0747f9f-9def-47b9-84f4-e91046b16cd2 req-ce3be257-658e-4e60-951c-4614e3855f81 service nova] Creating event network-vif-plugged:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:27:42.403889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a0747f9f-9def-47b9-84f4-e91046b16cd2 req-ce3be257-658e-4e60-951c-4614e3855f81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070529 Sep 07 10:27:42.410230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3164/6264] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:42.802282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3acfb3d7-7841-4727-83c2-8c20ba5ca926 req-4e735e93-e173-4b7a-8a80-d6d8f79cba00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b992954-bbef-4622-a66c-2905354c6847", "tag": "25064861-d638-4779-9cfe-ce78131ad381"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:42.838577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3acfb3d7-7841-4727-83c2-8c20ba5ca926 req-4e735e93-e173-4b7a-8a80-d6d8f79cba00 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:42.840396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3acfb3d7-7841-4727-83c2-8c20ba5ca926 req-4e735e93-e173-4b7a-8a80-d6d8f79cba00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:42.843977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3acfb3d7-7841-4727-83c2-8c20ba5ca926 req-4e735e93-e173-4b7a-8a80-d6d8f79cba00 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:42.869461 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3acfb3d7-7841-4727-83c2-8c20ba5ca926 req-4e735e93-e173-4b7a-8a80-d6d8f79cba00 service nova] Creating event network-changed:25064861-d638-4779-9cfe-ce78131ad381 for instance 4b992954-bbef-4622-a66c-2905354c6847 on n-h2-836830-16 Sep 07 10:27:42.884803 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3acfb3d7-7841-4727-83c2-8c20ba5ca926 req-4e735e93-e173-4b7a-8a80-d6d8f79cba00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088690 Sep 07 10:27:42.887705 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3101/6265] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:27:43.019357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:43.020346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:43.034659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:43.035473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:43.036104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:43.039709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:43.045687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:43.046479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:43.225670 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c559447-829a-4046-93c7-06856614e5ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.210849 Sep 07 10:27:43.226607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3165/6266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:43 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:44.252319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:44.254282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:44.262976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:44.263930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:44.264689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:44.266021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:44.267555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:44.268192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:44.292170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=100 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:44.462997 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ffe973db-7527-40b2-9e1e-21fc46675de8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.216515 Sep 07 10:27:44.465472 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3102/6267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:44 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:45.504564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:45.508886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:45.520182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:45.521332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:45.521784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:45.522853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:45.523505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:45.524126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:45.670476 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63dd3a2f-2d50-4f6a-bc70-27dae1d71cf8 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.171155 Sep 07 10:27:45.672068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3166/6268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:45 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:46.696742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:46.697518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:46.707777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:46.708357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:46.709055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:46.710485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:46.710988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:46.711427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:46.884769 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fde91e3d-fd73-40ff-a323-c78ad3103a3e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.193532 Sep 07 10:27:46.887066 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3103/6269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:46 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:47.907994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:47.908864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:47.916088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:47.916667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:47.917364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:47.918080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:47.918561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:47.919126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:48.097330 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0720bbd0-9c6b-4c30-8921-6a118438a8e6 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.192952 Sep 07 10:27:48.098323 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3167/6270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:47 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:48.642339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-48b8283c-d304-4e41-9620-887f29e16e0c req-c11219cc-f493-4841-9911-15923bae22d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b992954-bbef-4622-a66c-2905354c6847", "name": "network-vif-plugged", "status": "completed", "tag": "25064861-d638-4779-9cfe-ce78131ad381"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:48.659883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-48b8283c-d304-4e41-9620-887f29e16e0c req-c11219cc-f493-4841-9911-15923bae22d0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:48.660981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-48b8283c-d304-4e41-9620-887f29e16e0c req-c11219cc-f493-4841-9911-15923bae22d0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:48.662063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-48b8283c-d304-4e41-9620-887f29e16e0c req-c11219cc-f493-4841-9911-15923bae22d0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:48.678107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-48b8283c-d304-4e41-9620-887f29e16e0c req-c11219cc-f493-4841-9911-15923bae22d0 service nova] Creating event network-vif-plugged:25064861-d638-4779-9cfe-ce78131ad381 for instance 4b992954-bbef-4622-a66c-2905354c6847 on n-h2-836830-16 Sep 07 10:27:48.683899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-48b8283c-d304-4e41-9620-887f29e16e0c req-c11219cc-f493-4841-9911-15923bae22d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048823 Sep 07 10:27:48.685340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3104/6271] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:49.121092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:49.121908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:49.129627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:49.130137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:49.130593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:49.131316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:49.131910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:49.132389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:49.286446 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bea5fed3-805a-4c2b-a61f-43f7fd539cb2 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1465 microversion: 2.1 time: 0.169138 Sep 07 10:27:49.288192 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3168/6272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:49 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1465 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:50.313079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:50.314533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:50.321498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:50.322322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:27:50.325044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.325866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.327813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.328746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.329469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.330123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.489708 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6a23f51-340a-457b-9dd7-8e1448ac53bd tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1650 microversion: 2.1 time: 0.181508 Sep 07 10:27:50.497949 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3105/6273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:50 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1650 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:50.511641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:50.512271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:50.520165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.520665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.521111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.521850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.522413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.522854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.672061 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6fc4c657-9cc0-42f2-8d89-88f18abfbaad tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1650 microversion: 2.1 time: 0.164028 Sep 07 10:27:50.672562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3169/6274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:50 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1650 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:50.695001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:50.695604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:50.702455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.702947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.703376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.704060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.704509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.704926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.871836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4edfea2a-e316-424d-a55e-a39b35faa880 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1650 microversion: 2.1 time: 0.180444 Sep 07 10:27:50.872418 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3106/6275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:50 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1650 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:50.895543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:50.896301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:50.902989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.903770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.904398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.905476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:50.906118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:50.906564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:50.959474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:27:51.088323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b4d60576-243d-4e73-b778-11aef1000304 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 204 len: 0 microversion: 2.1 time: 0.195935 Sep 07 10:27:51.093981 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3170/6276] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:27:50 2022] DELETE /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:27:51.098601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:51.099226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:51.107021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:51.107766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:51.109323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:51.110209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:51.110905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:51.111563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:51.252809 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fd3b4e52-0863-4c2c-8af8-54f8f741be8e tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1656 microversion: 2.1 time: 0.157837 Sep 07 10:27:51.253429 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3107/6277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:51 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:52.276458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:52.277174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:52.284385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:52.284884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:52.285366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:52.286075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:52.286545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:52.286984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:52.439931 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88810152-8666-48df-8714-3cdcb1cd563a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1656 microversion: 2.1 time: 0.167505 Sep 07 10:27:52.440533 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3171/6278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:52 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:52.999234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bee1834b-3448-4d67-bca1-f3ead929dc9f req-f5703c20-e1d3-4ad8-95ce-9cd9b985c35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b992954-bbef-4622-a66c-2905354c6847", "name": "network-vif-deleted", "tag": "25064861-d638-4779-9cfe-ce78131ad381"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:53.015517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bee1834b-3448-4d67-bca1-f3ead929dc9f req-f5703c20-e1d3-4ad8-95ce-9cd9b985c35f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:53.016439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bee1834b-3448-4d67-bca1-f3ead929dc9f req-f5703c20-e1d3-4ad8-95ce-9cd9b985c35f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:53.017157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bee1834b-3448-4d67-bca1-f3ead929dc9f req-f5703c20-e1d3-4ad8-95ce-9cd9b985c35f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:53.031523 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bee1834b-3448-4d67-bca1-f3ead929dc9f req-f5703c20-e1d3-4ad8-95ce-9cd9b985c35f service nova] Creating event network-vif-deleted:25064861-d638-4779-9cfe-ce78131ad381 for instance 4b992954-bbef-4622-a66c-2905354c6847 on n-h2-836830-16 Sep 07 10:27:53.038415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bee1834b-3448-4d67-bca1-f3ead929dc9f req-f5703c20-e1d3-4ad8-95ce-9cd9b985c35f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042702 Sep 07 10:27:53.039684 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3108/6279] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:53.464676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:53.466638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:53.475695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:53.476506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:53.477265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:53.478883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:53.479589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:53.480258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:53.559434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:53.560200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:53.560888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:53.562808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lazy-loading 'fault' on Instance uuid 4b992954-bbef-4622-a66c-2905354c6847 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:27:53.625799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-be44c647-65bf-4271-8fa1-2f5f1771565f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 200 len: 1455 microversion: 2.1 time: 0.165504 Sep 07 10:27:53.626986 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3172/6280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:53 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:54.656796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:54.657537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 4b992954-bbef-4622-a66c-2905354c6847] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:54.664070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:54.664562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:54.665006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:54.665732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:54.666197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:54.666628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:54.680917 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] HTTP exception thrown: Instance 4b992954-bbef-4622-a66c-2905354c6847 could not be found. Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Request method failure captured: Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 HTTP/1.1 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHIJVrD6gEWt-gVZPn2QlaftqYSEkQvKgQi_IAUrIawrPdJVokfFgpLyukkjnphWPdpreuFysyTSREACBAw8FeVa7fFrxiNkV0-7Chm03JI8fDUcohUXl64rFh-goxQv3aL2KhOmvhWOIHn7HfKe8d7LxeZYXe-oHcmRoYL7wEpCgIk Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0efcf643e6c14af6870f59edb136214f Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestServerMultinode-1427987513 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0efcf643e6c14af6870f59edb136214f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0efcf643e6c14af6870f59edb136214f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0efcf643e6c14af6870f59edb136214f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0efcf643e6c14af6870f59edb136214f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestServerMultinode-1427987513 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0efcf643e6c14af6870f59edb136214f Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestServerMultinode-1427987513 Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestServerMultinode-1427987513-project-admin Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 771e289e0852494b898069715b6e9d8a Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestServerMultinode-1427987513-project-admin Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4b992954-bbef-4622-a66c-2905354c6847 could not be found. Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4b992954-bbef-4622-a66c-2905354c6847'} Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b992954-bbef-4622-a66c-2905354c6847 could not be found. Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b992954-bbef-4622-a66c-2905354c6847 could not be found. Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:54.682781 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b992954-bbef-4622-a66c-2905354c6847 could not be found. Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Returning 404 to user: Instance 4b992954-bbef-4622-a66c-2905354c6847 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e16bf7d2-ffa1-4c58-a518-9f64f542911f tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847" status: 404 len: 111 microversion: 2.1 time: 0.033520 Sep 07 10:27:54.690700 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3109/6281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:54 2022] GET /compute/v2.1/servers/4b992954-bbef-4622-a66c-2905354c6847 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:27:54.694835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:54.695356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:54.703811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:54.704318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:54.704776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:54.705783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:54.706272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:54.706720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:54.734728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:27:54.824992 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ed99fab-ee29-4376-aa70-6fdbd7651bfc tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 204 len: 0 microversion: 2.1 time: 0.133195 Sep 07 10:27:54.829825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3173/6282] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:27:54 2022] DELETE /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:27:54.835288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:54.836009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:54.842893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:54.843500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:54.844159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:54.845205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:54.845861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:54.846487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:54.988713 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52002369-adb5-4044-8c8a-2f547b4583ef tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1657 microversion: 2.1 time: 0.157350 Sep 07 10:27:54.989478 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3110/6283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:54 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:27:56.013742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:56.014491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:56.022440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:56.023171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:56.023799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:56.025230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:56.025713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:56.026326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:56.173574 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e6fcb1c6-35af-4c40-ad47-9091f8b81916 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1657 microversion: 2.1 time: 0.163545 Sep 07 10:27:56.185234 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3174/6284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:56 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1657 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:56.797843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-80f33d58-9a0c-436c-8bbe-33c875acd302 req-c6ecf123-a17b-447d-88f2-be20b5e2fd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c93d18-9ebf-4787-aba1-0f596207c2c8", "name": "network-vif-deleted", "tag": "d4276183-2a74-4111-acb3-385e1506b31f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:27:56.809166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-80f33d58-9a0c-436c-8bbe-33c875acd302 req-c6ecf123-a17b-447d-88f2-be20b5e2fd05 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:56.810137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-80f33d58-9a0c-436c-8bbe-33c875acd302 req-c6ecf123-a17b-447d-88f2-be20b5e2fd05 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:56.810975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-80f33d58-9a0c-436c-8bbe-33c875acd302 req-c6ecf123-a17b-447d-88f2-be20b5e2fd05 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:56.824304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-80f33d58-9a0c-436c-8bbe-33c875acd302 req-c6ecf123-a17b-447d-88f2-be20b5e2fd05 service nova] Creating event network-vif-deleted:d4276183-2a74-4111-acb3-385e1506b31f for instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 on n-h1-836830-16 Sep 07 10:27:56.831788 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-80f33d58-9a0c-436c-8bbe-33c875acd302 req-c6ecf123-a17b-447d-88f2-be20b5e2fd05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041645 Sep 07 10:27:56.836811 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3111/6285] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:27:57.198677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:57.201020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:57.211350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:57.212120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:57.213545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:57.214538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:57.215964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:57.216628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:57.260375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:57.260972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:57.261526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:57.262172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lazy-loading 'fault' on Instance uuid 30c93d18-9ebf-4787-aba1-0f596207c2c8 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:27:57.316971 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6a537ef-f6d4-4ee9-882e-95981c772945 tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 200 len: 1456 microversion: 2.1 time: 0.123288 Sep 07 10:27:57.330821 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3175/6286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:57 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 1456 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:27:58.345481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:27:58.346304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] [instance: 30c93d18-9ebf-4787-aba1-0f596207c2c8] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:27:58.357528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:58.358653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:58.359210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:58.359999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:27:58.360538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:27:58.361194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:27:58.376067 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] HTTP exception thrown: Instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 could not be found. Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Request method failure captured: Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 HTTP/1.1 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHIJVrD6gEWt-gVZPn2QlaftqYSEkQvKgQi_IAUrIawrPdJVokfFgpLyukkjnphWPdpreuFysyTSREACBAw8FeVa7fFrxiNkV0-7Chm03JI8fDUcohUXl64rFh-goxQv3aL2KhOmvhWOIHn7HfKe8d7LxeZYXe-oHcmRoYL7wEpCgIk Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 0efcf643e6c14af6870f59edb136214f Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestServerMultinode-1427987513 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0efcf643e6c14af6870f59edb136214f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0efcf643e6c14af6870f59edb136214f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0efcf643e6c14af6870f59edb136214f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0efcf643e6c14af6870f59edb136214f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestServerMultinode-1427987513 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 0efcf643e6c14af6870f59edb136214f Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestServerMultinode-1427987513 Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestServerMultinode-1427987513-project-admin Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 771e289e0852494b898069715b6e9d8a Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestServerMultinode-1427987513-project-admin Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 could not be found. Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '30c93d18-9ebf-4787-aba1-0f596207c2c8'} Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 could not be found. Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 could not be found. Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:27:58.377847 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 could not be found. Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] Returning 404 to user: Instance 30c93d18-9ebf-4787-aba1-0f596207c2c8 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:27:58.383779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-57116fa8-6f10-43bb-bfbf-ad38197ba11a tempest-TestServerMultinode-1427987513 tempest-TestServerMultinode-1427987513-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8" status: 404 len: 111 microversion: 2.1 time: 0.042963 Sep 07 10:27:58.385416 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3112/6287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:27:58 2022] GET /compute/v2.1/servers/30c93d18-9ebf-4787-aba1-0f596207c2c8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:28:05.656460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:05.658667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:05.671745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:05.674358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:05.674836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:05.675658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:05.678349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:05.681843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:05.767332 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d35d1c5-ad19-4a43-baf3-70a346c9ecca tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action" status: 200 len: 63234 microversion: 2.1 time: 0.116027 Sep 07 10:28:05.769166 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3176/6288] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:28:05 2022] POST /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de/action => generated 63234 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:28:12.024641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:12.025291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:12.028265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=25 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:12.029843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=44 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:12.036023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:12.036721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:12.037374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:12.038267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:12.038905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:12.039514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:12.188205 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9a7b4074-79eb-4a94-a766-830896bf5bbb tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1836 microversion: 2.1 time: 0.167231 Sep 07 10:28:12.188940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3113/6289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:12 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1836 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:13.170443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:13.171960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:13.179407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:13.181478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:13.181647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ea245db5-506a-433c-b677-7df30434ad86 req-6a6698a9-c1a9-4353-9fe6-7f42781745b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:13.182138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:13.182308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:13.183220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:13.183858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:13.184481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:13.190190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:13.201215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea245db5-506a-433c-b677-7df30434ad86 req-6a6698a9-c1a9-4353-9fe6-7f42781745b8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:13.202174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea245db5-506a-433c-b677-7df30434ad86 req-6a6698a9-c1a9-4353-9fe6-7f42781745b8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:13.202716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ea245db5-506a-433c-b677-7df30434ad86 req-6a6698a9-c1a9-4353-9fe6-7f42781745b8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:13.220366 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ea245db5-506a-433c-b677-7df30434ad86 req-6a6698a9-c1a9-4353-9fe6-7f42781745b8 service nova] Creating event network-changed:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:28:13.225767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:28:13.237432 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ea245db5-506a-433c-b677-7df30434ad86 req-6a6698a9-c1a9-4353-9fe6-7f42781745b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068069 Sep 07 10:28:13.238386 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3114/6290] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:28:13.368881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e9cbc028-1db3-4ebe-986d-f740fb208f89 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 204 len: 0 microversion: 2.1 time: 0.204368 Sep 07 10:28:13.369874 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3177/6291] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:28:13 2022] DELETE /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:28:13.383670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:13.384734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:13.392785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:13.393531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:13.394422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:13.395637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:13.396914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:13.397610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:13.621074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:13.631404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-940722d4-7cb2-453c-898a-bc6dcd57aad0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1689 microversion: 2.1 time: 0.256143 Sep 07 10:28:13.632710 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3115/6292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:13 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:14.657727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:14.658463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:14.674773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:14.675665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:14.676384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:14.677401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:14.678321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:14.678949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:14.932245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:14.953537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ffdc380e-2cf1-4243-8889-33cdc9154ccf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1689 microversion: 2.1 time: 0.300946 Sep 07 10:28:14.958520 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3178/6293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:14 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1689 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:15.595409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b97cee97-4278-45b5-9a35-75a59bf8b905 req-0f584899-ed12-45b9-984e-0e9fb558d89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420813e4-33fc-4533-b12e-f5c9a39e12de", "name": "network-vif-deleted", "tag": "5e6f0f64-9fc8-4c18-82c0-285642f59c63"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:15.605730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b97cee97-4278-45b5-9a35-75a59bf8b905 req-0f584899-ed12-45b9-984e-0e9fb558d89a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:15.606217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b97cee97-4278-45b5-9a35-75a59bf8b905 req-0f584899-ed12-45b9-984e-0e9fb558d89a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:15.606647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b97cee97-4278-45b5-9a35-75a59bf8b905 req-0f584899-ed12-45b9-984e-0e9fb558d89a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:15.620914 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b97cee97-4278-45b5-9a35-75a59bf8b905 req-0f584899-ed12-45b9-984e-0e9fb558d89a service nova] Creating event network-vif-deleted:5e6f0f64-9fc8-4c18-82c0-285642f59c63 for instance 420813e4-33fc-4533-b12e-f5c9a39e12de on n-h1-836830-16 Sep 07 10:28:15.627124 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b97cee97-4278-45b5-9a35-75a59bf8b905 req-0f584899-ed12-45b9-984e-0e9fb558d89a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214672 Sep 07 10:28:15.628540 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3116/6294] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:28:15.978164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:15.978768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:15.987211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:15.988065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:15.988707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:15.989767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:15.990408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:15.991036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:16.026893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:16.027394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:16.027847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:16.028536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lazy-loading 'fault' on Instance uuid 420813e4-33fc-4533-b12e-f5c9a39e12de {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:28:16.084500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:16.093401 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-78510732-d3f4-438f-843a-6bfd919fe587 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 200 len: 1357 microversion: 2.1 time: 0.118992 Sep 07 10:28:16.094704 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3179/6295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:15 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 1357 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:17.120454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:17.121160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 420813e4-33fc-4533-b12e-f5c9a39e12de] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:17.130598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:17.131226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:17.131904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:17.132717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:17.160596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:17.161149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:17.180290 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] HTTP exception thrown: Instance 420813e4-33fc-4533-b12e-f5c9a39e12de could not be found. Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Request method failure captured: Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de HTTP/1.1 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHElr-jtfg9tkZJQQRdOTu1MqVoIYXmKHjhqLwL9kI-prM3QLbxBlJDpY07lu25jnAnxlL7eUMv7rphaYeyr1U2lFwkv-rUdcDMU5kFU3xxRawRDh1cYbYdp51k9s29J_0UlWMe85FQHR6PrKI9fw00G1HM7mtzRIBdjePXMYHSDqZA Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_050638dd54d14d079b14d398e5ef9210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 821845320a8347e69590343607357785 Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 420813e4-33fc-4533-b12e-f5c9a39e12de could not be found. Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '420813e4-33fc-4533-b12e-f5c9a39e12de'} Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420813e4-33fc-4533-b12e-f5c9a39e12de could not be found. Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420813e4-33fc-4533-b12e-f5c9a39e12de could not be found. Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:28:17.182620 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420813e4-33fc-4533-b12e-f5c9a39e12de could not be found. Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Returning 404 to user: Instance 420813e4-33fc-4533-b12e-f5c9a39e12de could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:28:17.189836 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-361f0569-8003-4b39-a1fc-a2788eb79a6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de" status: 404 len: 111 microversion: 2.1 time: 0.069179 Sep 07 10:28:17.192218 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3117/6296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:17 2022] GET /compute/v2.1/servers/420813e4-33fc-4533-b12e-f5c9a39e12de => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:28:21.158951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e8bc017-0a31-4020-af5a-35dc7d83ea55 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '.version_select at 0x7f14b1b5a8b0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:21.196085 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e8bc017-0a31-4020-af5a-35dc7d83ea55 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1771878040" status: 202 len: 0 microversion: 2.1 time: 0.041095 Sep 07 10:28:21.196972 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3180/6297] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 7 10:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1771878040 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:28:21.240363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5bda7d7c-9858-424d-aff7-a35325d22520 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: .version_select at 0x7f14b27884c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-341392546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6vdzgUaBLKYHJxaszCmNfE6GUg5vdF0tqGmQl2jLnbxDyseyp/lkQOgZgTiUQUvCtF9P9HYlECnnVil2YTbQjYsQiqUtp42NiuCxr4hYwek+4Y7T3s7pU8scaSLBt1uQ=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:21.258845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5bda7d7c-9858-424d-aff7-a35325d22520 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:28:21.266267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5bda7d7c-9858-424d-aff7-a35325d22520 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:28:21.299493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5bda7d7c-9858-424d-aff7-a35325d22520 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.063412 Sep 07 10:28:21.300147 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3118/6298] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:28:21 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:28:28.201858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:28.206941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1898028776", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "3a246a89-3ea3-4d23-888c-544185ce8567"}], "key_name": "tempest-TestNetworkAdvancedServerOps-341392546", "security_groups": [{"name": "tempest-secgroup-smoke-991332940"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:28.376768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] validate_networks() for [('3a246a89-3ea3-4d23-888c-544185ce8567', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:28:29.047805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:28:29.048333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:28:29.048837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:28:29.049326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:28:29.049765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:28:29.081159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:29.081689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:29.082149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:29.082892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:29.083350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:29.083794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:29.147486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:28:29.161647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:28:29.204037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:28:29.210054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:28:29.290153 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e24bfaca-c412-4ab2-803d-3d27891252f3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.090572 Sep 07 10:28:29.293728 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3181/6299] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:28:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 10:28:29.307699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4aecb52b-cb86-44c2-8881-2ae729c2d717 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:29.308291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4aecb52b-cb86-44c2-8881-2ae729c2d717 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:29.315679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=18 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:29.452911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4aecb52b-cb86-44c2-8881-2ae729c2d717 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:29.464467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4aecb52b-cb86-44c2-8881-2ae729c2d717 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1266 microversion: 2.1 time: 0.161342 Sep 07 10:28:29.500254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3119/6300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:29 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:28:30.503998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:30.505338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:30.516427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:30.517270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:30.518557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:30.519561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:30.521369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:30.522053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:30.600462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:30.615042 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2882fbc2-a838-4652-8154-93f1c21601b5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1262 microversion: 2.1 time: 0.113451 Sep 07 10:28:30.619659 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3182/6301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:30 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1262 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:31.642854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:31.643373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:31.660815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:31.661338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:31.662088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:31.662487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:31.662953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:31.663389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:31.841934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:31.845350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2093e16-b6be-4c0e-9dbd-6ec3c63d6b6a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1324 microversion: 2.1 time: 0.206607 Sep 07 10:28:31.867045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3120/6302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:31 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:32.871124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:32.872610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:32.881927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:32.882685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:32.883679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:32.884674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:32.885409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:32.886245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:33.247414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:33.258196 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-412a9059-38f4-46ca-8a3e-aeffdd0cc26b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1391 microversion: 2.1 time: 0.391405 Sep 07 10:28:33.259585 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3183/6303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:32 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:33.796986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c34f2e4f-723d-4698-a07d-e627cdc9726f req-e759d690-bbdd-44ca-9628-fe72f05baf5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:33.816812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c34f2e4f-723d-4698-a07d-e627cdc9726f req-e759d690-bbdd-44ca-9628-fe72f05baf5f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:33.822641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c34f2e4f-723d-4698-a07d-e627cdc9726f req-e759d690-bbdd-44ca-9628-fe72f05baf5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:33.823270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c34f2e4f-723d-4698-a07d-e627cdc9726f req-e759d690-bbdd-44ca-9628-fe72f05baf5f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:33.848627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c34f2e4f-723d-4698-a07d-e627cdc9726f req-e759d690-bbdd-44ca-9628-fe72f05baf5f service nova] Creating event network-changed:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h2-836830-16 Sep 07 10:28:33.860046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c34f2e4f-723d-4698-a07d-e627cdc9726f req-e759d690-bbdd-44ca-9628-fe72f05baf5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067349 Sep 07 10:28:33.863545 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3121/6304] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:28:34.291213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:34.292631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:34.300473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:34.301469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:34.302178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:34.303182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:34.303889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:34.304685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:34.475940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:34.490167 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3def0ccb-21ab-4279-8136-a9d3565b8057 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1391 microversion: 2.1 time: 0.202795 Sep 07 10:28:34.490739 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3184/6305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:34 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:35.613717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:35.614570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:35.622141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:35.623574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:35.624205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:35.625463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:35.626118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:35.626617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:35.901001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:35.910482 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff087303-c50d-4671-b99a-e099716f3008 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1391 microversion: 2.1 time: 0.394056 Sep 07 10:28:35.911369 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3122/6306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:35 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1391 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:36.956627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:36.958099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:36.967560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:36.968407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:36.969273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:36.971584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:36.972473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:36.973676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:37.151893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:37.162216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-809a3d9c-0665-415c-a484-cfdee4737671 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1391 microversion: 2.1 time: 0.222768 Sep 07 10:28:37.173356 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3185/6307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:36 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:38.188521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:38.189015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:38.196656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:38.197505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:38.197953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:38.198668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:38.199131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:38.199599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:38.349447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:38.359580 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53c72c0a-d03b-440a-ac10-d0cefc44346e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1391 microversion: 2.1 time: 0.175918 Sep 07 10:28:38.360185 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3123/6308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:38 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:39.074568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-273376d4-26b7-4913-b96e-e2a95977d649 req-e7f1803b-e3de-49b8-8824-1dff051f9a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "name": "network-vif-plugged", "status": "completed", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:39.098925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-273376d4-26b7-4913-b96e-e2a95977d649 req-e7f1803b-e3de-49b8-8824-1dff051f9a0b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:39.099350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-273376d4-26b7-4913-b96e-e2a95977d649 req-e7f1803b-e3de-49b8-8824-1dff051f9a0b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:39.099979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-273376d4-26b7-4913-b96e-e2a95977d649 req-e7f1803b-e3de-49b8-8824-1dff051f9a0b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:39.112305 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-273376d4-26b7-4913-b96e-e2a95977d649 req-e7f1803b-e3de-49b8-8824-1dff051f9a0b service nova] Creating event network-vif-plugged:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h2-836830-16 Sep 07 10:28:39.117643 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-273376d4-26b7-4913-b96e-e2a95977d649 req-e7f1803b-e3de-49b8-8824-1dff051f9a0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143738 Sep 07 10:28:39.118558 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3186/6309] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:28:39.390383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:39.390916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:39.405574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:39.406423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:39.406870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:39.408091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:39.408865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:39.409810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:39.461995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:39.942701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:39.950682 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d579f45e-a195-48a7-a76a-8f712e6be6b3 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1391 microversion: 2.1 time: 0.565113 Sep 07 10:28:39.961975 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3124/6310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:39 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1391 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:40.974736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:40.975924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:40.982406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:40.983366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:40.991391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:40.992144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:40.992792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:40.993736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:40.994382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:40.995019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:41.167119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:41.177440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5b4c3fa-7134-445b-b03f-23d2d9b29ce4 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1564 microversion: 2.1 time: 0.203508 Sep 07 10:28:41.178034 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3187/6311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:40 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:28:41.202306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:41.203416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:41.211549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:41.212271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:41.212792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:41.213760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:41.214318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:41.215192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:41.394377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:41.419395 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6bd204b-8286-4116-86de-9c6c60355f36 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1564 microversion: 2.1 time: 0.221237 Sep 07 10:28:41.420715 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3125/6312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:41 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1564 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:43.543020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:43.543656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:43.548592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:43.563586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-808e7037-a858-4f9a-bff8-5d55556bf0d2 req-35cecf03-9f5b-465c-9611-ea41b296336b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:43.564829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:43.565660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:43.566562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:43.567673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:43.568358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:43.569101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:43.571937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:43.578966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-808e7037-a858-4f9a-bff8-5d55556bf0d2 req-35cecf03-9f5b-465c-9611-ea41b296336b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:43.579496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-808e7037-a858-4f9a-bff8-5d55556bf0d2 req-35cecf03-9f5b-465c-9611-ea41b296336b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:43.579939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-808e7037-a858-4f9a-bff8-5d55556bf0d2 req-35cecf03-9f5b-465c-9611-ea41b296336b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:43.593967 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-808e7037-a858-4f9a-bff8-5d55556bf0d2 req-35cecf03-9f5b-465c-9611-ea41b296336b service nova] Creating event network-changed:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h2-836830-16 Sep 07 10:28:43.599718 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-808e7037-a858-4f9a-bff8-5d55556bf0d2 req-35cecf03-9f5b-465c-9611-ea41b296336b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040652 Sep 07 10:28:43.603815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3126/6313] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:28:43.868630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:43.877921 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b12faa41-cc36-4425-97de-b2b51bc063a1 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1564 microversion: 2.1 time: 0.338938 Sep 07 10:28:43.881891 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3188/6314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:43 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1564 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:52.513020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dcced4d-deb9-4a6a-8ad4-f3c6aa31ca1b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Action: 'create', calling method: .version_select at 0x7f14b0a95e50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-133585651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/3p3fDwc+fdUeFcjC/jN9FhbLXrfNpjQNqMW2D0s3LZNlSSzf0xWCtevIb7KCX1hVM2Z1rUvByJFXvMP4mu6Azptdl/WXiQ0zm1Clh/SaRuLib9cXQRPrNi0qDYOpntg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:52.529322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1dcced4d-deb9-4a6a-8ad4-f3c6aa31ca1b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Getting quotas for project 59c2cf8121e245978ae7cbfef09e7e4a. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:28:52.534757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1dcced4d-deb9-4a6a-8ad4-f3c6aa31ca1b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Getting quotas for user 58ec9ab0347c467ba0e5a63c6ace112f and project 59c2cf8121e245978ae7cbfef09e7e4a. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:28:52.565858 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1dcced4d-deb9-4a6a-8ad4-f3c6aa31ca1b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.058167 Sep 07 10:28:52.566790 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3127/6315] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:28:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:28:53.740180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1166434245", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "78b50081-bc7c-4825-8081-c8c12db5e0d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-133585651", "security_groups": [{"name": "tempest-secgroup-smoke-912335927"}], "networks": [{"uuid": "86633cb1-83d9-442e-aa90-337dce015fe0"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:53.754180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:53.878845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] validate_networks() for [('86633cb1-83d9-442e-aa90-337dce015fe0', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:28:53.883487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=40 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:54.315229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:28:54.315657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:28:54.316309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:28:54.316740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:28:54.317167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:28:54.326638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:54.327148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:54.327600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:54.328350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:54.328818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:54.329281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:54.349950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Getting quotas for project 59c2cf8121e245978ae7cbfef09e7e4a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:28:54.355520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Getting quotas for user 58ec9ab0347c467ba0e5a63c6ace112f and project 59c2cf8121e245978ae7cbfef09e7e4a. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:28:54.425005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:28:54.427211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78b50081-bc7c-4825-8081-c8c12db5e0d0',volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:28:54.579521 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9202d3d1-011f-4de9-96a6-fe8a079fa82d tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.843246 Sep 07 10:28:54.580194 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3189/6316] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:28:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:28:54.592461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79b0164d-3bf3-4feb-9bb3-5831e7c3b877 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:54.593231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79b0164d-3bf3-4feb-9bb3-5831e7c3b877 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:54.596222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=34 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:28:54.659581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-79b0164d-3bf3-4feb-9bb3-5831e7c3b877 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:54.667245 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79b0164d-3bf3-4feb-9bb3-5831e7c3b877 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1098 microversion: 2.1 time: 0.079425 Sep 07 10:28:54.667822 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3128/6317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:54 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1098 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:55.692798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:55.694108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:55.700980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:55.702057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:55.702520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:55.703282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:55.703762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:55.704210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:55.779568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:55.788239 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ca932c18-1c83-446b-8739-ccedee3c73d4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1204 microversion: 2.1 time: 0.100395 Sep 07 10:28:55.788838 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3190/6318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:55 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:56.815818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:56.816355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:56.833974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:56.836984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:56.837647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:56.839178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:56.842159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:56.842810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:57.028684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:57.037030 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2002e0c4-0efe-4081-b950-f771fd72fa02 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1281 microversion: 2.1 time: 0.225314 Sep 07 10:28:57.038232 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3129/6319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:56 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:57.651327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9df1228a-4092-42ed-b8fb-d73bc2434f09 req-a0148751-bc65-444e-9be0-09035103a613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:28:57.665341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9df1228a-4092-42ed-b8fb-d73bc2434f09 req-a0148751-bc65-444e-9be0-09035103a613 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:57.666156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9df1228a-4092-42ed-b8fb-d73bc2434f09 req-a0148751-bc65-444e-9be0-09035103a613 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:57.666869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9df1228a-4092-42ed-b8fb-d73bc2434f09 req-a0148751-bc65-444e-9be0-09035103a613 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:57.687882 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9df1228a-4092-42ed-b8fb-d73bc2434f09 req-a0148751-bc65-444e-9be0-09035103a613 service nova] Creating event network-changed:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:28:57.695883 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9df1228a-4092-42ed-b8fb-d73bc2434f09 req-a0148751-bc65-444e-9be0-09035103a613 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048187 Sep 07 10:28:57.697161 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3191/6320] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:28:58.074229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:58.075663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:58.094893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:58.095674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:58.096302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:58.097213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:58.097867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:58.098299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:58.275727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:58.288911 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ef7b872-d821-417c-9f68-9da237382340 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1281 microversion: 2.1 time: 0.217588 Sep 07 10:28:58.289612 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3130/6321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:58 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:28:59.314887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:28:59.315640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:28:59.325756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:59.326392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:59.326923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:59.327751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:28:59.328313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:28:59.328827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:28:59.501496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:28:59.509657 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38b47ce7-8540-4c95-bd83-d4436568ba56 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1281 microversion: 2.1 time: 0.200274 Sep 07 10:28:59.510470 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3192/6322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:28:59 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:00.533980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:00.534602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:00.541934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:00.542426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:00.542871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:00.543573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:00.544679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:00.545114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:00.700751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:00.709096 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45eda02e-9e20-474d-b0ed-f52a988d3f47 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1281 microversion: 2.1 time: 0.179168 Sep 07 10:29:00.709703 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3131/6323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:00 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:01.733245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:01.734605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:01.741576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:01.742082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:01.742538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:01.743255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:01.743727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:01.744174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:01.885439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:01.894009 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-323337ef-09cd-4b16-90c4-0afc018d4b2f tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.165871 Sep 07 10:29:01.894600 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3193/6324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:01 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:02.918420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:02.919551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:02.926744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:02.927233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:02.927676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:02.928388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:02.928847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:02.929303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:03.069425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:03.077926 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0859a06d-5116-4373-a884-b705e6b5fd9b tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.163837 Sep 07 10:29:03.078532 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3132/6325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:02 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:04.101752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:04.102423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:04.109886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:04.110385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:04.110836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:04.111551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:04.112025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:04.112467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:04.257613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:04.265634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8fba974-e807-4439-84f5-ee3cb2106cd4 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.167868 Sep 07 10:29:04.266425 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3194/6326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:04 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:05.195278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:05.197597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:05.200917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:05.207024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:05.207551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:05.207996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:05.208729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:05.209229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:05.209673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:05.279202 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-212299e9-923a-45b6-9aef-b023b800025b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action" status: 200 len: 24572 microversion: 2.1 time: 0.087443 Sep 07 10:29:05.279998 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3133/6327] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:29:05 2022] POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action => generated 24572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:29:05.287676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:05.288305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:05.290309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:05.290989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:05.297821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:05.298315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:05.298762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:05.299464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:05.299937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:05.300371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:05.438301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:05.445939 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-552b4d6c-3cd0-4775-8790-fb0c1bbb91fb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.162082 Sep 07 10:29:05.446499 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3195/6328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:05 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:06.470143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:06.470857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:06.478256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:06.478751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:06.479197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:06.479895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:06.480356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:06.480788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:06.626282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:06.635799 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5a8b42fb-4ce9-4aec-a282-9e248f96c8aa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.169910 Sep 07 10:29:06.636378 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3134/6329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:06 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:07.659253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:07.660484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:07.667781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:07.668277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:07.668754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:07.669482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:07.669948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:07.670386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:07.814644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:07.822832 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bad142d1-8d98-425f-b06d-1e2df5ab85c6 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.167520 Sep 07 10:29:07.823629 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3196/6330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:07 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:08.845792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:08.846406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:08.853772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:08.854399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:08.855020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:08.855775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:08.857005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:08.857455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:09.002720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:09.011426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c149f5a4-c753-41f5-a1bc-4168092c3cb8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.169004 Sep 07 10:29:09.012326 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3135/6331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:08 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:10.046505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:10.047124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:10.053864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:10.054363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:10.054813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:10.055522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:10.055991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:10.056429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:10.207128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:10.215655 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc1e8a38-2243-48e5-847b-97e25b476618 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.174077 Sep 07 10:29:10.216332 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3197/6332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:10 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:10.519377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cc4b42d0-fe12-490c-a9ba-c11746e934a4 req-a3cd7d3c-54b9-4121-9a83-d6c37b13f07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "name": "network-vif-plugged", "status": "completed", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:10.532775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc4b42d0-fe12-490c-a9ba-c11746e934a4 req-a3cd7d3c-54b9-4121-9a83-d6c37b13f07d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:10.533616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc4b42d0-fe12-490c-a9ba-c11746e934a4 req-a3cd7d3c-54b9-4121-9a83-d6c37b13f07d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:10.534126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cc4b42d0-fe12-490c-a9ba-c11746e934a4 req-a3cd7d3c-54b9-4121-9a83-d6c37b13f07d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:10.546406 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cc4b42d0-fe12-490c-a9ba-c11746e934a4 req-a3cd7d3c-54b9-4121-9a83-d6c37b13f07d service nova] Creating event network-vif-plugged:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:29:10.551330 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cc4b42d0-fe12-490c-a9ba-c11746e934a4 req-a3cd7d3c-54b9-4121-9a83-d6c37b13f07d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Sep 07 10:29:10.552007 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3136/6333] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:11.239228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:11.239862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:11.247889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:11.248400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:11.248863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:11.249620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:11.250100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:11.250546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:11.391630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:11.399968 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b5fb51c1-2896-4955-ab45-fe431ba4f24c tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1269 microversion: 2.1 time: 0.164671 Sep 07 10:29:11.400552 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3198/6334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:11 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:12.425637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:12.426362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:12.432520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:12.432997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:12.433464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:12.434506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:12.434967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:12.435390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:12.575508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:12.583516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fe07fd65-5a2b-4986-aa91-d741ef7bebfa tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1457 microversion: 2.1 time: 0.163079 Sep 07 10:29:12.584077 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3137/6335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:12 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:12.607160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:12.607790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:12.614623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:12.615122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:12.615604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:12.616306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:12.616776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:12.617244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:12.758556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:12.766973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3c6fc2d0-cc7e-45e8-8bcd-1272e2a2a1cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1457 microversion: 2.1 time: 0.164186 Sep 07 10:29:12.767539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3199/6336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:12 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1457 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:15.056555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-77c46bb0-883a-4995-929d-46a792d11f48 req-312c1d8d-ca2d-4687-b2aa-e477c73f1a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:15.065943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:15.075876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-77c46bb0-883a-4995-929d-46a792d11f48 req-312c1d8d-ca2d-4687-b2aa-e477c73f1a2b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:15.076365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-77c46bb0-883a-4995-929d-46a792d11f48 req-312c1d8d-ca2d-4687-b2aa-e477c73f1a2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:15.076872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-77c46bb0-883a-4995-929d-46a792d11f48 req-312c1d8d-ca2d-4687-b2aa-e477c73f1a2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:15.089745 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-77c46bb0-883a-4995-929d-46a792d11f48 req-312c1d8d-ca2d-4687-b2aa-e477c73f1a2b service nova] Creating event network-changed:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:29:15.095248 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-77c46bb0-883a-4995-929d-46a792d11f48 req-312c1d8d-ca2d-4687-b2aa-e477c73f1a2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043826 Sep 07 10:29:15.096183 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3138/6337] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:16.321223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:16.321869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:16.332976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.334184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.341619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:16.342717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.343574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.344383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:16.576907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:16.585220 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b2a37ca-9721-4f48-ba20-0764a6a23880 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1682 microversion: 2.1 time: 0.267813 Sep 07 10:29:16.586231 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3200/6338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:16 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:16.692224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:16.695319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:16.702318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.702805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.703440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:16.705582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.706356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.707196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:16.759121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-95d242d2-a353-4105-9aea-44ffbd5a2c52 req-13755e65-ce7e-4dc8-ba41-766049ec5006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:16.771203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-95d242d2-a353-4105-9aea-44ffbd5a2c52 req-13755e65-ce7e-4dc8-ba41-766049ec5006 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.771815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-95d242d2-a353-4105-9aea-44ffbd5a2c52 req-13755e65-ce7e-4dc8-ba41-766049ec5006 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.772324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-95d242d2-a353-4105-9aea-44ffbd5a2c52 req-13755e65-ce7e-4dc8-ba41-766049ec5006 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:16.787691 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0e16b50a-436c-4ffc-a5ba-da06625f08eb tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action" status: 200 len: 32646 microversion: 2.1 time: 0.100670 Sep 07 10:29:16.794918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3139/6339] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:29:16 2022] POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action => generated 32646 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:29:16.798144 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-95d242d2-a353-4105-9aea-44ffbd5a2c52 req-13755e65-ce7e-4dc8-ba41-766049ec5006 service nova] Creating event network-changed:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:29:16.804627 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-95d242d2-a353-4105-9aea-44ffbd5a2c52 req-13755e65-ce7e-4dc8-ba41-766049ec5006 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049753 Sep 07 10:29:16.805653 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3201/6340] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:29:16.963857 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:16.964912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:16.973814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.975235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.975888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:16.976819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:16.977512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:16.978132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:17.138014 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4d384a10-8f72-4a9e-9396-25504343fa30 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1835 microversion: 2.1 time: 0.178972 Sep 07 10:29:17.139908 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3140/6341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:16 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1835 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:17.178432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:17.180892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:17.188730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:17.189617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:17.190494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:17.191405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:17.192747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:17.193704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:17.243219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lazy-loading 'flavor' on Instance uuid 562fdce5-9d26-4f33-9076-ffd3b79f11c0 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:29:17.258280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Going to try to live migrate instance to another host {{(pid=128832) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 10:29:18.820407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-256e47b1-d3eb-45bd-8513-5ded64aa92a8 req-b8269387-add3-4a85-b689-7735e082ba77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:18.833418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-256e47b1-d3eb-45bd-8513-5ded64aa92a8 req-b8269387-add3-4a85-b689-7735e082ba77 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:18.833418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-256e47b1-d3eb-45bd-8513-5ded64aa92a8 req-b8269387-add3-4a85-b689-7735e082ba77 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:18.833418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-256e47b1-d3eb-45bd-8513-5ded64aa92a8 req-b8269387-add3-4a85-b689-7735e082ba77 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:18.846709 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-256e47b1-d3eb-45bd-8513-5ded64aa92a8 req-b8269387-add3-4a85-b689-7735e082ba77 service nova] Creating event network-changed:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:29:18.851808 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-256e47b1-d3eb-45bd-8513-5ded64aa92a8 req-b8269387-add3-4a85-b689-7735e082ba77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035055 Sep 07 10:29:18.852477 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3141/6342] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:29:18.967006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5672bf78-6194-4dc2-9614-ee8697816d8e tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action" status: 202 len: 0 microversion: 2.1 time: 1.791138 Sep 07 10:29:18.968206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3202/6343] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:29:17 2022] POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action => generated 0 bytes in 1795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:29:18.979751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:18.980946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:18.991095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:18.991915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:18.993012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:18.994843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:18.995321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:18.995757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:19.274835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:19.290892 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d296d8aa-5800-461e-af85-9097ab85ce54 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.317352 Sep 07 10:29:19.292429 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3142/6344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:18 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:20.316212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:20.317143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:20.330639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:20.331394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:20.331786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:20.332557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:20.333041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:20.333516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:20.576215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:20.586599 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b335eef3-ee01-44fe-9d18-99880384f5a5 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.274344 Sep 07 10:29:20.587801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3203/6345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:20 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:20.870041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "name": "network-vif-unplugged", "status": "completed", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}, {"name": "network-changed", "server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:20.882492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:20.882966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:20.883389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:20.896396 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] Creating event network-vif-unplugged:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h2-836830-16 Sep 07 10:29:20.896987 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] Creating event network-changed:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h2-836830-16 Sep 07 10:29:20.915008 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-58d1b7c8-2688-4332-a01c-a3cc588c741a req-0e77052d-b355-470c-9b08-55e7729d3280 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.049152 Sep 07 10:29:20.915678 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3143/6346] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:21.624792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:21.628278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:21.647693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:21.648608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:21.649472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:21.650773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:21.651642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:21.653580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:21.919905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:21.928478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21ea2bbd-484c-4caa-9ef0-f261c511a662 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.310904 Sep 07 10:29:21.929060 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3204/6347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:21 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:22.953786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:22.954487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:22.961541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:22.964293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:22.964780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:22.965608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:22.966311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:22.966714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:23.127904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:23.137617 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f94dab7-34a9-496e-9cbc-be69cbe6a838 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.189031 Sep 07 10:29:23.140470 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3144/6348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:22 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:24.163813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:24.164455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:24.167686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:24.177682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:24.178378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:24.178729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:24.179645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:24.179930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:24.180378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:24.184615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:24.333214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:24.342650 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8ff0e29-bce2-4f96-8b82-7a268ac4f999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.182856 Sep 07 10:29:24.343278 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3205/6349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:24 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:25.367474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:25.368096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:25.376137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:25.376634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:25.377076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:25.377829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:25.378752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:25.379247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:25.382247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=77 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:25.524649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:25.533829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c6c0bbf-ce02-487c-a859-40e56eac6b72 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.170084 Sep 07 10:29:25.541282 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3145/6350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:25 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:26.560509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:26.561781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:26.568870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:26.569402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:26.569873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:26.570555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:26.571022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:26.571459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:26.787730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:26.798710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38abf798-6060-40f5-b5f6-5fe4f578a72c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1692 microversion: 2.1 time: 0.242955 Sep 07 10:29:26.799590 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3206/6351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:26 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1692 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:27.825010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:27.828146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:27.835551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:27.836046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:27.836492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:27.837213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:27.837674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:27.838103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.058281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:28.067830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea3c3611-b4e1-44b7-9f7c-6c715cb0ea5c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1682 microversion: 2.1 time: 0.246958 Sep 07 10:29:28.068541 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3146/6352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:27 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:28.093929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:28.094958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:28.102075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:28.102722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:28.103284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.104108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:28.104836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:28.105424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.251812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-03fc62f7-a295-4727-aea3-df030fc3eea7 tempest-TestNetworkAdvancedServerOps-52015988 tempest-TestNetworkAdvancedServerOps-52015988-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1835 microversion: 2.1 time: 0.162110 Sep 07 10:29:28.252502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3207/6353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:28 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1835 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:29:28.276532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:28.277142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:28.283965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:28.284389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:28.284825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.285537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:28.285989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:28.286411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.426313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:28.435255 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-daf44c4a-f774-4511-9dd1-7299513b3763 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1682 microversion: 2.1 time: 0.161745 Sep 07 10:29:28.435815 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3147/6354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:28 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:29:28.549397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:28.552461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:28.558646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:28.559824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:28.560335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.561234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:28.561719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:28.562182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:28.621440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38cf34db-65d8-499b-a054-1c2a6d5071fe tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action" status: 200 len: 38653 microversion: 2.1 time: 0.077543 Sep 07 10:29:28.623299 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3208/6355] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:29:28 2022] POST /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0/action => generated 38653 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:29:29.697392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-cf38982a-088a-4287-9cf1-f3a12663f939 req-96a21992-b914-417f-98a8-1b38dec38422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:29.704933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:29.705450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:29.712781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:29.713306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:29.713752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:29.714466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:29.714925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:29.715419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:29.729361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf38982a-088a-4287-9cf1-f3a12663f939 req-96a21992-b914-417f-98a8-1b38dec38422 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:29.730550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf38982a-088a-4287-9cf1-f3a12663f939 req-96a21992-b914-417f-98a8-1b38dec38422 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:29.730550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-cf38982a-088a-4287-9cf1-f3a12663f939 req-96a21992-b914-417f-98a8-1b38dec38422 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:29.751670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:29:29.756371 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-cf38982a-088a-4287-9cf1-f3a12663f939 req-96a21992-b914-417f-98a8-1b38dec38422 service nova] Creating event network-changed:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h1-836830-16 Sep 07 10:29:29.763591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-cf38982a-088a-4287-9cf1-f3a12663f939 req-96a21992-b914-417f-98a8-1b38dec38422 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072138 Sep 07 10:29:29.764746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3209/6356] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:29.875441 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2910dfd9-4e6c-401c-9c6d-b0a671619b7f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 204 len: 0 microversion: 2.1 time: 0.186652 Sep 07 10:29:29.876234 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3148/6357] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:29:29 2022] DELETE /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:29:29.893837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:29.894679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:29.909570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:29.917856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:29.919211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:29.923220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:29.926407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:29.927165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:30.552893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:30.564066 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31e056f6-097c-4c98-8d42-c4217d83278a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 200 len: 1688 microversion: 2.1 time: 0.682592 Sep 07 10:29:30.564681 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3210/6358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:29 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 1688 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:31.590543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:31.591648 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 562fdce5-9d26-4f33-9076-ffd3b79f11c0] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:31.598497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:31.598985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:31.599426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:31.600238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:31.600699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:31.601128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:31.615270 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] HTTP exception thrown: Instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 could not be found. Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Request method failure captured: Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 HTTP/1.1 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHElr-jtfg9tkZJQQRdOTu1MqVoIYXmKHjhqLwL9kI-prM3QLbxBlJDpY07lu25jnAnxlL7eUMv7rphaYeyr1U2lFwkv-rUdcDMU5kFU3xxRawRDh1cYbYdp51k9s29J_0UlWMe85FQHR6PrKI9fw00G1HM7mtzRIBdjePXMYHSDqZA Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_050638dd54d14d079b14d398e5ef9210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 821845320a8347e69590343607357785 Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 could not be found. Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '562fdce5-9d26-4f33-9076-ffd3b79f11c0'} Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 could not be found. Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 could not be found. Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:29:31.617153 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 could not be found. Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Returning 404 to user: Instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-72b08d9d-45d6-4b27-be6d-d080ae4d48ab tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0" status: 404 len: 111 microversion: 2.1 time: 0.032461 Sep 07 10:29:31.625450 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3149/6359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:31 2022] GET /compute/v2.1/servers/562fdce5-9d26-4f33-9076-ffd3b79f11c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:29:31.976122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fa1c7411-e13c-4f38-9e2e-b284d0a26ac8 req-0efdda86-e6ed-4911-b2d5-b9100e4abaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562fdce5-9d26-4f33-9076-ffd3b79f11c0", "name": "network-vif-deleted", "tag": "a3345573-dee9-454b-b986-e6e4a4ba88df"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:31.987656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fa1c7411-e13c-4f38-9e2e-b284d0a26ac8 req-0efdda86-e6ed-4911-b2d5-b9100e4abaf0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:31.988163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fa1c7411-e13c-4f38-9e2e-b284d0a26ac8 req-0efdda86-e6ed-4911-b2d5-b9100e4abaf0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:31.988603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fa1c7411-e13c-4f38-9e2e-b284d0a26ac8 req-0efdda86-e6ed-4911-b2d5-b9100e4abaf0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:32.003302 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fa1c7411-e13c-4f38-9e2e-b284d0a26ac8 req-0efdda86-e6ed-4911-b2d5-b9100e4abaf0 service nova] Creating event network-vif-deleted:a3345573-dee9-454b-b986-e6e4a4ba88df for instance 562fdce5-9d26-4f33-9076-ffd3b79f11c0 on n-h1-836830-16 Sep 07 10:29:32.009919 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fa1c7411-e13c-4f38-9e2e-b284d0a26ac8 req-0efdda86-e6ed-4911-b2d5-b9100e4abaf0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037011 Sep 07 10:29:32.010827 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3211/6360] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:29:35.337797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-471fdf08-86e3-489e-8c9c-83c83be88a07 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '.version_select at 0x7f14b123bee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:35.376087 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-471fdf08-86e3-489e-8c9c-83c83be88a07 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-341392546" status: 202 len: 0 microversion: 2.1 time: 0.043562 Sep 07 10:29:35.380056 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3150/6361] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 10:29:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-341392546 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:29:35.419412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58807408-2af0-4217-b8bc-4a2cddebd169 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: .version_select at 0x7f14b085d700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-898758649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRmYgOUHh3+O+mrs83rHJw6JBWHie1EpulY75MQCXcM0AQrYT1JDZPQMKeMl0Gs+WNVGuJ1c/3d9BIZpBwCkoSvvy7ayhF8PkZVMPAzau88bgowUakY1fRjLh8n/2iZEw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:35.442307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-58807408-2af0-4217-b8bc-4a2cddebd169 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:29:35.448493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-58807408-2af0-4217-b8bc-4a2cddebd169 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:29:35.477382 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58807408-2af0-4217-b8bc-4a2cddebd169 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062996 Sep 07 10:29:35.478001 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3212/6362] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:29:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:42.779066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:42.784701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-924125565", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "07d9a9ae-e837-4164-a9a3-9b9beae1415e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-898758649", "security_groups": [{"name": "tempest-secgroup-smoke-2097867032"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:42.939826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] validate_networks() for [('07d9a9ae-e837-4164-a9a3-9b9beae1415e', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:29:43.563462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:29:43.564248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:29:43.565264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:29:43.565695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:29:43.566124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:29:43.579523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:43.580616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:43.581362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:43.582146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:43.582618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:43.583047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:43.629150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:29:43.643863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Getting quotas for user 821845320a8347e69590343607357785 and project 050638dd54d14d079b14d398e5ef9210. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:29:43.672856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:29:43.675418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:29:43.758990 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a85b296e-7b9b-4048-9131-dab518eeae6e tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982649 Sep 07 10:29:43.760588 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3151/6363] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:29:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:29:43.775528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5ec04e4a-1cb4-400f-8ba3-5805a7c186e8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:43.776304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5ec04e4a-1cb4-400f-8ba3-5805a7c186e8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:43.784754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=31 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:44.047771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5ec04e4a-1cb4-400f-8ba3-5805a7c186e8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:44.055606 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5ec04e4a-1cb4-400f-8ba3-5805a7c186e8 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1265 microversion: 2.1 time: 0.286577 Sep 07 10:29:44.067025 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3213/6364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:43 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:45.084608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:45.085593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:45.093051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:45.094782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:45.096000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:45.097278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:45.098413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:45.099036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:45.100234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:45.179361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:45.194858 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5ebfda70-0a30-4c0b-b8c8-0600e8c87eaf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1317 microversion: 2.1 time: 0.114654 Sep 07 10:29:45.196022 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3152/6365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:45 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:46.222443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:46.223780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:46.232254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:46.233013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:46.234369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:46.235831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:46.236737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:46.237434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:46.807461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:46.824071 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-87ac316c-a166-438a-a9f4-0dd539ff4581 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.606753 Sep 07 10:29:46.825376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3214/6366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:46 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:47.562410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c5506d82-7498-464a-a7f1-3ccc7b52a3b2 req-7d06cb01-aea6-4c90-8082-61fc5ec48a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9dd86-d74e-482a-860a-999812d06d13", "tag": "254bc8a2-82d1-4d43-9798-a418aef95543"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:47.576307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c5506d82-7498-464a-a7f1-3ccc7b52a3b2 req-7d06cb01-aea6-4c90-8082-61fc5ec48a69 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:47.577347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c5506d82-7498-464a-a7f1-3ccc7b52a3b2 req-7d06cb01-aea6-4c90-8082-61fc5ec48a69 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:47.577347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c5506d82-7498-464a-a7f1-3ccc7b52a3b2 req-7d06cb01-aea6-4c90-8082-61fc5ec48a69 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:47.589250 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c5506d82-7498-464a-a7f1-3ccc7b52a3b2 req-7d06cb01-aea6-4c90-8082-61fc5ec48a69 service nova] Creating event network-changed:254bc8a2-82d1-4d43-9798-a418aef95543 for instance 48f9dd86-d74e-482a-860a-999812d06d13 on n-h2-836830-16 Sep 07 10:29:47.594972 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c5506d82-7498-464a-a7f1-3ccc7b52a3b2 req-7d06cb01-aea6-4c90-8082-61fc5ec48a69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037486 Sep 07 10:29:47.596299 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3153/6367] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:47.849685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:47.851263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:47.860146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:47.860927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:47.861539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:47.862368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:47.862950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:47.863507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:48.115318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:48.124064 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cac2fa5d-4805-4a0f-aaa6-e41df0d2b8a6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.279701 Sep 07 10:29:48.124973 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3215/6368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:47 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:49.150477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:49.151313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:49.159992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:49.160743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:49.161206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:49.162002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:49.162563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:49.163085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:49.414938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:49.425455 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3583ac1-47d6-435b-84f0-c71ac01505da tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.280387 Sep 07 10:29:49.426058 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3154/6369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:49 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:50.453400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:50.454211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:50.461817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:50.462325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:50.462783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:50.463496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:50.463971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:50.464418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:50.608202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:50.616054 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d21460b4-b872-472b-b711-aba46933d34f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.166711 Sep 07 10:29:50.616701 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3216/6370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:50 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:51.639813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:51.640405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:51.648622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:51.649280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:51.649725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:51.650432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:51.651669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:51.652101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:51.819782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:51.829264 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a381a912-aaf3-42ee-97e1-e3259d8c3630 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.193457 Sep 07 10:29:51.829849 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3155/6371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:51 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:52.852283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:52.853297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:52.861454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:52.862118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:52.863598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:52.863598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:52.864062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:52.864591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:53.015068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:53.024284 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8545300-e739-489d-9841-fc69c71193cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.175887 Sep 07 10:29:53.024880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3217/6372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:52 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:53.321061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-cbfb4ff5-93fa-4199-8378-6df8caf7a60e req-992bbe2b-0212-4614-bd93-b5a1cb3238c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9dd86-d74e-482a-860a-999812d06d13", "name": "network-vif-plugged", "status": "completed", "tag": "254bc8a2-82d1-4d43-9798-a418aef95543"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:53.341124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cbfb4ff5-93fa-4199-8378-6df8caf7a60e req-992bbe2b-0212-4614-bd93-b5a1cb3238c9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:53.342285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cbfb4ff5-93fa-4199-8378-6df8caf7a60e req-992bbe2b-0212-4614-bd93-b5a1cb3238c9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:53.343314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-cbfb4ff5-93fa-4199-8378-6df8caf7a60e req-992bbe2b-0212-4614-bd93-b5a1cb3238c9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:53.362559 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-cbfb4ff5-93fa-4199-8378-6df8caf7a60e req-992bbe2b-0212-4614-bd93-b5a1cb3238c9 service nova] Creating event network-vif-plugged:254bc8a2-82d1-4d43-9798-a418aef95543 for instance 48f9dd86-d74e-482a-860a-999812d06d13 on n-h2-836830-16 Sep 07 10:29:53.369925 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-cbfb4ff5-93fa-4199-8378-6df8caf7a60e req-992bbe2b-0212-4614-bd93-b5a1cb3238c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052222 Sep 07 10:29:53.372248 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3156/6373] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:54.047242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:54.048593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:54.056939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:54.060213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:54.061112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:54.061867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:54.062779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:54.063551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:54.064176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:54.219842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:54.228287 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3dddfac0-11a9-4231-b911-ffe45670b2be tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1391 microversion: 2.1 time: 0.185163 Sep 07 10:29:54.228861 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3218/6374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:54 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:55.251274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:55.252896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:55.260189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:55.261071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:55.272577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:55.273160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:55.273873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:55.274812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:55.275430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:55.276178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:55.446159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:55.456734 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f4267cd-0391-4526-8a7b-2be19af45454 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1563 microversion: 2.1 time: 0.206299 Sep 07 10:29:55.457774 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3157/6375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:55 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:55.480275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:55.480888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:55.483624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:29:55.489905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:55.490424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:55.490899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:55.491618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:55.492101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:55.492549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:55.643328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:55.653069 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1788f308-349e-40bf-8e1a-7cd41e85779f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1563 microversion: 2.1 time: 0.176569 Sep 07 10:29:55.653787 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3219/6376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:55 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:57.381776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:57.382932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:57.384628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9d3ee90f-d5cd-44bc-88d3-fffd21eb1ee2 req-a58a1b29-9f59-4e38-a530-8446cc6636a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9dd86-d74e-482a-860a-999812d06d13", "tag": "254bc8a2-82d1-4d43-9798-a418aef95543"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:57.392142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:57.393650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:57.394360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:57.395647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:57.396592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9d3ee90f-d5cd-44bc-88d3-fffd21eb1ee2 req-a58a1b29-9f59-4e38-a530-8446cc6636a6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:57.396765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:57.397217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:57.397627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9d3ee90f-d5cd-44bc-88d3-fffd21eb1ee2 req-a58a1b29-9f59-4e38-a530-8446cc6636a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:57.398240 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9d3ee90f-d5cd-44bc-88d3-fffd21eb1ee2 req-a58a1b29-9f59-4e38-a530-8446cc6636a6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:57.413462 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9d3ee90f-d5cd-44bc-88d3-fffd21eb1ee2 req-a58a1b29-9f59-4e38-a530-8446cc6636a6 service nova] Creating event network-changed:254bc8a2-82d1-4d43-9798-a418aef95543 for instance 48f9dd86-d74e-482a-860a-999812d06d13 on n-h2-836830-16 Sep 07 10:29:57.420650 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9d3ee90f-d5cd-44bc-88d3-fffd21eb1ee2 req-a58a1b29-9f59-4e38-a530-8446cc6636a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039826 Sep 07 10:29:57.421978 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3220/6377] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:29:57.679826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:57.692823 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c4bb83b3-8085-4b61-ada5-85baef0b920c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1563 microversion: 2.1 time: 0.315576 Sep 07 10:29:57.693472 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3158/6378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:57 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1563 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:58.969673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:58.971531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:58.984251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:58.984548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:58.984779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:58.985507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:58.986387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:58.986514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:59.014239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:29:59.112914 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a387222-461d-49ad-8d9e-900836ef4ac3 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 204 len: 0 microversion: 2.1 time: 0.149131 Sep 07 10:29:59.117250 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3221/6379] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:29:58 2022] DELETE /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:29:59.124326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:29:59.124956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:29:59.132845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:59.133378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:59.133817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:59.134640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:59.135141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:59.135571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:59.310853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:29:59.321618 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca87582d-5f03-4943-9bb6-f7be2c1ac920 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1580 microversion: 2.1 time: 0.201729 Sep 07 10:29:59.322607 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3159/6380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:29:59 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1580 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:29:59.440831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4444ec24-3d18-4be2-9417-7d08c9af02cd req-eb606de6-476e-49dc-978f-3ab5dd5b35dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:29:59.451443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4444ec24-3d18-4be2-9417-7d08c9af02cd req-eb606de6-476e-49dc-978f-3ab5dd5b35dd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:29:59.452085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4444ec24-3d18-4be2-9417-7d08c9af02cd req-eb606de6-476e-49dc-978f-3ab5dd5b35dd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:29:59.452538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4444ec24-3d18-4be2-9417-7d08c9af02cd req-eb606de6-476e-49dc-978f-3ab5dd5b35dd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:29:59.464109 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4444ec24-3d18-4be2-9417-7d08c9af02cd req-eb606de6-476e-49dc-978f-3ab5dd5b35dd service nova] Creating event network-changed:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:29:59.469637 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4444ec24-3d18-4be2-9417-7d08c9af02cd req-eb606de6-476e-49dc-978f-3ab5dd5b35dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034402 Sep 07 10:29:59.470493 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3222/6381] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:30:00.347450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:00.348026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:00.356217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:00.356714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:00.357154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:00.357948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:00.358406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:00.359303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:00.530043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:00.540217 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f669e3c-86e9-46fc-a0f9-e4f48bdbf778 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1580 microversion: 2.1 time: 0.196749 Sep 07 10:30:00.541087 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3160/6382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:00 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1580 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:01.435170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6b775702-7cbe-459b-9211-dc9eaa60cf89 req-38ae39fb-fd3e-4c99-9971-7edaba6fafbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7658cf36-23a1-48ba-972e-63ccba24953e", "name": "network-vif-deleted", "tag": "4c37d322-0ff7-4baa-8fa1-97d078996fb3"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:30:01.449802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6b775702-7cbe-459b-9211-dc9eaa60cf89 req-38ae39fb-fd3e-4c99-9971-7edaba6fafbd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:01.450359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6b775702-7cbe-459b-9211-dc9eaa60cf89 req-38ae39fb-fd3e-4c99-9971-7edaba6fafbd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:01.451402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6b775702-7cbe-459b-9211-dc9eaa60cf89 req-38ae39fb-fd3e-4c99-9971-7edaba6fafbd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:01.465150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6b775702-7cbe-459b-9211-dc9eaa60cf89 req-38ae39fb-fd3e-4c99-9971-7edaba6fafbd service nova] Creating event network-vif-deleted:4c37d322-0ff7-4baa-8fa1-97d078996fb3 for instance 7658cf36-23a1-48ba-972e-63ccba24953e on n-h1-836830-16 Sep 07 10:30:01.470838 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6b775702-7cbe-459b-9211-dc9eaa60cf89 req-38ae39fb-fd3e-4c99-9971-7edaba6fafbd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041592 Sep 07 10:30:01.472021 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3223/6383] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:30:01.565168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:01.566451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:01.576764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:01.577574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:01.578733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:01.579846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:01.580403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:01.580961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:01.655458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:01.664011 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02d3bf90-a9f4-44b8-a53c-f81486637a26 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1229 microversion: 2.1 time: 0.103124 Sep 07 10:30:01.665228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3161/6384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:01 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:02.688480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:02.689396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:02.696544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:02.697051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:02.697538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:02.698256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:02.698792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:02.699540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:02.788482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:02.797880 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-100f9936-0092-4cf5-81d1-7d9cafe06347 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1229 microversion: 2.1 time: 0.114341 Sep 07 10:30:02.798471 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3224/6385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:02 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:03.821324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:03.822058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:03.829922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:03.830413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:03.830851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:03.831808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:03.832296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:03.832724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:03.899500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:03.913460 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-43af3fd1-1f39-4677-b43f-a0c25d71a0b8 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1229 microversion: 2.1 time: 0.095925 Sep 07 10:30:03.917760 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3162/6386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:03 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:04.939676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:04.940918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:04.949836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:04.950780 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:04.951294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:04.952087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:04.952624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:04.953216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:05.032051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:05.040304 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b15c7274-a350-4a56-a0f7-8c9e3e491602 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1229 microversion: 2.1 time: 0.105200 Sep 07 10:30:05.040953 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3225/6387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:04 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:06.064713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:06.065430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:06.075112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:06.075696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:06.076613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:06.077453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:06.077953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:06.078390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:06.112989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:06.113563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:06.113988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:06.114627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lazy-loading 'fault' on Instance uuid 7658cf36-23a1-48ba-972e-63ccba24953e {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:30:06.165207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ec9ab0347c467ba0e5a63c6ace112f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2cf8121e245978ae7cbfef09e7e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:06.174658 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c6598c6b-dfb3-4696-a123-f3c53b3b16ad tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 200 len: 1234 microversion: 2.1 time: 0.113942 Sep 07 10:30:06.175237 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3163/6388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:06 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 1234 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:07.200126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:07.200859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] [instance: 7658cf36-23a1-48ba-972e-63ccba24953e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:07.209801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:07.210308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:07.210759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:07.211903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:07.212156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:07.212380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:07.233567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] HTTP exception thrown: Instance 7658cf36-23a1-48ba-972e-63ccba24953e could not be found. Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Request method failure captured: Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e HTTP/1.1 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHHQZE2GNCywKDq_NjRTgca4kbL01d9LFpe7tlhT44L0w-UKItG-n_4srXtLRDax6QpIZGoWAF1PEv6U9s9hrq-7pxO9aq2sVA0irHvVhlvJ8WNNbOrLhelhhGgfShKn6_dDN-i5xfQFwaxF7ZygH52tDuMSaglSKn723I14Jzumj1s Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 59c2cf8121e245978ae7cbfef09e7e4a Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestVolumeBackupRestore-579429012 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/59c2cf8121e245978ae7cbfef09e7e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59c2cf8121e245978ae7cbfef09e7e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59c2cf8121e245978ae7cbfef09e7e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_59c2cf8121e245978ae7cbfef09e7e4a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestVolumeBackupRestore-579429012 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 59c2cf8121e245978ae7cbfef09e7e4a Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestVolumeBackupRestore-579429012 Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestVolumeBackupRestore-579429012-project Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 58ec9ab0347c467ba0e5a63c6ace112f Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestVolumeBackupRestore-579429012-project Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 7658cf36-23a1-48ba-972e-63ccba24953e could not be found. Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '7658cf36-23a1-48ba-972e-63ccba24953e'} Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7658cf36-23a1-48ba-972e-63ccba24953e could not be found. Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7658cf36-23a1-48ba-972e-63ccba24953e could not be found. Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:30:07.237844 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7658cf36-23a1-48ba-972e-63ccba24953e could not be found. Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Returning 404 to user: Instance 7658cf36-23a1-48ba-972e-63ccba24953e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e563eed-c89c-4b4c-ad1b-bdd4e19512d1 tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e" status: 404 len: 111 microversion: 2.1 time: 0.041921 Sep 07 10:30:07.243437 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3226/6389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:07 2022] GET /compute/v2.1/servers/7658cf36-23a1-48ba-972e-63ccba24953e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:30:07.423301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-64900fab-ddcb-4cb6-af68-c844f4f6c3cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] Calling method '.version_select at 0x7f14b2798dc0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:07.447159 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-64900fab-ddcb-4cb6-af68-c844f4f6c3cb tempest-TestVolumeBackupRestore-579429012 tempest-TestVolumeBackupRestore-579429012-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-133585651" status: 202 len: 0 microversion: 2.1 time: 0.027519 Sep 07 10:30:07.447873 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3164/6390] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 7 10:30:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-133585651 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:30:19.095620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:30:19.098228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:19.113099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:30:19.113883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:30:19.116645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:19.117161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:19.117647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:19.118379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:19.118859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:19.119306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:19.202284 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd2cc128-6938-47e7-8b4e-b51cb93cb41f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13/action" status: 200 len: 24563 microversion: 2.1 time: 0.111285 Sep 07 10:30:19.203249 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3227/6391] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:30:19 2022] POST /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13/action => generated 24563 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:30:25.601542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=68 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:30:25.602333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:30:25.607878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:30:25.610627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:25.618766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:25.619250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:25.619688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:25.620384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:25.620938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:25.621405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:25.698196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:30:25.698629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:30:25.699102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:30:25.699524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:30:25.699913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:30:25.758985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:25.764907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:25.765429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:25.766682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:25.767201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:25.767630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:25.768395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:25.795327 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-acaef182-5dba-4bea-8eb1-7eb020a1c206 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13/action" status: 202 len: 1137 microversion: 2.1 time: 0.195677 Sep 07 10:30:25.795978 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3165/6392] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:30:25 2022] POST /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13/action => generated 1137 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 10:30:25.815810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:25.816591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:25.825226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:25.826009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:25.826458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:25.827187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:25.827670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:25.828120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:25.969855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:25.977794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d527bba-4b5b-4046-b56a-8f51633fef57 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.166501 Sep 07 10:30:25.978363 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3228/6393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:25 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:27.002430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:27.003021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:27.009670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:27.010156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:27.010626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:27.011992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:27.012458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:27.012884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:27.159615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:27.167733 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-912feab9-5acb-47b0-9dda-c3f44099421a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.169291 Sep 07 10:30:27.168309 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3166/6394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:26 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:30:28.192095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:28.192645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:28.201049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:28.201587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:28.202046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:28.202753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:28.203250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:28.203694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:28.343760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:28.352736 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-575344da-f88d-49f6-b37e-10928aa021f6 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.164628 Sep 07 10:30:28.353331 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3229/6395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:28 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:29.376089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:29.376700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:29.383643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:29.384127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:29.384565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:29.385287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:29.385785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:29.387787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:29.538542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:29.547007 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6992356d-c8ef-428f-a4c4-d49954437e0a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.174811 Sep 07 10:30:29.547583 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3167/6396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:29 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:30.571385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:30.572023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:30.579543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:30.580051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:30.580512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:30.581512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:30.582001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:30.582450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:30.723834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:30.731919 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81b43b36-b5d8-4915-a18e-4b64264cb9c9 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.164456 Sep 07 10:30:30.732547 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3230/6397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:30 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:31.755969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:31.756583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:31.764393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:31.764918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:31.765399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:31.766122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:31.766569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:31.767004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:31.909131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:31.917611 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1050e227-5c3e-45d2-be6c-93f33da345f0 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.164985 Sep 07 10:30:31.918454 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3168/6398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:31 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:32.942042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:32.942677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:32.950133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:32.950637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:32.951094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:32.951809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:32.952281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:32.952729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:33.093628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:33.101322 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4ccb8e4d-1fee-441d-8eb4-012ae40cd999 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.163169 Sep 07 10:30:33.101887 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3231/6399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:32 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:34.124956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:34.125630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:34.132837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:34.133369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:34.133819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:34.134532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:34.134996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:34.135430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:34.323281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:34.323281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a40e8f6-dda6-4663-a513-3b519ec17339 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.183467 Sep 07 10:30:34.323281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3169/6400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:34 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:35.328488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:35.339398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:35.342783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:35.343296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:35.343821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:35.344563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:35.345040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:35.345548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:35.490084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:35.498957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06b27f3c-18c9-4bbb-8138-47d4e47f33cf tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.174760 Sep 07 10:30:35.499635 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3232/6401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:35 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:36.522477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:36.523268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:36.530475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:36.530969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:36.531622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:36.532319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:36.532978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:36.533419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:36.676419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:36.685211 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eac95f95-9893-4f8b-802e-624dea053a50 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1691 microversion: 2.1 time: 0.166457 Sep 07 10:30:36.685789 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3170/6402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:36 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:37.710378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:37.711020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:37.719499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:37.720009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:37.720478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:37.721216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:37.721678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:37.722181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:38.254260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:38.263119 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d719490e-3217-452d-86eb-6fab453f9c4a tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1697 microversion: 2.1 time: 0.557383 Sep 07 10:30:38.263893 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3233/6403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:37 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1697 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:39.291103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:39.291797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:39.300541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:39.301052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:39.301550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:39.302405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:39.303102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:39.303901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:39.461781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:39.470829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d15e593a-aa4d-4485-847d-71c9bdd6b4cd tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1697 microversion: 2.1 time: 0.183692 Sep 07 10:30:39.471609 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3171/6404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:39 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:40.494680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:30:40.496143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:30:40.503500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:40.504018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:40.504482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:40.505241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:40.505723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:40.506176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:40.654262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:30:40.662589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a14393fb-06c0-48c5-83b8-a6670055704d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1682 microversion: 2.1 time: 0.171737 Sep 07 10:30:40.663284 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3234/6405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:30:40 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:30:41.438172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9c29cbba-8849-4a96-82a0-9e27d364f24b req-80e26c1a-5311-4356-841d-20cf9889d54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9dd86-d74e-482a-860a-999812d06d13", "name": "network-vif-plugged", "status": "completed", "tag": "254bc8a2-82d1-4d43-9798-a418aef95543"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:30:41.450617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9c29cbba-8849-4a96-82a0-9e27d364f24b req-80e26c1a-5311-4356-841d-20cf9889d54d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:30:41.451101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9c29cbba-8849-4a96-82a0-9e27d364f24b req-80e26c1a-5311-4356-841d-20cf9889d54d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:30:41.451535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9c29cbba-8849-4a96-82a0-9e27d364f24b req-80e26c1a-5311-4356-841d-20cf9889d54d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:30:41.463515 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9c29cbba-8849-4a96-82a0-9e27d364f24b req-80e26c1a-5311-4356-841d-20cf9889d54d service nova] Creating event network-vif-plugged:254bc8a2-82d1-4d43-9798-a418aef95543 for instance 48f9dd86-d74e-482a-860a-999812d06d13 on n-h2-836830-16 Sep 07 10:30:41.468902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9c29cbba-8849-4a96-82a0-9e27d364f24b req-80e26c1a-5311-4356-841d-20cf9889d54d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034727 Sep 07 10:30:41.469781 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3172/6406] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:31:04.867393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:04.870416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:04.873236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:04.874034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=46 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:04.880113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:04.880618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:04.881079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:04.881830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:04.882304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:04.882752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:04.961675 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1a45a765-6e2f-4752-9b5e-07e3e749253b tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "POST /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13/action" status: 200 len: 24571 microversion: 2.1 time: 0.098361 Sep 07 10:31:04.962391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3235/6407] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:31:04 2022] POST /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13/action => generated 24571 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:31:05.375463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=20 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:05.376229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:05.381089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1384781302", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:05.437577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:31:05.630951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:31:05.631380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:31:05.632263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:31:05.632263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:31:05.632645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:31:05.641929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:05.642416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:05.642853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:05.643578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:05.644036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:05.644494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:05.661266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Getting quotas for project bf114f9963bd4d4a8553e617566758cd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:31:05.667115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Getting quotas for user 8768395464fb400aa5d3a70aae6f9f18 and project bf114f9963bd4d4a8553e617566758cd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:31:05.679303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:31:05.682236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:31:05.725901 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d30b3316-7b53-47b5-9abe-1cb9aed6b0a9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.352389 Sep 07 10:31:05.726574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3173/6408] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:31:05.739051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74a284e3-9e84-44fb-b221-fd8c7954a4c0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:05.739768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-74a284e3-9e84-44fb-b221-fd8c7954a4c0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:05.800014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74a284e3-9e84-44fb-b221-fd8c7954a4c0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:05.808165 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74a284e3-9e84-44fb-b221-fd8c7954a4c0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1215 microversion: 2.1 time: 0.073161 Sep 07 10:31:05.808832 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3236/6409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:05 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:06.831780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:06.832400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:06.839776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:06.840262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:06.840696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:06.841447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:06.841900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:06.842324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:06.941133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:06.949778 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5df4e527-b1ae-4259-bbf3-48e60dd71096 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1275 microversion: 2.1 time: 0.123602 Sep 07 10:31:06.950443 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3174/6410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:06 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:07.975448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:07.976699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:07.986004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:07.986509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:07.986962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:07.987677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:07.988149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:07.988620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:08.216208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:08.225469 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-833d2c40-3554-4fe9-9f29-eb8f41ff88e9 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1315 microversion: 2.1 time: 0.253913 Sep 07 10:31:08.226137 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3237/6411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:07 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:08.467419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1a0a506f-1a15-4592-873c-3e658b0f6a8b req-79445041-08e5-4469-bd49-3c503a4572a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325a3d44-2759-46e7-b5d3-a3b9ad5953bf", "tag": "baafe2ba-0c72-4563-ab36-1b688fa908b9"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:08.477786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1a0a506f-1a15-4592-873c-3e658b0f6a8b req-79445041-08e5-4469-bd49-3c503a4572a0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:08.478358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1a0a506f-1a15-4592-873c-3e658b0f6a8b req-79445041-08e5-4469-bd49-3c503a4572a0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:08.479500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1a0a506f-1a15-4592-873c-3e658b0f6a8b req-79445041-08e5-4469-bd49-3c503a4572a0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:08.490767 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1a0a506f-1a15-4592-873c-3e658b0f6a8b req-79445041-08e5-4469-bd49-3c503a4572a0 service nova] Creating event network-changed:baafe2ba-0c72-4563-ab36-1b688fa908b9 for instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf on n-h1-836830-16 Sep 07 10:31:08.495821 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1a0a506f-1a15-4592-873c-3e658b0f6a8b req-79445041-08e5-4469-bd49-3c503a4572a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032835 Sep 07 10:31:08.496515 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3175/6412] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:31:09.249174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:09.249828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:09.256710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:09.257230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:09.257683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:09.258576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:09.259045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:09.259485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:09.399047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:09.407680 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-20ed5a4a-0eb6-4181-bb58-c66083de8eaf tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1315 microversion: 2.1 time: 0.162357 Sep 07 10:31:09.408266 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3238/6413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:09 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:10.431343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:10.432061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:10.439128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:10.439620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:10.440069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:10.440792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:10.441282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:10.441715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:10.578053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:10.585956 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6e2638e0-2e36-4b78-9aa0-ba942427c199 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1315 microversion: 2.1 time: 0.159799 Sep 07 10:31:10.586523 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3176/6414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:10 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:11.610223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:11.610866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:11.618163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:11.618673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:11.619125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:11.620603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:11.621082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:11.621551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:11.793643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:11.801459 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d34e2719-9374-440e-aa03-97605f258b44 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1315 microversion: 2.1 time: 0.195440 Sep 07 10:31:11.802121 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3239/6415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:11 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:12.280069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:12.280581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:12.284139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0727196d-38a3-4f40-a8d7-899e7e5df0a7 req-fded652b-3309-470c-97e4-ba4232d92faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9dd86-d74e-482a-860a-999812d06d13", "tag": "254bc8a2-82d1-4d43-9798-a418aef95543"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:12.288863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.289386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.289821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.290746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.291528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.292864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.296039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0727196d-38a3-4f40-a8d7-899e7e5df0a7 req-fded652b-3309-470c-97e4-ba4232d92faf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.296542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0727196d-38a3-4f40-a8d7-899e7e5df0a7 req-fded652b-3309-470c-97e4-ba4232d92faf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.297014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0727196d-38a3-4f40-a8d7-899e7e5df0a7 req-fded652b-3309-470c-97e4-ba4232d92faf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.319649 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0727196d-38a3-4f40-a8d7-899e7e5df0a7 req-fded652b-3309-470c-97e4-ba4232d92faf service nova] Creating event network-changed:254bc8a2-82d1-4d43-9798-a418aef95543 for instance 48f9dd86-d74e-482a-860a-999812d06d13 on n-h2-836830-16 Sep 07 10:31:12.325571 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0727196d-38a3-4f40-a8d7-899e7e5df0a7 req-fded652b-3309-470c-97e4-ba4232d92faf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046486 Sep 07 10:31:12.326239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:31:12.326704 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3240/6416] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:31:12.423183 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07d20640-1c20-4fc8-b25f-d56f6961f89c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 204 len: 0 microversion: 2.1 time: 0.147420 Sep 07 10:31:12.434046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:12.434888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:12.437277 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3177/6417] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:31:12 2022] DELETE /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:31:12.441710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.442412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.442882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.443770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.444255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.444709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.586905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:12.596116 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-579d78c6-02f4-4455-819a-a0a9bcc9ef64 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1688 microversion: 2.1 time: 0.166916 Sep 07 10:31:12.596975 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3241/6418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:12 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:12.826411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:12.827280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:12.833587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.834152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.834666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.835434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:12.835899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:12.836330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:12.973622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:12.991985 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab287076-da2e-47e7-b470-a421aba7e7cb tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1315 microversion: 2.1 time: 0.170493 Sep 07 10:31:12.992597 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3178/6419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:12 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:13.144256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-209cab34-1ed0-4099-8805-3ea46e3edd8b req-7d7f16d4-86aa-437b-a9d8-84970b4acabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325a3d44-2759-46e7-b5d3-a3b9ad5953bf", "name": "network-vif-plugged", "status": "completed", "tag": "baafe2ba-0c72-4563-ab36-1b688fa908b9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:13.162021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-209cab34-1ed0-4099-8805-3ea46e3edd8b req-7d7f16d4-86aa-437b-a9d8-84970b4acabe service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:13.162547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-209cab34-1ed0-4099-8805-3ea46e3edd8b req-7d7f16d4-86aa-437b-a9d8-84970b4acabe service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:13.163077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-209cab34-1ed0-4099-8805-3ea46e3edd8b req-7d7f16d4-86aa-437b-a9d8-84970b4acabe service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:13.177912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-209cab34-1ed0-4099-8805-3ea46e3edd8b req-7d7f16d4-86aa-437b-a9d8-84970b4acabe service nova] Creating event network-vif-plugged:baafe2ba-0c72-4563-ab36-1b688fa908b9 for instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf on n-h1-836830-16 Sep 07 10:31:13.183873 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-209cab34-1ed0-4099-8805-3ea46e3edd8b req-7d7f16d4-86aa-437b-a9d8-84970b4acabe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043830 Sep 07 10:31:13.184495 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3242/6420] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:31:13.619917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:13.620527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:13.627657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:13.628150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:13.628591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:13.629389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:13.629850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:13.630275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:13.835804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:13.844224 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d26d81d3-7b3d-41ef-b7c5-3a9708e0a07f tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1688 microversion: 2.1 time: 0.228161 Sep 07 10:31:13.844804 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3179/6421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:13 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:14.016069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:14.016804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:14.023522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:14.024043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:14.024503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:14.025256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:14.025773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:14.027041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:14.225955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:14.234928 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-087c39ce-bbe7-41e8-af34-113834325a84 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1315 microversion: 2.1 time: 0.223394 Sep 07 10:31:14.235517 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3243/6422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:14 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:14.446707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d80b39dc-93fe-4196-991d-b22e12b0edf6 req-9b6fb853-9ce7-4984-b463-bf58c1383b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9dd86-d74e-482a-860a-999812d06d13", "name": "network-vif-deleted", "tag": "254bc8a2-82d1-4d43-9798-a418aef95543"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:14.457480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d80b39dc-93fe-4196-991d-b22e12b0edf6 req-9b6fb853-9ce7-4984-b463-bf58c1383b3f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:14.457950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d80b39dc-93fe-4196-991d-b22e12b0edf6 req-9b6fb853-9ce7-4984-b463-bf58c1383b3f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:14.458373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d80b39dc-93fe-4196-991d-b22e12b0edf6 req-9b6fb853-9ce7-4984-b463-bf58c1383b3f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:14.469562 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d80b39dc-93fe-4196-991d-b22e12b0edf6 req-9b6fb853-9ce7-4984-b463-bf58c1383b3f service nova] Creating event network-vif-deleted:254bc8a2-82d1-4d43-9798-a418aef95543 for instance 48f9dd86-d74e-482a-860a-999812d06d13 on n-h2-836830-16 Sep 07 10:31:14.474924 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d80b39dc-93fe-4196-991d-b22e12b0edf6 req-9b6fb853-9ce7-4984-b463-bf58c1383b3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Sep 07 10:31:14.475962 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3180/6423] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:31:14.869470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:14.870865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:14.878154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:14.878664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:14.879575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:14.880302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:14.880784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:14.881252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:14.913591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:14.914039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:14.914628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:14.915179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lazy-loading 'fault' on Instance uuid 48f9dd86-d74e-482a-860a-999812d06d13 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:31:14.964671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821845320a8347e69590343607357785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050638dd54d14d079b14d398e5ef9210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:14.972911 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5cc8c3fa-2103-47fd-bca7-24e90a3cbe6c tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 200 len: 1355 microversion: 2.1 time: 0.107252 Sep 07 10:31:14.973778 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3244/6424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:14 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:15.259951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:15.260919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:15.267699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:15.268186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:15.268618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:15.269381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:15.269834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:15.270254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:15.407895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:15.415854 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8f165bd8-efcc-4775-b0bd-5959a7074e32 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1465 microversion: 2.1 time: 0.160885 Sep 07 10:31:15.416426 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3181/6425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:15 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:15.462447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:15.462969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:15.470714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:15.471216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:15.471695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:15.472400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:15.472869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:15.473339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:15.501409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:31:15.576061 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-44ff2e62-758f-4750-aaf1-25b3f82ed5b4 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "DELETE /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 204 len: 0 microversion: 2.1 time: 0.117179 Sep 07 10:31:15.576649 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3245/6426] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:31:15 2022] DELETE /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:31:15.585318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:15.585929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:15.592713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:15.593220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:15.593728 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:15.594410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:15.594863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:15.595286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:15.652319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:15.673567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:15.725855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:15.733667 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-87cb0299-1c36-436a-8107-b8ff798c450b tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1471 microversion: 2.1 time: 0.152536 Sep 07 10:31:15.734236 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3182/6427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:15 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:31:15.997388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:15.998107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] [instance: 48f9dd86-d74e-482a-860a-999812d06d13] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:16.000095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:16.005553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:16.006050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:16.006503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:16.007198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:16.007668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:16.008105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:16.022569 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] HTTP exception thrown: Instance 48f9dd86-d74e-482a-860a-999812d06d13 could not be found. Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Request method failure captured: Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 HTTP/1.1 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHElr-jtfg9tkZJQQRdOTu1MqVoIYXmKHjhqLwL9kI-prM3QLbxBlJDpY07lu25jnAnxlL7eUMv7rphaYeyr1U2lFwkv-rUdcDMU5kFU3xxRawRDh1cYbYdp51k9s29J_0UlWMe85FQHR6PrKI9fw00G1HM7mtzRIBdjePXMYHSDqZA Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/050638dd54d14d079b14d398e5ef9210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_050638dd54d14d079b14d398e5ef9210", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 050638dd54d14d079b14d398e5ef9210 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-485611081 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 821845320a8347e69590343607357785 Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-485611081-project Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 48f9dd86-d74e-482a-860a-999812d06d13 could not be found. Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '48f9dd86-d74e-482a-860a-999812d06d13'} Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9dd86-d74e-482a-860a-999812d06d13 could not be found. Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9dd86-d74e-482a-860a-999812d06d13 could not be found. Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:16.024218 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9dd86-d74e-482a-860a-999812d06d13 could not be found. Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Returning 404 to user: Instance 48f9dd86-d74e-482a-860a-999812d06d13 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad97ccfa-c953-4edc-bf54-1e4847e9a74d tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13" status: 404 len: 111 microversion: 2.1 time: 0.033446 Sep 07 10:31:16.027768 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3246/6428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:15 2022] GET /compute/v2.1/servers/48f9dd86-d74e-482a-860a-999812d06d13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:31:16.757021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:16.757840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:16.765072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:16.765620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:16.766062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:16.766757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:16.767212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:16.767638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:17.019345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:17.028686 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-683db6de-51ee-4531-ab8f-b366aa0386d0 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1471 microversion: 2.1 time: 0.275518 Sep 07 10:31:17.029298 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3183/6429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:16 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:17.990402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-74c1615f-b440-4918-9bd7-025c2e1fdc91 req-fe76347b-4e80-45eb-a11c-16849d8d7b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325a3d44-2759-46e7-b5d3-a3b9ad5953bf", "name": "network-vif-deleted", "tag": "baafe2ba-0c72-4563-ab36-1b688fa908b9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:18.003209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-74c1615f-b440-4918-9bd7-025c2e1fdc91 req-fe76347b-4e80-45eb-a11c-16849d8d7b41 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:18.004024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-74c1615f-b440-4918-9bd7-025c2e1fdc91 req-fe76347b-4e80-45eb-a11c-16849d8d7b41 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:18.004675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-74c1615f-b440-4918-9bd7-025c2e1fdc91 req-fe76347b-4e80-45eb-a11c-16849d8d7b41 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:18.018743 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-74c1615f-b440-4918-9bd7-025c2e1fdc91 req-fe76347b-4e80-45eb-a11c-16849d8d7b41 service nova] Creating event network-vif-deleted:baafe2ba-0c72-4563-ab36-1b688fa908b9 for instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf on n-h1-836830-16 Sep 07 10:31:18.024586 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-74c1615f-b440-4918-9bd7-025c2e1fdc91 req-fe76347b-4e80-45eb-a11c-16849d8d7b41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228690 Sep 07 10:31:18.025551 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3247/6430] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:31:18.051195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:18.051812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:18.059614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:18.060103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:18.060543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:18.061438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:18.061903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:18.062365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:18.100741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:18.101267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:18.101704 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:18.102149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lazy-loading 'fault' on Instance uuid 325a3d44-2759-46e7-b5d3-a3b9ad5953bf {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:31:18.171470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8768395464fb400aa5d3a70aae6f9f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf114f9963bd4d4a8553e617566758cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:18.179620 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e89d288-07b7-44df-a4e6-871bd1ad854e tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 200 len: 1305 microversion: 2.1 time: 0.132237 Sep 07 10:31:18.180205 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3184/6431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:18 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:19.207815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:19.212308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] [instance: 325a3d44-2759-46e7-b5d3-a3b9ad5953bf] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:19.230958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:19.232405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:19.233063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:19.234110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:19.234737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:19.235447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:19.261797 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] HTTP exception thrown: Instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf could not be found. Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Request method failure captured: Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf HTTP/1.1 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHLniy4T2OkJLxOIIyOBGcTOj-GCYgg0aJ0865Fi9V45AjB1Q937FZ4kGBGpnSSBHi9QEC-wYDbTuuHYqhHYzYo6EWmzf1K4Gx0Zh59sgPkOc1glHd4MfspFHR2nVLLMg9b6K3W-xX6-iatqSEvOJqW_zzA0pz_0t9nMAX9JNyh64I8 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: bf114f9963bd4d4a8553e617566758cd Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-VolumesNegativeTest-700622843 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf114f9963bd4d4a8553e617566758cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf114f9963bd4d4a8553e617566758cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf114f9963bd4d4a8553e617566758cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf114f9963bd4d4a8553e617566758cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-VolumesNegativeTest-700622843 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: bf114f9963bd4d4a8553e617566758cd Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-VolumesNegativeTest-700622843 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-VolumesNegativeTest-700622843-project Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 8768395464fb400aa5d3a70aae6f9f18 Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-VolumesNegativeTest-700622843-project Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf could not be found. Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '325a3d44-2759-46e7-b5d3-a3b9ad5953bf'} Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf could not be found. Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf could not be found. Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:31:19.263970 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf could not be found. Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] Returning 404 to user: Instance 325a3d44-2759-46e7-b5d3-a3b9ad5953bf could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:31:19.267726 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9af152d8-3c8c-4e7e-b873-6ee20a403d87 tempest-VolumesNegativeTest-700622843 tempest-VolumesNegativeTest-700622843-project] 10.222.0.60 "GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf" status: 404 len: 111 microversion: 2.1 time: 0.065391 Sep 07 10:31:19.271842 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3248/6432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:19 2022] GET /compute/v2.1/servers/325a3d44-2759-46e7-b5d3-a3b9ad5953bf => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:31:20.076741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b3e8edcc-ab8a-4cea-b345-a10e15605588 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] Calling method '.version_select at 0x7f14b0a38af0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:20.100772 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b3e8edcc-ab8a-4cea-b345-a10e15605588 tempest-TestNetworkAdvancedServerOps-485611081 tempest-TestNetworkAdvancedServerOps-485611081-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-898758649" status: 202 len: 0 microversion: 2.1 time: 0.028230 Sep 07 10:31:20.102231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3185/6433] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 10:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-898758649 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:31:33.646056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:33.648006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:33.856945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5f42f730-b6f9-4b87-9dca-9df42189d484 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Action: 'create', calling method: .version_select at 0x7f14b090fee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-366075584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdhTbggm5UDTF5nYTB/GfEOZww4jkd6Gaoh5rx/92IF4ThKuRRCyG4aDB8TfZ59f643Lkn5S2kkeEjrLCAeqS5OCvyw8vAcbdd77LGSh3EFF2bn132hrdjuBqSeb6aOBw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:33.877551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5f42f730-b6f9-4b87-9dca-9df42189d484 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Getting quotas for project 115c494da14d435a97c7e9103704f5fc. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:31:33.885073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5f42f730-b6f9-4b87-9dca-9df42189d484 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Getting quotas for user bd5ef8b53a5b4249a8202e1bbe839451 and project 115c494da14d435a97c7e9103704f5fc. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:31:33.916796 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5f42f730-b6f9-4b87-9dca-9df42189d484 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.278079 Sep 07 10:31:33.917669 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3249/6434] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:31:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:31:35.043846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-770126694", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-366075584", "security_groups": [{"name": "tempest-secgroup-smoke-1268120595"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "bcc35458-7557-42e5-bf0c-8eb8ea3f2d9c"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:35.056320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:35.057109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:35.169745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] validate_networks() for [('bcc35458-7557-42e5-bf0c-8eb8ea3f2d9c', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:31:35.603244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Getting quotas for project 115c494da14d435a97c7e9103704f5fc. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:31:35.609626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Getting quotas for user bd5ef8b53a5b4249a8202e1bbe839451 and project 115c494da14d435a97c7e9103704f5fc. Resources: dict_keys(['metadata_items']) {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:31:35.624939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:31:35.625483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:31:35.626062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:31:35.626543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:31:35.627028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:31:35.635539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:35.636140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:35.636610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:35.638630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:35.638630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:35.638630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:35.657034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Getting quotas for project 115c494da14d435a97c7e9103704f5fc. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:31:35.670053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Getting quotas for user bd5ef8b53a5b4249a8202e1bbe839451 and project 115c494da14d435a97c7e9103704f5fc. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:31:35.686417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:31:35.688785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:31:35.752171 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48466e0b-ba08-4c4a-97aa-abaea3285be7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712726 Sep 07 10:31:35.758797 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3186/6435] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:31:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:31:35.766439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c05ada51-dcd6-48b7-b38f-71e6b828b156 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:35.767069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c05ada51-dcd6-48b7-b38f-71e6b828b156 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:35.837783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c05ada51-dcd6-48b7-b38f-71e6b828b156 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:35.845514 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c05ada51-dcd6-48b7-b38f-71e6b828b156 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1301 microversion: 2.1 time: 0.083884 Sep 07 10:31:35.846420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3250/6436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:35 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:36.873953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:36.874602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:36.880724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:36.881239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:36.881676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:36.882398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:36.882854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:36.883277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:36.945802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:36.954261 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-751b08e3-718e-4f8d-8c9a-e3556103b774 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1353 microversion: 2.1 time: 0.086019 Sep 07 10:31:36.954801 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3187/6437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:36 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:37.983601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:37.984425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:37.997705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:38.002118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:38.002991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:38.004066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:38.004903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:38.005943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:38.298754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:38.308011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-651b89f4-34b5-4124-9698-96ae55054fe8 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.333131 Sep 07 10:31:38.308011 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3251/6438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:37 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:38.984304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-caa5b847-c857-4860-bcef-608de52a5f3f req-103a0974-273f-41ac-9558-f5ecc66a7980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14df3e28-810b-4488-b7d6-14f97997a160", "tag": "f4e668d3-e899-47d5-b06c-70b8bcbbd022"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:39.006650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caa5b847-c857-4860-bcef-608de52a5f3f req-103a0974-273f-41ac-9558-f5ecc66a7980 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:39.010483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caa5b847-c857-4860-bcef-608de52a5f3f req-103a0974-273f-41ac-9558-f5ecc66a7980 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:39.011060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caa5b847-c857-4860-bcef-608de52a5f3f req-103a0974-273f-41ac-9558-f5ecc66a7980 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:39.042614 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-caa5b847-c857-4860-bcef-608de52a5f3f req-103a0974-273f-41ac-9558-f5ecc66a7980 service nova] Creating event network-changed:f4e668d3-e899-47d5-b06c-70b8bcbbd022 for instance 14df3e28-810b-4488-b7d6-14f97997a160 on n-h1-836830-16 Sep 07 10:31:39.053346 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-caa5b847-c857-4860-bcef-608de52a5f3f req-103a0974-273f-41ac-9558-f5ecc66a7980 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068948 Sep 07 10:31:39.054650 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3188/6439] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:31:39.332229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:39.332858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:39.339946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:39.340448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:39.340907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:39.341653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:39.342134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:39.342579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:39.594383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:39.604791 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e9af3704-b510-4bb6-889e-ac685a5c25ab tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.276649 Sep 07 10:31:39.605604 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3252/6440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:39 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:40.632062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:40.632772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:40.640179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:40.640810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:40.641404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:40.642254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:40.642840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:40.643408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:40.876185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:40.884399 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4c33994b-b0f1-45a6-a90f-d1535a47ff4b tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.257540 Sep 07 10:31:40.885070 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3189/6441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:40 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:41.907325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:41.907957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:41.914957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:41.915411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:41.915894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:41.916601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:41.917077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:41.917549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:42.068659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:42.077345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b666fa54-4543-42ad-83f6-5eee089ac5b6 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.173880 Sep 07 10:31:42.077928 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3253/6442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:41 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:43.099961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:43.101127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:43.111278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:43.112030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:43.112632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:43.114270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:43.115592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:43.116221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:43.280319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:43.288942 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eeeb3679-ad81-4d3b-8c21-36312abf2f67 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.192861 Sep 07 10:31:43.289678 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3190/6443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:43 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:44.312799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:44.313457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:44.320815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:44.321347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:44.321810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:44.323567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:44.324046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:44.324491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:44.468808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:44.476917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-20b5ee64-97f9-4fe3-9785-8f616973a91f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.168025 Sep 07 10:31:44.477534 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3254/6444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:44 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:45.196716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e7c14e95-76cd-4bdb-87ae-84797000c6d7 req-d3199b76-1a9a-4d04-871f-3b0eed14b0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14df3e28-810b-4488-b7d6-14f97997a160", "name": "network-vif-plugged", "status": "completed", "tag": "f4e668d3-e899-47d5-b06c-70b8bcbbd022"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:45.209870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e7c14e95-76cd-4bdb-87ae-84797000c6d7 req-d3199b76-1a9a-4d04-871f-3b0eed14b0c0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:45.210554 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e7c14e95-76cd-4bdb-87ae-84797000c6d7 req-d3199b76-1a9a-4d04-871f-3b0eed14b0c0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:45.211139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e7c14e95-76cd-4bdb-87ae-84797000c6d7 req-d3199b76-1a9a-4d04-871f-3b0eed14b0c0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:45.227162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e7c14e95-76cd-4bdb-87ae-84797000c6d7 req-d3199b76-1a9a-4d04-871f-3b0eed14b0c0 service nova] Creating event network-vif-plugged:f4e668d3-e899-47d5-b06c-70b8bcbbd022 for instance 14df3e28-810b-4488-b7d6-14f97997a160 on n-h1-836830-16 Sep 07 10:31:45.233370 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e7c14e95-76cd-4bdb-87ae-84797000c6d7 req-d3199b76-1a9a-4d04-871f-3b0eed14b0c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041019 Sep 07 10:31:45.233992 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3191/6445] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:31:45.500302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:45.501254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:45.508219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:45.508714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:45.509166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:45.510555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:45.511059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:45.511503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:45.652949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:45.660753 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a729f9b3-317e-4a21-bdc9-bfa9ec226596 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1427 microversion: 2.1 time: 0.164387 Sep 07 10:31:45.661297 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3255/6446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:45 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:46.681057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:46.682599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:46.688468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:46.689198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:46.696710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:46.697904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:46.698377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:46.699265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:46.699874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:46.700439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:46.928734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:46.949134 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc43ab5d-5bdf-451b-8d7d-a70c24be31b5 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1607 microversion: 2.1 time: 0.268831 Sep 07 10:31:46.950014 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3192/6447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:46 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1607 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:46.972693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:46.973946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:46.976664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:31:46.985077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:46.985842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:46.986472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:46.987644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:46.988467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:46.989069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:47.161160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:47.169936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4594a8bd-aaad-420f-9428-5b1ed6c428c7 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1607 microversion: 2.1 time: 0.201194 Sep 07 10:31:47.170521 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3256/6448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:46 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1607 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:47.193734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:31:47.194428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:31:47.201829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:47.202729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:47.206267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:47.207610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:47.208759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:47.209367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:47.359542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:31:47.367591 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2c594b8-2cf6-4994-839f-55a71a79f78d tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1607 microversion: 2.1 time: 0.178259 Sep 07 10:31:47.368170 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3193/6449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:31:47 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1607 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:31:49.313833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-798e36b4-6d4a-4cbb-bbef-cc051d1a639b req-c6bb09a9-89f6-4fc1-88c4-a7ca31198dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14df3e28-810b-4488-b7d6-14f97997a160", "tag": "f4e668d3-e899-47d5-b06c-70b8bcbbd022"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:31:49.324836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-798e36b4-6d4a-4cbb-bbef-cc051d1a639b req-c6bb09a9-89f6-4fc1-88c4-a7ca31198dcd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:31:49.325354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-798e36b4-6d4a-4cbb-bbef-cc051d1a639b req-c6bb09a9-89f6-4fc1-88c4-a7ca31198dcd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:31:49.325801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-798e36b4-6d4a-4cbb-bbef-cc051d1a639b req-c6bb09a9-89f6-4fc1-88c4-a7ca31198dcd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:31:49.338348 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-798e36b4-6d4a-4cbb-bbef-cc051d1a639b req-c6bb09a9-89f6-4fc1-88c4-a7ca31198dcd service nova] Creating event network-changed:f4e668d3-e899-47d5-b06c-70b8bcbbd022 for instance 14df3e28-810b-4488-b7d6-14f97997a160 on n-h1-836830-16 Sep 07 10:31:49.343537 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-798e36b4-6d4a-4cbb-bbef-cc051d1a639b req-c6bb09a9-89f6-4fc1-88c4-a7ca31198dcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033403 Sep 07 10:31:49.344158 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3257/6450] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:32:28.267264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:32:28.267815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:32:28.269851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:32:28.270532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=36 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:32:28.276645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:32:28.277136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:32:28.278294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:32:28.279135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:32:28.279640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:32:28.280072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:32:28.304674 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f059f2d-fbc0-4f17-92ea-f0f1682e202f tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043285 Sep 07 10:32:28.305281 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3194/6451] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 7 10:32:28 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:36:32.025086 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 10:36:32.026055 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 10:36:32.026678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:32.027442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=38 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:32.028777 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 10:36:32.028890 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 (ip 10.222.0.60) !!! Sep 07 10:36:32.030071 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 10:36:32.030201 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 (ip 10.222.0.60) !!! Sep 07 10:36:32.031161 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:36:32.031293 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 (ip 10.222.0.60) !!! Sep 07 10:36:32.040596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:32.041252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:32.052215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:32.052723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:32.053200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:32.053935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:32.054413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:32.054887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:32.081008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:36:32.161668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cf3b8530-8706-4b40-8d6c-d4d80d5c4183 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 204 len: 0 microversion: 2.1 time: 0.138090 Sep 07 10:36:32.162168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3258/6452] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:36:32 2022] DELETE /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:36:32.168665 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 10:36:32.169875 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 10:36:32.170342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:32.171085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:32.172225 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 10:36:32.172410 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 (ip 10.222.0.60) !!! Sep 07 10:36:32.174462 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 10:36:32.174729 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 (ip 10.222.0.60) !!! Sep 07 10:36:32.176413 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 10:36:32.176521 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 (ip 10.222.0.60) !!! Sep 07 10:36:32.184916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:32.185576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:32.201508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:32.202038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:32.202492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:32.203201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:32.203694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:32.204129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:32.526654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:32.535561 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75a71a8c-e90b-4aca-b591-568812db3a61 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1732 microversion: 2.1 time: 0.368778 Sep 07 10:36:32.536145 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3195/6453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:32 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1732 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:36:33.559029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:33.559761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:33.569302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:33.569799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:33.570244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:33.570943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:33.571408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:33.571846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:33.579168 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 60232. Sep 07 10:36:33.589719 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 60230. Sep 07 10:36:33.962818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:33.970756 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-45672adf-58c9-43ff-b9a6-be5ba0b24d25 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1732 microversion: 2.1 time: 0.415957 Sep 07 10:36:33.972173 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3259/6454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:33 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1732 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:36:34.731602 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 60246. Sep 07 10:36:34.741203 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 60244. Sep 07 10:36:34.801967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1aef70b0-5f4c-424d-a2f2-23ed7861c4a7 req-444753ab-1c53-4348-af05-1d4c78c91e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14df3e28-810b-4488-b7d6-14f97997a160", "name": "network-vif-deleted", "tag": "f4e668d3-e899-47d5-b06c-70b8bcbbd022"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:36:34.820297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1aef70b0-5f4c-424d-a2f2-23ed7861c4a7 req-444753ab-1c53-4348-af05-1d4c78c91e9c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:34.820791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1aef70b0-5f4c-424d-a2f2-23ed7861c4a7 req-444753ab-1c53-4348-af05-1d4c78c91e9c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:34.821261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1aef70b0-5f4c-424d-a2f2-23ed7861c4a7 req-444753ab-1c53-4348-af05-1d4c78c91e9c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:34.836114 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1aef70b0-5f4c-424d-a2f2-23ed7861c4a7 req-444753ab-1c53-4348-af05-1d4c78c91e9c service nova] Creating event network-vif-deleted:f4e668d3-e899-47d5-b06c-70b8bcbbd022 for instance 14df3e28-810b-4488-b7d6-14f97997a160 on n-h1-836830-16 Sep 07 10:36:34.843488 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1aef70b0-5f4c-424d-a2f2-23ed7861c4a7 req-444753ab-1c53-4348-af05-1d4c78c91e9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133708 Sep 07 10:36:34.844427 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3196/6455] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:36:34.995644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:34.996280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:35.003819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:35.004318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:35.004779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:35.005517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:35.006223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:35.006644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:35.050474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:35.050970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:35.051424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:35.051877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lazy-loading 'fault' on Instance uuid 14df3e28-810b-4488-b7d6-14f97997a160 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:36:35.093906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5ef8b53a5b4249a8202e1bbe839451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115c494da14d435a97c7e9103704f5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:35.102052 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9ef3c9e3-f878-4c00-ad39-dfc818dcc6fe tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 200 len: 1387 microversion: 2.1 time: 0.110297 Sep 07 10:36:35.102640 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3260/6456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:34 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 1387 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:36:36.125836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:36.126548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:36.134572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:36.135055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:36.135493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:36.136184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:36.136640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:36.137067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:36.150720 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] HTTP exception thrown: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Request method failure captured: Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 HTTP/1.1 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHL-USy0ssCuoXECce81_kXFzN_njqlmxSbqomGqAlXwMeHE0YC7oK3Qdf89kU6Lgw_hVatSHpsTnDJVrzyxjc-O7D1Kn6e6Wy00piXGd4vjgADGLFGECR2r4bj2FZIdZoFzD0HL04HDP3ob1BZ-Rxti7-Ng6Y3lEh0lbnMY3HszD9c Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 115c494da14d435a97c7e9103704f5fc Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_115c494da14d435a97c7e9103704f5fc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 115c494da14d435a97c7e9103704f5fc Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestServerBasicOps-1628818617-project Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: bd5ef8b53a5b4249a8202e1bbe839451 Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestServerBasicOps-1628818617-project Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '14df3e28-810b-4488-b7d6-14f97997a160'} Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:36:36.152325 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Returning 404 to user: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d92517da-b68f-4d13-aefd-063a9c3d5234 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 404 len: 111 microversion: 2.1 time: 0.032255 Sep 07 10:36:36.156447 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3197/6457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:36 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:36:36.622088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:36.622604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:36.631000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:36.631500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:36.631951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:36.632662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:36.633171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:36.633606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:36.648575 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] HTTP exception thrown: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Request method failure captured: Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 HTTP/1.1 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHL-USy0ssCuoXECce81_kXFzN_njqlmxSbqomGqAlXwMeHE0YC7oK3Qdf89kU6Lgw_hVatSHpsTnDJVrzyxjc-O7D1Kn6e6Wy00piXGd4vjgADGLFGECR2r4bj2FZIdZoFzD0HL04HDP3ob1BZ-Rxti7-Ng6Y3lEh0lbnMY3HszD9c Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 115c494da14d435a97c7e9103704f5fc Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_115c494da14d435a97c7e9103704f5fc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 115c494da14d435a97c7e9103704f5fc Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestServerBasicOps-1628818617-project Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: bd5ef8b53a5b4249a8202e1bbe839451 Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestServerBasicOps-1628818617-project Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '14df3e28-810b-4488-b7d6-14f97997a160'} Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:36:36.650314 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Returning 404 to user: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63d16cd9-e72b-44b0-acc1-9f7690ac75c3 tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 404 len: 111 microversion: 2.1 time: 0.033612 Sep 07 10:36:36.654207 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3261/6458] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:36:36 2022] DELETE /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:36:36.660378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:36.660998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] [instance: 14df3e28-810b-4488-b7d6-14f97997a160] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:36.667114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:36.667541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:36.667981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:36.668671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:36.669127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:36.669578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:36.683292 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] HTTP exception thrown: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Request method failure captured: Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 HTTP/1.1 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHL-USy0ssCuoXECce81_kXFzN_njqlmxSbqomGqAlXwMeHE0YC7oK3Qdf89kU6Lgw_hVatSHpsTnDJVrzyxjc-O7D1Kn6e6Wy00piXGd4vjgADGLFGECR2r4bj2FZIdZoFzD0HL04HDP3ob1BZ-Rxti7-Ng6Y3lEh0lbnMY3HszD9c Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 115c494da14d435a97c7e9103704f5fc Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/115c494da14d435a97c7e9103704f5fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_115c494da14d435a97c7e9103704f5fc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 115c494da14d435a97c7e9103704f5fc Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestServerBasicOps-1628818617 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestServerBasicOps-1628818617-project Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: bd5ef8b53a5b4249a8202e1bbe839451 Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestServerBasicOps-1628818617-project Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '14df3e28-810b-4488-b7d6-14f97997a160'} Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:36:36.684838 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Returning 404 to user: Instance 14df3e28-810b-4488-b7d6-14f97997a160 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2782db4b-ee7e-4221-a9c4-11fca025d0bd tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160" status: 404 len: 111 microversion: 2.1 time: 0.029787 Sep 07 10:36:36.688851 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3198/6459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:36 2022] GET /compute/v2.1/servers/14df3e28-810b-4488-b7d6-14f97997a160 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:36:36.861958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0b5f63dc-6aa8-4c95-a595-1e1ac623c3ed tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] Calling method '.version_select at 0x7f14b1b5a5e0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:36.890846 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0b5f63dc-6aa8-4c95-a595-1e1ac623c3ed tempest-TestServerBasicOps-1628818617 tempest-TestServerBasicOps-1628818617-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-366075584" status: 202 len: 0 microversion: 2.1 time: 0.033488 Sep 07 10:36:36.891441 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3262/6460] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 10:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-366075584 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:36:55.214289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:55.215028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:55.327192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1827625283", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:36:55.392635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] validate_networks() for None {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:36:55.586321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:36:55.586744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:36:55.587256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:36:55.587693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:36:55.588117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:36:55.598126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:55.598612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:55.599051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:55.599779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:55.600248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:55.600663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:55.618185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Getting quotas for project 74ebca2d13084bb8b482627c63ba7acd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:36:55.623454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Getting quotas for user 677cf545ff4943ba8233fdff667b6686 and project 74ebca2d13084bb8b482627c63ba7acd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:36:55.636473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:36:55.638683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:36:55.687642 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-96898a97-0b1d-4310-bdc0-e9718c359609 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478698 Sep 07 10:36:55.688322 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3199/6461] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:36:55.703497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ddd1452-7326-4dab-aa1e-f72027647815 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:55.705020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ddd1452-7326-4dab-aa1e-f72027647815 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:55.708959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:55.709661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:36:55.774977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1ddd1452-7326-4dab-aa1e-f72027647815 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:55.783228 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ddd1452-7326-4dab-aa1e-f72027647815 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1222 microversion: 2.1 time: 0.084582 Sep 07 10:36:55.783915 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3263/6462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:55 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:36:56.807021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:56.807660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:56.814532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:56.815012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:56.815449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:56.816135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:56.816587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:56.817014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:56.880697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:56.889516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2987eaa-60fe-4f48-a17a-2e2fe9e15f32 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1274 microversion: 2.1 time: 0.087101 Sep 07 10:36:56.890090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3200/6463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:56 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:36:57.914197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:57.914820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:57.922078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:57.922582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:57.923031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:57.923765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:57.924239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:57.924677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:58.073848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:58.082929 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b57a32d0-b448-40f5-aef5-97d4cb77d71e tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.172533 Sep 07 10:36:58.099449 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3264/6464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:57 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:36:58.875457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-62eaf348-a8f2-47f2-ad8c-6edadf4fa400 req-493c494c-1dc8-444b-9509-3bd0d5bfb9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6112a789-e4d3-4ba9-8936-f8c292a4aea2", "tag": "c3b43408-2b93-4278-b3f4-7ab0b461a3e9"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:36:58.885110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-62eaf348-a8f2-47f2-ad8c-6edadf4fa400 req-493c494c-1dc8-444b-9509-3bd0d5bfb9b6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:58.885706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-62eaf348-a8f2-47f2-ad8c-6edadf4fa400 req-493c494c-1dc8-444b-9509-3bd0d5bfb9b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:58.886215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-62eaf348-a8f2-47f2-ad8c-6edadf4fa400 req-493c494c-1dc8-444b-9509-3bd0d5bfb9b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:58.898083 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-62eaf348-a8f2-47f2-ad8c-6edadf4fa400 req-493c494c-1dc8-444b-9509-3bd0d5bfb9b6 service nova] Creating event network-changed:c3b43408-2b93-4278-b3f4-7ab0b461a3e9 for instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 on n-h2-836830-16 Sep 07 10:36:58.903277 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-62eaf348-a8f2-47f2-ad8c-6edadf4fa400 req-493c494c-1dc8-444b-9509-3bd0d5bfb9b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106388 Sep 07 10:36:58.904036 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3201/6465] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:36:59.106630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:36:59.107360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:36:59.114502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:59.115006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:59.115464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:59.116178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:36:59.116652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:36:59.117100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:36:59.255596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:36:59.264299 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-89189cc7-b49a-42ca-98a1-1eb5412f5890 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.161607 Sep 07 10:36:59.264873 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3265/6466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:36:59 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:00.288956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:00.289707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:00.296572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:00.297053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:00.297517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:00.298229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:00.298705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:00.299183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:00.436558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:00.444999 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eb8179d2-6e60-4052-85c9-4a351d05b636 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.160328 Sep 07 10:37:00.445598 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3202/6467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:00 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:37:01.469026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:01.469679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:01.476958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:01.477495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:01.477944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:01.478644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:01.479111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:01.479546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:01.608185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:01.616077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-183c8933-2da8-41d7-ab08-44084c0a17f1 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.150984 Sep 07 10:37:01.616648 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3266/6468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:01 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:02.639121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:02.639737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:02.646720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:02.647206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:02.647642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:02.648328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:02.648781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:02.649224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:02.784694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:02.792490 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cecc77d8-8136-4570-96e4-6753523b208c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.157304 Sep 07 10:37:02.793065 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3203/6469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:02 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:03.816687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:03.817352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:03.823818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:03.824339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:03.824786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:03.825543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:03.826048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:03.826526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:03.955370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:03.963296 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9b8fd6e2-191a-43a0-95d9-f2fc0c23ed4d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.151621 Sep 07 10:37:03.963864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3267/6470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:03 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:04.985997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:04.986688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:04.992783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:04.993294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:04.993735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:04.994429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:04.994888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:04.995315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:05.133304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:05.141028 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8817166a-bf55-4d2a-a5ab-9f6641bff6cf tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.159479 Sep 07 10:37:05.141638 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3204/6471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:04 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:05.385039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7b6a147b-f2ea-4e16-9536-9fd7db626991 req-0125bdf5-0b22-4b1f-a91d-c9e6a3d7b273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6112a789-e4d3-4ba9-8936-f8c292a4aea2", "name": "network-vif-plugged", "status": "completed", "tag": "c3b43408-2b93-4278-b3f4-7ab0b461a3e9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:05.394732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7b6a147b-f2ea-4e16-9536-9fd7db626991 req-0125bdf5-0b22-4b1f-a91d-c9e6a3d7b273 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:05.395223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7b6a147b-f2ea-4e16-9536-9fd7db626991 req-0125bdf5-0b22-4b1f-a91d-c9e6a3d7b273 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:05.395668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7b6a147b-f2ea-4e16-9536-9fd7db626991 req-0125bdf5-0b22-4b1f-a91d-c9e6a3d7b273 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:05.407183 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7b6a147b-f2ea-4e16-9536-9fd7db626991 req-0125bdf5-0b22-4b1f-a91d-c9e6a3d7b273 service nova] Creating event network-vif-plugged:c3b43408-2b93-4278-b3f4-7ab0b461a3e9 for instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 on n-h2-836830-16 Sep 07 10:37:05.412814 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7b6a147b-f2ea-4e16-9536-9fd7db626991 req-0125bdf5-0b22-4b1f-a91d-c9e6a3d7b273 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106858 Sep 07 10:37:05.413450 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3268/6472] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:06.164709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:06.165261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:06.167266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:06.167930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:06.174441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:06.174920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:06.175353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:06.176037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:06.176486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:06.176911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:06.309206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:06.317393 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-16cb44f5-970f-45d1-8040-8639cf4fbebc tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1322 microversion: 2.1 time: 0.156624 Sep 07 10:37:06.317976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3205/6473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:06 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:07.337390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:07.342403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:07.343159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:07.349841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:07.350344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:07.350807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:07.351687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:07.352168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:07.352616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:07.490626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:07.499325 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-019ed9ad-815b-48bb-95ba-ca54609fe43d tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1472 microversion: 2.1 time: 0.162909 Sep 07 10:37:07.500109 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3269/6474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:07 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:07.574266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cd6a73a-e68f-4cd5-8a80-4cc4ac0c46bb tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Calling method '.version_select at 0x7f14b08a29d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:07.641250 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cd6a73a-e68f-4cd5-8a80-4cc4ac0c46bb tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/f6b66e8057614c86aa99d82cbe6f5126" status: 200 len: 371 microversion: 2.1 time: 0.119520 Sep 07 10:37:07.642031 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3206/6475] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 10:37:07 2022] GET /compute/v2.1/os-quota-sets/f6b66e8057614c86aa99d82cbe6f5126 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:07.653974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-874d6c72-ee0e-4acd-ab04-c537b1581044 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1834076856", "id": 1381049756, "os-flavor-access:is_public": "True"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:07.672147 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-874d6c72-ee0e-4acd-ab04-c537b1581044 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021881 Sep 07 10:37:07.672730 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3270/6476] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:37:07 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:37:07.685579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1381049756"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:07.687937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:07.694890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:07.695374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:07.695820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:07.696514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:07.696975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:07.697441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:07.851239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1a3b415eaa94415d9fe838196ed9e258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b66e8057614c86aa99d82cbe6f5126', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:07.857760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1834076856 {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:37:07.865093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:07.865603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:07.866042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:07.866776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:07.867231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:07.867656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:07.888357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Getting quotas for project 74ebca2d13084bb8b482627c63ba7acd. Resources: {'cores', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:37:07.893319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Getting quotas for user 677cf545ff4943ba8233fdff667b6686 and project 74ebca2d13084bb8b482627c63ba7acd. Resources: {'cores', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:37:07.905154 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.api [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] ram quota exceeded for f6b66e8057614c86aa99d82cbe6f5126, tried to resize instance. Sep 07 10:37:07.905716 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Request method failure captured: Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2/action HTTP/1.1 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 39 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHRHA258Zsw-lbEkJFaL0wa4H0TWEujny0inQb2IjvXth8WlU6d9W5rV2kM95Q4Uh1XdzqK--vpHWOWxLDxFYlaYJTjW6LMCoKZe-5WwbCMEDzzJgCG6bz1itGo6lfHKmJwCFeUe25u1vfNdbCzqNQFV0CQ6izNBHMEeaAURa9AJ0k4 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: f6b66e8057614c86aa99d82cbe6f5126 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2020289214 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,admin,reader Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,admin,reader Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f6b66e8057614c86aa99d82cbe6f5126"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f6b66e8057614c86aa99d82cbe6f5126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f6b66e8057614c86aa99d82cbe6f5126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f6b66e8057614c86aa99d82cbe6f5126", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2020289214 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: f6b66e8057614c86aa99d82cbe6f5126 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2020289214 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAdminNegativeTestJSON-2020289214-project-admin Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 1a3b415eaa94415d9fe838196ed9e258 Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2020289214-project-admin Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: {"resize": {"flavorRef": "1381049756"}} Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6112a789-e4d3-4ba9-8936-f8c292a4aea2', 'body': {'resize': {'flavorRef': '1381049756'}}} Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:37:07.908305 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd60b826-5d74-4ce0-918e-541ca48d9ec7 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2/action" status: 403 len: 118 microversion: 2.1 time: 0.228145 Sep 07 10:37:07.912663 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3207/6477] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:37:07 2022] POST /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2/action => generated 118 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:37:07.919001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c0a75ade-7a50-4da5-8068-23d6c8786f35 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:07.937006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c0a75ade-7a50-4da5-8068-23d6c8786f35 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1381049756" status: 202 len: 0 microversion: 2.1 time: 0.021778 Sep 07 10:37:07.937631 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3271/6478] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 7 10:37:07 2022] DELETE /compute/v2.1/flavors/1381049756 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:37:07.945721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e1c75fce-dc9d-49a1-b41d-9cdff1da8d78 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:07.966067 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e1c75fce-dc9d-49a1-b41d-9cdff1da8d78 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024065 Sep 07 10:37:07.966638 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3208/6479] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:37:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:07.987754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9c398e53-d7c6-47e1-b2b7-082aa9e8706d tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Calling method '.version_select at 0x7f14b088b280>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:08.058413 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9c398e53-d7c6-47e1-b2b7-082aa9e8706d tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/f6b66e8057614c86aa99d82cbe6f5126" status: 200 len: 371 microversion: 2.1 time: 0.075029 Sep 07 10:37:08.059250 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3272/6480] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 7 10:37:07 2022] GET /compute/v2.1/os-quota-sets/f6b66e8057614c86aa99d82cbe6f5126 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:08.070937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-50b6b771-22a7-4405-855c-f7f36847cd1b tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-174001278", "id": 165606267, "os-flavor-access:is_public": "True"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:08.089560 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-50b6b771-22a7-4405-855c-f7f36847cd1b tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022321 Sep 07 10:37:08.090132 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3209/6481] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:37:08 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:08.102693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "165606267"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:08.104922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:08.111783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.112290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.112747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.113488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.113968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.114415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.250871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1a3b415eaa94415d9fe838196ed9e258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b66e8057614c86aa99d82cbe6f5126', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:08.257559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-174001278 {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:37:08.264030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.264518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.264963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.265719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.266186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.267120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.289484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Getting quotas for project 74ebca2d13084bb8b482627c63ba7acd. Resources: {'cores', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:37:08.294460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Getting quotas for user 677cf545ff4943ba8233fdff667b6686 and project 74ebca2d13084bb8b482627c63ba7acd. Resources: {'cores', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:37:08.307580 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] cores quota exceeded for f6b66e8057614c86aa99d82cbe6f5126, tried to resize instance. Sep 07 10:37:08.308127 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Request method failure captured: Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2/action HTTP/1.1 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 38 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHRHA258Zsw-lbEkJFaL0wa4H0TWEujny0inQb2IjvXth8WlU6d9W5rV2kM95Q4Uh1XdzqK--vpHWOWxLDxFYlaYJTjW6LMCoKZe-5WwbCMEDzzJgCG6bz1itGo6lfHKmJwCFeUe25u1vfNdbCzqNQFV0CQ6izNBHMEeaAURa9AJ0k4 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: f6b66e8057614c86aa99d82cbe6f5126 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2020289214 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,admin,reader Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,admin,reader Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f6b66e8057614c86aa99d82cbe6f5126"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f6b66e8057614c86aa99d82cbe6f5126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f6b66e8057614c86aa99d82cbe6f5126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f6b66e8057614c86aa99d82cbe6f5126", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2020289214 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: f6b66e8057614c86aa99d82cbe6f5126 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2020289214 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersAdminNegativeTestJSON-2020289214-project-admin Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 1a3b415eaa94415d9fe838196ed9e258 Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2020289214-project-admin Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: {"resize": {"flavorRef": "165606267"}} Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6112a789-e4d3-4ba9-8936-f8c292a4aea2', 'body': {'resize': {'flavorRef': '165606267'}}} Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:37:08.310204 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-22d05c6d-83db-408d-8d8b-3e5e97756d63 tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2/action" status: 403 len: 113 microversion: 2.1 time: 0.213007 Sep 07 10:37:08.314569 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3273/6482] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:37:08 2022] POST /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2/action => generated 113 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:37:08.320279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0d0072e6-57e6-4158-8cea-ffeab4b3d62c tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:08.337877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0d0072e6-57e6-4158-8cea-ffeab4b3d62c tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/165606267" status: 202 len: 0 microversion: 2.1 time: 0.021258 Sep 07 10:37:08.338425 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3210/6483] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 7 10:37:08 2022] DELETE /compute/v2.1/flavors/165606267 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:37:08.346723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b837e8b-279f-46bb-9e15-5af1a52fab3a tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:08.367988 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b837e8b-279f-46bb-9e15-5af1a52fab3a tempest-ServersAdminNegativeTestJSON-2020289214 tempest-ServersAdminNegativeTestJSON-2020289214-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025414 Sep 07 10:37:08.368486 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3274/6484] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 7 10:37:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:08.389628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:08.390135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:08.396872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.397414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.397859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.398569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.399034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.399464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.426119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:37:08.506167 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cbc9627a-74c4-4d09-833c-0692ab853125 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 204 len: 0 microversion: 2.1 time: 0.120055 Sep 07 10:37:08.506861 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3211/6485] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:37:08 2022] DELETE /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:37:08.515366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:08.516022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:08.522908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.523416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.523867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.524567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:08.525036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:08.525504 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:08.971108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:08.978852 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bddbf0e9-4465-407e-aef8-dae44ff36446 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1478 microversion: 2.1 time: 0.467462 Sep 07 10:37:08.979428 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3275/6486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:08 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1478 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:10.002706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:10.003419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:10.010222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:10.010711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:10.011149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:10.011843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:10.012327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:10.012756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:10.153261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cf545ff4943ba8233fdff667b6686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ebca2d13084bb8b482627c63ba7acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:10.162250 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0062a945-53f6-4897-9c3e-ce8560035c7c tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 200 len: 1478 microversion: 2.1 time: 0.164162 Sep 07 10:37:10.162820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3212/6487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:09 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 1478 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:10.453439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0e948da3-5e62-49a7-afe1-1bed3c3dde25 req-a26f1804-eb26-4a0c-9228-d288f3f47013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6112a789-e4d3-4ba9-8936-f8c292a4aea2", "name": "network-vif-deleted", "tag": "c3b43408-2b93-4278-b3f4-7ab0b461a3e9"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:10.466060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e948da3-5e62-49a7-afe1-1bed3c3dde25 req-a26f1804-eb26-4a0c-9228-d288f3f47013 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:10.466560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e948da3-5e62-49a7-afe1-1bed3c3dde25 req-a26f1804-eb26-4a0c-9228-d288f3f47013 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:10.467015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e948da3-5e62-49a7-afe1-1bed3c3dde25 req-a26f1804-eb26-4a0c-9228-d288f3f47013 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:10.480480 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0e948da3-5e62-49a7-afe1-1bed3c3dde25 req-a26f1804-eb26-4a0c-9228-d288f3f47013 service nova] Creating event network-vif-deleted:c3b43408-2b93-4278-b3f4-7ab0b461a3e9 for instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 on n-h2-836830-16 Sep 07 10:37:10.485821 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0e948da3-5e62-49a7-afe1-1bed3c3dde25 req-a26f1804-eb26-4a0c-9228-d288f3f47013 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036235 Sep 07 10:37:10.486449 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3276/6488] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:11.185313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:11.185835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] [instance: 6112a789-e4d3-4ba9-8936-f8c292a4aea2] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:11.193128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:11.201356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:11.201356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:11.201356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:11.201356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:11.201356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:11.210260 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] HTTP exception thrown: Instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 could not be found. Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Request method failure captured: Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 HTTP/1.1 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHRGfIVEe51_JL_GXOk3WVS2chbuK2HrpphQqNltHclbG04ZRM2H0p2UFOn1j98SNOVxZFVFmKTWQEHuKpeuXZG1VO4Yi3r28FDFnO_qklYP7MGpAJeX0_fWe-k94P3C3iMbucLq2Y8plGrXqIMwpheON9XlNshn_Dcy_Vfgqv7pKAE Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 74ebca2d13084bb8b482627c63ba7acd Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1790276400 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ebca2d13084bb8b482627c63ba7acd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ebca2d13084bb8b482627c63ba7acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ebca2d13084bb8b482627c63ba7acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ebca2d13084bb8b482627c63ba7acd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1790276400 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 74ebca2d13084bb8b482627c63ba7acd Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1790276400 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersAdminNegativeTestJSON-1790276400-project Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 677cf545ff4943ba8233fdff667b6686 Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1790276400-project Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 could not be found. Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '6112a789-e4d3-4ba9-8936-f8c292a4aea2'} Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 could not be found. Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 could not be found. Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:11.211932 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 could not be found. Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] Returning 404 to user: Instance 6112a789-e4d3-4ba9-8936-f8c292a4aea2 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-406053bd-1280-4620-9143-6f156929e226 tempest-ServersAdminNegativeTestJSON-1790276400 tempest-ServersAdminNegativeTestJSON-1790276400-project] 10.222.0.60 "GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2" status: 404 len: 111 microversion: 2.1 time: 0.032156 Sep 07 10:37:11.215900 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3213/6489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:11 2022] GET /compute/v2.1/servers/6112a789-e4d3-4ba9-8936-f8c292a4aea2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:37:17.512287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-45582112", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "e0ed2bea-5b28-432b-93a3-57840f33cc1c"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:17.568525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] validate_networks() for [('e0ed2bea-5b28-432b-93a3-57840f33cc1c', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:37:17.997518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:37:17.997957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:37:17.998445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:37:17.998852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:37:17.999274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:37:18.010250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:18.011023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:18.011551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:18.012380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:18.012928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:18.013470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:18.036898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Getting quotas for project d3c70d29a3954d79a678aef144db59ae. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:37:18.043373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Getting quotas for user 2f837de5ac0045fa804b7b702ec2286f and project d3c70d29a3954d79a678aef144db59ae. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:37:18.058049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:37:18.060818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:37:18.113925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-351a06a9-88b0-48f3-8c05-b038da9e5cc4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756497 Sep 07 10:37:18.114840 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3277/6490] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:37:18.127493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-def89da3-d0ba-46d0-8bf4-3588d89d9372 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:18.128697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-def89da3-d0ba-46d0-8bf4-3588d89d9372 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:18.132525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:18.136256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:18.205673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-def89da3-d0ba-46d0-8bf4-3588d89d9372 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:18.219161 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-def89da3-d0ba-46d0-8bf4-3588d89d9372 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1213 microversion: 2.1 time: 0.096853 Sep 07 10:37:18.220106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3214/6491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:18 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:19.255114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:19.255505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:19.265955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:19.266637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:19.267249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:19.267974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:19.268457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:19.268906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:19.339675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:19.348449 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ff1ead4-61f2-4a3a-80e6-f1388c42efe4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1265 microversion: 2.1 time: 0.098775 Sep 07 10:37:19.349631 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3278/6492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:19 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:20.372178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:20.373395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:20.382608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:20.383514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:20.384043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:20.384884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:20.385531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:20.386110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:20.531375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:20.540706 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-75990f3f-c754-4cba-8f7b-79b4dbc9db36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.172341 Sep 07 10:37:20.541681 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3215/6493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:20 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:20.896553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0f545e03-704c-402f-9a44-afe1c40a2432 req-9274e1ff-14d9-4b25-be77-65a240d0a043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a020d5c-e6ed-4431-a305-6d3bd6e8881c", "tag": "bb9cfc69-57e3-429f-ae03-5b9b8fe3333e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:20.908020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f545e03-704c-402f-9a44-afe1c40a2432 req-9274e1ff-14d9-4b25-be77-65a240d0a043 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:20.908644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f545e03-704c-402f-9a44-afe1c40a2432 req-9274e1ff-14d9-4b25-be77-65a240d0a043 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:20.909232 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f545e03-704c-402f-9a44-afe1c40a2432 req-9274e1ff-14d9-4b25-be77-65a240d0a043 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:20.922057 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0f545e03-704c-402f-9a44-afe1c40a2432 req-9274e1ff-14d9-4b25-be77-65a240d0a043 service nova] Creating event network-changed:bb9cfc69-57e3-429f-ae03-5b9b8fe3333e for instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c on n-h2-836830-16 Sep 07 10:37:20.928066 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0f545e03-704c-402f-9a44-afe1c40a2432 req-9274e1ff-14d9-4b25-be77-65a240d0a043 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 Sep 07 10:37:20.928685 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3279/6494] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:21.566454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:21.567198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:21.574090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:21.574570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:21.575004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:21.575688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:21.576171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:21.576591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:21.707837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:21.715782 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-337d0c22-4848-4a29-8556-699606b58403 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.153867 Sep 07 10:37:21.716352 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3216/6495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:21 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:22.740642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:22.741388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:22.747585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:22.748084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:22.748542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:22.749276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:22.749752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:22.750196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:22.887803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:22.895783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4b9b0bf4-1fa0-42ad-b208-37fe8035398e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.160747 Sep 07 10:37:22.896363 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3280/6496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:22 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:23.918932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:23.919551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:23.928223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:23.928718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:23.929163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:23.929911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:23.930362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:23.930952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:24.074073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:24.082572 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f0b8d87f-8ab5-4b69-ae9d-dc5d5fe7a2b5 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.167529 Sep 07 10:37:24.083406 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3217/6497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:23 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:25.106173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:25.106860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:25.114407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:25.114904 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:25.115359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:25.116058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:25.116532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:25.116975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:25.255291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:25.264110 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ee1c9a8-5b93-4dd7-ad5e-fc04e6f458cf tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.161824 Sep 07 10:37:25.264683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3281/6498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:25 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:26.287644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:26.288264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:26.290999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:26.296435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:26.296920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:26.297888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:26.298779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:26.299260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:26.299686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:26.304693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:26.442470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:26.450336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb2c5295-fd8f-4b94-8cfd-4f5974c162ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.166589 Sep 07 10:37:26.450912 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3218/6499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:26 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:27.419282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5835a6c0-2dae-4976-96d1-80d2d96a2e4a req-e36b1bfd-41a3-4a05-93c0-623cdfe4576f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a020d5c-e6ed-4431-a305-6d3bd6e8881c", "name": "network-vif-plugged", "status": "completed", "tag": "bb9cfc69-57e3-429f-ae03-5b9b8fe3333e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:27.426014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:27.432663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5835a6c0-2dae-4976-96d1-80d2d96a2e4a req-e36b1bfd-41a3-4a05-93c0-623cdfe4576f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:27.433264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5835a6c0-2dae-4976-96d1-80d2d96a2e4a req-e36b1bfd-41a3-4a05-93c0-623cdfe4576f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:27.434104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5835a6c0-2dae-4976-96d1-80d2d96a2e4a req-e36b1bfd-41a3-4a05-93c0-623cdfe4576f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:27.439881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=76 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:27.447835 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5835a6c0-2dae-4976-96d1-80d2d96a2e4a req-e36b1bfd-41a3-4a05-93c0-623cdfe4576f service nova] Creating event network-vif-plugged:bb9cfc69-57e3-429f-ae03-5b9b8fe3333e for instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c on n-h2-836830-16 Sep 07 10:37:27.453168 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5835a6c0-2dae-4976-96d1-80d2d96a2e4a req-e36b1bfd-41a3-4a05-93c0-623cdfe4576f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037830 Sep 07 10:37:27.454825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3282/6500] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:37:27.475982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:27.476610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:27.483497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:27.484085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:27.484417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:27.485123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:27.485619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:27.486037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:27.633553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:27.641889 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-71f4ffdf-124b-494c-8e00-fe1fad3d32d3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.169196 Sep 07 10:37:27.642689 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3219/6501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:27 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:28.661774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=5 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:28.662553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:28.667721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:28.668475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:28.675354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:28.675863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:28.676322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:28.677031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:28.677542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:28.677989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:28.821505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:28.829918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-df06cc0d-4a03-4b69-a0f3-ce4814c9dce1 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1313 microversion: 2.1 time: 0.169318 Sep 07 10:37:28.830486 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3283/6502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:28 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:37:29.853602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:29.854220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:29.856132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:29.862733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:29.863224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:29.863662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:29.864361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:29.864818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:29.865281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:29.995551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:30.003779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0253d6e-43dd-45c5-909b-7e44235cb0bc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1500 microversion: 2.1 time: 0.154053 Sep 07 10:37:30.004337 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3220/6503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:29 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:30.026244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:37:30.028526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:30.035564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:30.036128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:30.036619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:30.037376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:30.037831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:30.038274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:30.067474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:30.073356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:37:30.079792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:37:30.080229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:37:30.080723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:37:30.081166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:37:30.081608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:37:30.148686 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63dd5288-09d7-4e23-bdf5-9ff77e268107 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "POST /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c/action" status: 202 len: 0 microversion: 2.1 time: 0.126221 Sep 07 10:37:30.149358 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3284/6504] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:37:30 2022] POST /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:37:30.157621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:30.158336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:30.165136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:30.165733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:30.166251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:30.167525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:30.167621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:30.168196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:30.307116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:30.316246 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e77c978-c0b1-4a32-85ce-7fb108472da3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1509 microversion: 2.1 time: 0.162616 Sep 07 10:37:30.316831 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3221/6505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:30 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:37:31.341355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:31.341988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:31.348841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:31.349571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:31.350195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:31.350906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:31.351826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:31.351826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:31.488835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:31.496504 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3cda66c8-de04-4da6-9883-887353672a31 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1509 microversion: 2.1 time: 0.159941 Sep 07 10:37:31.497075 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3285/6506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:31 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:32.520433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:32.521040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:32.527876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:32.528356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:32.528799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:32.529493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:32.529942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:32.530362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:32.666772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:32.675034 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b119d1cb-19fa-4803-ac62-79f2a3cac8d8 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.158976 Sep 07 10:37:32.675610 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3222/6507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:32 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:33.699415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:33.700000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:33.706556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:33.707058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:33.707514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:33.708480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:33.708953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:33.709421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:33.839933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:33.848330 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc3a6ec9-caa6-4446-a17d-e633bef09cad tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.152850 Sep 07 10:37:33.848900 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3286/6508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:33 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:34.871467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:34.872094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:34.878855 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:34.879508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:34.879961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:34.880660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:34.881123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:34.881580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:35.013192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:35.020989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-18ca8c48-78cb-4204-97bf-5cdafefbc95d tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.153759 Sep 07 10:37:35.021581 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3223/6509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:34 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:36.044978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:36.045627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:36.053420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:36.053915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:36.054362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:36.055055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:36.055520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:36.055956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:36.194666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:36.202515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-81177ed5-c10e-4798-a72c-eae86159e726 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.161394 Sep 07 10:37:36.203274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3287/6510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:36 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:37.226559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:37.227173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:37.234598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:37.236267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:37.236712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:37.237431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:37.237890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:37.238317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:37.369262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:37.377227 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-36b5655b-fc7c-454e-a7ea-e83ef02d82ef tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.154562 Sep 07 10:37:37.377817 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3224/6511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:37 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:38.400032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:38.400666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:38.407758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:38.408265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:38.408721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:38.409459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:38.409938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:38.410385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:38.546469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:38.555148 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a02db598-9b8b-4581-86bf-93a7477b76f6 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.159094 Sep 07 10:37:38.555726 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3288/6512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:38 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:39.578165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:39.578949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:39.585874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:39.586357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:39.586789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:39.587476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:39.587929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:39.588354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:39.718420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:39.726761 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c50943f7-d68c-4bf2-b4e7-6cf4372910ae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.152462 Sep 07 10:37:39.727330 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3225/6513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:39 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:40.754350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:40.754980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:40.762038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:40.762545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:40.763004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:40.763713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:40.764223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:40.764673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:40.899798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:40.908036 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c588c210-463d-4ab4-86ce-fb277c4e10dc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.158476 Sep 07 10:37:40.908595 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3289/6514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:40 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:41.931590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:41.932106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:41.939645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:41.940119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:41.940549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:41.941260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:41.941712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:41.942229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:42.079115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:42.087092 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0bec1dbd-4c51-403d-8fb9-861a4894ad36 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.159467 Sep 07 10:37:42.087670 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3226/6515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:41 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:43.111187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:43.111851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:43.118793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:43.119672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:43.120480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:43.121774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:43.122692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:43.123474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:43.280075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:43.288538 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fbf1fc5b-7f83-493b-ac3f-6459617c1f75 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.181973 Sep 07 10:37:43.289111 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3290/6516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:43 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:37:44.311916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:44.313171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:44.320320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:44.320810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:44.321292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:44.321992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:44.322443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:44.322873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:44.460773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:44.468569 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8e954ff9-766f-48a8-91fb-dcb4e6200acc tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.160535 Sep 07 10:37:44.469131 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3227/6517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:44 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:45.492806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:45.493477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:45.500367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:45.500866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:45.501354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:45.502646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:45.503122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:45.503566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:45.636960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:45.645378 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-300c49af-41ff-4f33-a49e-1d5dbb791908 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.156486 Sep 07 10:37:45.645967 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3291/6518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:45 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:46.668654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:46.669238 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:46.676235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:46.676797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:46.677264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:46.677959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:46.678419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:46.678846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:46.812788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:46.820617 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-29be8053-4d06-47f4-95b4-25726a866d6b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.155931 Sep 07 10:37:46.821199 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3228/6519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:46 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:47.844409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:47.844990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:47.852055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:47.852481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:47.852939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:47.853682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:47.854160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:47.854605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:47.986666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:47.994563 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88b3d46b-fa33-4a2e-9d11-99fdd505de49 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.154116 Sep 07 10:37:47.995142 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3292/6520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:47 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:49.019922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:49.020570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:49.027565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:49.028053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:49.028496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:49.029206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:49.029674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:49.030103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:49.161421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:49.169275 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7aa186a6-5428-480b-afb4-dbe65114cbae tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.153827 Sep 07 10:37:49.169855 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3229/6521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:49 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:50.193130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:50.193720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:50.200612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:50.201159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:50.201665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:50.202370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:50.202841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:50.203280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:50.340311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:50.348897 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d070f1c2-935d-47ff-8169-4a2106df5128 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.160162 Sep 07 10:37:50.349767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3293/6522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:50 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:51.371993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:51.372601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:51.380418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:51.380927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:51.381463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:51.382149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:51.382601 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:51.383113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:51.515007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:51.523795 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9acf1696-8179-4543-8797-9915924d40b4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.155674 Sep 07 10:37:51.524359 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3230/6523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:51 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:52.546597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:52.547224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:52.554226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:52.554710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:52.555156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:52.555881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:52.556345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:52.556781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:52.691810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:52.699650 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-457cd705-8577-4fc5-b3da-b432ea57955f tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.157018 Sep 07 10:37:52.700227 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3294/6524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:52 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:53.724952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:53.725624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:53.732710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:53.733224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:53.733845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:53.734547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:53.735002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:53.735429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:53.869989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:53.878047 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1efec2cc-f222-43c2-baa8-9e7d864bbee9 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.158365 Sep 07 10:37:53.878784 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3231/6525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:53 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:54.901414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:54.902048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:54.909019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:54.909561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:54.910185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:54.910954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:54.911429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:54.911876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:55.048537 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:55.056858 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-becf5027-0bf3-4979-bb1c-f81d0b0f61b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.159485 Sep 07 10:37:55.057447 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3295/6526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:54 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:56.080770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:56.081409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:56.089266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:56.089750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:56.090183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:56.090886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:56.091338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:56.091759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:56.229325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:56.237028 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0abee5f8-0d4c-41dd-90ea-0a88949ce6af tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.160177 Sep 07 10:37:56.237652 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3232/6527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:56 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:57.260697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:57.261361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:57.268302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:57.268805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:57.269484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:57.270247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:57.270724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:57.271176 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:57.413121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:57.421012 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26b8a597-2de0-4cca-bd7d-39fd5de495fb tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.164236 Sep 07 10:37:57.421603 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3296/6528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:57 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:58.444362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:58.444971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:58.447678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=30 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:58.453025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:58.453534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:58.453971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:58.454747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:58.455226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:58.455650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:58.460018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=90 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:58.601875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:58.609755 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9bda65fd-2a97-4393-8f9a-a6d0356e1460 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.169915 Sep 07 10:37:58.610322 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3233/6529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:58 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:37:59.633376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:37:59.634034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:37:59.636775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=34 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:59.642547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:59.643047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:59.643505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:59.644213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:37:59.644712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:37:59.645152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:37:59.649149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:37:59.783236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:37:59.791515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1122c2c9-8ed8-415d-9a99-7218defbb4c0 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.162715 Sep 07 10:37:59.792106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3297/6530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:37:59 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:00.815928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:00.816544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:00.824824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:00.825381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:00.825827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:00.826538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:00.826996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:00.827422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:00.963743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:00.971458 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-59c87038-3f6b-4f49-8d63-df82077641f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.159567 Sep 07 10:38:00.972022 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3234/6531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:00 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:01.996195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:01.996819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:02.003681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:02.004191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:02.004659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:02.005377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:02.005845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:02.006279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:02.135484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:02.143098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6344ea8b-411a-46f7-909f-7151658705b3 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.150857 Sep 07 10:38:02.143668 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3298/6532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:01 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:03.166824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:03.167470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:03.175968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:03.176972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:03.177447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:03.178154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:03.178607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:03.179192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:03.310536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:03.318336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-47637a98-c07a-447a-910f-b1051cee956e tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1514 microversion: 2.1 time: 0.155430 Sep 07 10:38:03.318901 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3235/6533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:03 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:04.342344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:04.342972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:04.349641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:04.350132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:04.350580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:04.351279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:04.351744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:04.352182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:04.557104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:04.565049 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c3494cfe-a07b-4cce-8664-93cf99e610f2 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1513 microversion: 2.1 time: 0.227000 Sep 07 10:38:04.565681 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3299/6534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:04 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:04.863604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a020d5c-e6ed-4431-a305-6d3bd6e8881c", "name": "network-vif-unplugged", "status": "completed", "tag": "bb9cfc69-57e3-429f-ae03-5b9b8fe3333e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:04.873854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:04.874375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:04.874842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:04.888690 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] Creating event network-vif-unplugged:bb9cfc69-57e3-429f-ae03-5b9b8fe3333e for instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c on n-h1-836830-16 Sep 07 10:38:04.894851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:38:04.907441 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a50574d4-ce13-4502-ad42-732f7e5f0964 req-b45b9832-bd62-429c-9618-0cb8aa237a30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047682 Sep 07 10:38:04.910420 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3236/6535] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:38:05.588645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:05.589303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:05.596249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:05.596752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:05.597227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:05.598109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:05.599123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:05.599581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:05.826277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:05.834545 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f2e9ff4b-b133-4ce3-adc1-154d534b6fc7 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1513 microversion: 2.1 time: 0.249879 Sep 07 10:38:05.835133 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3300/6536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:05 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:06.858457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:06.859161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:06.866267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:06.866742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:06.867172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:06.867850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:06.868299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:06.868718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:06.923371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a020d5c-e6ed-4431-a305-6d3bd6e8881c", "tag": "bb9cfc69-57e3-429f-ae03-5b9b8fe3333e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:06.934301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:06.934797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:06.935246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:06.947284 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] Creating event network-changed:bb9cfc69-57e3-429f-ae03-5b9b8fe3333e for instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c on n-h1-836830-16 Sep 07 10:38:06.952778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:38:06.964624 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-e13730ed-dcbe-4e1a-b3b0-594b2c312fe2 req-d9fc5b12-3e01-4131-ad32-4e6a4cd7eba8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044943 Sep 07 10:38:06.965247 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3301/6537] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:38:07.021391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:07.029394 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41fa9254-0629-4d84-bd96-970f85fc1ad4 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1511 microversion: 2.1 time: 0.175046 Sep 07 10:38:07.030211 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3237/6538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:06 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:08.056084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:08.056720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:08.063557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:08.064069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:08.064525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:08.065279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:08.065755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:08.066202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:08.264593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:08.273284 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f25a367f-0374-4c0f-8aa2-b554d850fe41 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1508 microversion: 2.1 time: 0.223233 Sep 07 10:38:08.273862 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3302/6539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:08 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:38:08.296061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:08.296545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:08.303618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:08.304100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:08.304564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:08.305371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:08.305826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:08.306302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:08.332099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:38:08.384692 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.compute.api [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Found an unconfirmed migration during delete, id: 16, status: finished Sep 07 10:38:09.843976 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-62b77627-ee0f-4209-8239-01fb927578ba tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 204 len: 0 microversion: 2.1 time: 1.551241 Sep 07 10:38:09.844771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3238/6540] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:38:08 2022] DELETE /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 0 bytes in 1553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:38:09.855116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:09.855768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:09.862648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:09.863143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:09.863588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:09.864821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:09.865323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:09.865760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:09.996172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:10.004145 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b77a9e46-9f58-4d0e-8969-78c01ed1da70 tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1500 microversion: 2.1 time: 0.154438 Sep 07 10:38:10.005458 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3303/6541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:09 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:11.031757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:11.032476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:11.040934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:11.041506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:11.042010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:11.042814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:11.043278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:11.043816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:11.185427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f837de5ac0045fa804b7b702ec2286f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c70d29a3954d79a678aef144db59ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:11.193591 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5baef80c-9d73-4a6d-903d-90c3d95c352c tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 200 len: 1500 microversion: 2.1 time: 0.166061 Sep 07 10:38:11.194168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3239/6542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:11 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:11.700303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-06a46518-41c9-4c42-9be2-c391a7518bc2 req-32435de3-8758-4cf2-b473-8f616fd40bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a020d5c-e6ed-4431-a305-6d3bd6e8881c", "name": "network-vif-deleted", "tag": "bb9cfc69-57e3-429f-ae03-5b9b8fe3333e"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:11.713038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06a46518-41c9-4c42-9be2-c391a7518bc2 req-32435de3-8758-4cf2-b473-8f616fd40bfb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:11.713599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06a46518-41c9-4c42-9be2-c391a7518bc2 req-32435de3-8758-4cf2-b473-8f616fd40bfb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:11.714056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-06a46518-41c9-4c42-9be2-c391a7518bc2 req-32435de3-8758-4cf2-b473-8f616fd40bfb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:11.736127 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-06a46518-41c9-4c42-9be2-c391a7518bc2 req-32435de3-8758-4cf2-b473-8f616fd40bfb service nova] Creating event network-vif-deleted:bb9cfc69-57e3-429f-ae03-5b9b8fe3333e for instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c on n-h1-836830-16 Sep 07 10:38:11.742309 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-06a46518-41c9-4c42-9be2-c391a7518bc2 req-32435de3-8758-4cf2-b473-8f616fd40bfb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046952 Sep 07 10:38:11.742923 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3304/6543] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:38:12.216989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:12.217586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:12.225242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:12.225734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:12.226176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:12.226870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:12.227330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:12.227758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:12.241544 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] HTTP exception thrown: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Request method failure captured: Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c HTTP/1.1 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHRdHZlXRMZhBHTKaqdFZj101iUzxx4ma7smMwPmZ2YnwRa4Lq1emcOFUmdVVdlmxQmAC0tEjjqnsHEaS8IlsOplRVRPeUVQoOF-l4Sd3jp8qe7SoVvlffNHfw9Ywb5XNSCz2bpRDtZOtKRls5YIzSdiLc5qJUIopR1QGlY_IE-DpFs Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d3c70d29a3954d79a678aef144db59ae Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d3c70d29a3954d79a678aef144db59ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d3c70d29a3954d79a678aef144db59ae Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersTestJSON-1425901819-project Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2f837de5ac0045fa804b7b702ec2286f Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersTestJSON-1425901819-project Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4a020d5c-e6ed-4431-a305-6d3bd6e8881c'} Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:38:12.243221 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Returning 404 to user: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d180f4cf-5ffd-4420-aa90-9181d466f20b tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 404 len: 111 microversion: 2.1 time: 0.031654 Sep 07 10:38:12.247425 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3240/6544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:12 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:38:12.262149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:12.262756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:12.269893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:12.271103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:12.271670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:12.272381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:12.272859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:12.273342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:12.287018 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] HTTP exception thrown: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Request method failure captured: Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c HTTP/1.1 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHRdHZlXRMZhBHTKaqdFZj101iUzxx4ma7smMwPmZ2YnwRa4Lq1emcOFUmdVVdlmxQmAC0tEjjqnsHEaS8IlsOplRVRPeUVQoOF-l4Sd3jp8qe7SoVvlffNHfw9Ywb5XNSCz2bpRDtZOtKRls5YIzSdiLc5qJUIopR1QGlY_IE-DpFs Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: d3c70d29a3954d79a678aef144db59ae Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d3c70d29a3954d79a678aef144db59ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: d3c70d29a3954d79a678aef144db59ae Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-DeleteServersTestJSON-1425901819-project Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 2f837de5ac0045fa804b7b702ec2286f Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-DeleteServersTestJSON-1425901819-project Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4a020d5c-e6ed-4431-a305-6d3bd6e8881c'} Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:38:12.288723 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Returning 404 to user: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f8be11f7-14c7-4136-93b8-9598492a3dbe tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 404 len: 111 microversion: 2.1 time: 0.032223 Sep 07 10:38:12.292957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3305/6545] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:38:12 2022] DELETE /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:38:12.298668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:12.299293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] [instance: 4a020d5c-e6ed-4431-a305-6d3bd6e8881c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:12.305614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:12.306103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:12.306543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:12.307236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:12.307695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:12.308124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:12.322394 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] HTTP exception thrown: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Request method failure captured: Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c HTTP/1.1 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHRdHZlXRMZhBHTKaqdFZj101iUzxx4ma7smMwPmZ2YnwRa4Lq1emcOFUmdVVdlmxQmAC0tEjjqnsHEaS8IlsOplRVRPeUVQoOF-l4Sd3jp8qe7SoVvlffNHfw9Ywb5XNSCz2bpRDtZOtKRls5YIzSdiLc5qJUIopR1QGlY_IE-DpFs Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: d3c70d29a3954d79a678aef144db59ae Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d3c70d29a3954d79a678aef144db59ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d3c70d29a3954d79a678aef144db59ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: d3c70d29a3954d79a678aef144db59ae Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425901819 Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-DeleteServersTestJSON-1425901819-project Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 2f837de5ac0045fa804b7b702ec2286f Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-DeleteServersTestJSON-1425901819-project Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4a020d5c-e6ed-4431-a305-6d3bd6e8881c'} Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:38:12.323941 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] Returning 404 to user: Instance 4a020d5c-e6ed-4431-a305-6d3bd6e8881c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:38:12.328166 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45594c33-2b40-42aa-9b1d-63f9240a64ce tempest-DeleteServersTestJSON-1425901819 tempest-DeleteServersTestJSON-1425901819-project] 10.222.0.60 "GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c" status: 404 len: 111 microversion: 2.1 time: 0.030520 Sep 07 10:38:12.329090 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3241/6546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:12 2022] GET /compute/v2.1/servers/4a020d5c-e6ed-4431-a305-6d3bd6e8881c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:38:20.946737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1687024344", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "69c3b1c0-ad84-40c8-ba29-d957efbc2218"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:21.005518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] validate_networks() for [('69c3b1c0-ad84-40c8-ba29-d957efbc2218', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:38:21.399523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:38:21.400099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:38:21.400654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:38:21.401167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:38:21.401677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:38:21.411443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:21.412104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:21.412662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:21.414038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:21.414587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:21.415285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:21.432093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Getting quotas for project 17cda8db22334d39a32a48ccd80731ca. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:38:21.437350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Getting quotas for user 5ea70ac21bea4db0a7b08176d1c55110 and project 17cda8db22334d39a32a48ccd80731ca. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:38:21.449682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:38:21.451980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:38:21.498840 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1fedd357-fbcb-4cd0-b323-0f1985168388 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682993 Sep 07 10:38:21.499490 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3306/6547] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:38:21.511756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-12f17829-816f-43f4-9eac-d686e9c17c00 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:21.512559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-12f17829-816f-43f4-9eac-d686e9c17c00 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:21.592446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-12f17829-816f-43f4-9eac-d686e9c17c00 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:21.600138 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-12f17829-816f-43f4-9eac-d686e9c17c00 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1218 microversion: 2.1 time: 0.093125 Sep 07 10:38:21.601800 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3242/6548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:21 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:22.625227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:22.625812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:22.634777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:22.635278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:22.635729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:22.637131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:22.637623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:22.638221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:22.732836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:22.742998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-578644a3-a023-4796-9900-e7744a2f0eb8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1278 microversion: 2.1 time: 0.122056 Sep 07 10:38:22.744783 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3307/6549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:22 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:23.766838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:23.767928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:23.771633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:23.781422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:23.782276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:23.782937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:23.783911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:23.784780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:23.785811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:24.062059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:24.076446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1bd8923e-294f-4a5b-bdf1-0ac7f1bd743d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.313564 Sep 07 10:38:24.078486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3243/6550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:23 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:24.593002 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8b3d5b72-12a7-4a93-bf5c-88587f6e3610 req-ea2ea155-ded0-462f-a472-58d9836b3a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15084b8-f339-4074-8959-fc1a6c7633b1", "tag": "05fe0447-023b-4fda-9761-dc7a02dd3c6b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:24.604861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8b3d5b72-12a7-4a93-bf5c-88587f6e3610 req-ea2ea155-ded0-462f-a472-58d9836b3a3d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:24.605483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8b3d5b72-12a7-4a93-bf5c-88587f6e3610 req-ea2ea155-ded0-462f-a472-58d9836b3a3d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:24.606001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8b3d5b72-12a7-4a93-bf5c-88587f6e3610 req-ea2ea155-ded0-462f-a472-58d9836b3a3d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:24.621716 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8b3d5b72-12a7-4a93-bf5c-88587f6e3610 req-ea2ea155-ded0-462f-a472-58d9836b3a3d service nova] Creating event network-changed:05fe0447-023b-4fda-9761-dc7a02dd3c6b for instance b15084b8-f339-4074-8959-fc1a6c7633b1 on n-h1-836830-16 Sep 07 10:38:24.627966 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8b3d5b72-12a7-4a93-bf5c-88587f6e3610 req-ea2ea155-ded0-462f-a472-58d9836b3a3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042736 Sep 07 10:38:24.628674 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3308/6551] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:38:25.102253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:25.102898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:25.109879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:25.110363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:25.110806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:25.111498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:25.111953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:25.112378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:25.244492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:25.252366 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b4bb870-8ea5-4033-864d-a13a42e3cff1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.155548 Sep 07 10:38:25.252942 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3244/6552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:25 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:26.276833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:26.277584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:26.283810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:26.284310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:26.284765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:26.285494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:26.286493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:26.287031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:26.514172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:26.522660 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-153f618a-5918-451f-9fe8-639709535cb2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.250950 Sep 07 10:38:26.523243 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3309/6553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:26 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:27.546515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:27.547082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:27.554526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:27.555007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:27.555438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:27.556123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:27.556569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:27.556990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:27.686012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:27.694573 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d1db87f3-2864-4d31-bb87-c859d82f5ee2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.152008 Sep 07 10:38:27.695150 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3245/6554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:27 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:28.717759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:28.718300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:28.725750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:28.726241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:28.726686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:28.727378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:28.727845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:28.728278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:28.863560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:28.873615 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-adf0e5a0-98b3-4d08-9561-5d6ce69239e3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.159694 Sep 07 10:38:28.874203 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3310/6555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:28 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:29.897199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:29.897874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:29.900562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:29.905975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:29.906459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:29.906905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:29.907599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:29.908058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:29.908490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:30.047965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:30.056463 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2f31fd8-33c5-470c-a081-429e72419bc4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.163995 Sep 07 10:38:30.057078 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3246/6556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:29 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:31.037975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-84c3d5df-6f6a-49a1-8983-f961875c0965 req-5b70a9bf-5563-4083-90c3-285c6db5b69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15084b8-f339-4074-8959-fc1a6c7633b1", "name": "network-vif-plugged", "status": "completed", "tag": "05fe0447-023b-4fda-9761-dc7a02dd3c6b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:31.043759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:31.050362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-84c3d5df-6f6a-49a1-8983-f961875c0965 req-5b70a9bf-5563-4083-90c3-285c6db5b69b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:31.050858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-84c3d5df-6f6a-49a1-8983-f961875c0965 req-5b70a9bf-5563-4083-90c3-285c6db5b69b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:31.051443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-84c3d5df-6f6a-49a1-8983-f961875c0965 req-5b70a9bf-5563-4083-90c3-285c6db5b69b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:31.058307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=66 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:31.066596 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-84c3d5df-6f6a-49a1-8983-f961875c0965 req-5b70a9bf-5563-4083-90c3-285c6db5b69b service nova] Creating event network-vif-plugged:05fe0447-023b-4fda-9761-dc7a02dd3c6b for instance b15084b8-f339-4074-8959-fc1a6c7633b1 on n-h1-836830-16 Sep 07 10:38:31.072540 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-84c3d5df-6f6a-49a1-8983-f961875c0965 req-5b70a9bf-5563-4083-90c3-285c6db5b69b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039032 Sep 07 10:38:31.073346 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3311/6557] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:38:31.080775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:31.081447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:31.095569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:31.096069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:31.096505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:31.097307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:31.097760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:31.098183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:31.296733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:31.305343 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbdc257b-7bef-4bca-81e0-97d15200bbe7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.229012 Sep 07 10:38:31.305919 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3247/6558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:31 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:32.329314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:32.330024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:32.332159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:32.333797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:32.341886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:32.342564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:32.343036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:32.343880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:32.344361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:32.344809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:32.492728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:32.500426 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-589d1177-b217-4c43-bde0-e80369571377 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1318 microversion: 2.1 time: 0.175566 Sep 07 10:38:32.501153 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3312/6559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:32 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:33.524424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:33.525696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:33.527649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:33.533690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.534181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.534624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.535332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.536182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.536617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.671905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:33.680435 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f62b457e-0b7c-45b7-9456-243e3496ae64 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1509 microversion: 2.1 time: 0.160189 Sep 07 10:38:33.681007 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3248/6560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:33 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:33.703396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:33.704031 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:33.710948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.711447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.711902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.712606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.713085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.713559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.845520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:33.853623 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-38f5f374-560d-45c5-aba0-a0d91e46ecbc tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1509 microversion: 2.1 time: 0.154292 Sep 07 10:38:33.854202 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3313/6561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:33 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:33.875322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:33.877856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:33.884713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.885249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.885718 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.886421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.886888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.887317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.950518 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54205d4d-c55a-47d8-8c2c-42cef6de975f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "PUT /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1081 microversion: 2.1 time: 0.079075 Sep 07 10:38:33.952725 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3249/6562] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 7 10:38:33 2022] PUT /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1081 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:33.970526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:33.971148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:33.977385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.977879 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.978326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:33.979021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:33.979486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:33.979922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.113396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:34.121755 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fc8af0d9-d31f-497f-81b1-f51c77640649 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1507 microversion: 2.1 time: 0.155109 Sep 07 10:38:34.122354 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3314/6563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:33 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:34.144292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:34.144292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:34.151203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:34.151699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:34.152143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.152841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:34.153326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:34.153758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.282860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:34.293197 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f401adb-1505-417d-ad8a-0c34c4ab3413 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1507 microversion: 2.1 time: 0.153372 Sep 07 10:38:34.293794 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3250/6564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:34 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:34.315255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:38:34.317647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:34.323579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:34.324069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:34.324512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.325258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:34.325727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:34.326165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.356054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:34.362054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:38:34.369305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:38:34.369751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:38:34.370246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:38:34.370672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:38:34.371103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:38:34.440220 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3ecf2ef-12cc-4efb-8e6b-e637b1257fb6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1/action" status: 202 len: 0 microversion: 2.1 time: 0.128840 Sep 07 10:38:34.440840 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3315/6565] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:38:34 2022] POST /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:38:34.449801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:34.450419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:34.456440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:34.456886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:34.457932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.458901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:34.459360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:34.459780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:34.602217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:34.609989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb1af902-b180-4709-b84e-2508c44cc550 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1518 microversion: 2.1 time: 0.164010 Sep 07 10:38:34.610549 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3251/6566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:34 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:35.634517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:35.635148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:35.641383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:35.641889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:35.642340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:35.643051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:35.643518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:35.643956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:35.878476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:35.890798 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-62399712-805d-438b-83ac-ff730bc6b555 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1518 microversion: 2.1 time: 0.261762 Sep 07 10:38:35.891396 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3316/6567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:35 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:36.914219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:36.914768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:36.921430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:36.921914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:36.922351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:36.923037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:36.923489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:36.923911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:37.055177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:37.062927 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fc8ea301-a2b2-46be-aaf2-038089ac7722 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.152688 Sep 07 10:38:37.063498 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3252/6568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:36 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:38.087591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:38.088227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:38.095182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:38.095684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:38.096142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:38.096851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:38.097388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:38.097922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:38.231778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:38.243530 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6149fea1-5446-4bf2-9764-5dd4e47ddbc2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.160097 Sep 07 10:38:38.244112 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3317/6569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:38 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:39.269330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:39.270839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:39.277745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:39.278234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:39.278677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:39.279369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:39.279828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:39.280258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:39.417591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:39.425681 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61abe46c-9ee5-4e2a-87fe-ec8ef3ef5778 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.160317 Sep 07 10:38:39.426341 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3253/6570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:39 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:40.448922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:40.449578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:40.456573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:40.457073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:40.457934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:40.458923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:40.459397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:40.459840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:40.593677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:40.602262 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cad64f0b-213e-4440-9a22-4a06b8bdc98b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.157252 Sep 07 10:38:40.602835 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3318/6571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:40 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:41.626445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:41.627001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:41.635061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:41.635572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:41.636009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:41.636721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:41.637173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:41.637629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:41.774693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:41.782426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94d9e437-02b2-47aa-8fc0-395d4c7c77c5 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.159956 Sep 07 10:38:41.782995 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3254/6572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:41 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:42.806861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:42.807495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:42.814575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:42.815068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:42.815518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:42.816216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:42.816906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:42.817555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:42.950743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:42.958824 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36efdb90-3402-4588-b9e5-a7d9c1f151ee tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.155604 Sep 07 10:38:42.959407 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3319/6573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:42 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:43.981948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:43.982596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:43.989821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:43.990308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:43.990753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:43.991457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:43.991915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:43.992343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:44.128292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:44.136971 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-77fe379f-e1ed-44a1-8160-bb355065219d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.159030 Sep 07 10:38:44.137630 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3255/6574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:43 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:45.162234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:45.163426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:45.171078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:45.171578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:45.172036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:45.172746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:45.173248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:45.173704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:45.307925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:45.315585 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-afd8fa72-70a8-4f63-8530-28e70d2555c3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.159287 Sep 07 10:38:45.316154 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3320/6575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:45 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:46.339624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:46.340332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:46.347268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:46.347797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:46.348235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:46.348929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:46.349423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:46.349867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:46.483366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:46.491084 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54b38978-9c1a-417d-852b-f7708d8641ff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.155354 Sep 07 10:38:46.491657 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3256/6576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:46 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:47.515092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:47.515720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:47.522731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:47.523228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:47.523674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:47.524376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:47.524837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:47.525306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:47.687059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:47.694847 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-957ddd31-f292-43e1-9ff3-bcc8c2e3dd4b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.183677 Sep 07 10:38:47.695426 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3321/6577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:47 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:48.718839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:48.719380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:48.728322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:48.728811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:48.729275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:48.729972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:48.730433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:48.730863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:48.861985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:48.870672 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca00e963-7477-41d2-a355-d69d6e9cd783 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.155818 Sep 07 10:38:48.871261 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3257/6578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:48 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:49.894067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:49.895308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:49.902246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:49.902747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:49.903204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:49.903913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:49.904387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:49.904832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:50.039217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:50.046977 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eec62f7d-9eae-4a23-89f0-45a55efc212f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.156893 Sep 07 10:38:50.047546 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3322/6579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:49 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:51.071143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:51.071665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:51.078434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:51.078912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:51.079347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:51.080028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:51.080492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:51.080901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:51.213716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:51.217242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:38:51.222357 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6a6fa077-62d3-48ab-9332-658df3b3ccef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.155267 Sep 07 10:38:51.223585 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3258/6580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:51 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:52.246190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:52.246814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:52.254022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:52.254266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:52.254714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:52.255412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:52.255881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:52.256314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:52.387118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:52.395760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-acacbe47-3d61-4a29-8eb0-50e654cd1ce3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.153450 Sep 07 10:38:52.396331 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3323/6581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:52 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:53.420414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:53.421038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:53.428407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:53.428904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:53.429382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:53.430088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:53.430552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:53.430988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:53.572009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:53.579845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa4174ba-f604-4efc-8b13-011fc4bfff79 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.164222 Sep 07 10:38:53.580418 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3259/6582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:53 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:54.604107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:54.604771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:54.611848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:54.612353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:54.612805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:54.613547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:54.614022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:54.614463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:54.752113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:54.760796 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e57186cc-1ace-4fa5-91be-5ce8404f24e6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.160587 Sep 07 10:38:54.761420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3324/6583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:54 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:38:55.784383 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:55.784989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:55.792550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:55.793024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:55.793489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:55.794172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:55.794624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:55.795045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:55.927557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:55.935168 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e04e4861-d275-4ecf-bd2a-3a7f4e2bb713 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.154735 Sep 07 10:38:55.935737 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3260/6584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:55 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:56.958913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:56.959542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:56.966458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:56.966950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:56.967395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:56.968085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:56.968556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:56.968993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:57.359623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:57.367902 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0065a5d-446f-4fd2-8ffc-07a4a4816aef tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.413687 Sep 07 10:38:57.368478 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3325/6585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:56 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:58.394920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:58.395547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:58.402654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:58.403149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:58.403592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:58.404295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:58.404760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:58.405209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:58.534926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:58.543389 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab23f7f1-0fc1-4d3f-b4f0-d0f03c403d46 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.152738 Sep 07 10:38:58.543965 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3261/6586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:58 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:38:59.568789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:38:59.569568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:38:59.576808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:59.577344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:59.577804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:59.578720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:38:59.579196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:38:59.579771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:38:59.718451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:38:59.726486 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b312858e-ca8e-44ba-9196-f7cbf0d5cb05 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.162575 Sep 07 10:38:59.727057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3326/6587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:38:59 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:00.750091 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:00.750712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:00.753424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=32 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:00.761663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:00.762349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:00.763114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:00.768047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:00.768047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:00.768047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:00.898065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:00.906077 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca6ece25-0849-4e13-a817-539ebe1b73f9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.159838 Sep 07 10:39:00.906783 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3262/6588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:00 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:01.928258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:01.928891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:01.935790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:01.936309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:01.936756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:01.937479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:01.937953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:01.938389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:01.942313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:02.075236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:02.083415 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f37d7463-3be5-4787-9dd6-d652fb3e1953 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.159209 Sep 07 10:39:02.084257 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3327/6589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:01 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:03.107862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:03.108478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:03.115889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:03.116373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:03.116813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:03.117532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:03.117988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:03.118415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:03.298265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:03.307593 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08b4651a-6fd0-4e48-b00b-fc8acda32511 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1523 microversion: 2.1 time: 0.203600 Sep 07 10:39:03.308231 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3263/6590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:03 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:03.857058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15084b8-f339-4074-8959-fc1a6c7633b1", "name": "network-vif-unplugged", "status": "completed", "tag": "05fe0447-023b-4fda-9761-dc7a02dd3c6b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:03.862274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=38 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:03.868881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:03.869478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:03.869962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:03.882440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] Creating event network-vif-unplugged:05fe0447-023b-4fda-9761-dc7a02dd3c6b for instance b15084b8-f339-4074-8959-fc1a6c7633b1 on n-h2-836830-16 Sep 07 10:39:03.887965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] Instance b15084b8-f339-4074-8959-fc1a6c7633b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:39:03.900248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0127868f-2d41-4bfe-ad98-e72a7d5656f3 req-9a327a4a-9ce9-477a-ab23-0009f842947a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046966 Sep 07 10:39:03.901030 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3328/6591] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:04.331070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:04.331684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:04.339107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:04.339623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:04.340058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:04.340748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:04.341372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:04.341800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:05.075651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:05.084169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-23b4cd8a-bc8d-48c7-8307-909acd5c35ed tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1522 microversion: 2.1 time: 0.756827 Sep 07 10:39:05.084734 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3264/6592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:04 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1522 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:05.929841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15084b8-f339-4074-8959-fc1a6c7633b1", "tag": "05fe0447-023b-4fda-9761-dc7a02dd3c6b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:05.942000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:05.943344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:05.943688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:05.955571 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] Creating event network-changed:05fe0447-023b-4fda-9761-dc7a02dd3c6b for instance b15084b8-f339-4074-8959-fc1a6c7633b1 on n-h2-836830-16 Sep 07 10:39:05.961403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] Instance b15084b8-f339-4074-8959-fc1a6c7633b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:39:05.972125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-4d30ba74-b180-4e71-a68c-02deb6b11850 req-d785b495-7131-4b75-80cc-e6befb5f606b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047220 Sep 07 10:39:05.972716 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3329/6593] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:06.107864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:06.108484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:06.116513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:06.117006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:06.117477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:06.118180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:06.118639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:06.119071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:06.336783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:06.345623 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0a9000b-4f90-4570-8433-2f70e3cccfa0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1520 microversion: 2.1 time: 0.241609 Sep 07 10:39:06.346380 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3265/6594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:06 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:07.376582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:07.377247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:07.384319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:07.384820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:07.385303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:07.386018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:07.386494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:07.386938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:07.523754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:07.531836 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79080a18-17d4-4ef5-a984-1b333bffd4dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1517 microversion: 2.1 time: 0.160620 Sep 07 10:39:07.532409 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3330/6595] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:07 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:07.555957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:07.556500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:07.563434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:07.563944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:07.564368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:07.565065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:07.565561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:07.565995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:07.623969 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b32ea7a7-37fa-43f6-b1bb-2121af4a9b57 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1/action" status: 204 len: 0 microversion: 2.1 time: 0.072566 Sep 07 10:39:07.624597 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3266/6596] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:39:07 2022] POST /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:39:07.633023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:07.633646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:07.639728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:07.640233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:07.640685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:07.641430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:07.641901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:07.642336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:07.898906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:07.907977 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de1d278d-2bb6-4343-9cfa-9c584fe77fff tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1517 microversion: 2.1 time: 0.278994 Sep 07 10:39:07.908746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3331/6597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:07 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1517 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:39:08.935261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:08.936173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:08.943899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:08.944393 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:08.944829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:08.945569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:08.946048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:08.946482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:09.095558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:09.104283 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7eccea6d-e7f5-4fbf-a380-fe8d94671881 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1509 microversion: 2.1 time: 0.174337 Sep 07 10:39:09.104918 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3267/6598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:08 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:09.128394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:09.129153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:09.136661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:09.137275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:09.137794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:09.138575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:09.139114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:09.139621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:09.279951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:09.288493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ff45d9b6-159a-407b-9ab0-ffe73b8acd91 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1509 microversion: 2.1 time: 0.164050 Sep 07 10:39:09.289078 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3332/6599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:09 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:09.319605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cf4ada7-3204-4493-8963-ba6dc8c48959 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'create', calling method: .version_select at 0x7f14b05b7b80>, body: {"keypair": {"name": "tempest-keypair-1850766374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpJCXcdSsGsWS+7GjbL7MseTqyQqErte2qZDkaqCazwD7PH/AhR8du5WUVfO2SPCyCdwPqURs+qcS6+jIEiwJIqCkoEhDJjUAPypvtudEso4TfkyJ/Q2+t99Mvj4cWXpg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:09.335506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9cf4ada7-3204-4493-8963-ba6dc8c48959 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Getting quotas for project 17cda8db22334d39a32a48ccd80731ca. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:39:09.340533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-9cf4ada7-3204-4493-8963-ba6dc8c48959 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Getting quotas for user 5ea70ac21bea4db0a7b08176d1c55110 and project 17cda8db22334d39a32a48ccd80731ca. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:39:09.369596 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cf4ada7-3204-4493-8963-ba6dc8c48959 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053869 Sep 07 10:39:09.370196 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3268/6600] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:39:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:09.815902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-50075caa-aeb9-44e2-9012-f47f023c66f3 req-181db1e0-c828-40e2-8faf-6b95bd0b3cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15084b8-f339-4074-8959-fc1a6c7633b1", "name": "network-vif-plugged", "status": "completed", "tag": "05fe0447-023b-4fda-9761-dc7a02dd3c6b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:09.829941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-50075caa-aeb9-44e2-9012-f47f023c66f3 req-181db1e0-c828-40e2-8faf-6b95bd0b3cb4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:09.829941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-50075caa-aeb9-44e2-9012-f47f023c66f3 req-181db1e0-c828-40e2-8faf-6b95bd0b3cb4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:09.829941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-50075caa-aeb9-44e2-9012-f47f023c66f3 req-181db1e0-c828-40e2-8faf-6b95bd0b3cb4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:09.840799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-50075caa-aeb9-44e2-9012-f47f023c66f3 req-181db1e0-c828-40e2-8faf-6b95bd0b3cb4 service nova] Creating event network-vif-plugged:05fe0447-023b-4fda-9761-dc7a02dd3c6b for instance b15084b8-f339-4074-8959-fc1a6c7633b1 on n-h2-836830-16 Sep 07 10:39:09.846028 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-50075caa-aeb9-44e2-9012-f47f023c66f3 req-181db1e0-c828-40e2-8faf-6b95bd0b3cb4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 Sep 07 10:39:09.846712 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3333/6601] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:10.564602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:10.565232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:10.572142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:10.572627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:10.573066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:10.573790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:10.574245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:10.574669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:10.711864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:10.719601 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-047e9e58-1fdb-4a67-80f3-b867902e6002 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 200 len: 1509 microversion: 2.1 time: 0.159934 Sep 07 10:39:10.720163 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3269/6602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:10 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:10.745049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:10.745714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:10.751812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:10.752300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:10.752743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:10.753465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:10.753930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:10.754366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:10.779009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:39:10.855109 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8d73583-7a15-41f1-a916-358c4e89d9b2 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 204 len: 0 microversion: 2.1 time: 0.115393 Sep 07 10:39:10.855609 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3334/6603] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:39:10 2022] DELETE /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:39:10.914161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-223511632", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "69c3b1c0-ad84-40c8-ba29-d957efbc2218"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:10.971649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] validate_networks() for [('69c3b1c0-ad84-40c8-ba29-d957efbc2218', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:39:11.347447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:39:11.347878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:39:11.348387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:39:11.348902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:39:11.349427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:39:11.358657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:11.358957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:11.359417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:11.360141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:11.360696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:11.361032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:11.378701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Getting quotas for project 17cda8db22334d39a32a48ccd80731ca. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:39:11.384513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Getting quotas for user 5ea70ac21bea4db0a7b08176d1c55110 and project 17cda8db22334d39a32a48ccd80731ca. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:39:11.398074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:39:11.400398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:39:11.446772 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea25ae19-0483-41a6-ae67-a164a6b231da tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537273 Sep 07 10:39:11.447421 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3270/6604] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:39:11.459975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2d1ff68b-6d40-4b3f-a2ac-348dc95b6c51 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:11.460741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d1ff68b-6d40-4b3f-a2ac-348dc95b6c51 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:11.517312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d1ff68b-6d40-4b3f-a2ac-348dc95b6c51 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:11.524859 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2d1ff68b-6d40-4b3f-a2ac-348dc95b6c51 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1217 microversion: 2.1 time: 0.069989 Sep 07 10:39:11.525462 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3335/6605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:11 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:12.548969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:12.549733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:12.557252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:12.557750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:12.558194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:12.558899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:12.559358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:12.559798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:12.640334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:12.650164 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c9aad05-7bfa-48c4-a9ee-9ccd13e623a9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1269 microversion: 2.1 time: 0.105839 Sep 07 10:39:12.650838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3271/6606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:12 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:12.765229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ee08f00e-ef47-4d6a-8f6e-294dcee8d88d req-fb3ee3f7-26e4-4c0c-8145-a5e0e755af5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15084b8-f339-4074-8959-fc1a6c7633b1", "name": "network-vif-deleted", "tag": "05fe0447-023b-4fda-9761-dc7a02dd3c6b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:12.783694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee08f00e-ef47-4d6a-8f6e-294dcee8d88d req-fb3ee3f7-26e4-4c0c-8145-a5e0e755af5b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:12.784478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee08f00e-ef47-4d6a-8f6e-294dcee8d88d req-fb3ee3f7-26e4-4c0c-8145-a5e0e755af5b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:12.784974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee08f00e-ef47-4d6a-8f6e-294dcee8d88d req-fb3ee3f7-26e4-4c0c-8145-a5e0e755af5b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:12.798609 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ee08f00e-ef47-4d6a-8f6e-294dcee8d88d req-fb3ee3f7-26e4-4c0c-8145-a5e0e755af5b service nova] Creating event network-vif-deleted:05fe0447-023b-4fda-9761-dc7a02dd3c6b for instance b15084b8-f339-4074-8959-fc1a6c7633b1 on n-h2-836830-16 Sep 07 10:39:12.804435 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ee08f00e-ef47-4d6a-8f6e-294dcee8d88d req-fb3ee3f7-26e4-4c0c-8145-a5e0e755af5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043651 Sep 07 10:39:12.805855 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3336/6607] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:13.674884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:13.675528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:13.683144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:13.683545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:13.683984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:13.684683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:13.685146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:13.685599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:13.917908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:13.925580 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-33c22f5e-fc9d-434a-be37-a6981aea810f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.254595 Sep 07 10:39:13.926346 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3272/6608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:13 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:14.261418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5b9c3b36-1b27-4822-8496-571a8dd257f1 req-4ac3b670-5d23-4ba3-98a6-80676c7efc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c9480d-5713-4300-9b7f-e27115a8bc6b", "tag": "a962a943-9b6e-4ff9-972b-e865b6223bc2"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:14.272124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b9c3b36-1b27-4822-8496-571a8dd257f1 req-4ac3b670-5d23-4ba3-98a6-80676c7efc7f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:14.272581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b9c3b36-1b27-4822-8496-571a8dd257f1 req-4ac3b670-5d23-4ba3-98a6-80676c7efc7f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:14.273067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b9c3b36-1b27-4822-8496-571a8dd257f1 req-4ac3b670-5d23-4ba3-98a6-80676c7efc7f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:14.284210 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5b9c3b36-1b27-4822-8496-571a8dd257f1 req-4ac3b670-5d23-4ba3-98a6-80676c7efc7f service nova] Creating event network-changed:a962a943-9b6e-4ff9-972b-e865b6223bc2 for instance 77c9480d-5713-4300-9b7f-e27115a8bc6b on n-h2-836830-16 Sep 07 10:39:14.290241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5b9c3b36-1b27-4822-8496-571a8dd257f1 req-4ac3b670-5d23-4ba3-98a6-80676c7efc7f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033748 Sep 07 10:39:14.290869 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3337/6609] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:14.952153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:14.953306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:14.965512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:14.966401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:14.967183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:14.968061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:14.968750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:14.969218 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:15.111960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:15.120370 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-03578d9a-6fe0-4060-aef4-301dc37ae447 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.173147 Sep 07 10:39:15.120938 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3273/6610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:14 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:16.145105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:16.145850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:16.152703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:16.153230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:16.153690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:16.154394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:16.154869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:16.155311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:16.292741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:16.300753 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a959aae-8294-463c-8d5e-925f4293396a tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.160845 Sep 07 10:39:16.301365 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3338/6611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:16 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:17.324197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:17.324820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:17.331743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:17.332234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:17.332679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:17.333407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:17.334184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:17.334619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:17.467950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:17.476462 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b5a50ea8-dc64-4e8f-af32-392c4f0609c0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.156210 Sep 07 10:39:17.477033 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3274/6612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:17 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:18.499992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:18.500674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:18.508474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:18.508979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:18.509468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:18.510182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:18.510658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:18.511101 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:18.644174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:18.651973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5ffcb8d-c711-45c3-8c70-893bb771465c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.155968 Sep 07 10:39:18.652544 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3339/6613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:18 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:19.674691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:19.675247 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:19.683452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:19.683951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:19.684392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:19.685089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:19.685582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:19.686012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:19.823769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:19.831793 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d765ce30-d8c8-44ff-acd5-07224a230c85 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.161319 Sep 07 10:39:19.832376 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3275/6614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:19 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:19.895195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-89d7d890-26e4-4ba8-a8a9-0fbec031627b req-3a9d52cc-ca6b-4d9d-b5b6-a719ee97fb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c9480d-5713-4300-9b7f-e27115a8bc6b", "name": "network-vif-plugged", "status": "completed", "tag": "a962a943-9b6e-4ff9-972b-e865b6223bc2"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:19.906113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-89d7d890-26e4-4ba8-a8a9-0fbec031627b req-3a9d52cc-ca6b-4d9d-b5b6-a719ee97fb2b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:19.906655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-89d7d890-26e4-4ba8-a8a9-0fbec031627b req-3a9d52cc-ca6b-4d9d-b5b6-a719ee97fb2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:19.907121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-89d7d890-26e4-4ba8-a8a9-0fbec031627b req-3a9d52cc-ca6b-4d9d-b5b6-a719ee97fb2b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:19.919484 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-89d7d890-26e4-4ba8-a8a9-0fbec031627b req-3a9d52cc-ca6b-4d9d-b5b6-a719ee97fb2b service nova] Creating event network-vif-plugged:a962a943-9b6e-4ff9-972b-e865b6223bc2 for instance 77c9480d-5713-4300-9b7f-e27115a8bc6b on n-h2-836830-16 Sep 07 10:39:19.924526 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-89d7d890-26e4-4ba8-a8a9-0fbec031627b req-3a9d52cc-ca6b-4d9d-b5b6-a719ee97fb2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Sep 07 10:39:19.925215 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3340/6615] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:39:20.856329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:20.856945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:20.863780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:20.864263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:20.864701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:20.865952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:20.866469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:20.866890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:20.869544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:21.009800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:21.023626 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ae2cefe8-ef91-435f-8bcb-cb2ffc0f0907 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1317 microversion: 2.1 time: 0.169722 Sep 07 10:39:21.024229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3276/6616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:20 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:22.045398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:22.049881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:22.050596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:22.057860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.058352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.058802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.059497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.059965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.060403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.198932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:22.206653 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cbdc4f3a-4ece-4aa3-856b-1af464647ba6 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1507 microversion: 2.1 time: 0.163170 Sep 07 10:39:22.207230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3341/6617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:22 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:22.230661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:22.231280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:22.233128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:22.233837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:22.240958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.241482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.241928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.242627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.243088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.243519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.379698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:22.387598 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fcc23e3c-b7c5-47e6-b08c-c1bd2ef02fc7 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1507 microversion: 2.1 time: 0.160878 Sep 07 10:39:22.388173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3277/6618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:22 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:22.411096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:22.415245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:22.422456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.422961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.423413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.424125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.424596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.425039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.455119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:22.463017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Old instance type m1.heat2, new instance type m1.heat {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:39:22.469487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:39:22.469930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:39:22.470419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:39:22.470841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:39:22.471265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:39:22.534432 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65ef5c3e-1808-4dbc-93f9-5a3bc99810d4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b/action" status: 202 len: 0 microversion: 2.1 time: 0.127438 Sep 07 10:39:22.535043 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3342/6619] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:39:22 2022] POST /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:39:22.543823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:22.544440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:22.550567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.551053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.551486 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.552175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:22.552629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:22.553965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:22.690071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:22.698734 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-86ff574e-23d1-4afb-b561-a3eed7734629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1514 microversion: 2.1 time: 0.158816 Sep 07 10:39:22.699311 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3278/6620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:22 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:39:23.724277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:23.725714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:23.731940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:23.732442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:23.732897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:23.733633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:23.734174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:23.734632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:23.965329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:23.973091 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-76a88282-a16a-48aa-995f-d6c30fc49ed1 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1514 microversion: 2.1 time: 0.253846 Sep 07 10:39:23.973712 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3343/6621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:23 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:24.997889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:24.998501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:25.007395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:25.007918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:25.008372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:25.009382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:25.009850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:25.010284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:25.144620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:25.152357 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-be9db434-22de-45d5-8df7-c45e14ed7f21 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.158576 Sep 07 10:39:25.152928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3279/6622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:24 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:26.176089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:26.176655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:26.184112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:26.184609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:26.185055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:26.185778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:26.186243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:26.186682 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:26.323535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:26.331526 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58cd0fc1-4518-4eca-8292-bef1e7dbf006 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.159493 Sep 07 10:39:26.332116 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3344/6623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:26 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:27.355774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:27.356371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:27.363264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:27.363748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:27.364184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:27.364872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:27.365874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:27.366454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:27.503987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:27.512446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e205fa5d-4b56-4a43-a0cf-32fbf789ce90 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.160534 Sep 07 10:39:27.513023 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3280/6624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:27 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:28.536122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:28.536753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:28.544426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:28.544918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:28.545394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:28.546103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:28.546578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:28.547021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:28.549684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:28.681026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:28.688714 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0d5051ff-10cc-4863-abd6-64be7444c454 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.156539 Sep 07 10:39:28.689301 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3345/6625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:28 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:29.713296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:29.713858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:29.720727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:29.721245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:29.721691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:29.722384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:29.722871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:29.723301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:29.861459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:29.869463 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-774ac78f-45df-4aae-bd36-a57b57941133 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.161364 Sep 07 10:39:29.870033 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3281/6626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:29 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:30.892148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:30.892784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:30.901543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:30.902128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:30.902651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:30.903549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:30.903928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:30.904456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:31.039212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:31.046994 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6adb13d-be69-4d30-b538-19322ffde816 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.158963 Sep 07 10:39:31.047573 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3346/6627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:30 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:32.072369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:32.073004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:32.075769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:32.081111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:32.081635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:32.082072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:32.082762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:32.083212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:32.083637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:32.220906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:32.229499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3558319a-be1b-4c5d-8370-b98d4330b629 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.161950 Sep 07 10:39:32.230063 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3282/6628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:32 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:39:33.253157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:33.253817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:33.261405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:33.261905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:33.262359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:33.263066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:33.263540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:33.263985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:33.397958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:33.406065 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7dcbc8a2-02bd-4ed1-b23e-8100bf243e7d tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.156803 Sep 07 10:39:33.406643 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3347/6629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:33 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:34.431272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:34.431887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:34.438849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:34.439333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:34.439765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:34.440455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:34.440906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:34.441363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:34.577557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:34.585852 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-435b5082-19d1-411e-8bc7-5dec9f8345f4 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.159372 Sep 07 10:39:34.586440 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3283/6630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:34 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:39:35.609987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:35.610649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:35.612735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:35.618695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:35.619201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:35.619659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:35.620369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:35.620846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:35.621325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:35.756706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:35.764476 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-95af8487-1713-4c99-a234-811d15a6f0f0 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.158555 Sep 07 10:39:35.765056 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3348/6631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:35 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:36.790954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:36.791564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:36.797906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:36.798390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:36.798829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:36.799524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:36.799979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:36.800402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:36.933874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:36.942043 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84fed4af-5c2e-4483-99be-b6ef57ffd717 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.155829 Sep 07 10:39:36.942621 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3284/6632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:36 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:37.965817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:37.966460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:37.973709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:37.974283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:37.974781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:37.975466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:37.975942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:37.976413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:38.113134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:38.121103 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cd3069fc-0f03-47b9-8376-6a735b00190b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.159203 Sep 07 10:39:38.121696 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3349/6633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:37 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:39.143502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:39.144133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:39.151966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:39.152500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:39.152948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:39.153682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:39.154147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:39.154587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:39.292135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:39.299962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b41db4b5-23b8-4a3f-92f3-0fb2452342dd tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.160326 Sep 07 10:39:39.300535 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3285/6634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:39 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:40.324342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:40.324991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:40.331919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:40.332425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:40.332916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:40.334214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:40.334748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:40.335128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:40.472375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:40.480674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e96cb6c-1fdc-441a-910e-bfe43f8d5300 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.160260 Sep 07 10:39:40.481263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3350/6635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:40 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:41.504027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:41.504646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:41.511711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:41.512204 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:41.512651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:41.513385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:41.513854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:41.514289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:41.645051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:41.654350 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1a4790f7-350f-4e7b-b6f8-51dd8aa5a81c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.154265 Sep 07 10:39:41.654928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3286/6636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:41 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:42.679221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:42.679771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:42.686654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:42.687216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:42.687674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:42.688379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:42.688854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:42.689329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:42.818880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:42.826612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e4c9f8e5-ef57-4110-a862-0695a0c567ac tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.151985 Sep 07 10:39:42.827187 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3351/6637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:42 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:43.850946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:43.851576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:43.858566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:43.859060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:43.859504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:43.860203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:43.860666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:43.861100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:43.999128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:44.008184 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b10a5b75-10e2-456b-aae5-910d35ac2468 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.161880 Sep 07 10:39:44.008752 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3287/6638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:43 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:45.031694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:45.032339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:45.040153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:45.040656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:45.041114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:45.041851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:45.042327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:45.042774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:45.175021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:45.183978 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1440d670-6782-4393-bd11-66bb9615d38f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.156229 Sep 07 10:39:45.184556 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3352/6639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:45 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:46.210796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:46.211326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:46.219039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:46.219539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:46.219988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:46.220730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:46.221223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:46.221666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:46.368124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:46.378203 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1940738-a465-472b-9793-0f3dbb07dd63 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.172139 Sep 07 10:39:46.378775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3288/6640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:46 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:47.405344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:47.405972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:47.413208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:47.413721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:47.414182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:47.414907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:47.415384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:47.415830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:47.554228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:47.562248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-83c8a261-11f9-41e4-87dc-e1b940596142 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.160831 Sep 07 10:39:47.562836 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3353/6641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:47 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:39:48.585440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:48.585961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:48.592796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:48.593320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:48.593763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:48.594454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:48.594915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:48.595345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:48.729641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:48.737524 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-baef99dd-0735-4f44-9ba7-49d869232b6b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.156889 Sep 07 10:39:48.738125 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3289/6642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:48 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:49.760918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:49.761604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:49.768567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:49.769071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:49.769561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:49.770269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:49.770746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:49.771945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:49.911376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:49.919878 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39d4b0c6-07da-4901-bb9f-288652773528 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.162928 Sep 07 10:39:49.920453 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3354/6643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:49 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:50.942509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:50.943121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:50.950756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:50.951236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:50.951668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:50.952347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:50.952798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:50.953234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:50.955759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=84 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:51.090080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:51.097892 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-13e90a73-002a-4b49-abf9-a6d1d7ed7015 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.159275 Sep 07 10:39:51.098466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3290/6644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:50 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:52.121706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:52.122334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:52.129170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:52.129693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:52.130146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:52.130934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:52.131947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:52.132569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:52.269258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:52.271875 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:39:52.272106 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b (ip 10.222.0.60) !!! Sep 07 10:39:52.281712 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d3db6bb-1b64-41b3-9083-0d0f8cf1057c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.163811 Sep 07 10:39:52.282282 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3355/6645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:52 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:53.305002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:53.305655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:53.312896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:53.313416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:53.313874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:53.314563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:53.315014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:53.315432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:53.454128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:53.463028 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f2c386ba-052d-48fc-827e-aa4a587e9dae tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.162220 Sep 07 10:39:53.463604 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3291/6646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:53 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:54.487902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:54.488528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:54.496347 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:54.496846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:54.497332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:54.498035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:54.498502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:54.498942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:54.635831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:54.643595 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-004990bf-2949-4e6f-9941-d1d7e2037d78 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.160963 Sep 07 10:39:54.644166 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3356/6647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:54 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:55.675209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:55.675738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:55.682642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:55.683134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:55.683576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:55.684275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:55.684738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:55.685251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:55.817110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:55.825657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6eed61d1-17ec-4257-bf8b-c08c16d57750 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1519 microversion: 2.1 time: 0.154630 Sep 07 10:39:55.826221 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3292/6648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:55 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:39:56.848686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:56.849355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:56.856992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:56.857615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:56.858081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:56.858801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:56.859281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:56.859731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:57.092293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:57.099976 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1dec6ef0-58d5-45b7-b7d3-5273e808edcb tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1518 microversion: 2.1 time: 0.255287 Sep 07 10:39:57.100543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3357/6649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:56 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:57.275625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c9480d-5713-4300-9b7f-e27115a8bc6b", "name": "network-vif-unplugged", "status": "completed", "tag": "a962a943-9b6e-4ff9-972b-e865b6223bc2"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:57.286190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:57.286669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:57.287100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:57.308184 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] Creating event network-vif-unplugged:a962a943-9b6e-4ff9-972b-e865b6223bc2 for instance 77c9480d-5713-4300-9b7f-e27115a8bc6b on n-h1-836830-16 Sep 07 10:39:57.318260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:39:57.339464 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-03d83e05-4166-4750-86b0-69518edda934 req-e90c1971-11ad-438c-be31-11c591d0a1d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068166 Sep 07 10:39:57.340613 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3293/6650] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:39:58.123988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:58.124713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:58.132853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:58.133483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:58.133856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:58.134580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:58.135053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:58.135531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:58.271737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:58.280547 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-769c6373-3e82-4688-8965-4e48e18e6c5f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1518 microversion: 2.1 time: 0.160542 Sep 07 10:39:58.281261 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3358/6651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:58 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:39:59.306847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:39:59.307559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:39:59.314118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:59.314800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:59.315369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:59.316239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:59.316701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:59.317132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:59.371972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c9480d-5713-4300-9b7f-e27115a8bc6b", "tag": "a962a943-9b6e-4ff9-972b-e865b6223bc2"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:39:59.383726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:39:59.385043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:39:59.385521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:39:59.389648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=84 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:39:59.402426 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] Creating event network-changed:a962a943-9b6e-4ff9-972b-e865b6223bc2 for instance 77c9480d-5713-4300-9b7f-e27115a8bc6b on n-h1-836830-16 Sep 07 10:39:59.408177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:39:59.422142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-715de77b-c653-4716-bb39-2e685be90dcc req-7a23eae0-6a3b-482e-9f10-3397cf003d6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053367 Sep 07 10:39:59.423233 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3359/6652] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:39:59.477458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:39:59.485310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b30cd09a-7654-4543-b2df-bd6caedd2dc3 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1516 microversion: 2.1 time: 0.184571 Sep 07 10:39:59.485895 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3294/6653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:39:59 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:00.511219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:00.511938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:00.518306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:00.518800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:00.519247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:00.519950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:00.520416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:00.520854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:00.656407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:00.664142 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8ffd8abe-4bd3-4c9a-af90-3e690fde4823 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1513 microversion: 2.1 time: 0.158286 Sep 07 10:40:00.664722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3360/6654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:00 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:00.686503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:00.687030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:00.693936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:00.694429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:00.695449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:00.696158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:00.696613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:00.697042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:00.764089 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ee13a15-a567-48a8-9e79-5b27b5670709 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "POST /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b/action" status: 204 len: 0 microversion: 2.1 time: 0.081228 Sep 07 10:40:00.764835 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3295/6655] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:40:00 2022] POST /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:40:00.775056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:00.775826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:00.782039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:00.782634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:00.783229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:00.784036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:00.784513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:00.784965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:01.010889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:01.018648 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a238830-aa74-4337-9206-a9c9566e9c4f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1513 microversion: 2.1 time: 0.249454 Sep 07 10:40:01.019235 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3361/6656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:00 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:02.045255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:02.045981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:02.052313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:02.052809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:02.053295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:02.054099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:02.054579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:02.055013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:02.207165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:02.217011 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93bc9b7b-db16-4574-9639-c2c720200eb9 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1513 microversion: 2.1 time: 0.176724 Sep 07 10:40:02.217642 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3296/6657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:02 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:40:03.240365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:03.240977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:03.248891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.249431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.249891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.250602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.251072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.251515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.386214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:03.394384 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6788bc5a-c578-4179-bf7c-44fb1a8f5b36 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1505 microversion: 2.1 time: 0.157747 Sep 07 10:40:03.395294 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3362/6658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:03 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:03.417962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:03.418589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:03.421751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=30 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:03.427131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.427621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.428067 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.428765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.429256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.429829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.567474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:03.575446 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e781d92c-5d9e-462c-88c3-afce6a3be435 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1505 microversion: 2.1 time: 0.162142 Sep 07 10:40:03.576033 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3297/6659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:03 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:03.600123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:03.600935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:03.607899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.608495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.609141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.609870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.610411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.611042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.618362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b1d9f521-846c-4a79-aa9e-94b921305b10 req-9cceeb66-e21e-4e37-8ae9-0195e1855e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c9480d-5713-4300-9b7f-e27115a8bc6b", "name": "network-vif-plugged", "status": "completed", "tag": "a962a943-9b6e-4ff9-972b-e865b6223bc2"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:03.631695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b1d9f521-846c-4a79-aa9e-94b921305b10 req-9cceeb66-e21e-4e37-8ae9-0195e1855e29 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.632230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b1d9f521-846c-4a79-aa9e-94b921305b10 req-9cceeb66-e21e-4e37-8ae9-0195e1855e29 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.633329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b1d9f521-846c-4a79-aa9e-94b921305b10 req-9cceeb66-e21e-4e37-8ae9-0195e1855e29 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.645246 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b1d9f521-846c-4a79-aa9e-94b921305b10 req-9cceeb66-e21e-4e37-8ae9-0195e1855e29 service nova] Creating event network-vif-plugged:a962a943-9b6e-4ff9-972b-e865b6223bc2 for instance 77c9480d-5713-4300-9b7f-e27115a8bc6b on n-h1-836830-16 Sep 07 10:40:03.651991 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b1d9f521-846c-4a79-aa9e-94b921305b10 req-9cceeb66-e21e-4e37-8ae9-0195e1855e29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037498 Sep 07 10:40:03.652611 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3298/6660] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:40:03.750817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:03.758715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2578a619-e0a5-4db1-92b0-bb2fe2de467e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1505 microversion: 2.1 time: 0.162713 Sep 07 10:40:03.759295 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3363/6661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:03 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:03.780799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:03.781473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:03.787651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.788141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.788582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.789813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.790271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.790702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.815947 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:40:03.891891 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-028ef4a4-924f-4ee9-85e2-f090a7b50c9b tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 204 len: 0 microversion: 2.1 time: 0.114919 Sep 07 10:40:03.892432 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3299/6662] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:40:03 2022] DELETE /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:40:03.906613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:03.907299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:03.913322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.913818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.914819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.915796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:03.916265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:03.916711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:03.943119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:40:03.988236 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.compute.api [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Instance is already in deleting state, ignoring this request Sep 07 10:40:03.989086 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4229d16d-bce7-4600-ab31-684510643f3f tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 204 len: 0 microversion: 2.1 time: 0.086501 Sep 07 10:40:03.989697 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3364/6663] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:40:03 2022] DELETE /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:40:03.999066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:03.999783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:04.005775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:04.006266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:04.006713 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:04.007407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:04.007972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:04.008423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:04.146054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:04.154366 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1b4acd7-2c06-4578-b411-fec348db3c93 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1511 microversion: 2.1 time: 0.159566 Sep 07 10:40:04.155127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3300/6664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:03 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:05.177933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:05.178584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:05.186405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:05.186898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:05.187346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:05.188050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:05.188516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:05.188952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:05.339094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea70ac21bea4db0a7b08176d1c55110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17cda8db22334d39a32a48ccd80731ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:05.346905 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d4eb209-7494-46e9-a180-5a0ea62190a8 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 200 len: 1511 microversion: 2.1 time: 0.172926 Sep 07 10:40:05.347498 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3365/6665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:05 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:06.127290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-66d52a6a-c362-40dd-904b-3d6080beec33 req-65882252-38c6-4638-810e-b11f3271ec35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c9480d-5713-4300-9b7f-e27115a8bc6b", "name": "network-vif-deleted", "tag": "a962a943-9b6e-4ff9-972b-e865b6223bc2"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:06.141297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66d52a6a-c362-40dd-904b-3d6080beec33 req-65882252-38c6-4638-810e-b11f3271ec35 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:06.141793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66d52a6a-c362-40dd-904b-3d6080beec33 req-65882252-38c6-4638-810e-b11f3271ec35 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:06.142235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-66d52a6a-c362-40dd-904b-3d6080beec33 req-65882252-38c6-4638-810e-b11f3271ec35 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:06.155185 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-66d52a6a-c362-40dd-904b-3d6080beec33 req-65882252-38c6-4638-810e-b11f3271ec35 service nova] Creating event network-vif-deleted:a962a943-9b6e-4ff9-972b-e865b6223bc2 for instance 77c9480d-5713-4300-9b7f-e27115a8bc6b on n-h1-836830-16 Sep 07 10:40:06.161295 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-66d52a6a-c362-40dd-904b-3d6080beec33 req-65882252-38c6-4638-810e-b11f3271ec35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038241 Sep 07 10:40:06.161950 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3301/6666] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:40:06.370346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:06.370925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: 77c9480d-5713-4300-9b7f-e27115a8bc6b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:06.373772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=36 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:06.379047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:06.379545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:06.379998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:06.380703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:06.381171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:06.381634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:06.395846 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] HTTP exception thrown: Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b could not be found. Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Request method failure captured: Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b HTTP/1.1 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHSczxeVpL-cH6lDZ85QY8DMuJdGjeoF24E9GELO4JtWGUUuejAGWN-U4ojOdMyDk-6UQwwut5mz8YHpwWY43pSTXszExBszt1TmBp507xmZs0aB_20IstjfchDfpdv-ENTcrYGklwCHrcqM_Vs7YJy6SAe42_gUQvxFPU8P2HH2yqk Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 17cda8db22334d39a32a48ccd80731ca Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17cda8db22334d39a32a48ccd80731ca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 17cda8db22334d39a32a48ccd80731ca Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerDiskConfigTestJSON-603784383-project Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 5ea70ac21bea4db0a7b08176d1c55110 Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerDiskConfigTestJSON-603784383-project Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b could not be found. Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '77c9480d-5713-4300-9b7f-e27115a8bc6b'} Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b could not be found. Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b could not be found. Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:40:06.397556 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b could not be found. Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Returning 404 to user: Instance 77c9480d-5713-4300-9b7f-e27115a8bc6b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-27dde8b6-a61b-48fd-9a5f-2d1946bf570e tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b" status: 404 len: 111 microversion: 2.1 time: 0.033568 Sep 07 10:40:06.402690 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3366/6667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:06 2022] GET /compute/v2.1/servers/77c9480d-5713-4300-9b7f-e27115a8bc6b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:40:06.409532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-537c8872-5fa8-442f-be29-772212f2f312 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '.version_select at 0x7f14b057a9d0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:06.430955 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-537c8872-5fa8-442f-be29-772212f2f312 tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850766374" status: 202 len: 0 microversion: 2.1 time: 0.025993 Sep 07 10:40:06.431546 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3302/6668] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 7 10:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850766374 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:40:07.055939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:07.056465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:07.062802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:07.063436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:07.063901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:07.064620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:07.065098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:07.065577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:07.080089 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] HTTP exception thrown: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Request method failure captured: Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 HTTP/1.1 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHSczxeVpL-cH6lDZ85QY8DMuJdGjeoF24E9GELO4JtWGUUuejAGWN-U4ojOdMyDk-6UQwwut5mz8YHpwWY43pSTXszExBszt1TmBp507xmZs0aB_20IstjfchDfpdv-ENTcrYGklwCHrcqM_Vs7YJy6SAe42_gUQvxFPU8P2HH2yqk Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 17cda8db22334d39a32a48ccd80731ca Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17cda8db22334d39a32a48ccd80731ca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 17cda8db22334d39a32a48ccd80731ca Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerDiskConfigTestJSON-603784383-project Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 5ea70ac21bea4db0a7b08176d1c55110 Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerDiskConfigTestJSON-603784383-project Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b15084b8-f339-4074-8959-fc1a6c7633b1'} Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:40:07.081729 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Returning 404 to user: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab74eb55-2d39-4637-8d55-02fc581d9b8c tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 404 len: 111 microversion: 2.1 time: 0.032032 Sep 07 10:40:07.086348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3367/6669] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:40:07 2022] DELETE /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:40:07.092108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:07.092860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] [instance: b15084b8-f339-4074-8959-fc1a6c7633b1] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:07.099003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:07.099495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:07.099946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:07.100652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:07.101116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:07.101582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:07.115103 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] HTTP exception thrown: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Request method failure captured: Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 HTTP/1.1 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHSczxeVpL-cH6lDZ85QY8DMuJdGjeoF24E9GELO4JtWGUUuejAGWN-U4ojOdMyDk-6UQwwut5mz8YHpwWY43pSTXszExBszt1TmBp507xmZs0aB_20IstjfchDfpdv-ENTcrYGklwCHrcqM_Vs7YJy6SAe42_gUQvxFPU8P2HH2yqk Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 17cda8db22334d39a32a48ccd80731ca Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17cda8db22334d39a32a48ccd80731ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17cda8db22334d39a32a48ccd80731ca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 17cda8db22334d39a32a48ccd80731ca Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-603784383 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerDiskConfigTestJSON-603784383-project Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 5ea70ac21bea4db0a7b08176d1c55110 Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerDiskConfigTestJSON-603784383-project Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'b15084b8-f339-4074-8959-fc1a6c7633b1'} Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:40:07.116762 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] Returning 404 to user: Instance b15084b8-f339-4074-8959-fc1a6c7633b1 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60dea10f-8562-4bdd-b833-7f1191276eaa tempest-ServerDiskConfigTestJSON-603784383 tempest-ServerDiskConfigTestJSON-603784383-project] 10.222.0.60 "GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1" status: 404 len: 111 microversion: 2.1 time: 0.030651 Sep 07 10:40:07.121832 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3303/6670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:07 2022] GET /compute/v2.1/servers/b15084b8-f339-4074-8959-fc1a6c7633b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:40:15.919729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d688e83-d6ff-44ac-baa8-6fd87621f63f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'create', calling method: .version_select at 0x7f14b0aa8f70>, body: {"keypair": {"name": "tempest-keypair-655676691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuEo1jYQiPeQOMsULghspfwlyzTLoO5X8d0rSbkWgjarD6M9Xhxvgvz2DT0h0SZTjyqeZbd2w6Se8JeihVT2u6jVt0JHUNXGTwTx/xqiJAPsC4gesOPwOONqPJsVRLpUw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:15.936233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5d688e83-d6ff-44ac-baa8-6fd87621f63f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:40:15.941908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-5d688e83-d6ff-44ac-baa8-6fd87621f63f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:40:15.973402 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d688e83-d6ff-44ac-baa8-6fd87621f63f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177678 Sep 07 10:40:15.974391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3368/6671] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:40:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:40:17.332820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1458719422", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "993b582c-6f57-4dcb-bebc-03405ecfec60"}], "security_groups": [{"name": "tempest-securitygroup--96321384"}], "key_name": "tempest-keypair-655676691", "user_data": "}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:17.343691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:17.344363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:17.457312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] validate_networks() for [('993b582c-6f57-4dcb-bebc-03405ecfec60', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:40:17.857162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:40:17.857613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:40:17.858231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:40:17.858653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:40:17.859071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:40:17.868879 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:17.869354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:17.869796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:17.870531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:17.870991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:17.871431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:17.888549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:40:17.894171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:40:17.907888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:40:17.910229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:40:17.971231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4fcc6cca-c1d5-4bf3-b22e-232cfea7ecb8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.642599 Sep 07 10:40:17.971863 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3304/6672] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:40:17 2022] POST /compute/v2.1/servers => generated 407 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:40:17.984227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab2e3ed0-65eb-46f1-a339-3158887f8439 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:17.985500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab2e3ed0-65eb-46f1-a339-3158887f8439 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:17.989292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:18.051940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ab2e3ed0-65eb-46f1-a339-3158887f8439 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:18.059995 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab2e3ed0-65eb-46f1-a339-3158887f8439 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1238 microversion: 2.1 time: 0.079791 Sep 07 10:40:18.061931 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3369/6673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:17 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:19.085538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:19.086374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:19.093729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:19.094354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:19.094801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:19.095505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:19.096052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:19.096423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:19.162209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:19.171099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c656c25-4880-42d7-bc7b-89c3a2f90f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1290 microversion: 2.1 time: 0.090830 Sep 07 10:40:19.171696 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3305/6674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:19 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:20.195130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:20.196937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:20.204227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:20.204712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:20.205159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:20.205908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:20.206538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:20.207102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:20.456563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:20.465435 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac47e058-0253-4038-b46f-244b8ee93dce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.274428 Sep 07 10:40:20.466022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3370/6675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:20 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:20.996783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5b6b518c-09b7-4e1d-baff-aba001a7ae95 req-d03e13ae-077b-4a4d-a642-dc6c5386ee91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:21.008700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b6b518c-09b7-4e1d-baff-aba001a7ae95 req-d03e13ae-077b-4a4d-a642-dc6c5386ee91 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:21.009170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b6b518c-09b7-4e1d-baff-aba001a7ae95 req-d03e13ae-077b-4a4d-a642-dc6c5386ee91 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:21.009634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b6b518c-09b7-4e1d-baff-aba001a7ae95 req-d03e13ae-077b-4a4d-a642-dc6c5386ee91 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:21.021133 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5b6b518c-09b7-4e1d-baff-aba001a7ae95 req-d03e13ae-077b-4a4d-a642-dc6c5386ee91 service nova] Creating event network-changed:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h2-836830-16 Sep 07 10:40:21.026756 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5b6b518c-09b7-4e1d-baff-aba001a7ae95 req-d03e13ae-077b-4a4d-a642-dc6c5386ee91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033878 Sep 07 10:40:21.027501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3306/6676] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:40:21.490209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:21.490965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:21.498788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:21.499295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:21.499783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:21.500502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:21.500996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:21.501461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:21.638181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:21.645944 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9971996c-574a-43fb-b7f1-0be820fed7a4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.161906 Sep 07 10:40:21.646509 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3371/6677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:21 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:22.670714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:22.671503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:22.677699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:22.678188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:22.678624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:22.679316 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:22.679769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:22.680202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:22.840995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:22.848795 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4ce665c2-2ffc-4d54-b173-185c8023ba55 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.183327 Sep 07 10:40:22.849388 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3307/6678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:22 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:23.872541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:23.873197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:23.880269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:23.880805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:23.881295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:23.882010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:23.882489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:23.882934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:24.013827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:24.022173 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-55cdbb99-ba8c-46db-b8fa-33b287d7af5d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.154401 Sep 07 10:40:24.022746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3372/6679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:23 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:25.044128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:25.045020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:25.051992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:25.052489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:25.052935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:25.053665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:25.054130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:25.054563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:25.188089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:25.195763 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ff264427-394f-4c11-8bbd-e5ac96a23055 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.155715 Sep 07 10:40:25.196862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3308/6680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:25 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:26.193081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6de334ea-cf38-498e-a1b1-14da5028f037 req-893eb598-f99c-4694-83b2-bb79981e3a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "name": "network-vif-plugged", "status": "completed", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:26.205866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6de334ea-cf38-498e-a1b1-14da5028f037 req-893eb598-f99c-4694-83b2-bb79981e3a61 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:26.206373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6de334ea-cf38-498e-a1b1-14da5028f037 req-893eb598-f99c-4694-83b2-bb79981e3a61 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:26.206830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6de334ea-cf38-498e-a1b1-14da5028f037 req-893eb598-f99c-4694-83b2-bb79981e3a61 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:26.219296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:26.219822 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6de334ea-cf38-498e-a1b1-14da5028f037 req-893eb598-f99c-4694-83b2-bb79981e3a61 service nova] Creating event network-vif-plugged:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h2-836830-16 Sep 07 10:40:26.219932 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:26.226153 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6de334ea-cf38-498e-a1b1-14da5028f037 req-893eb598-f99c-4694-83b2-bb79981e3a61 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036393 Sep 07 10:40:26.226343 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3373/6681] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:40:26.226887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:26.228188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:26.228644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:26.229390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:26.229845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:26.230361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:26.415198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:26.423354 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54c1f4ec-09f9-482d-a1b2-8ff121f4815d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.207943 Sep 07 10:40:26.423932 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3309/6682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:26 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:40:27.447589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:27.448303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:27.455768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:27.456272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:27.456721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:27.457454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:27.457924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:27.458361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:27.605900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:27.613728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6b885a5-9e12-4e2d-8756-403fdb1ceb6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1362 microversion: 2.1 time: 0.170984 Sep 07 10:40:27.614334 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3374/6683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:27 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:28.637624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:28.638236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:28.641005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:28.641757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:28.647643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:28.648133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:28.648573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:28.649355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:28.649829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:28.650255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:28.780413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:40:28.788522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-332a4a0e-e4eb-4d3a-973f-1f5aaafd3e75 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1549 microversion: 2.1 time: 0.155447 Sep 07 10:40:28.789095 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3310/6684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:40:28 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:40:28.812754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:40:28.813287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:40:28.815320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:40:28.822108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:28.822603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:28.823049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:28.823754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:28.824225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:28.824662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:28.901936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4565f332-bc0e-47ed-9c5a-6801513ab1b9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093539 Sep 07 10:40:28.902530 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3375/6685] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:40:28 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:40:29.873502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ed3d7ac8-2fee-451a-b6ec-b955609bc90e req-fd2c1b71-2057-4d16-b78f-b4eef50852d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:40:29.884515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed3d7ac8-2fee-451a-b6ec-b955609bc90e req-fd2c1b71-2057-4d16-b78f-b4eef50852d2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:40:29.884998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed3d7ac8-2fee-451a-b6ec-b955609bc90e req-fd2c1b71-2057-4d16-b78f-b4eef50852d2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:40:29.885468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ed3d7ac8-2fee-451a-b6ec-b955609bc90e req-fd2c1b71-2057-4d16-b78f-b4eef50852d2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:40:29.900405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ed3d7ac8-2fee-451a-b6ec-b955609bc90e req-fd2c1b71-2057-4d16-b78f-b4eef50852d2 service nova] Creating event network-changed:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h2-836830-16 Sep 07 10:40:29.906231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ed3d7ac8-2fee-451a-b6ec-b955609bc90e req-fd2c1b71-2057-4d16-b78f-b4eef50852d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036022 Sep 07 10:40:29.906801 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3311/6686] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:41:04.170412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:04.171301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=30 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:04.175720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:04.176430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:04.183674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.184254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.184714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.185540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.186022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.186470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.323355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:04.331895 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e82c66a6-dfa4-44f3-b0ec-58bd998d600b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1668 microversion: 2.1 time: 0.163896 Sep 07 10:41:04.332467 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3376/6687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:04 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:04.355574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:04.356323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:04.359098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:04.359750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=36 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:04.365851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.366349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.366794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.367524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.367993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.368425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.506230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:04.513935 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-089a033f-4b2e-491b-97d4-c9c7c2254362 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1668 microversion: 2.1 time: 0.163149 Sep 07 10:41:04.514501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3312/6688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:04 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:41:04.536330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:04.536921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:04.542894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.543392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.543848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.544550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.545032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.546256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.680813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:04.688694 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26aecba3-be21-44ca-9e6a-35e1835a0f90 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1668 microversion: 2.1 time: 0.156426 Sep 07 10:41:04.689275 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3377/6689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:04 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:04.711875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:04.714200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:04.721011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.721545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.721991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.722692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.723155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.723587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.752164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:04.758017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Old instance type m1.heat2, new instance type m1.heat {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:41:04.765068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:41:04.765621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:41:04.766109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:41:04.766527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:41:04.766943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:41:04.835299 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c5a2a1fc-c011-4004-a089-47c3f415be03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588/action" status: 202 len: 0 microversion: 2.1 time: 0.127616 Sep 07 10:41:04.835889 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3313/6690] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:41:04 2022] POST /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:41:04.845292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:04.845935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:04.851952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.852462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.852950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.853715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:04.854222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:04.854673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:04.991476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:05.000619 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-18faa461-b77f-4043-bab9-42324aee1f24 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1677 microversion: 2.1 time: 0.160045 Sep 07 10:41:05.001227 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3378/6691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:04 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:06.026248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:06.026823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:06.033407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:06.033897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:06.034339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:06.035039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:06.035499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:06.035930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:06.266950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:06.276013 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-16874e63-dde8-4178-ac9a-8b6376eafe9b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1677 microversion: 2.1 time: 0.254793 Sep 07 10:41:06.276678 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3314/6692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:06 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:07.300658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:07.301336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:07.308213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:07.308721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:07.309203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:07.309915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:07.310395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:07.310915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:07.451935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:07.459921 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb5f5e87-fa7b-4be1-a62c-e0deb7e22215 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.163313 Sep 07 10:41:07.460484 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3379/6693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:07 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:08.484249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:08.484869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:08.491886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:08.492375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:08.492822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:08.493669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:08.494133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:08.494572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:08.630098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:08.637940 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cb4679f-cc5d-42e3-9077-af7913a8bf91 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.157925 Sep 07 10:41:08.638518 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3315/6694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:08 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:09.661681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:09.662308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:09.669263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:09.669703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:09.670793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:09.671492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:09.671967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:09.672400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:09.807410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:09.815392 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8fe86199-e8f3-4ba5-b13a-416d2e4ea194 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.157629 Sep 07 10:41:09.815956 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3380/6695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:09 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:10.839135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:10.839872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:10.846843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:10.847342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:10.847798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:10.848510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:10.848982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:10.849444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:10.984926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:10.993054 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f70059b3-4b98-4558-8514-e5d069288bbd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.157876 Sep 07 10:41:10.993668 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3316/6696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:10 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:12.016463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:12.017100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:12.024287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:12.024821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:12.025305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:12.026021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:12.026499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:12.026947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:12.161921 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:12.169806 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d295fa27-6afb-4d0e-9808-0f94929a533c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.157392 Sep 07 10:41:12.170982 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3381/6697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:12 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:13.193542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:13.194165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:13.201121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:13.201766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:13.202208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:13.202907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:13.203371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:13.203804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:13.352252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:13.360856 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-730e9a0c-c879-481e-b768-51064150cdcf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.171244 Sep 07 10:41:13.361478 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3317/6698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:13 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:14.384578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:14.385244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:14.393375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:14.393889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:14.394349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:14.395077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:14.395585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:14.396014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:14.534903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:14.542750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-167c3a1c-6f0b-4974-8991-07acc19f3e20 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.162145 Sep 07 10:41:14.543326 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3382/6699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:14 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:15.567126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:15.567751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:15.574709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:15.575201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:15.575646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:15.577093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:15.577584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:15.578019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:15.711615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:15.719454 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04f29025-8826-4aa9-875c-e84b527cc068 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.156297 Sep 07 10:41:15.720027 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3318/6700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:15 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:16.742639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:16.743267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:16.750500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:16.750998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:16.751449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:16.752149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:16.752615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:16.753054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:16.889358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:16.897297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd960d53-ee25-419a-885a-71315dbe61f4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.158529 Sep 07 10:41:16.897868 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3383/6701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:16 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:17.922692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:17.923335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:17.930568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:17.931059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:17.931501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:17.932192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:17.932649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:17.933075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:18.075967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:18.084911 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-502f1e6a-e03a-4c05-b42f-ce22f573d720 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1682 microversion: 2.1 time: 0.167109 Sep 07 10:41:18.085524 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3319/6702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:17 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:19.108811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:19.109474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:19.116409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:19.116919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:19.117429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:19.118150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:19.118629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:19.119079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:19.141193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "name": "network-vif-unplugged", "status": "completed", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:19.153014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:19.153523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:19.153956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:19.167214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] Creating event network-vif-unplugged:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h1-836830-16 Sep 07 10:41:19.173649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:41:19.185225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-894d65d7-9947-4e6a-a35e-2a2575c5488e req-dee93375-19f2-407c-be1a-1278bf753e4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048213 Sep 07 10:41:19.186954 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3320/6703] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:41:19.415923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:19.426764 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebccc8b8-6d7b-4196-b584-ae987ae6ae21 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1681 microversion: 2.1 time: 0.322633 Sep 07 10:41:19.427359 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3384/6704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:19 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:20.451623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:20.452480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:20.460470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:20.460967 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:20.461462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:20.462169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:20.462636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:20.463072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:20.594359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:20.602254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adfe473d-89a4-4763-8559-9a6ce859e210 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1679 microversion: 2.1 time: 0.155569 Sep 07 10:41:20.602834 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3321/6705] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:20 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:41:21.204058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:21.214906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:21.215406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:21.215857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:21.227931 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] Creating event network-changed:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h1-836830-16 Sep 07 10:41:21.234262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:41:21.245134 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-48cf7bba-c508-416d-b9db-af7fae76e611 req-c824b0d6-193e-428e-9219-21e2f637c1da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045280 Sep 07 10:41:21.245755 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3385/6706] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:41:21.625710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:21.626318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:21.633168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:21.633681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:21.634114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:21.634805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:21.635258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:21.635683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:21.912106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:21.921390 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2b9842ab-968b-4d0f-aa86-b53235c1fd8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1679 microversion: 2.1 time: 0.299564 Sep 07 10:41:21.921978 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3322/6707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:21 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1679 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:22.945420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:22.946175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:22.952538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:22.953041 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:22.953539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:22.954255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:22.954735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:22.955187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:23.098138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:23.106435 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-885a7871-3f0f-4cf7-9c10-4166950203c7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1676 microversion: 2.1 time: 0.165937 Sep 07 10:41:23.107115 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3386/6708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:22 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:23.129342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:23.129903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:23.137668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:23.138152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:23.139340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:23.140037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:23.140491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:23.140914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:23.200387 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3a1282eb-0b3b-4944-bf99-4a9a329ed673 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588/action" status: 204 len: 0 microversion: 2.1 time: 0.074666 Sep 07 10:41:23.201788 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3323/6709] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:41:23 2022] POST /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:41:23.210602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:23.211254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:23.217724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:23.218447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:23.219059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:23.219846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:23.220300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:23.220840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:23.432286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:23.441154 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a370141f-460d-45d0-b315-712589b43df8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1676 microversion: 2.1 time: 0.235077 Sep 07 10:41:23.441958 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3387/6710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:23 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:24.465641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:24.467188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:24.473575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:24.474061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:24.474503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:24.475199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:24.475655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:24.476068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:24.628476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:24.636409 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-39593199-884e-47da-a9fa-e8d75e3a8cec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1676 microversion: 2.1 time: 0.175936 Sep 07 10:41:24.636999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3324/6711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:24 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:25.664441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:25.665093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:25.672362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:25.672794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:25.673297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:25.674000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:25.674469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:25.674906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:25.812583 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:25.820889 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c28c97a-45eb-4df3-a5d8-f65120c7231a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1668 microversion: 2.1 time: 0.160511 Sep 07 10:41:25.821503 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3388/6712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:25 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:25.845438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:25.846065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:25.853066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:25.853592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:25.854042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:25.854752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:25.855357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:25.855645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:25.922963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-40f80d9a-165b-43fe-ae30-a14cc7d097e8 req-8888651e-a35b-420f-94bd-ff275cefe971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "name": "network-vif-plugged", "status": "completed", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:25.934883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-40f80d9a-165b-43fe-ae30-a14cc7d097e8 req-8888651e-a35b-420f-94bd-ff275cefe971 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:25.935356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-40f80d9a-165b-43fe-ae30-a14cc7d097e8 req-8888651e-a35b-420f-94bd-ff275cefe971 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:25.935969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-40f80d9a-165b-43fe-ae30-a14cc7d097e8 req-8888651e-a35b-420f-94bd-ff275cefe971 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:25.948125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-40f80d9a-165b-43fe-ae30-a14cc7d097e8 req-8888651e-a35b-420f-94bd-ff275cefe971 service nova] Creating event network-vif-plugged:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h1-836830-16 Sep 07 10:41:25.954161 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-40f80d9a-165b-43fe-ae30-a14cc7d097e8 req-8888651e-a35b-420f-94bd-ff275cefe971 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035047 Sep 07 10:41:25.954987 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3389/6713] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:41:25.994707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:26.003269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2893f6e-4857-4881-aed1-a49fec541b9e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1668 microversion: 2.1 time: 0.162837 Sep 07 10:41:26.003850 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3325/6714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:25 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:26.026844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:26.027570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:26.034017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:26.034522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:26.035009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:26.035718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:26.036193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:26.036641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:26.165323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:26.173289 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-026129f8-d1f9-4d40-b076-c601672ac0d8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1668 microversion: 2.1 time: 0.150727 Sep 07 10:41:26.173801 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3390/6715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:26 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:26.195560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:26.196062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:26.202973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:26.203461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:26.203899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:26.204593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:26.205052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:26.205514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:26.220921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:26.233584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:41:26.311614 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5623827e-f226-4e8b-91ff-9e7efdd198fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 204 len: 0 microversion: 2.1 time: 0.118724 Sep 07 10:41:26.312676 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3326/6716] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:41:26 2022] DELETE /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:41:26.321066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:26.321896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:26.328967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:26.329499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:26.329952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:26.330660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:26.331133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:26.331574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:26.471108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:26.478922 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a31eab61-ee16-4935-af21-31d0d3b78f3e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1674 microversion: 2.1 time: 0.161920 Sep 07 10:41:26.479527 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3391/6717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:26 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:27.504333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:27.505047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:27.512710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:27.513350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:27.514616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:27.515354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:27.515821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:27.516257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:27.648526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:27.656302 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b3b404e1-ec67-4c97-8999-76c9842d5437 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1674 microversion: 2.1 time: 0.156449 Sep 07 10:41:27.656876 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3327/6718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:27 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:28.679487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:28.680248 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:28.688148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:28.688666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:28.689124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:28.689869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:28.690357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:28.690795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:28.782911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:28.793611 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-74e07e73-1930-4c17-b604-85b34133d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 200 len: 1608 microversion: 2.1 time: 0.118059 Sep 07 10:41:28.794603 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3392/6719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:28 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 1608 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:29.012162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-22a187e4-7319-4de3-9d29-3890e8fb10d1 req-a0bd36db-58aa-4508-8bd1-984f13d14900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6bb739-c3c7-45d1-a96f-8f91f3103588", "name": "network-vif-deleted", "tag": "9c19f2e1-a2f9-48a9-8021-5d168d5d10c4"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:29.024628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22a187e4-7319-4de3-9d29-3890e8fb10d1 req-a0bd36db-58aa-4508-8bd1-984f13d14900 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:29.025120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22a187e4-7319-4de3-9d29-3890e8fb10d1 req-a0bd36db-58aa-4508-8bd1-984f13d14900 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:29.025587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-22a187e4-7319-4de3-9d29-3890e8fb10d1 req-a0bd36db-58aa-4508-8bd1-984f13d14900 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:29.038060 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-22a187e4-7319-4de3-9d29-3890e8fb10d1 req-a0bd36db-58aa-4508-8bd1-984f13d14900 service nova] Creating event network-vif-deleted:9c19f2e1-a2f9-48a9-8021-5d168d5d10c4 for instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 on n-h1-836830-16 Sep 07 10:41:29.043336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-22a187e4-7319-4de3-9d29-3890e8fb10d1 req-a0bd36db-58aa-4508-8bd1-984f13d14900 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034865 Sep 07 10:41:29.043984 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3328/6720] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:41:29.816887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:29.817841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:29.825188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:29.825741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:29.826494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:29.827318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:29.827801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:29.828269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:29.843982 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 HTTP/1.1 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ec6bb739-c3c7-45d1-a96f-8f91f3103588'} Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:41:29.845745 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b8b1ab5-ec24-413b-9f90-4f7b62083a78 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 404 len: 111 microversion: 2.1 time: 0.034378 Sep 07 10:41:29.849683 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3393/6721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:29 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:41:29.860211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:29.860951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:29.867721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:29.868166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:29.868609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:29.869443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:29.869908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:29.870340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:29.884636 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 HTTP/1.1 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ec6bb739-c3c7-45d1-a96f-8f91f3103588'} Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:41:29.886339 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:41:29.890981 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-131b7559-4679-46ad-9f23-5c8c621caddc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 404 len: 111 microversion: 2.1 time: 0.032743 Sep 07 10:41:29.892454 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3329/6722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:29 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:41:29.938845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1174350756", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "993b582c-6f57-4dcb-bebc-03405ecfec60"}], "security_groups": [{"name": "tempest-securitygroup--96321384"}], "key_name": "tempest-keypair-655676691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:30.052281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] validate_networks() for [('993b582c-6f57-4dcb-bebc-03405ecfec60', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:41:30.437109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:41:30.437577 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:41:30.438072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:41:30.438497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:41:30.438967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:41:30.447986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:30.448484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:30.448932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:30.449708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:30.450201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:30.450615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:30.457899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=100 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:30.470302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:41:30.475779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:41:30.488084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:41:30.490411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:41:30.538324 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c585aab-35fb-4470-9e0b-8a744ebe4a42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.604282 Sep 07 10:41:30.538977 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3394/6723] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:41:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:41:30.550156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ecc847b5-4b1e-4563-aec5-95a448fa3e49 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:30.550778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ecc847b5-4b1e-4563-aec5-95a448fa3e49 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:30.614527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ecc847b5-4b1e-4563-aec5-95a448fa3e49 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:30.622458 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ecc847b5-4b1e-4563-aec5-95a448fa3e49 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1238 microversion: 2.1 time: 0.076108 Sep 07 10:41:30.623542 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3330/6724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:30 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:41:31.647073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:31.648519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:31.658246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:31.658764 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:31.659253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:31.659984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:31.660461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:31.661043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:31.745050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:31.754030 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05b7a1bb-b9db-4a07-bdf1-5426b0ef251c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1308 microversion: 2.1 time: 0.111268 Sep 07 10:41:31.754618 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3395/6725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:31 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:32.779766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:32.780618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:32.787614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:32.788108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:32.788550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:32.789283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:32.789749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:32.790181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:33.052524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:33.061294 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-983acf1c-36d3-4cb4-8f76-e905bdd7f891 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1362 microversion: 2.1 time: 0.285830 Sep 07 10:41:33.061885 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3331/6726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:32 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:33.136051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-23a41b4d-fd31-40b1-8b2d-e135f22cf7b0 req-8ef41389-7efb-4c09-9021-5f94135eb40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:33.151382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-23a41b4d-fd31-40b1-8b2d-e135f22cf7b0 req-8ef41389-7efb-4c09-9021-5f94135eb40c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:33.152043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-23a41b4d-fd31-40b1-8b2d-e135f22cf7b0 req-8ef41389-7efb-4c09-9021-5f94135eb40c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:33.152597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-23a41b4d-fd31-40b1-8b2d-e135f22cf7b0 req-8ef41389-7efb-4c09-9021-5f94135eb40c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:33.168448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-23a41b4d-fd31-40b1-8b2d-e135f22cf7b0 req-8ef41389-7efb-4c09-9021-5f94135eb40c service nova] Creating event network-changed:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h2-836830-16 Sep 07 10:41:33.174829 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-23a41b4d-fd31-40b1-8b2d-e135f22cf7b0 req-8ef41389-7efb-4c09-9021-5f94135eb40c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042757 Sep 07 10:41:33.175870 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3396/6727] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:41:34.086722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:34.087347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:34.095023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:34.095514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:34.095961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:34.096661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:34.097128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:34.097588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:34.230877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:34.239489 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-925ca8b5-47b3-4d96-a8cf-544b0d1180e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1362 microversion: 2.1 time: 0.156907 Sep 07 10:41:34.240067 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3332/6728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:34 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:35.266177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:35.266894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:35.269015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:35.274461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:35.274958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:35.275409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:35.276106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:35.276576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:35.277014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:35.466124 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:35.473864 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8a1b719e-ed15-4421-96d4-cb4bd83c0616 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1362 microversion: 2.1 time: 0.213892 Sep 07 10:41:35.474431 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3397/6729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:35 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:36.498322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:36.499347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:36.501738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:36.507514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:36.508015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:36.508466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:36.509205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:36.509676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:36.510114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:36.650881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:36.659419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b15ee0a7-4e46-42ad-a605-0072fd8a236d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1362 microversion: 2.1 time: 0.165912 Sep 07 10:41:36.660002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3333/6730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:36 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:37.683815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:37.684377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:37.692307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:37.692813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:37.693300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:37.694018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:37.694495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:37.694940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:37.827873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:37.835966 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-73974b90-cad1-4498-9c18-b709b43cf3dc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1362 microversion: 2.1 time: 0.156192 Sep 07 10:41:37.836541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3398/6731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:37 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:38.720248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-16f074f6-29f7-4fe3-bd4f-2bd5e8408606 req-31f810b8-3f04-46c3-8474-1d72ae191d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "name": "network-vif-plugged", "status": "completed", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:38.730745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-16f074f6-29f7-4fe3-bd4f-2bd5e8408606 req-31f810b8-3f04-46c3-8474-1d72ae191d37 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:38.731227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-16f074f6-29f7-4fe3-bd4f-2bd5e8408606 req-31f810b8-3f04-46c3-8474-1d72ae191d37 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:38.731657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-16f074f6-29f7-4fe3-bd4f-2bd5e8408606 req-31f810b8-3f04-46c3-8474-1d72ae191d37 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:38.743802 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-16f074f6-29f7-4fe3-bd4f-2bd5e8408606 req-31f810b8-3f04-46c3-8474-1d72ae191d37 service nova] Creating event network-vif-plugged:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h2-836830-16 Sep 07 10:41:38.749579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-16f074f6-29f7-4fe3-bd4f-2bd5e8408606 req-31f810b8-3f04-46c3-8474-1d72ae191d37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Sep 07 10:41:38.750186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3334/6732] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:41:38.860132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:38.860755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:38.867669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:38.868174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:38.868632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:38.869377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:38.869856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:38.870301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:39.023094 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:39.031577 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-113cde69-9e21-4f81-99a1-f05cec56762b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1362 microversion: 2.1 time: 0.175423 Sep 07 10:41:39.032164 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3399/6733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:38 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:40.057629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:40.058399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:40.065036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:40.065572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:40.066010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:40.066703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:40.067157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:40.067582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:40.200419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:41:40.209008 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-07e324c2-d0cc-4129-8c38-7bb5d52da8d3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1550 microversion: 2.1 time: 0.157003 Sep 07 10:41:40.209893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3335/6734] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:41:40 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:41:40.234226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:41:40.234768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:41:40.241666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:40.242163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:40.242615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:40.243364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:40.243833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:40.244272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:40.327279 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2a48be13-629c-4e05-addb-0a2b32d3f781 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097194 Sep 07 10:41:40.327895 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3400/6735] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:41:40 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:41:41.610256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:41:41.680966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fd59b645-6bc4-46ce-87a7-18158608c537 req-c50dfacb-aec8-45a6-a6e1-f8114b453e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:41:41.690995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fd59b645-6bc4-46ce-87a7-18158608c537 req-c50dfacb-aec8-45a6-a6e1-f8114b453e19 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:41:41.691477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fd59b645-6bc4-46ce-87a7-18158608c537 req-c50dfacb-aec8-45a6-a6e1-f8114b453e19 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:41:41.691912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fd59b645-6bc4-46ce-87a7-18158608c537 req-c50dfacb-aec8-45a6-a6e1-f8114b453e19 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:41:41.703753 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fd59b645-6bc4-46ce-87a7-18158608c537 req-c50dfacb-aec8-45a6-a6e1-f8114b453e19 service nova] Creating event network-changed:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h2-836830-16 Sep 07 10:41:41.708736 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fd59b645-6bc4-46ce-87a7-18158608c537 req-c50dfacb-aec8-45a6-a6e1-f8114b453e19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104376 Sep 07 10:41:41.709697 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3336/6736] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:14.535767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:14.536588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:14.538686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=7 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:14.539362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=30 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:14.544077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6dd9acdf-ffca-4858-b5d9-24ca1d803edd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:14.551659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dd9acdf-ffca-4858-b5d9-24ca1d803edd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:14.552141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dd9acdf-ffca-4858-b5d9-24ca1d803edd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:14.552594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dd9acdf-ffca-4858-b5d9-24ca1d803edd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:14.574464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6dd9acdf-ffca-4858-b5d9-24ca1d803edd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Going to try to stop instance {{(pid=128832) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 10:42:14.619976 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6dd9acdf-ffca-4858-b5d9-24ca1d803edd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action" status: 202 len: 0 microversion: 2.1 time: 0.084653 Sep 07 10:42:14.620963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3401/6737] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:42:14 2022] POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:42:14.629236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=7 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:14.630135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:14.635128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:14.635846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:14.651445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:14.651985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:14.652461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:14.653249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:14.653685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:14.654121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:14.789403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:14.797170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cb23e2cc-5161-46d2-8c89-d318da156d81 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.171375 Sep 07 10:42:14.797793 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3337/6738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:14 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:15.822376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:15.823122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:15.831074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:15.831568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:15.832017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:15.832715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:15.833205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:15.833651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:15.964947 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:15.973623 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb06b02b-1033-426f-aa42-81569bea181a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.155684 Sep 07 10:42:15.974194 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3402/6739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:15 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:16.996935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:16.997586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:17.004603 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:17.005104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:17.005583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:17.006285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:17.006748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:17.007183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:17.245406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:17.253823 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8700fa11-a463-4853-b1a0-564bfdb14b4e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.260854 Sep 07 10:42:17.254397 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3338/6740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:16 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:18.278608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:18.279138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:18.286701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:18.287211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:18.287690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:18.288424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:18.288910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:18.289402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:18.466839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:18.475158 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d15bdc7e-f05d-4452-8bae-c1ac7c6a25e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.200558 Sep 07 10:42:18.475748 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3403/6741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:18 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:19.499249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:19.499871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:19.506845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:19.507339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:19.507786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:19.508488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:19.508949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:19.509414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:19.736925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:19.744729 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cbce27a8-e6bc-4cb7-b8c0-626f6ef7ca4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.249423 Sep 07 10:42:19.745322 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3339/6742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:19 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:20.768185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:20.768821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:20.775719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:20.776221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:20.776677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:20.777421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:20.777897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:20.778342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:20.994763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:21.002656 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79d2a77c-409c-4512-9bc0-a5258cdd92b7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.238410 Sep 07 10:42:21.003337 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3404/6743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:20 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:22.026372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:22.026999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:22.035155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:22.035654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:22.036103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:22.036812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:22.037304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:22.037749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:22.167763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:22.176467 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9c64bd7-e190-4af2-86af-137579c5c09f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.154105 Sep 07 10:42:22.177041 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3340/6744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:22 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:23.200430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:23.201196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:23.210601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:23.211197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:23.211658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:23.212383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:23.212877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:23.213351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:23.348953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:23.356899 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ea3e27bd-e6f6-4687-a49a-0f6cae4a8d10 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.160816 Sep 07 10:42:23.357509 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3405/6745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:23 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:24.380651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:24.381171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:24.388074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:24.388476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:24.388917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:24.389636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:24.390095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:24.390522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:24.523165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:24.531000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-92cccc38-6c60-441f-b221-c83041f21d02 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.154962 Sep 07 10:42:24.531577 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3341/6746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:24 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:25.555222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:25.555853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:25.563155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:25.563671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:25.564136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:25.565604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:25.566090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:25.566542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:25.700210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:25.708177 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8897a632-b785-4c76-972a-92161c2c18f9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1656 microversion: 2.1 time: 0.156855 Sep 07 10:42:25.708751 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3406/6747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:25 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:25.731346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:25.733775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:25.743129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:25.743928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:25.744379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:25.745474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:25.746262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:25.746703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:25.778504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:25.784904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:42:25.791625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:42:25.792054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:42:25.792535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:42:25.792952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:42:25.793410 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:42:25.856811 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2098435-e015-43fe-ba24-f2b647451d97 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action" status: 202 len: 0 microversion: 2.1 time: 0.129441 Sep 07 10:42:25.857486 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3342/6748] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:42:25 2022] POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:42:25.866373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:25.867003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:25.873263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:25.873768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:25.874223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:25.874936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:25.875414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:25.875856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:26.013697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:26.022842 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ea7feba0-da76-4557-9197-cc455086b428 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.161025 Sep 07 10:42:26.023562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3407/6749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:25 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:27.050657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:27.051277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:27.058283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:27.058778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:27.059227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:27.059925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:27.060388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:27.060820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:27.201988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:27.211224 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1dbb7a64-3aae-411e-a4ce-eb21d7f6e441 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1679 microversion: 2.1 time: 0.166112 Sep 07 10:42:27.213217 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3343/6750] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:27 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:28.236353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:28.237056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:28.244046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:28.244554 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:28.245017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:28.245763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:28.246246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:28.246692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:28.382988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:28.391125 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1206813b-2c85-449a-9be7-463221db8d27 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1684 microversion: 2.1 time: 0.159066 Sep 07 10:42:28.391703 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3408/6751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:28 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:29.416023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:29.416656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:29.423629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:29.424132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:29.425137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:29.425874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:29.426338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:29.426807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:29.562069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:29.570763 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-79be7f50-e586-4f9f-a0bf-b59d2589701a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1684 microversion: 2.1 time: 0.158654 Sep 07 10:42:29.571367 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3344/6752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:29 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:30.300579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "name": "network-vif-unplugged", "status": "completed", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:30.311054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:30.311559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:30.312015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:30.324647 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] Creating event network-vif-unplugged:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h1-836830-16 Sep 07 10:42:30.330325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:42:30.342466 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0fd5cdfa-cb5d-4cb5-b430-cc7c126dffcc req-3bd8f602-1045-4658-8cc8-4c25217d9766 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046340 Sep 07 10:42:30.343311 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3409/6753] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:30.594510 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:30.595258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:30.602884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:30.603376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:30.603820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:30.604520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:30.604982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:30.605463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:30.812454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:30.821312 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0b80b54e-f0fc-404e-8661-a647c31b9912 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1683 microversion: 2.1 time: 0.230696 Sep 07 10:42:30.822008 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3345/6754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:30 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:31.847746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:31.848543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:31.855198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:31.855715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:31.856179 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:31.857006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:31.857520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:31.857970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:32.001446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:32.009902 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1ffcef6d-8c3a-450f-b2fa-0ba8e684ad6d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1681 microversion: 2.1 time: 0.168042 Sep 07 10:42:32.010491 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3410/6755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:31 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:32.385727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:32.398884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:32.399374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:32.399819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:32.418098 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] Creating event network-changed:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h1-836830-16 Sep 07 10:42:32.426950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:42:32.438026 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4f506e58-353c-438a-b12d-1df38ba65c77 req-016e92e1-7e2e-4f54-a0d9-a68f32da7e8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056013 Sep 07 10:42:32.438765 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3346/6756] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:42:33.035724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:33.036384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:33.043837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:33.044353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:33.044864 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:33.045630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:33.046119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:33.046572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:33.589523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:33.597959 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-512b68b0-64c0-4cb1-a88c-3c853ffbe360 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1677 microversion: 2.1 time: 0.567691 Sep 07 10:42:33.598788 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3411/6757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:33 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1677 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:33.621762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:33.622431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:33.629578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:33.630142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:33.630591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:33.631294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:33.631760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:33.632197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:33.695864 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-848e88d6-0c88-460d-93e4-10b5a0df49e8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action" status: 204 len: 0 microversion: 2.1 time: 0.078890 Sep 07 10:42:33.696453 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3347/6758] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:42:33 2022] POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:42:33.704620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:33.705972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:33.713339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:33.713989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:33.714455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:33.715322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:33.715833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:33.716299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:34.034546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:34.043122 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c4007ced-c903-478c-86e7-be375982f09a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1677 microversion: 2.1 time: 0.342375 Sep 07 10:42:34.044541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3412/6759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:33 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1677 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:35.069980 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:35.070599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:35.077039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:35.077571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:35.078020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:35.078725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:35.079191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:35.079626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:35.241276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:35.249699 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-786a2bca-7121-4d80-acb0-030bd78c3f67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1677 microversion: 2.1 time: 0.185264 Sep 07 10:42:35.250304 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3348/6760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:35 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:36.256418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d784a9ac-a0cf-4113-9ddb-19f3f243dac1 req-aff8b7a8-014e-4f0b-adc4-15da5853e843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "name": "network-vif-plugged", "status": "completed", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:36.268415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d784a9ac-a0cf-4113-9ddb-19f3f243dac1 req-aff8b7a8-014e-4f0b-adc4-15da5853e843 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.268415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d784a9ac-a0cf-4113-9ddb-19f3f243dac1 req-aff8b7a8-014e-4f0b-adc4-15da5853e843 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.269140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d784a9ac-a0cf-4113-9ddb-19f3f243dac1 req-aff8b7a8-014e-4f0b-adc4-15da5853e843 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.273953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:36.274675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:36.281496 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d784a9ac-a0cf-4113-9ddb-19f3f243dac1 req-aff8b7a8-014e-4f0b-adc4-15da5853e843 service nova] Creating event network-vif-plugged:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h1-836830-16 Sep 07 10:42:36.281949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.282317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.282811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.283661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.284131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.284565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.288250 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d784a9ac-a0cf-4113-9ddb-19f3f243dac1 req-aff8b7a8-014e-4f0b-adc4-15da5853e843 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101060 Sep 07 10:42:36.288899 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3413/6761] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:36.421834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:36.430505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c79101b1-fb1e-49b6-a720-e2cd74c391e1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1656 microversion: 2.1 time: 0.160514 Sep 07 10:42:36.431078 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3349/6762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:36 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:36.453778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:36.454501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:36.460986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.461531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.461984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.462691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.463169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.463623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.598593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:36.606584 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9a27aef6-d6a6-409f-9b63-2b5e73fc5cdb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1656 microversion: 2.1 time: 0.157073 Sep 07 10:42:36.607155 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3414/6763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:36 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:36.629802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9344b481-103d-4347-9305-57022a8d811e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:36.635944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9344b481-103d-4347-9305-57022a8d811e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.636438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9344b481-103d-4347-9305-57022a8d811e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.636881 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9344b481-103d-4347-9305-57022a8d811e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.659523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9344b481-103d-4347-9305-57022a8d811e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Going to try to start instance {{(pid=128833) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 10:42:36.685535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:36.703763 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9344b481-103d-4347-9305-57022a8d811e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action" status: 202 len: 0 microversion: 2.1 time: 0.078047 Sep 07 10:42:36.704360 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3350/6764] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:42:36 2022] POST /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:42:36.714698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:36.715334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:36.722762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.723514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.724215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.725382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:36.726587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:36.727044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:36.971905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:36.979838 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d2892099-d19c-4006-891d-1448fff24875 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1665 microversion: 2.1 time: 0.270526 Sep 07 10:42:36.980502 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3415/6765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:36 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1665 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:38.005781 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:38.006505 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:38.012780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:38.013307 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:38.013784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:38.014487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:38.014948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:38.015377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:38.148100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:38.155899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a2268ef6-743f-4cbc-bc0d-68434f475a95 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1669 microversion: 2.1 time: 0.155849 Sep 07 10:42:38.156466 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3351/6766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:37 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:38.178366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:38.178889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:38.185820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:38.186325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:38.186786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:38.187782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:38.188266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:38.188718 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:38.216117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:42:38.245653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:38.297151 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-76418e47-abbc-46a5-854e-052383144365 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 204 len: 0 microversion: 2.1 time: 0.122282 Sep 07 10:42:38.297746 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3416/6767] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:42:38 2022] DELETE /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:42:38.308133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:38.308810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:38.315616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:38.316259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:38.316709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:38.317449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:38.317915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:38.318369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:38.450472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:38.458547 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8676863-7bd3-44e5-aea0-25a88684654e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1675 microversion: 2.1 time: 0.155591 Sep 07 10:42:38.459115 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3352/6768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:38 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:39.483327 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:39.484058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:39.491081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:39.491628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:39.492062 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:39.492778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:39.493279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:39.493728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:39.631277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:39.639047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14599104-3ef2-4c0e-a9f8-557af2b43d34 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1675 microversion: 2.1 time: 0.160154 Sep 07 10:42:39.639645 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3417/6769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:39 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:40.664441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:40.666423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:40.676615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:40.677120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:40.677744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:40.679048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:40.679679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:40.681065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:40.718136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ac1f03b7-d1bd-42bd-83ee-f0310ae6b90c req-e5c422da-119c-40b1-98c7-e56208a6224d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12f4540-7e56-4405-83f8-5ccdfd6a413c", "name": "network-vif-deleted", "tag": "e093e33d-787e-4e42-8567-6c26becde9a5"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:40.728468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ac1f03b7-d1bd-42bd-83ee-f0310ae6b90c req-e5c422da-119c-40b1-98c7-e56208a6224d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:40.729112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ac1f03b7-d1bd-42bd-83ee-f0310ae6b90c req-e5c422da-119c-40b1-98c7-e56208a6224d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:40.729664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ac1f03b7-d1bd-42bd-83ee-f0310ae6b90c req-e5c422da-119c-40b1-98c7-e56208a6224d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:40.754367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ac1f03b7-d1bd-42bd-83ee-f0310ae6b90c req-e5c422da-119c-40b1-98c7-e56208a6224d service nova] Creating event network-vif-deleted:e093e33d-787e-4e42-8567-6c26becde9a5 for instance b12f4540-7e56-4405-83f8-5ccdfd6a413c on n-h1-836830-16 Sep 07 10:42:40.760860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:40.767035 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ac1f03b7-d1bd-42bd-83ee-f0310ae6b90c req-e5c422da-119c-40b1-98c7-e56208a6224d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116090 Sep 07 10:42:40.767674 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3353/6770] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:40.775734 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-627347f8-cf6e-4769-b67f-a4dd07b40f0d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 200 len: 1323 microversion: 2.1 time: 0.116419 Sep 07 10:42:40.776348 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3418/6771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:40 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 1323 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:41.801934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:41.802679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:41.808920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:41.809443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:41.809892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:41.810581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:41.811041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:41.811470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:41.825685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c HTTP/1.1 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'b12f4540-7e56-4405-83f8-5ccdfd6a413c'} Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:42:41.827310 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-97a91c79-d80f-43f0-9145-68e6a1e0453c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 404 len: 111 microversion: 2.1 time: 0.032367 Sep 07 10:42:41.832181 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3354/6772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:41 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:42:41.843322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:41.843962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:41.851068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:41.851574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:41.852036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:41.852751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:41.853261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:41.853890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:41.867358 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c HTTP/1.1 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b12f4540-7e56-4405-83f8-5ccdfd6a413c'} Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:42:41.869032 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c39581da-489d-4866-8974-bd546810789d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 404 len: 111 microversion: 2.1 time: 0.031168 Sep 07 10:42:41.873724 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3419/6773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:41 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:42:41.919990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-793839023", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "993b582c-6f57-4dcb-bebc-03405ecfec60"}], "security_groups": [{"name": "tempest-securitygroup--96321384"}], "key_name": "tempest-keypair-655676691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:42.029205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] validate_networks() for [('993b582c-6f57-4dcb-bebc-03405ecfec60', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:42:42.454491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:42:42.454920 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:42:42.456222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:42:42.456665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:42:42.457085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:42:42.466357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:42.466850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:42.467295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:42.468030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:42.468493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:42.468948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:42.485908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:42:42.491345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:42:42.504452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:42:42.506821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:42:42.555091 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1fb511f9-0e90-4da5-aff2-b5ec452f9eac tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.638961 Sep 07 10:42:42.555921 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3355/6774] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:42:41 2022] POST /compute/v2.1/servers => generated 404 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:42:42.567100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d5b4d11f-bfd4-42c5-b226-2b7b7411bbb1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:42.567735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d5b4d11f-bfd4-42c5-b226-2b7b7411bbb1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:42.623288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d5b4d11f-bfd4-42c5-b226-2b7b7411bbb1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:42.630359 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d5b4d11f-bfd4-42c5-b226-2b7b7411bbb1 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1237 microversion: 2.1 time: 0.067268 Sep 07 10:42:42.630962 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3420/6775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:42 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:43.655553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:43.656108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:43.664015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:43.664508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:43.664949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:43.665687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:43.666147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:43.666579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:43.769203 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:43.779133 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8dd76626-4596-494e-a3e8-dc974b77d8d4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1297 microversion: 2.1 time: 0.128990 Sep 07 10:42:43.779837 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3356/6776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:43 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:44.804655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:44.805329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:44.809071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:44.814566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:44.815199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:44.815635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:44.816358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:44.816837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:44.817314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:45.066696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:45.075026 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6f54125-e9fd-45c5-affa-356f596b0dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.274374 Sep 07 10:42:45.075703 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3421/6777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:44 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:45.281926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1a05e11e-2ca1-493e-b94d-c85fac43093f req-8f8a61e5-3cf4-4fa1-a4e0-b82df9dc913b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:45.290228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:45.294650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1a05e11e-2ca1-493e-b94d-c85fac43093f req-8f8a61e5-3cf4-4fa1-a4e0-b82df9dc913b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:45.295233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1a05e11e-2ca1-493e-b94d-c85fac43093f req-8f8a61e5-3cf4-4fa1-a4e0-b82df9dc913b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:45.295770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1a05e11e-2ca1-493e-b94d-c85fac43093f req-8f8a61e5-3cf4-4fa1-a4e0-b82df9dc913b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:45.308575 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1a05e11e-2ca1-493e-b94d-c85fac43093f req-8f8a61e5-3cf4-4fa1-a4e0-b82df9dc913b service nova] Creating event network-changed:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:42:45.315272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1a05e11e-2ca1-493e-b94d-c85fac43093f req-8f8a61e5-3cf4-4fa1-a4e0-b82df9dc913b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036415 Sep 07 10:42:45.315879 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3357/6778] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:46.098889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:46.099525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:46.106502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:46.107009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:46.107473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:46.108184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:46.108663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:46.109113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:46.244024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:46.252415 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-253ba63e-2440-42ea-a93d-120126475249 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.157085 Sep 07 10:42:46.253232 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3422/6779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:46 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:47.277867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:47.278580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:47.285148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:47.285647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:47.286089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:47.286785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:47.287253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:47.287674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:47.420914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:47.429410 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f02ae65-47fd-4e11-b556-400b5d1a8ddd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.156697 Sep 07 10:42:47.429982 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3358/6780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:47 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:48.454044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:48.454684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:48.462814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:48.463322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:48.463779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:48.464505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:48.464982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:48.465463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:48.616458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:48.626676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5dfbd806-54b2-4b24-bbf6-a126e2f4a0b3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.176568 Sep 07 10:42:48.627478 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3423/6781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:48 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:49.650487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:49.651159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:49.658133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:49.658629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:49.659074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:49.659777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:49.660236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:49.660671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:50.128380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:50.136120 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3f9c7de6-fa0d-49f9-bb2d-f2494ff69c65 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.489609 Sep 07 10:42:50.136702 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3359/6782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:49 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:51.160976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:51.161737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:51.162974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-da542f94-b8fa-458c-a033-7b5cced73add req-1c0729e4-ffa6-427e-9b11-5c63c19a8452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "name": "network-vif-plugged", "status": "completed", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:51.168547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:51.169117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:51.169694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:51.170481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:51.171026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:51.171531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:51.172635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-da542f94-b8fa-458c-a033-7b5cced73add req-1c0729e4-ffa6-427e-9b11-5c63c19a8452 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:51.173140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-da542f94-b8fa-458c-a033-7b5cced73add req-1c0729e4-ffa6-427e-9b11-5c63c19a8452 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:51.174188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-da542f94-b8fa-458c-a033-7b5cced73add req-1c0729e4-ffa6-427e-9b11-5c63c19a8452 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:51.188493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-da542f94-b8fa-458c-a033-7b5cced73add req-1c0729e4-ffa6-427e-9b11-5c63c19a8452 service nova] Creating event network-vif-plugged:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:42:51.194242 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-da542f94-b8fa-458c-a033-7b5cced73add req-1c0729e4-ffa6-427e-9b11-5c63c19a8452 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085865 Sep 07 10:42:51.194922 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3424/6783] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:51.347125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:51.355462 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c6617743-d3de-4279-8707-23cd3a5d3208 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.199218 Sep 07 10:42:51.356161 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3360/6784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:51 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:42:52.380932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:52.381683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:52.388212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:52.388719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:52.389213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:52.389911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:52.390390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:52.390842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:52.537602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:52.546944 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ce850a6-3571-4c31-988d-3e11fa146e64 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1361 microversion: 2.1 time: 0.171351 Sep 07 10:42:52.547535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3425/6785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:52 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:53.571294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:53.571911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:53.574774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:53.575431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:53.581267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:53.581752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:53.582193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:53.582887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:53.583351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:53.583775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:53.723362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:42:53.731570 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-170854c8-369b-41f3-81dc-7e997fe18b99 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1549 microversion: 2.1 time: 0.164082 Sep 07 10:42:53.732149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3361/6786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:42:53 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:42:53.755641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:42:53.756160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:42:53.758622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:42:53.764462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:53.764975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:53.765471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:53.766196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:53.766677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:53.767126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:53.848518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2aa761be-ea35-4510-9694-0d2210b90e79 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097477 Sep 07 10:42:53.849128 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3426/6787] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:42:53 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:42:54.828152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2c228de9-35b8-4b01-8254-98b4bbc7c56c req-0b5ada28-f989-42f0-8e56-5c492817b265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:42:54.839969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2c228de9-35b8-4b01-8254-98b4bbc7c56c req-0b5ada28-f989-42f0-8e56-5c492817b265 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:42:54.840449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2c228de9-35b8-4b01-8254-98b4bbc7c56c req-0b5ada28-f989-42f0-8e56-5c492817b265 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:42:54.840883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2c228de9-35b8-4b01-8254-98b4bbc7c56c req-0b5ada28-f989-42f0-8e56-5c492817b265 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:42:54.854147 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2c228de9-35b8-4b01-8254-98b4bbc7c56c req-0b5ada28-f989-42f0-8e56-5c492817b265 service nova] Creating event network-changed:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:42:54.859330 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2c228de9-35b8-4b01-8254-98b4bbc7c56c req-0b5ada28-f989-42f0-8e56-5c492817b265 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035038 Sep 07 10:42:54.859945 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3362/6788] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:43:27.719431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=11 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:27.720194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:27.721611 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:43:27.721779 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/action (ip 10.222.0.60) !!! Sep 07 10:43:27.727747 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:27.730059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:27.740220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:27.740716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:27.741163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:27.741891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:27.742440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:27.742908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:27.771980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:27.777728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Old instance type m1.heat2, new instance type m1.heat {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:43:27.784010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:43:27.784440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:43:27.784924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:43:27.786159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:43:27.786490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:43:27.848739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2d5153ff-3e3b-4f20-8505-5158a76d4bf0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/action" status: 202 len: 0 microversion: 2.1 time: 0.130748 Sep 07 10:43:27.849757 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3427/6789] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:43:27 2022] POST /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:43:27.858150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:27.858902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:27.861399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=11 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:27.862414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:27.863448 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:43:27.863680 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa (ip 10.222.0.60) !!! Sep 07 10:43:27.879069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:27.879950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:27.880470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:27.881370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:27.881838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:27.882327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:28.025265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:28.043271 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e42046b3-35fd-489b-8edd-029046c31745 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1677 microversion: 2.1 time: 0.189372 Sep 07 10:43:28.043862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3363/6790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:27 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:29.068513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:29.069231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:29.075334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:29.075840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:29.076301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:29.077045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:29.077558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:29.078007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:29.215122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:29.222921 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ba991d8f-5347-4950-8140-65cc4b612d41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1677 microversion: 2.1 time: 0.159476 Sep 07 10:43:29.223496 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3428/6791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:29 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:30.246803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:30.247424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:30.255557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:30.256050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:30.256492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:30.257200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:30.257670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:30.258101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:30.398159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:30.406234 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02eeb20e-f169-43ff-8df3-7bd08b8fbc9d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.163324 Sep 07 10:43:30.406820 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3364/6792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:30 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:31.433098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:31.433785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:31.440669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:31.441187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:31.441669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:31.443296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:31.443832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:31.444293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:31.574928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:31.582794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67959a57-a77e-47e9-ba1d-5e7ba0b1f78e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.153774 Sep 07 10:43:31.583394 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3429/6793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:31 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:32.612729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:32.612729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:32.614155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:32.616356 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:32.616808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:32.617544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:32.618005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:32.618433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:32.761814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:32.772530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ec23003b-f888-4f0d-91e2-7fb6750d09d0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.169868 Sep 07 10:43:32.773151 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3365/6794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:32 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:33.795792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:33.796425 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:33.805689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:33.806196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:33.806658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:33.807375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:33.807853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:33.808299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:33.948134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:33.955988 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8f85fb72-e042-42a7-84c4-e0fe5a4bc4c2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.164212 Sep 07 10:43:33.956557 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3430/6795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:33 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:34.979084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:34.979709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:34.986163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:34.986658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:34.987110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:34.987810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:34.988273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:34.988710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:35.122125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:35.130454 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-67e8ad75-2fc9-4c45-ac37-6ca43f41398c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.154681 Sep 07 10:43:35.131173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3366/6796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:34 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:36.154352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:36.154974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:36.162249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:36.162742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:36.163193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:36.163902 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:36.164370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:36.164808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:36.303106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:36.310902 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ef526555-d8d1-4465-9ace-c2fd6743ecec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.160545 Sep 07 10:43:36.311464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3431/6797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:36 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:37.336159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:37.336819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:37.345792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:37.346287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:37.346731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:37.347429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:37.347892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:37.348322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:37.480734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:37.488612 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e55cbd56-fb90-41c5-9e04-f4b990dc202c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.157852 Sep 07 10:43:37.489270 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3367/6798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:37 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:38.512137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:38.512809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:38.520357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:38.520862 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:38.521362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:38.522076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:38.522585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:38.523029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:38.660294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:38.668820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-50125d2d-49bc-4810-a7cc-a4ef2351f78b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.160666 Sep 07 10:43:38.669430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3432/6799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:38 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:43:39.693841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:39.694366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:39.701408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:39.701892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:39.702330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:39.703019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:39.703475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:39.703899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:39.839969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:39.847829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8849c022-712a-40b3-b099-5bb839e9b612 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.158453 Sep 07 10:43:39.848402 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3368/6800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:39 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:40.872406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:40.873206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:40.880999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:40.881540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:40.882004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:40.882723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:40.883199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:40.883650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:41.020411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:41.028767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8680d9a6-ea86-4b00-9be9-6d2c57b916cb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.160534 Sep 07 10:43:41.029360 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3433/6801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:40 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:42.052441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:42.053380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:42.060302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:42.060798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:42.061277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:42.062081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:42.062546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:42.062984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:42.198770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:42.206860 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-312767b4-f40d-4b47-99d2-fabe1ae5edc7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.158877 Sep 07 10:43:42.207432 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3369/6802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:42 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:43.230861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:43.231485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:43.238561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:43.239067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:43.240412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:43.241128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:43.241669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:43.242114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:43.381492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:43.389321 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-467c6a0b-4724-4741-ac77-a2e819f138a2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.162398 Sep 07 10:43:43.389893 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3434/6803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:43 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:44.413882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:44.414518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:44.421502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:44.421991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:44.422427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:44.423119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:44.423573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:44.424000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:44.555786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:44.563714 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce67bb3c-7edf-4d02-9407-67054fda4849 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.154648 Sep 07 10:43:44.564286 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3370/6804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:44 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:45.588058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:45.588826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:45.595917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:45.596418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:45.596877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:45.597661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:45.598138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:45.598587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:45.733058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:45.746114 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3615872a-7116-49b1-84ef-985208166dd8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.162795 Sep 07 10:43:45.746920 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3435/6805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:45 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:46.770361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:46.771752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:46.779036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:46.779540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:46.780054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:46.781002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:46.781617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:46.782136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:46.955278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:46.965788 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48fde167-8720-45ef-b2bc-7cfd489fff45 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1682 microversion: 2.1 time: 0.199311 Sep 07 10:43:46.966384 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3371/6806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:46 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:47.635478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "name": "network-vif-unplugged", "status": "completed", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:47.646940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:47.647434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:47.647886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:47.662417 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] Creating event network-vif-unplugged:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h1-836830-16 Sep 07 10:43:47.670409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:43:47.683184 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0e5db139-3893-4607-9e6c-692fc6e015c2 req-0fa39447-d7a6-47f5-a79b-9dcf1d4fdda4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051541 Sep 07 10:43:47.683938 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3436/6807] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:43:47.988840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:47.990087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:47.997357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:47.997862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:47.998304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:47.999015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:47.999479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:47.999912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:48.237047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:48.246159 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9b21c56-d715-4282-a76a-47173d4fb779 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1681 microversion: 2.1 time: 0.261148 Sep 07 10:43:48.250243 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3372/6808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:47 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:49.273444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:49.274184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:49.280434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:49.280937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:49.281434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:49.282141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:49.282621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:49.283071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:49.421187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:49.429893 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1547512-2eff-49cf-8555-e500eb060a14 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1679 microversion: 2.1 time: 0.162590 Sep 07 10:43:49.430483 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3437/6809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:49 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:49.719047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:49.730260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:49.730754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:49.731196 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:49.743768 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] Creating event network-changed:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h1-836830-16 Sep 07 10:43:49.749169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:43:49.760404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ae706642-e542-4464-a08f-bed990bf71ea req-78e7a5ef-6f74-4d79-8209-a1744ce1eba7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045102 Sep 07 10:43:49.761025 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3373/6810] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:43:50.457440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:50.459113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:50.467463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:50.468313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:50.468778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:50.469550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:50.470328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:50.470998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:50.726509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:50.734965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1d7a3d5b-a35b-4ab7-9193-a8d02d391680 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1679 microversion: 2.1 time: 0.282954 Sep 07 10:43:50.735883 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3438/6811] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:50 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:51.767943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:51.768916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:51.777152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:51.777616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:51.778061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:51.778814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:51.779260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:51.779690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:51.925301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:51.933202 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ecd61c34-c511-41e3-8e4d-0fef4cd11f37 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1676 microversion: 2.1 time: 0.171090 Sep 07 10:43:51.933776 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3374/6812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:51 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:51.956186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:51.956737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:51.964751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:51.965292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:51.975183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:51.976407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:51.976889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:51.977403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:52.014602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:52.015091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:52.015540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:52.016274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:52.016738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:52.017205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:52.040495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:43:52.045956 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:43:52.123754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:52.148029 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28724967-5a9f-4f9c-b7bc-186b72626f00 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/action" status: 202 len: 0 microversion: 2.1 time: 0.195543 Sep 07 10:43:52.148646 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3439/6813] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:43:51 2022] POST /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:43:52.156743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:52.157391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:52.163688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:52.164174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:52.164837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:52.165762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:52.166333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:52.166661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:52.377503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:52.385875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f491e277-0ed6-41e2-bd09-5e3705cf86d2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1675 microversion: 2.1 time: 0.232962 Sep 07 10:43:52.386445 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3375/6814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:52 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:52.560585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "name": "network-vif-plugged", "status": "completed", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:52.570873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:52.571472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:52.571909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:52.585493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] Creating event network-vif-plugged:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h1-836830-16 Sep 07 10:43:52.591230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:43:52.603230 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-58c70c94-3d9c-41d0-9138-662c4ac5b0d4 req-384fec91-aa9c-44b8-bd05-cf1f2cc5cc0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046675 Sep 07 10:43:52.604068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3440/6815] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:43:53.410472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:53.411021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:53.421475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:53.421969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:53.422462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:53.423174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:53.423632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:53.424058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:53.560561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:53.569099 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1f9869ab-a73a-40bd-ac86-5968135d73ce tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1675 microversion: 2.1 time: 0.162940 Sep 07 10:43:53.569715 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3376/6816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:53 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:54.594892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:54.595625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:54.602348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:54.602859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:54.603319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:54.604194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:54.604509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:54.604955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:54.747086 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:54.754938 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-98edb08c-f477-4c1c-b158-ca16f94e7c54 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1675 microversion: 2.1 time: 0.165069 Sep 07 10:43:54.756125 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3441/6817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:54 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:55.654335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "name": "network-vif-unplugged", "status": "completed", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:55.665146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:55.665816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:55.666291 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:55.680295 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] Creating event network-vif-unplugged:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:43:55.686286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:43:55.698524 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d06f6a35-7d34-40b5-8cf5-8d402be49131 req-528cdcad-1a9d-402b-a678-dcc962968e36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048051 Sep 07 10:43:55.699142 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3377/6818] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:43:55.778511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:55.779152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:55.786758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:55.787274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:55.787731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:55.788449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:55.788929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:55.789411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:55.997533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:56.005981 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb5f5eed-42d7-4e43-9e01-ec0716a61c5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1675 microversion: 2.1 time: 0.230803 Sep 07 10:43:56.006756 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3442/6819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:55 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:57.032572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:57.033311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:57.040140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:57.040624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:57.041064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:57.041777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:57.042233 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:57.042702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:57.179468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:57.187442 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85c10644-0d26-49ff-b97b-a3677788653d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1675 microversion: 2.1 time: 0.160001 Sep 07 10:43:57.188030 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3378/6820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:57 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:57.738555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:43:57.744561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:57.750350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:57.750842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:57.751289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:57.766674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] Creating event network-changed:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:43:57.772623 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:43:57.783462 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5405f090-dcee-4ab4-a835-165197cf1dd1 req-0ad00bf8-48a0-4e86-bbe6-aebbe3d3d6a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048679 Sep 07 10:43:57.784060 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3443/6821] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:43:58.212300 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:58.213003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:58.215970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=33 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:58.221441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:58.221934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:58.222380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:58.223089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:58.223614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:58.224431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:58.227506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=93 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:43:58.533057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:58.541331 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-063b6675-a8e6-4a30-9657-db4f6b7016d9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1675 microversion: 2.1 time: 0.334010 Sep 07 10:43:58.541939 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3379/6822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:58 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1675 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:59.569462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:59.570329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:59.576607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:59.577107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:59.577601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:59.578307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:59.578778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:59.579231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:59.716299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:59.724604 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-240299a2-254c-4a6a-82ed-31c7820853f3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1668 microversion: 2.1 time: 0.160622 Sep 07 10:43:59.725203 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3444/6823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:59 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:59.747721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:59.748343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:59.755694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:59.756183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:59.756622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:59.757354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:59.757816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:59.758248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:59.890334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:43:59.899359 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-deab3165-14cc-4623-8fb2-b50e28a2d56b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1668 microversion: 2.1 time: 0.155425 Sep 07 10:43:59.899950 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3380/6824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:59 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:43:59.922525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:43:59.923157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:43:59.929309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:59.929813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:59.930485 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:43:59.931194 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:43:59.931670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:43:59.932114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:00.069162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:00.076967 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05ba8a6c-2fa1-4793-b895-aa3bec8b4ed0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1668 microversion: 2.1 time: 0.158359 Sep 07 10:44:00.077587 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3445/6825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:43:59 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:00.099207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:00.099924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:00.105852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:00.106341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:00.106786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:00.107483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:00.107943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:00.108375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:00.136673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:44:00.212682 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c3147fe0-f271-44c6-aef9-f957e6205e6b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 204 len: 0 microversion: 2.1 time: 0.117059 Sep 07 10:44:00.213338 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3381/6826] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:44:00 2022] DELETE /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:44:00.221816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:00.222448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:00.229001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:00.229532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:00.229987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:00.230681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:00.231150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:00.231593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:00.361603 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:00.370105 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f3d2cb41-3704-486f-bd14-7017aeb1bffb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1674 microversion: 2.1 time: 0.152304 Sep 07 10:44:00.370681 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3446/6827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:00 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:01.395325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:01.396080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:01.403566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:01.404062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:01.404515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:01.405277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:01.405744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:01.406179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:01.458601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5526234b-09c6-445b-bb19-454915acb3bf req-c2c62d57-81e1-499e-ad3e-62557f9091c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "name": "network-vif-plugged", "status": "completed", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:01.471189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5526234b-09c6-445b-bb19-454915acb3bf req-c2c62d57-81e1-499e-ad3e-62557f9091c4 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:01.471702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5526234b-09c6-445b-bb19-454915acb3bf req-c2c62d57-81e1-499e-ad3e-62557f9091c4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:01.472161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5526234b-09c6-445b-bb19-454915acb3bf req-c2c62d57-81e1-499e-ad3e-62557f9091c4 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:01.485468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5526234b-09c6-445b-bb19-454915acb3bf req-c2c62d57-81e1-499e-ad3e-62557f9091c4 service nova] Creating event network-vif-plugged:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:44:01.493010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5526234b-09c6-445b-bb19-454915acb3bf req-c2c62d57-81e1-499e-ad3e-62557f9091c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Sep 07 10:44:01.493653 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3447/6828] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:44:01.551528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:01.559911 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-43fe5687-9870-42af-9425-ec0f0f7abb0f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1674 microversion: 2.1 time: 0.168888 Sep 07 10:44:01.560481 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3382/6829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:01 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:02.486224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:02.492053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-dcabf60f-a5ee-4657-ad14-bbe26056e9a9 req-bde7bd4d-aee3-48ba-8d24-fcd4c0fdea6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4574c0a5-fb59-4f60-911f-e6cb107e1efa", "name": "network-vif-deleted", "tag": "13cf2998-796f-445f-b0fb-9a4759214776"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:02.502647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dcabf60f-a5ee-4657-ad14-bbe26056e9a9 req-bde7bd4d-aee3-48ba-8d24-fcd4c0fdea6a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:02.503122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dcabf60f-a5ee-4657-ad14-bbe26056e9a9 req-bde7bd4d-aee3-48ba-8d24-fcd4c0fdea6a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:02.503565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-dcabf60f-a5ee-4657-ad14-bbe26056e9a9 req-bde7bd4d-aee3-48ba-8d24-fcd4c0fdea6a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:02.515177 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-dcabf60f-a5ee-4657-ad14-bbe26056e9a9 req-bde7bd4d-aee3-48ba-8d24-fcd4c0fdea6a service nova] Creating event network-vif-deleted:13cf2998-796f-445f-b0fb-9a4759214776 for instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa on n-h2-836830-16 Sep 07 10:44:02.520382 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-dcabf60f-a5ee-4657-ad14-bbe26056e9a9 req-bde7bd4d-aee3-48ba-8d24-fcd4c0fdea6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035087 Sep 07 10:44:02.521129 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3448/6830] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:44:02.584405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:02.586287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:02.593896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:02.594449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:02.594893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:02.595621 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:02.596079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:02.596680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:02.633665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:02.634259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:02.634931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:02.635589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lazy-loading 'fault' on Instance uuid 4574c0a5-fb59-4f60-911f-e6cb107e1efa {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:44:02.691607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:02.700215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d2b5381b-dcb7-4535-a796-62568b25e620 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 200 len: 1327 microversion: 2.1 time: 0.120148 Sep 07 10:44:02.701127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3383/6831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:02 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:03.725838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:03.726465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:03.733567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:03.734427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:03.735280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:03.736448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:03.736925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:03.737604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:03.758820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa HTTP/1.1 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4574c0a5-fb59-4f60-911f-e6cb107e1efa'} Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:44:03.760513 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b932d1f1-bb28-4193-9f5a-3522fb63a8dd tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 404 len: 111 microversion: 2.1 time: 0.041923 Sep 07 10:44:03.767143 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3449/6832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:03 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:44:03.783343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:03.783973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:03.791593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:03.792066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:03.792508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:03.793268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:03.793736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:03.794167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:03.808828 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa HTTP/1.1 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4574c0a5-fb59-4f60-911f-e6cb107e1efa'} Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:44:03.810534 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-784f94b3-91e7-478e-8251-50eafdcef17a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 404 len: 111 microversion: 2.1 time: 0.036652 Sep 07 10:44:03.815037 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3384/6833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:03 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:44:03.861469 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1351023734", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "993b582c-6f57-4dcb-bebc-03405ecfec60"}], "security_groups": [{"name": "tempest-securitygroup--96321384"}], "key_name": "tempest-keypair-655676691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:03.972254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] validate_networks() for [('993b582c-6f57-4dcb-bebc-03405ecfec60', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:44:04.457728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:44:04.458282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:44:04.458926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:44:04.459360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:44:04.459789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:44:04.471509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:04.472017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:04.472480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:04.473252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:04.473754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:04.474185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:04.492231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:44:04.498662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:44:04.513385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:44:04.515731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:44:04.564510 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8d85ac39-f6d9-46c4-8b59-703c272a3c19 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.706647 Sep 07 10:44:04.565168 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3450/6834] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:44:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:44:04.577483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ae5eefe9-de99-4557-991f-03481cf5953c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:04.578189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ae5eefe9-de99-4557-991f-03481cf5953c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:04.635599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ae5eefe9-de99-4557-991f-03481cf5953c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:04.645065 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ae5eefe9-de99-4557-991f-03481cf5953c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1238 microversion: 2.1 time: 0.071604 Sep 07 10:44:04.645717 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3385/6835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:04 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:05.668852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:05.669628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:05.678648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:05.679471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:05.680163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:05.681098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:05.681730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:05.682419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:05.754919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:05.764119 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-729bc0d6-a39a-4ba2-8fcd-d5f78c506fab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1298 microversion: 2.1 time: 0.099556 Sep 07 10:44:05.764810 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3451/6836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:05 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:06.791163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:06.791960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:06.799421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:06.800132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:06.800943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:06.801683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:06.802311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:06.802674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:07.046820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:07.054604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48337795-f323-475a-ace7-b9682915eec7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.270013 Sep 07 10:44:07.055980 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3386/6837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:06 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:07.258388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fb9dab21-1a82-4316-81eb-133db9322da2 req-3d4827c1-66b4-46cc-bda2-33489e702992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:07.272401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb9dab21-1a82-4316-81eb-133db9322da2 req-3d4827c1-66b4-46cc-bda2-33489e702992 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:07.273036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb9dab21-1a82-4316-81eb-133db9322da2 req-3d4827c1-66b4-46cc-bda2-33489e702992 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:07.273792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fb9dab21-1a82-4316-81eb-133db9322da2 req-3d4827c1-66b4-46cc-bda2-33489e702992 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:07.286593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fb9dab21-1a82-4316-81eb-133db9322da2 req-3d4827c1-66b4-46cc-bda2-33489e702992 service nova] Creating event network-changed:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:44:07.292077 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fb9dab21-1a82-4316-81eb-133db9322da2 req-3d4827c1-66b4-46cc-bda2-33489e702992 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038574 Sep 07 10:44:07.292709 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3452/6838] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:44:08.078816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:08.079433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:08.087280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:08.087769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:08.088262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:08.089021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:08.089504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:08.089934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:08.229597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:08.237419 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99f5db6a-703d-476f-a25f-bc8cc6a45bee tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.162709 Sep 07 10:44:08.237997 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3387/6839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:08 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:09.263716 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:09.264432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:09.271370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:09.272189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:09.272660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:09.273406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:09.273884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:09.274332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:09.413852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:09.422311 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc790341-33b0-4a99-9f43-aaf9aeded62d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.163754 Sep 07 10:44:09.422897 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3453/6840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:09 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:10.446825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:10.447475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:10.454643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:10.455402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:10.455829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:10.456535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:10.456997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:10.459279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:10.599564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:10.607750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b35a2f50-3448-4a6f-b58a-8650b46ba16c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.165792 Sep 07 10:44:10.608333 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3388/6841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:10 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:11.631907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:11.632545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:11.639638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:11.640139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:11.640627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:11.641367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:11.641844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:11.642287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:11.777130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:11.785083 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e39f1fa1-255a-4859-96c4-917a00bb69c6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.157355 Sep 07 10:44:11.785709 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3454/6842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:11 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:12.613759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c789d04a-a3af-4e95-a386-21618826db6c req-d8868ceb-038c-4426-9b11-4a249db28b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "name": "network-vif-plugged", "status": "completed", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:12.625983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c789d04a-a3af-4e95-a386-21618826db6c req-d8868ceb-038c-4426-9b11-4a249db28b32 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:12.626474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c789d04a-a3af-4e95-a386-21618826db6c req-d8868ceb-038c-4426-9b11-4a249db28b32 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:12.626915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c789d04a-a3af-4e95-a386-21618826db6c req-d8868ceb-038c-4426-9b11-4a249db28b32 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:12.638269 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c789d04a-a3af-4e95-a386-21618826db6c req-d8868ceb-038c-4426-9b11-4a249db28b32 service nova] Creating event network-vif-plugged:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:44:12.643333 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c789d04a-a3af-4e95-a386-21618826db6c req-d8868ceb-038c-4426-9b11-4a249db28b32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Sep 07 10:44:12.643925 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3389/6843] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:44:12.808896 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:12.809612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:12.816698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:12.817230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:12.817689 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:12.818395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:12.819546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:12.820266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:12.949259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:12.957073 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-23aca9bb-f148-422c-87bc-8cb9ef9bef46 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.152107 Sep 07 10:44:12.957685 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3455/6844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:12 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:13.982401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:13.983147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:13.989556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:13.990056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:13.990514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:13.991248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:13.991708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:13.992144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:14.132961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:14.140904 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cffb94f-b750-4cf4-bb25-97351a0b77c5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1362 microversion: 2.1 time: 0.163692 Sep 07 10:44:14.141509 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3390/6845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:13 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:15.165088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:15.165768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:15.168612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:15.169427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:15.175789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:15.176294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:15.176872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:15.177624 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:15.178102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:15.179231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:15.309944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:15.317687 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c2e44cd-60c6-4166-b932-b0e654f72f92 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1550 microversion: 2.1 time: 0.156852 Sep 07 10:44:15.318263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3456/6846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:15 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:15.341456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:15.341992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:15.343998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:15.350254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:15.350899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:15.351450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:15.352162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:15.352629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:15.353066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:15.433539 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2422fb55-af04-48d5-af86-bf3413910cb3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096059 Sep 07 10:44:15.434154 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3391/6847] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 7 10:44:15 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:44:16.697926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1b5021f3-027b-4160-8ccf-4a9602510890 req-040aedb5-3316-4cd5-b93b-2e352a1153eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:16.708475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b5021f3-027b-4160-8ccf-4a9602510890 req-040aedb5-3316-4cd5-b93b-2e352a1153eb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:16.709043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b5021f3-027b-4160-8ccf-4a9602510890 req-040aedb5-3316-4cd5-b93b-2e352a1153eb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:16.709580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b5021f3-027b-4160-8ccf-4a9602510890 req-040aedb5-3316-4cd5-b93b-2e352a1153eb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:16.721467 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1b5021f3-027b-4160-8ccf-4a9602510890 req-040aedb5-3316-4cd5-b93b-2e352a1153eb service nova] Creating event network-changed:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:44:16.727378 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1b5021f3-027b-4160-8ccf-4a9602510890 req-040aedb5-3316-4cd5-b93b-2e352a1153eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033162 Sep 07 10:44:16.727988 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3457/6848] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:44:56.294876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:56.295684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:56.299685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:44:56.300335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:56.311765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:56.312197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:56.312634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:56.313372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:56.313829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:56.314255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:56.449076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:44:56.456977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-81694e14-6dec-401c-9c7f-46eed09be879 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1669 microversion: 2.1 time: 0.164118 Sep 07 10:44:56.457575 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3392/6849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:44:56 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:44:56.478773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:56.479613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:44:56.484440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58220ae5-9b80-4632-8baa-f31be394ca08"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:44:56.486946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:44:56.496042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:56.496546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:56.496998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:56.497735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:44:56.498211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:44:56.498654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:44:56.734945 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b95d9f0a-20eb-470e-94d3-a580ebe2ccab tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258138 Sep 07 10:44:56.735577 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3458/6850] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:44:56 2022] POST /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:45:08.527913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:08.530210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:08.532329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:08.533119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:08.539772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:08.540252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:08.540716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:08.541436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:08.541890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:08.542315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:08.571239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:08.577502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Old instance type m1.heat2, new instance type m1.heat {{(pid=128833) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:45:08.584461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:45:08.584895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:45:08.585661 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:45:08.586070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:45:08.586481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:45:08.654210 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-790144ea-ad14-49f2-b296-3005cea7bdf6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/action" status: 202 len: 0 microversion: 2.1 time: 0.130933 Sep 07 10:45:08.654870 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3393/6851] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:45:08 2022] POST /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:45:08.661487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:08.662482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:08.667748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:08.668685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:08.680592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:08.681200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:08.681785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:08.682502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:08.683078 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:08.683656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:08.827736 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:08.836606 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9df10f07-04c4-455d-91b8-e09d229ab036 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1724 microversion: 2.1 time: 0.177206 Sep 07 10:45:08.837228 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3459/6852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:08 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:45:09.862861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:09.863520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:09.869588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:09.870076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:09.871061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:09.872085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:09.872548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:09.872981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:10.032598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:10.040949 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ed4dc5dd-5aba-40b7-ac9e-46718ed97e42 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1724 microversion: 2.1 time: 0.182856 Sep 07 10:45:10.041557 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3394/6853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:09 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:11.065438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:11.066081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:11.072978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:11.073514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:11.074227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:11.074951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:11.075427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:11.075875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:11.209389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:11.219241 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e7746745-513b-4686-96d0-b7f8c9bb63b6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.157853 Sep 07 10:45:11.219816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3460/6854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:11 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:12.243497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:12.244120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:12.251847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:12.252342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:12.252789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:12.253524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:12.253988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:12.254421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:12.390912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:12.399314 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b434340f-e6fc-4aa8-a974-863fdf029bda tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.159771 Sep 07 10:45:12.399901 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3395/6855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:12 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:13.425436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:13.426006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:13.433712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:13.434728 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:13.435166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:13.435875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:13.436350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:13.436796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:13.568095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:13.576385 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3b4a6406-4a05-4b10-ac36-28a5b61b419e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.156813 Sep 07 10:45:13.576955 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3461/6856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:13 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:14.599893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:14.600507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:14.607514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:14.608188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:14.608633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:14.609722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:14.610186 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:14.610613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:14.746806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:14.755281 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-886f716d-d4f2-4c58-8d7b-9a4e3852a86e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.159268 Sep 07 10:45:14.755858 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3396/6857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:14 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:45:15.827964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:15.828608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:15.834891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:15.835660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:15.836116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:15.836828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:15.837401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:15.837848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:15.981634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:15.990593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-768352c2-57c2-4416-8de8-0f0c29352df9 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.215966 Sep 07 10:45:15.991184 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3462/6858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:15 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:17.015588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:17.016428 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:17.024112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:17.024611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:17.025060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:17.025808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:17.026271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:17.026896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:17.167016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:17.176067 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-932167e2-790e-4e6d-b0f8-26ad581d11ae tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.166123 Sep 07 10:45:17.176640 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3397/6859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:17 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:18.200584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:18.201279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:18.208430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:18.208936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:18.209430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:18.210146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:18.210887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:18.211333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:18.347134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:18.355888 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5172b579-5c96-4b0a-86d6-5760f06481ec tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.159653 Sep 07 10:45:18.356465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3463/6860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:18 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:19.380311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:19.380929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:19.388127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:19.388615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:19.389051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:19.389806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:19.390264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:19.390690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:19.523070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:19.532096 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-aafd3bc6-0f44-4e3e-9ba8-90cb176c2fa0 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.155849 Sep 07 10:45:19.532667 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3398/6861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:19 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:20.555087 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:20.555735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:20.563169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:20.563667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:20.564123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:20.564828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:20.565336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:20.565779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:20.701685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:20.709996 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d59b870-a622-4f2b-b373-00c516e09305 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.158880 Sep 07 10:45:20.710838 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3464/6862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:20 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:21.734141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:21.734759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:21.741692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:21.742179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:21.742654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:21.743347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:21.743806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:21.744235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:21.886803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:21.897527 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0412eef6-47f0-444e-a154-98cbb7862c74 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.167507 Sep 07 10:45:21.898626 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3399/6863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:21 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:22.921566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:22.922198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:22.929136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:22.929667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:22.930126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:22.930833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:22.931308 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:22.931753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:23.067501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:23.076430 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-69619a05-d88a-4d48-80d7-5a7acafb89bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.159303 Sep 07 10:45:23.077269 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3465/6864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:22 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:24.102115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:24.102739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:24.110187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:24.110679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:24.111123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:24.111822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:24.112283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:24.112717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:24.248921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:24.257292 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-229b126b-663e-464b-994a-1dfe873f8c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.159071 Sep 07 10:45:24.257868 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3400/6865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:24 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:25.282727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:25.283359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:25.290160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:25.290654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:25.291104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:25.291798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:25.292320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:25.292758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:25.426989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:25.436460 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39c75d6d-107a-4f5c-859b-5d2d457a5fa2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.157854 Sep 07 10:45:25.437041 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3466/6866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:25 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:26.459598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:26.460250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:26.467965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:26.468454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:26.468905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:26.469633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:26.470101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:26.470537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:26.606156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:26.614520 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e788e62d-7501-4383-a01e-d17c68d0e88c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.158826 Sep 07 10:45:26.615071 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3401/6867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:26 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:27.639550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:27.640188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:27.647074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:27.647579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:27.648042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:27.648754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:27.649254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:27.649711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:27.788203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:27.796642 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2fe73b78-d873-4107-b716-385a5257b708 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.161721 Sep 07 10:45:27.797227 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3467/6868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:27 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:28.820802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:28.821458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:28.829742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:28.830244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:28.830691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:28.831408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:28.831873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:28.832303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:28.972445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:28.981447 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e002d7ea-ea59-4209-bee6-bc5f317a6c4f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1729 microversion: 2.1 time: 0.164642 Sep 07 10:45:28.982003 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3402/6869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:28 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:30.011352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:30.012545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:30.023876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:30.024391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:30.024853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:30.025608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:30.026089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:30.026671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:30.225241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:30.234364 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-41a081fd-8112-4c11-9b28-7e1a5763191f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1728 microversion: 2.1 time: 0.231989 Sep 07 10:45:30.234947 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3468/6870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:30 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:30.492915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "name": "network-vif-unplugged", "status": "completed", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:30.504259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:30.504761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:30.505243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:30.518691 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] Creating event network-vif-unplugged:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h2-836830-16 Sep 07 10:45:30.525112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] Instance 5f782905-ff19-4202-a6de-2e28e329cf24 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:45:30.537402 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0c4f70c9-c6cb-4212-8974-211e07946c7c req-888cf3e8-53c7-44cd-98e1-796158b24231 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048152 Sep 07 10:45:30.538023 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3403/6871] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:45:31.257938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:31.258597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:31.266076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:31.266571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:31.267047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:31.267760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:31.268278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:31.268670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:31.493520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:31.502815 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-13d64b79-111d-4d36-8878-3089ca42d7d7 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1728 microversion: 2.1 time: 0.248733 Sep 07 10:45:31.503515 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3469/6872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:31 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:32.528609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:32.529359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:32.535577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:32.536061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:32.536495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:32.537201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:32.537738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:32.538163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:32.552712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:32.563853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:32.564359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:32.564786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:32.588422 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] Creating event network-changed:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h2-836830-16 Sep 07 10:45:32.595650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] Instance 5f782905-ff19-4202-a6de-2e28e329cf24 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:45:32.610395 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-45cef873-1af7-4491-a5e4-1ec9b506f776 req-65a2b6c7-21a9-43f6-93ab-0e24a77862a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061359 Sep 07 10:45:32.611020 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3470/6873] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:45:32.820345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:32.838319 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4b9144b7-fe75-4344-9e70-ae4c8fd26efb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.315548 Sep 07 10:45:32.840179 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3404/6874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:32 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:33.865865 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:33.866789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:33.874737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:33.875410 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:33.875996 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:33.876843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:33.877476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:33.878019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:34.028028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:34.037150 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e214ec96-810d-421e-a14c-7ea8db300081 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.176222 Sep 07 10:45:34.037839 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3471/6875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:33 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:35.064991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:35.065657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:35.071829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:35.072319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:35.072792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:35.073764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:35.074404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:35.074840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:35.215968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:35.224494 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5f3a16b7-485c-4653-b274-64cf41aa8ec6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.163728 Sep 07 10:45:35.225076 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3405/6876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:35 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:36.250491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:36.251276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:36.258555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:36.259071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:36.259531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:36.260261 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:36.261357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:36.261894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:36.403790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:36.412972 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14e98da8-c91e-446d-b477-bb20032dd7fb tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.166482 Sep 07 10:45:36.413934 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3472/6877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:36 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:37.439584 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:37.440199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:37.447008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:37.447518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:37.448479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:37.449646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:37.450184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:37.450611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:37.593591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:37.601954 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b7da64b7-e616-47c2-b401-92af87206a9c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.166311 Sep 07 10:45:37.602542 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3406/6878] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:37 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:38.626044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:38.626711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:38.633576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:38.634084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:38.634542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:38.635253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:38.636474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:38.636922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:38.768205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:38.770568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=87 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:38.779422 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-33963f11-2e67-414e-b4ac-4b056b4834ca tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.157284 Sep 07 10:45:38.780004 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3473/6879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:38 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:39.803093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:39.803716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:39.806515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=33 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:39.813657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:39.814150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:39.814599 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:39.815293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:39.815753 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:39.816197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:39.820703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:39.952796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:39.961406 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27c2fc53-4038-470c-aef3-e00163b79f0a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.162247 Sep 07 10:45:39.961970 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3407/6880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:39 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:40.986376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:40.987007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:40.989713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=31 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:40.995650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:40.996150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:40.996605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:40.997328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:40.997806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:40.998244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:41.134500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:41.143200 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06650576-daf9-4fba-a62a-c67b2ca4e4b4 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.160800 Sep 07 10:45:41.143771 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3474/6881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:40 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:42.167214 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:42.167827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:42.175374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:42.175885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:42.176324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:42.177019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:42.177506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:42.177929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:42.310898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:42.319468 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c4887fed-8e13-46d3-9480-0f49c3ae5dd3 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.156210 Sep 07 10:45:42.320105 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3408/6882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:42 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:43.344940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:43.345631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:43.352608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:43.353111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:43.353712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:43.354938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:43.355579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:43.356032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:43.497897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:43.506194 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8a25744-c8a7-46d4-81ad-f66d6d4e9171 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1726 microversion: 2.1 time: 0.165264 Sep 07 10:45:43.506762 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3475/6883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:43 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:44.529278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:44.529900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:44.536814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.537374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.537823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.538521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.538984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.539421 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.674358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:44.683405 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-08ec3d4b-bafb-463d-a74f-63ffb28e5d4b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1723 microversion: 2.1 time: 0.158660 Sep 07 10:45:44.683966 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3409/6884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:44 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:44.761993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:44.762573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:44.769388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.769893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.770353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.771109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.771704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.772149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.810210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.810701 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.811154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.811890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.812362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.812805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.832992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:45:44.838594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Getting quotas for user a7efa7d2347b43b78fa397a784235fb9 and project 51ba165434b545c9bcd37bef628fdefd. Resources: {'cores', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:45:44.937929 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f659b6d6-bc76-4ee6-82aa-d91fd7c78c70 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "POST /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/action" status: 202 len: 0 microversion: 2.1 time: 0.180018 Sep 07 10:45:44.938486 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3476/6885] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:45:44 2022] POST /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:45:44.947375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:44.948663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:44.955065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.955600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.956058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:44.956777 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:44.957265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:44.957767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:45.161509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:45.170004 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3b4d3f1a-615e-4bc4-a8c0-874ff840897d tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.227279 Sep 07 10:45:45.170568 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3410/6886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:44 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:46.195640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:46.196365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:46.207263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:46.207787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:46.208238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:46.208949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:46.209458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:46.209903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:46.367207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:46.377670 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8cfefa84-178f-426b-a97d-1248fb5ca4af tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.187061 Sep 07 10:45:46.378968 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3477/6887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:46 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:47.402444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:47.403133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:47.410166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:47.410652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:47.411092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:47.411789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:47.412244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:47.412669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:47.551972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:47.561577 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cbac8e46-7a2f-4dad-930d-ed28d55ed59f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.163598 Sep 07 10:45:47.562155 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3411/6888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:47 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:47.971102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "name": "network-vif-plugged", "status": "completed", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:47.985134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:47.985842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:47.986457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:48.000201 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] Creating event network-vif-plugged:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h2-836830-16 Sep 07 10:45:48.006551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] Instance 5f782905-ff19-4202-a6de-2e28e329cf24 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:45:48.019268 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0aac5730-a190-4ed0-8622-f0c6599bc09b req-ca28c4b3-7b26-45ba-a019-922592a880b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052449 Sep 07 10:45:48.020117 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3478/6889] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:45:48.587036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:48.587813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:48.595795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:48.596285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:48.596726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:48.597463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:48.597929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:48.598483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:48.739620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:48.749457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5e4d15ad-a341-4b7b-aa5b-5b0fa50c7763 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.166605 Sep 07 10:45:48.750068 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3412/6890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:48 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:49.774298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:49.775026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:49.781975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:49.782484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:49.782942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:49.783665 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:49.784146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:49.784602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:49.933230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:49.942886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-18ef1f1d-cd65-4fab-9ff1-0baa696670d5 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.173779 Sep 07 10:45:49.943641 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3479/6891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:49 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:45:50.501079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "name": "network-vif-unplugged", "status": "completed", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:50.513120 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:50.513828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:50.514311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:50.527791 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] Creating event network-vif-unplugged:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:45:50.533376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] Instance 5f782905-ff19-4202-a6de-2e28e329cf24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:45:50.546080 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-63a37316-2288-466c-a6cf-851e1ede90ab req-2429ab61-e1f0-45c2-9742-7bc77a8d9aa8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049108 Sep 07 10:45:50.546892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3413/6892] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:45:50.967903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:50.968598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:50.976330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:50.976837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:50.977328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:50.978045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:50.978520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:50.979534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:51.194292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:51.203416 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4458e57c-f799-4d81-acb7-613ce3dc5e9a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.240176 Sep 07 10:45:51.203993 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3480/6893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:50 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:52.228080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:52.228696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:52.236804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:52.237333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:52.237773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:52.238483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:52.238938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:52.239362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:52.383222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:52.392989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e8ccdfe-29ed-43a2-9bbe-e4a95e315f50 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.169313 Sep 07 10:45:52.393613 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3414/6894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:52 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:52.587613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:45:52.599324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:52.600069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:52.600531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:52.613781 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] Creating event network-changed:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:45:52.621395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] Instance 5f782905-ff19-4202-a6de-2e28e329cf24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-16', 'n-h2-836830-16'} {{(pid=128832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 10:45:52.633448 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a1a8f291-7df1-4bc6-b5dc-151a03891008 req-659a0078-6878-45c9-8a70-a5e0fcaf6531 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050948 Sep 07 10:45:52.634071 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3481/6895] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:45:53.426714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:53.427329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:53.440363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:53.441090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:53.441725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:53.442590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:53.443202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:53.443772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:53.750887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:53.761634 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a33f4ca-062b-4b80-8dbf-5a7f90e74d67 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.339393 Sep 07 10:45:53.762229 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3415/6896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:53 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:54.786463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:54.787211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:54.795860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:54.796384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:54.796848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:54.797740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:54.798091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:54.798542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:54.825666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:45:55.007128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:55.016636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e0754e69-0442-426d-84b2-5da5d9fc7963 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.234469 Sep 07 10:45:55.017236 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3482/6897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:54 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:56.039974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:56.040616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:56.047953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:56.048443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:56.048894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:56.049627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:56.050094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:56.050525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:56.189299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:56.198459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-660f561d-161b-4819-9c64-ae3b84214a69 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.161798 Sep 07 10:45:56.199049 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3416/6898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:56 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:57.223120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:57.223745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:57.230787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:57.231280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:57.231731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:57.232428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:57.232895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:57.233360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:57.371791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:57.380171 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ff6a58b5-2220-439a-921a-3248176b7193 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.160962 Sep 07 10:45:57.380752 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3483/6899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:57 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:45:58.404764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:58.405346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:58.412490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:58.412985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:58.413461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:58.414179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:58.415030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:58.415124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:58.546107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:58.554610 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e22e8ac0-f067-417d-8da2-39e0a550e1fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.154497 Sep 07 10:45:58.555188 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3417/6900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:58 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:45:59.580130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:45:59.580957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:45:59.589540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:59.590048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:59.590506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:59.591225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:45:59.591702 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:45:59.592150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:45:59.731775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:45:59.740175 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-17b924cf-3685-4eb2-9d1d-e81fa631acdc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.164906 Sep 07 10:45:59.740767 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3484/6901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:45:59 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:00.764544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:00.765159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:00.771958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:00.772444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:00.772911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:00.773688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:00.774145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:00.774570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:00.907848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:00.916377 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0719713a-6a16-4293-a177-13db24c8f50c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.156224 Sep 07 10:46:00.917084 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3418/6902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:00 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:01.940420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:01.941072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:01.948042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:01.948532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:01.948995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:01.949713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:01.950182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:01.950621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:02.088851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:02.097271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f011c3fe-ad6d-4065-adef-a0d4cb5aef41 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.160722 Sep 07 10:46:02.097851 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3485/6903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:01 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:03.121355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:03.121969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:03.128921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:03.129438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:03.129870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:03.130575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:03.131010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:03.131433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:03.264740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:03.273201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f4b72f46-e01b-4871-8230-b0d16e3eefe8 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1722 microversion: 2.1 time: 0.155820 Sep 07 10:46:03.273779 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3419/6904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:03 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:04.297958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:04.298626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:04.304989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.305520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.305979 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.307364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.307854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.308296 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.450634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:04.459231 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-165af3dd-86f4-4b6c-a9fc-c102fe5f5181 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1715 microversion: 2.1 time: 0.165219 Sep 07 10:46:04.459812 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3486/6905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:04 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:04.482476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:04.483100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:04.489906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.490390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.490835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.491521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.491979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.492406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.647148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:04.656201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c0895500-13ff-448d-8590-54ac4ff7cbc2 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1715 microversion: 2.1 time: 0.178244 Sep 07 10:46:04.656775 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3420/6906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:04 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:04.679173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:04.681549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:04.686044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.686550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.687016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.687730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.688206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.688654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.827657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:04.836349 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-138e6f56-86e2-40a3-99f7-febcf6b1187f tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1715 microversion: 2.1 time: 0.161067 Sep 07 10:46:04.836937 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3487/6907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:04 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:04.859675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:04.860184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:04.866675 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.867173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.867626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.868332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.868796 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.869338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.895586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:46:04.980367 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-80dbaacc-a72d-4ad1-a1da-07ee86cbe32c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 204 len: 0 microversion: 2.1 time: 0.123755 Sep 07 10:46:04.984230 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3421/6908] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:04 2022] DELETE /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:46:04.989693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:04.990499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:04.997790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.998302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:04.998763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:04.999486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:04.999967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:05.000418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:05.007909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:05.208085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:05.218257 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cda179d7-47dc-498d-8e05-cc122930e3fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1721 microversion: 2.1 time: 0.232404 Sep 07 10:46:05.218691 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3488/6909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:04 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:06.242903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:06.243653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:06.251209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:06.251706 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:06.252157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:06.252861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:06.253362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:06.253800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:06.269992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:06.390098 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:06.398773 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9f79e75-0c45-46af-99b2-791c4a0fce5b tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1721 microversion: 2.1 time: 0.160101 Sep 07 10:46:06.399364 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3422/6910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:06 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:07.125985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5680a931-7ce7-4bba-96b5-e76ab0dcdaef req-2bfe08ea-e771-4b75-a215-9d8cb9baa99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "name": "network-vif-plugged", "status": "completed", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:07.140363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5680a931-7ce7-4bba-96b5-e76ab0dcdaef req-2bfe08ea-e771-4b75-a215-9d8cb9baa99a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:07.140803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5680a931-7ce7-4bba-96b5-e76ab0dcdaef req-2bfe08ea-e771-4b75-a215-9d8cb9baa99a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:07.141447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5680a931-7ce7-4bba-96b5-e76ab0dcdaef req-2bfe08ea-e771-4b75-a215-9d8cb9baa99a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:07.153486 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5680a931-7ce7-4bba-96b5-e76ab0dcdaef req-2bfe08ea-e771-4b75-a215-9d8cb9baa99a service nova] Creating event network-vif-plugged:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:46:07.158684 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5680a931-7ce7-4bba-96b5-e76ab0dcdaef req-2bfe08ea-e771-4b75-a215-9d8cb9baa99a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038096 Sep 07 10:46:07.159465 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3489/6911] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:07.423181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:07.423769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:07.437791 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:07.438837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:07.439723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:07.440748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:07.441397 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:07.442054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:07.522778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:07.531971 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-10693bf3-ea7d-4bc1-be39-ce53622ac08e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1655 microversion: 2.1 time: 0.113072 Sep 07 10:46:07.532904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3423/6912] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:07 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:46:07.655203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-c58adfbc-1292-4c68-b176-f8893c857564 req-02b6ec70-3c1b-43ea-ab5a-39e7e44ceb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f782905-ff19-4202-a6de-2e28e329cf24", "name": "network-vif-deleted", "tag": "afeeed74-98fd-45af-8b15-9136fa1fcea0"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:07.666664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c58adfbc-1292-4c68-b176-f8893c857564 req-02b6ec70-3c1b-43ea-ab5a-39e7e44ceb7c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:07.667250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c58adfbc-1292-4c68-b176-f8893c857564 req-02b6ec70-3c1b-43ea-ab5a-39e7e44ceb7c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:07.667818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-c58adfbc-1292-4c68-b176-f8893c857564 req-02b6ec70-3c1b-43ea-ab5a-39e7e44ceb7c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:07.680493 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-c58adfbc-1292-4c68-b176-f8893c857564 req-02b6ec70-3c1b-43ea-ab5a-39e7e44ceb7c service nova] Creating event network-vif-deleted:afeeed74-98fd-45af-8b15-9136fa1fcea0 for instance 5f782905-ff19-4202-a6de-2e28e329cf24 on n-h1-836830-16 Sep 07 10:46:07.686198 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-c58adfbc-1292-4c68-b176-f8893c857564 req-02b6ec70-3c1b-43ea-ab5a-39e7e44ceb7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039360 Sep 07 10:46:07.687631 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3490/6913] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:08.558740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:08.559866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:08.572785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:08.573328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:08.573780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:08.574507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:08.574973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:08.575409 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:08.648418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:08.658440 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e7a1674b-f191-4c7e-aca1-1dc7161faf03 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1369 microversion: 2.1 time: 0.105972 Sep 07 10:46:08.659039 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3424/6914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:08 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:09.684005 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:09.684648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:09.692666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:09.693204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:09.694026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:09.694985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:09.695748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:09.696569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:09.773349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:09.782468 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6dacb82e-a576-4e01-91d2-2c5bb076472c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1369 microversion: 2.1 time: 0.104195 Sep 07 10:46:09.793221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3491/6915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:09 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:10.806346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:10.807558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:10.810536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:10.817046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:10.817595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:10.818035 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:10.818761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:10.819239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:10.819665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:10.884030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:10.893591 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f26907e6-974f-4289-bba3-b5d204d85aa6 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1369 microversion: 2.1 time: 0.091099 Sep 07 10:46:10.894349 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3425/6916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:10 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:11.918755 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:11.919402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:11.922435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:11.929017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:11.929567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:11.930029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:11.930762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:11.931238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:11.932351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:12.002142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7efa7d2347b43b78fa397a784235fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba165434b545c9bcd37bef628fdefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:12.010965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c998915b-7f42-460a-ae2a-cd186d0da6bf tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 200 len: 1369 microversion: 2.1 time: 0.096946 Sep 07 10:46:12.011539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3492/6917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:11 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:13.035104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:13.035722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:13.043345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:13.043829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:13.044269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:13.044956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:13.045438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:13.045867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:13.059505 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 HTTP/1.1 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5f782905-ff19-4202-a6de-2e28e329cf24'} Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:13.061154 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ddfef75-3999-4bad-afb4-54fb7e53d58c tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 404 len: 111 microversion: 2.1 time: 0.031415 Sep 07 10:46:13.065975 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3426/6918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:13 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:13.127746 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:13.131010 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:13.139620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:13.140123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:13.140578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:13.141324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:13.141800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:13.142244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:13.157355 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-volume_attachments HTTP/1.1 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': '5f782905-ff19-4202-a6de-2e28e329cf24'} Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:13.159091 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7b3a81a-9af2-4b7f-a06b-742859bfc38e tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038444 Sep 07 10:46:13.163783 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3493/6919] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:46:13 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.498141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.498654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.505940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.506376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.506822 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.507527 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.508004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.508443 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.522186 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 HTTP/1.1 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '5f782905-ff19-4202-a6de-2e28e329cf24'} Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.523743 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fe4a85d5-b488-481b-bc80-a0096045a0fc tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 404 len: 111 microversion: 2.1 time: 0.031763 Sep 07 10:46:16.528246 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3427/6920] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:16 2022] DELETE /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.534393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.535028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 5f782905-ff19-4202-a6de-2e28e329cf24] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.542671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.543167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.543621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.544328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.544804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.545276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.559007 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 HTTP/1.1 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5f782905-ff19-4202-a6de-2e28e329cf24'} Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.560552 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 5f782905-ff19-4202-a6de-2e28e329cf24 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d3c6f693-2510-4e7b-8744-98f61040c504 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24" status: 404 len: 111 microversion: 2.1 time: 0.031503 Sep 07 10:46:16.565006 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3494/6921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:16 2022] GET /compute/v2.1/servers/5f782905-ff19-4202-a6de-2e28e329cf24 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.570563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.571105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.578757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.579468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.579935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.581008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.581977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.582773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.606559 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa HTTP/1.1 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '4574c0a5-fb59-4f60-911f-e6cb107e1efa'} Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.608207 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.612532 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-35077b82-4433-4902-b86b-c826e486aa28 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 404 len: 111 microversion: 2.1 time: 0.043022 Sep 07 10:46:16.613483 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3428/6922] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:16 2022] DELETE /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.619528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.620592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: 4574c0a5-fb59-4f60-911f-e6cb107e1efa] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.627220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.627813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.628275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.629000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.629494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.629937 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.645612 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa HTTP/1.1 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4574c0a5-fb59-4f60-911f-e6cb107e1efa'} Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.647196 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance 4574c0a5-fb59-4f60-911f-e6cb107e1efa could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-951e144a-ccff-43b8-9ff3-2645ef443327 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa" status: 404 len: 111 microversion: 2.1 time: 0.034026 Sep 07 10:46:16.655463 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3495/6923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:16 2022] GET /compute/v2.1/servers/4574c0a5-fb59-4f60-911f-e6cb107e1efa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.658332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.658448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.664662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.665147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.665654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.666654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.667033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.667463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.682638 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c HTTP/1.1 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'b12f4540-7e56-4405-83f8-5ccdfd6a413c'} Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.684234 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3cb34ea3-558a-4de0-8923-a40a02eae706 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 404 len: 111 microversion: 2.1 time: 0.031501 Sep 07 10:46:16.688892 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3429/6924] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:16 2022] DELETE /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.694767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.695482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: b12f4540-7e56-4405-83f8-5ccdfd6a413c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.702088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.702642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.703165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.703933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.704489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.705003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.719805 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c HTTP/1.1 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b12f4540-7e56-4405-83f8-5ccdfd6a413c'} Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.721506 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance b12f4540-7e56-4405-83f8-5ccdfd6a413c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.726098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d28154c-320e-4343-994c-df0629189c5a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c" status: 404 len: 111 microversion: 2.1 time: 0.033557 Sep 07 10:46:16.730674 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3496/6925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:16 2022] GET /compute/v2.1/servers/b12f4540-7e56-4405-83f8-5ccdfd6a413c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.735301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.735803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.741782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.742263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.742699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.743390 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.743911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.744350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.758142 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 HTTP/1.1 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'ec6bb739-c3c7-45d1-a96f-8f91f3103588'} Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.759708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6e82561-90c9-4549-82bd-11e4bd2b2b8a tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 404 len: 111 microversion: 2.1 time: 0.029783 Sep 07 10:46:16.767398 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3430/6926] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:16 2022] DELETE /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:46:16.769846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.770471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] [instance: ec6bb739-c3c7-45d1-a96f-8f91f3103588] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:16.777698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.778191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.778740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.779341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:16.779808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:16.780246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:16.794741 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] HTTP exception thrown: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Request method failure captured: Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 HTTP/1.1 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHUPNleLt7irQJIV9R7EwMi4kNGc7Id07bgKrnYIVOpZyXjfqNL8Xb-Jhi2JalqZbxKhFyH4tg5P6_n-z2Dvqtwu0E-A4TIbwf5_RSfnk5chlqXxm9_vvZigCneaGTeyX-3w4LueAt3db_6QCa9o5jO-O1oa7c5AQepKjYhp3lueBDc Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ba165434b545c9bcd37bef628fdefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ba165434b545c9bcd37bef628fdefd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 51ba165434b545c9bcd37bef628fdefd Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServerActionsTestJSON-476571863 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: a7efa7d2347b43b78fa397a784235fb9 Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServerActionsTestJSON-476571863-project Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'ec6bb739-c3c7-45d1-a96f-8f91f3103588'} Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:16.796981 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Returning 404 to user: Instance ec6bb739-c3c7-45d1-a96f-8f91f3103588 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65537d00-ed50-416e-ab1b-4caf20f61cef tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588" status: 404 len: 111 microversion: 2.1 time: 0.032084 Sep 07 10:46:16.804404 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3497/6927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:16 2022] GET /compute/v2.1/servers/ec6bb739-c3c7-45d1-a96f-8f91f3103588 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:16.807547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-56bf5116-130a-42a3-8b93-241dad4bed61 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] Calling method '.version_select at 0x7f14b206f940>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:16.833757 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-56bf5116-130a-42a3-8b93-241dad4bed61 tempest-ServerActionsTestJSON-476571863 tempest-ServerActionsTestJSON-476571863-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655676691" status: 202 len: 0 microversion: 2.1 time: 0.030739 Sep 07 10:46:16.834346 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3431/6928] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 7 10:46:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655676691 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:46:26.465926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1494008182", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "2da1a844-884e-4466-8fca-2db63b4c5414"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:26.526585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] validate_networks() for [('2da1a844-884e-4466-8fca-2db63b4c5414', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:46:26.784832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=31 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:26.919758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:46:26.920418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:46:26.920986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:46:26.921446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:46:26.921884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:46:26.932385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:26.932897 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:26.933395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:26.934180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:26.934657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:26.935283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:26.955151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Getting quotas for project 8c547a0477c64a3596d43026433ad820. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:46:26.960954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Getting quotas for user 040ac16d3b324bb789ecc22364a96d4e and project 8c547a0477c64a3596d43026433ad820. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:46:26.973599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:46:26.975941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:46:27.022596 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d7eb7e16-a4cd-4ee5-999a-e5a3b60e0733 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683831 Sep 07 10:46:27.023525 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3498/6929] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:46:27.033632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=31 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:27.035242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:27.039762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-391f0b70-cabe-4907-8470-5a14e77e9caf tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:27.040431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-391f0b70-cabe-4907-8470-5a14e77e9caf tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:27.105040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-391f0b70-cabe-4907-8470-5a14e77e9caf tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:27.112858 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-391f0b70-cabe-4907-8470-5a14e77e9caf tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1217 microversion: 2.1 time: 0.080965 Sep 07 10:46:27.114102 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3432/6930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:27 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:28.139246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:28.142029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:28.155849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:28.156569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:28.157858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:28.159143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:28.162450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:28.163131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:28.266401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:28.274149 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3af0992d-fd3d-4189-8c3f-d8125a29e212 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1277 microversion: 2.1 time: 0.139989 Sep 07 10:46:28.289945 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3499/6931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:28 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:29.299056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:29.299689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:29.308119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:29.308625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:29.309081 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:29.309826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:29.310462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:29.311054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:29.571755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:29.580062 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-92cd5e9c-4a0a-464f-944c-6f28a770ef54 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.284842 Sep 07 10:46:29.581400 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3433/6932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:29 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:29.808522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-f8fc08c5-a664-42c1-bfe1-5db70deeeefd req-77cac06c-da6b-4ea2-aa92-aa45e72aca6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44433d75-9410-471b-af5d-1092050839b3", "tag": "fec8bc61-5af0-4766-935b-5d9ef09f300b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:29.820304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f8fc08c5-a664-42c1-bfe1-5db70deeeefd req-77cac06c-da6b-4ea2-aa92-aa45e72aca6f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:29.821043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f8fc08c5-a664-42c1-bfe1-5db70deeeefd req-77cac06c-da6b-4ea2-aa92-aa45e72aca6f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:29.821525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-f8fc08c5-a664-42c1-bfe1-5db70deeeefd req-77cac06c-da6b-4ea2-aa92-aa45e72aca6f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:29.833568 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-f8fc08c5-a664-42c1-bfe1-5db70deeeefd req-77cac06c-da6b-4ea2-aa92-aa45e72aca6f service nova] Creating event network-changed:fec8bc61-5af0-4766-935b-5d9ef09f300b for instance 44433d75-9410-471b-af5d-1092050839b3 on n-h2-836830-16 Sep 07 10:46:29.839567 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-f8fc08c5-a664-42c1-bfe1-5db70deeeefd req-77cac06c-da6b-4ea2-aa92-aa45e72aca6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 Sep 07 10:46:29.840631 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3500/6933] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:30.609612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:30.610174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:30.616963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:30.617482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:30.617924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:30.619319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:30.619784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:30.620215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:30.756843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:30.765493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-02e0dba2-df89-49dc-b97f-4ba1628a123f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.159874 Sep 07 10:46:30.766078 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3434/6934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:30 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:31.791592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:31.792318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:31.798524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:31.799027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:31.799479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:31.800215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:31.800687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:31.801131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:31.940868 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:31.949346 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-04d05d7a-6830-42e6-a274-21a323bad634 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.163917 Sep 07 10:46:31.949954 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3501/6935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:31 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:32.973073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:32.973730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:32.980761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:32.981282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:32.981729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:32.982448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:32.982939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:32.983377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:33.114045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:33.122823 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d73e8b4b-38ce-4713-b848-6cbdf401f308 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.153664 Sep 07 10:46:33.123396 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3435/6936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:32 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:34.146610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:34.147246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:34.153717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:34.154222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:34.154678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:34.155389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:34.155860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:34.156303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:34.303453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:34.311636 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a53db0af-e348-4014-9d46-c357174eb58f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.168893 Sep 07 10:46:34.312263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3502/6937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:34 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:35.335364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:35.336158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:35.343249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:35.343741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:35.344189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:35.344924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:35.345433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:35.345869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:35.476285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:35.486659 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0df8c655-4b6f-4028-afab-6f347f74f9ec tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.155176 Sep 07 10:46:35.487484 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3436/6938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:35 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:36.229599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5b5e8fa6-da7b-4e7c-b61e-1652d83cd084 req-fe25eb50-7517-4f52-bc05-647772956301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44433d75-9410-471b-af5d-1092050839b3", "name": "network-vif-plugged", "status": "completed", "tag": "fec8bc61-5af0-4766-935b-5d9ef09f300b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:36.240449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b5e8fa6-da7b-4e7c-b61e-1652d83cd084 req-fe25eb50-7517-4f52-bc05-647772956301 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:36.240946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b5e8fa6-da7b-4e7c-b61e-1652d83cd084 req-fe25eb50-7517-4f52-bc05-647772956301 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:36.241441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b5e8fa6-da7b-4e7c-b61e-1652d83cd084 req-fe25eb50-7517-4f52-bc05-647772956301 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:36.253478 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5b5e8fa6-da7b-4e7c-b61e-1652d83cd084 req-fe25eb50-7517-4f52-bc05-647772956301 service nova] Creating event network-vif-plugged:fec8bc61-5af0-4766-935b-5d9ef09f300b for instance 44433d75-9410-471b-af5d-1092050839b3 on n-h2-836830-16 Sep 07 10:46:36.258442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5b5e8fa6-da7b-4e7c-b61e-1652d83cd084 req-fe25eb50-7517-4f52-bc05-647772956301 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033456 Sep 07 10:46:36.259137 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3503/6939] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:36.511073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:36.511726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:36.518544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:36.519037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:36.519536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:36.520234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:36.520694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:36.521122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:36.652422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:36.660140 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-735c473d-94b8-4992-ab28-a0ece734f883 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1317 microversion: 2.1 time: 0.153051 Sep 07 10:46:36.660703 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3437/6940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:36 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:37.680604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:37.682168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:37.687135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:37.687894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:37.695055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:37.695559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:37.696020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:37.697315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:37.697798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:37.698251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:37.832115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:37.841067 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8310002-30a1-40f1-a558-1bb7fdb960cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.161438 Sep 07 10:46:37.841666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3504/6941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:37 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:37.902476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-698633976", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "2da1a844-884e-4466-8fca-2db63b4c5414"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:37.911380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:37.957415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] validate_networks() for [('2da1a844-884e-4466-8fca-2db63b4c5414', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:46:38.422703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:46:38.423161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:46:38.423643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:46:38.424083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:46:38.424500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:46:38.434858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:38.435349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:38.435783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:38.436545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:38.437003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:38.437458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:38.460467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Getting quotas for project 8c547a0477c64a3596d43026433ad820. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:46:38.467315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Getting quotas for user 040ac16d3b324bb789ecc22364a96d4e and project 8c547a0477c64a3596d43026433ad820. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:46:38.480886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:46:38.483225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:46:38.532201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2dc5f6ea-f6f5-4d09-84e4-74453279f707 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634178 Sep 07 10:46:38.532893 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3438/6942] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:46:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:46:38.544001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-666e11d3-887f-4818-8743-57e985fef058 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:38.544625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-666e11d3-887f-4818-8743-57e985fef058 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:38.601625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-666e11d3-887f-4818-8743-57e985fef058 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:38.608989 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-666e11d3-887f-4818-8743-57e985fef058 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1216 microversion: 2.1 time: 0.069012 Sep 07 10:46:38.609824 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3505/6943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:38 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:39.632278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:39.633924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:39.644824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:39.645498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:39.645982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:39.646747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:39.647427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:39.648090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:39.735051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:39.743042 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f391953-f267-44c1-aa99-99ec7d7c8347 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1286 microversion: 2.1 time: 0.114963 Sep 07 10:46:39.744285 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3439/6944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:39 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:40.767578 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:40.768340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:40.776163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:40.776757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:40.777336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:40.778140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:40.778679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:40.779197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:41.336034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:41.344508 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b451236d-3254-4f26-b15a-e3755bf174ac tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.581367 Sep 07 10:46:41.345098 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3506/6945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:40 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:41.486198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-c1c18ca7-2d6a-4475-8c49-558e163239b1 req-86897b12-4882-4e0d-822d-2965cbbb1580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6745dd-0b31-4b32-812e-ae47f3a1563d", "tag": "820d53a3-6403-4d99-b710-f40413e1db4e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:41.501452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c1c18ca7-2d6a-4475-8c49-558e163239b1 req-86897b12-4882-4e0d-822d-2965cbbb1580 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:41.501934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c1c18ca7-2d6a-4475-8c49-558e163239b1 req-86897b12-4882-4e0d-822d-2965cbbb1580 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:41.502367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-c1c18ca7-2d6a-4475-8c49-558e163239b1 req-86897b12-4882-4e0d-822d-2965cbbb1580 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:41.516596 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-c1c18ca7-2d6a-4475-8c49-558e163239b1 req-86897b12-4882-4e0d-822d-2965cbbb1580 service nova] Creating event network-changed:820d53a3-6403-4d99-b710-f40413e1db4e for instance db6745dd-0b31-4b32-812e-ae47f3a1563d on n-h1-836830-16 Sep 07 10:46:41.522306 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-c1c18ca7-2d6a-4475-8c49-558e163239b1 req-86897b12-4882-4e0d-822d-2965cbbb1580 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039721 Sep 07 10:46:41.523120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3440/6946] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:42.367678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:42.368998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:42.371744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:42.377118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:42.377645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:42.378104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:42.378820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:42.379354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:42.379749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:42.513590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:42.521297 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8d36cef7-e29b-42b3-91e9-e3b7d7a82c1e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.157578 Sep 07 10:46:42.521885 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3507/6947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:42 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:43.545276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:43.545987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:43.553361 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:43.553859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:43.554304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:43.555040 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:43.555504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:43.555999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:43.692715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:43.700881 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0f639036-a21a-4902-ab1d-58801db885cd tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.160416 Sep 07 10:46:43.701488 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3441/6948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:43 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:44.724778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:44.725388 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:44.732418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:44.732926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:44.733423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:44.734143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:44.734619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:44.735069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:44.867998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:44.875985 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7c6fad0a-6fa4-4d55-89df-203ddfd856c6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.155340 Sep 07 10:46:44.876576 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3508/6949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:44 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:45.901604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:45.902256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:45.910738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:45.911240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:45.911682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:45.912387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:45.912847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:45.913301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:46.046503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:46.054227 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8bb2519f-d7ad-48cf-96d9-a29d3dae2c65 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.158885 Sep 07 10:46:46.054795 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3442/6950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:45 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:47.077481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:47.078133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:47.085014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:47.085549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:47.086265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:47.087189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:47.087846 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:47.088292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:47.226674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:47.235492 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2bc82430-22b5-4c59-a695-d2c64dadf27e tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.161914 Sep 07 10:46:47.236086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3509/6951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:47 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:47.359445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-d2466945-9993-4545-b74e-9e45c81b17c1 req-0a20c256-ecdf-4860-9005-dec38957775b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6745dd-0b31-4b32-812e-ae47f3a1563d", "name": "network-vif-plugged", "status": "completed", "tag": "820d53a3-6403-4d99-b710-f40413e1db4e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:47.371518 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d2466945-9993-4545-b74e-9e45c81b17c1 req-0a20c256-ecdf-4860-9005-dec38957775b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:47.372008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d2466945-9993-4545-b74e-9e45c81b17c1 req-0a20c256-ecdf-4860-9005-dec38957775b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:47.372445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-d2466945-9993-4545-b74e-9e45c81b17c1 req-0a20c256-ecdf-4860-9005-dec38957775b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:47.384375 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-d2466945-9993-4545-b74e-9e45c81b17c1 req-0a20c256-ecdf-4860-9005-dec38957775b service nova] Creating event network-vif-plugged:820d53a3-6403-4d99-b710-f40413e1db4e for instance db6745dd-0b31-4b32-812e-ae47f3a1563d on n-h1-836830-16 Sep 07 10:46:47.389516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-d2466945-9993-4545-b74e-9e45c81b17c1 req-0a20c256-ecdf-4860-9005-dec38957775b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Sep 07 10:46:47.390125 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3443/6952] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:48.259532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:48.260230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:48.267297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:48.267802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:48.268256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:48.268964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:48.269460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:48.269906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:48.405802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:48.413742 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d9624cca-c989-45db-9ea9-e94d5634d3ad tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1316 microversion: 2.1 time: 0.158772 Sep 07 10:46:48.414326 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3510/6953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:48 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:49.437164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:49.437970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:49.442961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:49.443710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:49.451961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:49.452451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:49.452894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:49.453622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:49.454085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:49.454515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:49.587227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:49.594830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-45a4f95e-79e9-47cd-ab1d-9ebae7377b9f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1504 microversion: 2.1 time: 0.159520 Sep 07 10:46:49.595396 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3444/6954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:49 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:49.616777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:49.617328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:49.620303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:49.621934 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:46:49.622077 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d (ip 10.222.0.60) !!! Sep 07 10:46:49.633040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:49.634203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:49.634675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:49.635395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:49.635880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:49.636331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:49.662376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:46:49.738801 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3a0ac71e-ae08-4196-90af-90071f09280f tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "DELETE /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 204 len: 0 microversion: 2.1 time: 0.125629 Sep 07 10:46:49.739482 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3511/6955] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:49 2022] DELETE /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:46:49.747801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:49.748418 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:49.754450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:49.754934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:49.755369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:49.756050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:49.756503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:49.756928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:49.896014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:49.904534 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d943b852-1046-42dd-99b1-dc6952325fae tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1510 microversion: 2.1 time: 0.160624 Sep 07 10:46:49.905294 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3445/6956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:49 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:50.928781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:50.929530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:50.936553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:50.937044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:50.937594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:50.938291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:50.938760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:50.939191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:51.078877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:51.087157 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bb72261b-50e8-4d53-bf4f-e9549b162d91 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1510 microversion: 2.1 time: 0.162573 Sep 07 10:46:51.087841 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3512/6957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:50 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:51.622749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-4a22ee56-646e-4e0f-81d6-90935f1bd1d3 req-40e817bc-8096-4778-b303-7142eb6b4692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6745dd-0b31-4b32-812e-ae47f3a1563d", "name": "network-vif-deleted", "tag": "820d53a3-6403-4d99-b710-f40413e1db4e"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:51.633096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4a22ee56-646e-4e0f-81d6-90935f1bd1d3 req-40e817bc-8096-4778-b303-7142eb6b4692 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:51.634655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4a22ee56-646e-4e0f-81d6-90935f1bd1d3 req-40e817bc-8096-4778-b303-7142eb6b4692 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:51.635493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-4a22ee56-646e-4e0f-81d6-90935f1bd1d3 req-40e817bc-8096-4778-b303-7142eb6b4692 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:51.648906 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-4a22ee56-646e-4e0f-81d6-90935f1bd1d3 req-40e817bc-8096-4778-b303-7142eb6b4692 service nova] Creating event network-vif-deleted:820d53a3-6403-4d99-b710-f40413e1db4e for instance db6745dd-0b31-4b32-812e-ae47f3a1563d on n-h1-836830-16 Sep 07 10:46:51.656507 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-4a22ee56-646e-4e0f-81d6-90935f1bd1d3 req-40e817bc-8096-4778-b303-7142eb6b4692 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037790 Sep 07 10:46:51.657127 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3446/6958] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:52.109877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:52.110515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:52.117484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:52.118069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:52.118526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:52.119625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:52.120321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:52.120534 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:52.155314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:52.155812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:52.156267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:52.156732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lazy-loading 'fault' on Instance uuid db6745dd-0b31-4b32-812e-ae47f3a1563d {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:46:52.204646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:52.212324 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3f3ecfbc-169f-4de6-99f9-00f0014e3eb2 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 200 len: 1306 microversion: 2.1 time: 0.106276 Sep 07 10:46:52.212955 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3513/6959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:52 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:53.237611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:53.238362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.246267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.246767 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.247211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.247928 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.248391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.248824 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.263575 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] HTTP exception thrown: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d HTTP/1.1 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'db6745dd-0b31-4b32-812e-ae47f3a1563d'} Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:53.265279 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 404 to user: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:53.270070 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c06ddf36-cc05-4900-8d63-0429275d4285 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 404 len: 111 microversion: 2.1 time: 0.034764 Sep 07 10:46:53.276275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:53.276914 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.280806 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3447/6960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:53 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:53.284389 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.285013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.285818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.286660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.287187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.287640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.430987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:53.438828 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ada22ba8-cf21-4bf4-a759-2286d38d9a98 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.166813 Sep 07 10:46:53.439415 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3514/6961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:53 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:46:53.462327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db71ad79-8747-41e7-9a4f-ad4c03269067 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:53.464615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-db71ad79-8747-41e7-9a4f-ad4c03269067 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 08082a03-3b66-496e-bae4-e212d59309c4] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.470215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-db71ad79-8747-41e7-9a4f-ad4c03269067 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] HTTP exception thrown: Instance 08082a03-3b66-496e-bae4-e212d59309c4 could not be found. Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db71ad79-8747-41e7-9a4f-ad4c03269067 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/08082a03-3b66-496e-bae4-e212d59309c4/action HTTP/1.1 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 32 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: {"resize": {"flavorRef": "452"}} Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 08082a03-3b66-496e-bae4-e212d59309c4 could not be found. Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '08082a03-3b66-496e-bae4-e212d59309c4', 'body': {'resize': {'flavorRef': '452'}}} Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08082a03-3b66-496e-bae4-e212d59309c4 could not be found. Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:53.471756 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08082a03-3b66-496e-bae4-e212d59309c4 could not be found. Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08082a03-3b66-496e-bae4-e212d59309c4 could not be found. Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-db71ad79-8747-41e7-9a4f-ad4c03269067 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 404 to user: Instance 08082a03-3b66-496e-bae4-e212d59309c4 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-db71ad79-8747-41e7-9a4f-ad4c03269067 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "POST /compute/v2.1/servers/08082a03-3b66-496e-bae4-e212d59309c4/action" status: 404 len: 111 microversion: 2.1 time: 0.015717 Sep 07 10:46:53.476193 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3448/6962] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:46:53 2022] POST /compute/v2.1/servers/08082a03-3b66-496e-bae4-e212d59309c4/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:53.482964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:53.483602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.489681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.490184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.490636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.491348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.491824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.492266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.516337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:53.639079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:53.646957 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b28a892f-127f-4f85-8d0c-41ec20eed060 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.168381 Sep 07 10:46:53.647535 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3515/6963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:53 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:53.670448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:53.671368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.679073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.679580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.680052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.680890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.681432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.681874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.820039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:53.828925 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-39e18eb7-5a1d-4abc-ae1b-a8912d453090 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.162409 Sep 07 10:46:53.829540 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3449/6964] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:53 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:53.853018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7befe0b2-1f1d-49af-b9f7-c07ac87c243a"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:53.855441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.861672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.862174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.862635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.863339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.863813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.864254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.893789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:53.899884 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] HTTP exception thrown: Flavor 7befe0b2-1f1d-49af-b9f7-c07ac87c243a could not be found. Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: request: POST /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3/action HTTP/1.1 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 65 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: {"resize": {"flavorRef": "7befe0b2-1f1d-49af-b9f7-c07ac87c243a"}} Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: exception: Flavor 7befe0b2-1f1d-49af-b9f7-c07ac87c243a could not be found. Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '44433d75-9410-471b-af5d-1092050839b3', 'body': {'resize': {'flavorRef': '7befe0b2-1f1d-49af-b9f7-c07ac87c243a'}}} Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:53.901910 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7befe0b2-1f1d-49af-b9f7-c07ac87c243a could not be found. Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7befe0b2-1f1d-49af-b9f7-c07ac87c243a could not be found. Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7befe0b2-1f1d-49af-b9f7-c07ac87c243a could not be found. Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 400 to user: Flavor 7befe0b2-1f1d-49af-b9f7-c07ac87c243a could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:53.906271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fa512bbb-d974-4594-b4fa-80eee5d25fba tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "POST /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3/action" status: 400 len: 107 microversion: 2.1 time: 0.054691 Sep 07 10:46:53.908539 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3516/6965] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:46:53 2022] POST /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3/action => generated 107 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:46:53.913324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:53.914033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:53.921106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.921710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.922227 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:53.923002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:53.923540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:53.924061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.060581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:54.068577 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d651bf66-d121-4dec-b433-61c652f2e2b5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.159293 Sep 07 10:46:54.069154 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3450/6966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:53 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:54.095155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:54.096233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:54.103289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.103992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.104550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.105511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.106055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.106569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.257304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:54.265793 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4528bd07-b834-429c-9108-4ccf9d281d5d tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.175142 Sep 07 10:46:54.266352 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3517/6967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:54 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:54.290544 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28dd8a91-9375-4e9f-b390-f639e5ef09df tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28dd8a91-9375-4e9f-b390-f639e5ef09df tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: request: POST /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3/action HTTP/1.1 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 29 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: {"resize": {"flavorRef": ""}} Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '44433d75-9410-471b-af5d-1092050839b3', 'body': {'resize': {'flavorRef': ''}}} Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise error Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi '' Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.295708 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-28dd8a91-9375-4e9f-b390-f639e5ef09df tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-28dd8a91-9375-4e9f-b390-f639e5ef09df tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "POST /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3/action" status: 400 len: 113 microversion: 2.1 time: 0.012696 Sep 07 10:46:54.301974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3451/6968] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:46:54 2022] POST /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3/action => generated 113 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 10:46:54.306933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:54.307563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:54.315321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.315839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.316298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.317038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.317546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.318020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.476332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:54.485420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4ef7bf7a-6e5c-4de3-bf43-c0d9585d849c tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1506 microversion: 2.1 time: 0.183000 Sep 07 10:46:54.486010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3518/6969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:54 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:46:54.519079 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:54.519593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:54.529866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.530360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.530803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.531514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.531977 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.532412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.547522 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] HTTP exception thrown: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: request: DELETE /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d HTTP/1.1 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'db6745dd-0b31-4b32-812e-ae47f3a1563d'} Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:54.549275 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 404 to user: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c60dcbe0-94e4-49dd-a127-137ae2999e00 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "DELETE /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 404 len: 111 microversion: 2.1 time: 0.039319 Sep 07 10:46:54.553882 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3452/6970] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:54 2022] DELETE /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:54.561213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:54.562433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: db6745dd-0b31-4b32-812e-ae47f3a1563d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:54.569218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.569723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.570450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.571760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.572279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.572733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.590503 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] HTTP exception thrown: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d HTTP/1.1 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'db6745dd-0b31-4b32-812e-ae47f3a1563d'} Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:54.592102 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 404 to user: Instance db6745dd-0b31-4b32-812e-ae47f3a1563d could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-32d7df94-fc64-403b-9e94-9a0887130168 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d" status: 404 len: 111 microversion: 2.1 time: 0.038062 Sep 07 10:46:54.597614 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3519/6971] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:54 2022] GET /compute/v2.1/servers/db6745dd-0b31-4b32-812e-ae47f3a1563d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:46:54.604898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:54.605723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:54.612831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.613406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.613844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.614547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.615000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.615422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.648506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:46:54.714256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:54.756459 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91e0ac56-9a01-4ee8-95b2-2c8253a5b70a tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "DELETE /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 204 len: 0 microversion: 2.1 time: 0.156948 Sep 07 10:46:54.757477 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3453/6972] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:46:54 2022] DELETE /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:46:54.766015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:54.766657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:54.772831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.773381 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.773843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.775320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:54.775972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:54.776112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:54.938129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:54.948513 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-17998141-6902-4ed5-9541-6c6209e3a021 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1512 microversion: 2.1 time: 0.186302 Sep 07 10:46:54.949095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3520/6973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:54 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:55.974746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:55.975465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:55.983010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:55.983501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:55.983949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:55.984652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:55.985117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:55.985581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:56.118606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:56.126510 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4a23f8b6-8282-4756-b642-c88f2073d4f5 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1512 microversion: 2.1 time: 0.156071 Sep 07 10:46:56.127083 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3454/6974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:55 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:56.646585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-af0374bb-feb7-446d-b168-ef05544678b7 req-d3208c0b-6b6f-4107-be7d-661ed88b146b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44433d75-9410-471b-af5d-1092050839b3", "name": "network-vif-deleted", "tag": "fec8bc61-5af0-4766-935b-5d9ef09f300b"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:46:56.658648 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-af0374bb-feb7-446d-b168-ef05544678b7 req-d3208c0b-6b6f-4107-be7d-661ed88b146b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:56.659328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-af0374bb-feb7-446d-b168-ef05544678b7 req-d3208c0b-6b6f-4107-be7d-661ed88b146b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:56.659938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-af0374bb-feb7-446d-b168-ef05544678b7 req-d3208c0b-6b6f-4107-be7d-661ed88b146b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:56.675411 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-af0374bb-feb7-446d-b168-ef05544678b7 req-d3208c0b-6b6f-4107-be7d-661ed88b146b service nova] Creating event network-vif-deleted:fec8bc61-5af0-4766-935b-5d9ef09f300b for instance 44433d75-9410-471b-af5d-1092050839b3 on n-h2-836830-16 Sep 07 10:46:56.683215 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-af0374bb-feb7-446d-b168-ef05544678b7 req-d3208c0b-6b6f-4107-be7d-661ed88b146b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040850 Sep 07 10:46:56.683991 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3521/6975] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:46:57.150691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:57.152061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:57.155685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:46:57.162051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:57.162550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:57.162996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:57.163705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:57.164333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:57.164782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:57.200388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:57.200885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:57.201346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:57.201802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lazy-loading 'fault' on Instance uuid 44433d75-9410-471b-af5d-1092050839b3 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:46:57.247902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040ac16d3b324bb789ecc22364a96d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c547a0477c64a3596d43026433ad820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:46:57.256607 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f6439f52-782f-42b6-8513-20bbaa7b1217 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 200 len: 1307 microversion: 2.1 time: 0.110317 Sep 07 10:46:57.257225 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3455/6976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:57 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:46:58.281472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:46:58.282201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] [instance: 44433d75-9410-471b-af5d-1092050839b3] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:46:58.288405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:58.288891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:58.289377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:58.290111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:46:58.290589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:46:58.291027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:46:58.304593 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] HTTP exception thrown: Instance 44433d75-9410-471b-af5d-1092050839b3 could not be found. Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Request method failure captured: Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 HTTP/1.1 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHaC7X4nrpFUWx_yqr8MdprwT-R5H3pitmttOFbnTdDcRkBWai7wnUUCOTEaedurcj6J8gZnIuqFMlFtVV6ZMYjJberJpW3QLLLQSOCaGi2g3FXMejgfGe_GrHBt9f0Bc5yOiBQCrP7Ro6Qe8PW_wRj6ujwh10n5R7e_TvDKBYse71U Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c547a0477c64a3596d43026433ad820"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c547a0477c64a3596d43026433ad820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c547a0477c64a3596d43026433ad820", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 8c547a0477c64a3596d43026433ad820 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1534347726 Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 040ac16d3b324bb789ecc22364a96d4e Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-ServersNegativeTestJSON-1534347726-project Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 44433d75-9410-471b-af5d-1092050839b3 could not be found. Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '44433d75-9410-471b-af5d-1092050839b3'} Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44433d75-9410-471b-af5d-1092050839b3 could not be found. Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44433d75-9410-471b-af5d-1092050839b3 could not be found. Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:46:58.306348 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44433d75-9410-471b-af5d-1092050839b3 could not be found. Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] Returning 404 to user: Instance 44433d75-9410-471b-af5d-1092050839b3 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-39a4c56d-9055-45e9-9ea4-1c0f513988e6 tempest-ServersNegativeTestJSON-1534347726 tempest-ServersNegativeTestJSON-1534347726-project] 10.222.0.60 "GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3" status: 404 len: 111 microversion: 2.1 time: 0.031734 Sep 07 10:46:58.311342 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3522/6977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:46:58 2022] GET /compute/v2.1/servers/44433d75-9410-471b-af5d-1092050839b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:47:31.683124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:31.684070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=14 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:31.900640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2248126b-3bbc-44dd-9b01-132c51841d3a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: .version_select at 0x7f14b2098820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2051930233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRjLYKsGmHeyfs6bdSwh30hmI+WgjwrAGp5rjlt/9jR1Cp/4JB+A0QShHL69Mjh8O8PD/5RsPFoCVVGIUF6KA/28VzlM+jkiTIVQfCV35rZKJMHcbXCoEZ25Dh3eVkN4w=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:47:31.918087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2248126b-3bbc-44dd-9b01-132c51841d3a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for project 81e79e63a9054ad99bd6d0606be77417. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:47:31.923734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-2248126b-3bbc-44dd-9b01-132c51841d3a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for user 28a14db16bcd4eceae66b74e8436ed82 and project 81e79e63a9054ad99bd6d0606be77417. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:47:31.953415 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2248126b-3bbc-44dd-9b01-132c51841d3a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.275858 Sep 07 10:47:31.954034 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3456/6978] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:47:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:47:32.005588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1649692329", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2051930233", "networks": [{"uuid": "37f60241-7e66-4aea-b1af-d5df00d7c6ea"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:47:32.016339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:32.017157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=30 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:32.283656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] validate_networks() for [('37f60241-7e66-4aea-b1af-d5df00d7c6ea', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:47:32.747295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:47:32.747731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:47:32.748217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:47:32.748638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:47:32.749059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:47:32.758016 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:32.758508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:32.758954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:32.759688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:32.760153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:32.760588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:32.780858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for project 81e79e63a9054ad99bd6d0606be77417. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:47:32.786129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for user 28a14db16bcd4eceae66b74e8436ed82 and project 81e79e63a9054ad99bd6d0606be77417. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:47:32.798989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:47:32.801320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:47:32.848821 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6f56a116-ceca-472c-8f4b-9524f8d4033a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847280 Sep 07 10:47:32.849506 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3523/6979] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:47:32.862529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-54b336a9-ebc9-445b-ab6c-85c4398c1bea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:32.863267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-54b336a9-ebc9-445b-ab6c-85c4398c1bea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:33.030926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-54b336a9-ebc9-445b-ab6c-85c4398c1bea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:33.040835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-54b336a9-ebc9-445b-ab6c-85c4398c1bea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1263 microversion: 2.1 time: 0.183353 Sep 07 10:47:33.041429 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3457/6980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:32 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:47:34.065415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:34.066807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:34.073809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:34.074617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:34.075290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:34.076336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:34.077023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:34.077856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:34.174406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:34.184442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0faba330-4970-45c4-a309-e0a08fdd58b4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1333 microversion: 2.1 time: 0.124089 Sep 07 10:47:34.185134 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3524/6981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:34 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:35.208562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:35.209506 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:35.216306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:35.216899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:35.217469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:35.218282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:35.219112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:35.219629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:35.477589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:35.485609 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f7c01195-d551-4615-9eee-e10364e75640 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.281420 Sep 07 10:47:35.486193 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3458/6982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:35 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:35.928436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-b22a81cd-1c51-4524-a937-bcce962a0b6b req-32a27c28-007b-49d7-b1cf-8ac22acba075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88766a4c-8ded-4fa3-b41a-775ba4f8af20", "tag": "ae3d6bc6-ef2a-4f2f-a53d-0fac27d762ab"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:47:35.941301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b22a81cd-1c51-4524-a937-bcce962a0b6b req-32a27c28-007b-49d7-b1cf-8ac22acba075 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:35.942142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b22a81cd-1c51-4524-a937-bcce962a0b6b req-32a27c28-007b-49d7-b1cf-8ac22acba075 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:35.943550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-b22a81cd-1c51-4524-a937-bcce962a0b6b req-32a27c28-007b-49d7-b1cf-8ac22acba075 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:35.963676 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-b22a81cd-1c51-4524-a937-bcce962a0b6b req-32a27c28-007b-49d7-b1cf-8ac22acba075 service nova] Creating event network-changed:ae3d6bc6-ef2a-4f2f-a53d-0fac27d762ab for instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 on n-h2-836830-16 Sep 07 10:47:35.969408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-b22a81cd-1c51-4524-a937-bcce962a0b6b req-32a27c28-007b-49d7-b1cf-8ac22acba075 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044952 Sep 07 10:47:35.970551 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3525/6983] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:47:36.510234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:36.510859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:36.518491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:36.519060 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:36.519593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:36.520359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:36.520876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:36.521256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:36.674287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:36.683569 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2624eab0-c735-4666-b7d7-83fb00126016 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.177394 Sep 07 10:47:36.684149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3459/6984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:36 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:37.708449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:37.709242 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:37.716505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:37.717017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:37.717500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:37.718219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:37.718695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:37.719145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:37.861126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:37.868879 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8d59c7a7-a07a-4a0a-b9ac-8d0ce3cadef1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.165833 Sep 07 10:47:37.869427 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3526/6985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:37 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:38.892283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:38.892900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:38.900620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:38.901441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:38.901889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:38.902596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:38.903056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:38.903485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:39.037555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:39.045314 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4fbb2565-8c06-4c9d-8029-83af4ae0c8a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.156976 Sep 07 10:47:39.045882 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3460/6986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:38 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:40.068582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:40.069286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:40.076516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:40.077017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:40.077503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:40.078257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:40.078705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:40.079149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:40.218227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:40.226211 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a58c29c2-f5b6-4a78-bf16-d5ba408114e9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.161494 Sep 07 10:47:40.227042 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3527/6987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:40 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:41.249112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:41.249764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:41.256637 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:41.257126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:41.257871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:41.258577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:41.259041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:41.259476 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:41.398367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:41.406773 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94f5caba-d3d2-414f-b3e1-1b74f11e4226 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.161156 Sep 07 10:47:41.407361 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3461/6988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:41 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:42.431594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:42.432403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:42.439328 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:42.439829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:42.440283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:42.440987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:42.441479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:42.441920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:42.543363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-59cf5b97-8c84-459b-b9c0-c2a049004017 req-1e0ecfed-424a-4f5c-95b1-421bdfa096f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88766a4c-8ded-4fa3-b41a-775ba4f8af20", "name": "network-vif-plugged", "status": "completed", "tag": "ae3d6bc6-ef2a-4f2f-a53d-0fac27d762ab"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:47:42.556411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-59cf5b97-8c84-459b-b9c0-c2a049004017 req-1e0ecfed-424a-4f5c-95b1-421bdfa096f2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:42.557140 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-59cf5b97-8c84-459b-b9c0-c2a049004017 req-1e0ecfed-424a-4f5c-95b1-421bdfa096f2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:42.557612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-59cf5b97-8c84-459b-b9c0-c2a049004017 req-1e0ecfed-424a-4f5c-95b1-421bdfa096f2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:42.569208 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-59cf5b97-8c84-459b-b9c0-c2a049004017 req-1e0ecfed-424a-4f5c-95b1-421bdfa096f2 service nova] Creating event network-vif-plugged:ae3d6bc6-ef2a-4f2f-a53d-0fac27d762ab for instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 on n-h2-836830-16 Sep 07 10:47:42.577555 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-59cf5b97-8c84-459b-b9c0-c2a049004017 req-1e0ecfed-424a-4f5c-95b1-421bdfa096f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Sep 07 10:47:42.577704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:42.578318 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3462/6989] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:47:42.585663 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-653c2e11-9e0a-4698-8be8-a0a2048da1df tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.158924 Sep 07 10:47:42.586601 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3528/6990] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:42 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:43.606852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:43.612366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:43.613111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:43.620780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:43.621296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:43.621736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:43.622432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:43.622889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:43.623320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:43.763678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:43.772344 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0212e05f-1851-4baf-a438-c0450943a1ee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1363 microversion: 2.1 time: 0.166468 Sep 07 10:47:43.779260 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3463/6991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:43 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:44.796018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:44.796653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:44.798692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:44.799545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:44.807598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:44.808100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:44.808558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:44.809419 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:44.809900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:44.810379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:44.943571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:44.951408 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8e3e2641-92e5-47db-b8c9-ee00138144ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1556 microversion: 2.1 time: 0.159372 Sep 07 10:47:44.951984 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3529/6992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:44 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:44.973993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:44.974617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:44.982019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:44.982508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:44.982955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:44.983650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:44.984108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:44.984536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:45.115368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:47:45.123830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-733b89cf-5ca1-4117-b81a-4925feafc135 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1556 microversion: 2.1 time: 0.153718 Sep 07 10:47:45.124409 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3464/6993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:47:44 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:47:46.814796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b40412-031b-4b2d-9856-03f577fc74c4"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:47:46.821361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:46.828277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:46.828806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:46.829302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:46.830055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:46.830551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:46.831003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:47.098162 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0c2e9b3-4ce0-4971-9dac-868e11cbf5b7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288026 Sep 07 10:47:47.098830 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3530/6994] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:47:46 2022] POST /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:47:57.839837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:57.840351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:57.843255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:57.843917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=38 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:57.850646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:57.851142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:57.851591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:57.852337 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:57.852805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:57.853281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:57.939266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lazy-loading 'services' on Instance uuid 88766a4c-8ded-4fa3-b41a-775ba4f8af20 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:47:58.011588 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fa3673ce-9f32-409a-957b-acfc69d1bd6c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments/57b40412-031b-4b2d-9856-03f577fc74c4" status: 202 len: 0 microversion: 2.1 time: 0.175860 Sep 07 10:47:58.012226 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3465/6995] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:47:57 2022] DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments/57b40412-031b-4b2d-9856-03f577fc74c4 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:47:58.021166 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:58.023670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:58.027442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:58.028193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:47:58.034776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:58.035340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:58.035849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:58.036662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:58.037162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:58.037637 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:58.072240 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b3cc315e-ec03-49ab-a826-79b727812448 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055422 Sep 07 10:47:58.073227 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3531/6996] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:47:58 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:47:59.085634 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:47:59.088537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:47:59.094875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:59.095363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:59.095805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:59.096500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:47:59.096978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:47:59.097420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:47:59.130476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2cb5f6f0-4f69-44e9-9586-5a41fbebf92f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 Sep 07 10:47:59.131050 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3466/6997] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:47:59 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:00.143514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:00.145815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:00.154205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:00.154722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:00.155188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:00.155924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:00.156405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:00.156854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:00.192475 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6bc61007-681a-428f-bd4f-62a9fed7f122 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052971 Sep 07 10:48:00.193074 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3532/6998] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:00 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:01.204249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:01.206536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:01.214523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:01.215017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:01.215460 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:01.216165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:01.216631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:01.217095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:01.247463 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27b22d77-971a-4168-8291-9ba0fc631982 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047275 Sep 07 10:48:01.248043 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3467/6999] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:01 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:02.260493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:02.262860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:02.269995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:02.270487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:02.270934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:02.271635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:02.272102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:02.272539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:02.305165 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2911fc78-9fd4-4734-a080-79664ab76d45 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048676 Sep 07 10:48:02.306094 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3533/7000] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:02 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:48:03.317859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:03.320143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:03.327876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:03.328366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:03.328814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:03.329541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:03.330009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:03.330445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:03.361539 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4159af4c-598a-439a-8264-16cdaeee47a7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047732 Sep 07 10:48:03.362106 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3468/7001] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:03 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:48:03.373491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:03.374060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:03.380759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:03.381289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:03.381744 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:03.382477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:03.382946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:03.383382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:03.462974 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] HTTP exception thrown: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 is not attached to volume 57b40412-031b-4b2d-9856-03f577fc74c4 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Request method failure captured: Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments/57b40412-031b-4b2d-9856-03f577fc74c4 HTTP/1.1 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHa-a8IAl7_gMJ4N-UQbCH1ORRbEEGEHMyqEFl6K2t9hH2KcCSquOL99uvDHR7LA9QMxwOd8ixPFP1xpn89371PmmpTqQu83pUqgaUMvf9IX9pqw9702Wif90USlZcMn69h4p6NDvstaZImkTZctBcO80QcC3wI6PBVrastHNM3NJgs Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81e79e63a9054ad99bd6d0606be77417", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 28a14db16bcd4eceae66b74e8436ed82 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 is not attached to volume 57b40412-031b-4b2d-9856-03f577fc74c4 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': '88766a4c-8ded-4fa3-b41a-775ba4f8af20', 'id': '57b40412-031b-4b2d-9856-03f577fc74c4'} Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 57b40412-031b-4b2d-9856-03f577fc74c4. Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 is not attached to volume 57b40412-031b-4b2d-9856-03f577fc74c4 Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:03.481711 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 is not attached to volume 57b40412-031b-4b2d-9856-03f577fc74c4 Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Returning 404 to user: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 is not attached to volume 57b40412-031b-4b2d-9856-03f577fc74c4 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-01a9cdf3-bcf5-492a-8da0-f112be1b598f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments/57b40412-031b-4b2d-9856-03f577fc74c4" status: 404 len: 154 microversion: 2.1 time: 0.114520 Sep 07 10:48:03.486224 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3534/7002] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:48:03 2022] DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20/os-volume_attachments/57b40412-031b-4b2d-9856-03f577fc74c4 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:48:06.851592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:06.852151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:06.859545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:06.860282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:06.860889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:06.861656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:06.862127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:06.862564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:06.890701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:48:06.971907 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dee4453d-8800-4125-b805-f634fe82f0c3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 204 len: 0 microversion: 2.1 time: 0.124189 Sep 07 10:48:06.972533 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3469/7003] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:48:06 2022] DELETE /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:48:06.981634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:06.982276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:06.988940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:06.989482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:06.989936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:06.990649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:06.991123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:06.991591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:07.131684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:07.140272 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ee30486-69a2-4b08-90e1-8152bb23082d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1562 microversion: 2.1 time: 0.163356 Sep 07 10:48:07.140852 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3535/7004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:06 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:48:08.164520 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:08.165162 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:08.172586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:08.173073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:08.173547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:08.174244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:08.174703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:08.175131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:08.306303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:08.314699 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b929d59e-c660-4681-85e6-0cc26775c819 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1562 microversion: 2.1 time: 0.154644 Sep 07 10:48:08.315283 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3470/7005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:08 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:09.214239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6bbadfbf-a9ad-461b-bb94-0857483c8a3c req-149215f1-10d7-431c-9efc-8eee14033188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88766a4c-8ded-4fa3-b41a-775ba4f8af20", "name": "network-vif-deleted", "tag": "ae3d6bc6-ef2a-4f2f-a53d-0fac27d762ab"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:09.223878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6bbadfbf-a9ad-461b-bb94-0857483c8a3c req-149215f1-10d7-431c-9efc-8eee14033188 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:09.224377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6bbadfbf-a9ad-461b-bb94-0857483c8a3c req-149215f1-10d7-431c-9efc-8eee14033188 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:09.224828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6bbadfbf-a9ad-461b-bb94-0857483c8a3c req-149215f1-10d7-431c-9efc-8eee14033188 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:09.236576 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6bbadfbf-a9ad-461b-bb94-0857483c8a3c req-149215f1-10d7-431c-9efc-8eee14033188 service nova] Creating event network-vif-deleted:ae3d6bc6-ef2a-4f2f-a53d-0fac27d762ab for instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 on n-h2-836830-16 Sep 07 10:48:09.241881 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6bbadfbf-a9ad-461b-bb94-0857483c8a3c req-149215f1-10d7-431c-9efc-8eee14033188 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095591 Sep 07 10:48:09.242552 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3536/7006] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:09.338047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:09.338864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:09.345763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:09.346180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:09.346641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:09.347312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:09.347766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:09.348190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:09.384260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:09.384820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:09.385288 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:09.385736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lazy-loading 'fault' on Instance uuid 88766a4c-8ded-4fa3-b41a-775ba4f8af20 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:48:09.428921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:09.437607 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-101277b1-1632-4e34-ad2a-2c279e3da7b9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 200 len: 1353 microversion: 2.1 time: 0.103820 Sep 07 10:48:09.438242 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3471/7007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:09 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:10.463714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:10.464373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 88766a4c-8ded-4fa3-b41a-775ba4f8af20] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:10.470593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:10.471096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:10.471551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:10.472257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:10.472730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:10.473198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:10.489608 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] HTTP exception thrown: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 could not be found. Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Request method failure captured: Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 HTTP/1.1 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHa-a8IAl7_gMJ4N-UQbCH1ORRbEEGEHMyqEFl6K2t9hH2KcCSquOL99uvDHR7LA9QMxwOd8ixPFP1xpn89371PmmpTqQu83pUqgaUMvf9IX9pqw9702Wif90USlZcMn69h4p6NDvstaZImkTZctBcO80QcC3wI6PBVrastHNM3NJgs Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81e79e63a9054ad99bd6d0606be77417", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 28a14db16bcd4eceae66b74e8436ed82 Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 could not be found. Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '88766a4c-8ded-4fa3-b41a-775ba4f8af20'} Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 could not be found. Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 could not be found. Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:10.491247 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 could not be found. Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Returning 404 to user: Instance 88766a4c-8ded-4fa3-b41a-775ba4f8af20 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a9d908c-35e9-4673-b116-980752057071 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20" status: 404 len: 111 microversion: 2.1 time: 0.034714 Sep 07 10:48:10.496616 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3537/7008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:10 2022] GET /compute/v2.1/servers/88766a4c-8ded-4fa3-b41a-775ba4f8af20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:48:10.502314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b9dbebe6-80c3-4903-8209-2566df742bce tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '.version_select at 0x7f14b5dc5670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:10.524015 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b9dbebe6-80c3-4903-8209-2566df742bce tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2051930233" status: 202 len: 0 microversion: 2.1 time: 0.025526 Sep 07 10:48:10.524603 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3472/7009] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 7 10:48:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2051930233 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:48:10.543855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d896e651-7498-48bb-b6fe-5f22b86d43c4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: .version_select at 0x7f14b069e040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2026681454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpyVnuG4Pam1J1E8xR4JwhKna1vBGyHOSw3pSbMw8N8A724xRM7f77RvDzQ834Ukn10gedb+AlumUPShZGSgLuePvLOHyhY2e2Z8pOMTRwCAJi0vhgScN5EimncWWBrwQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:10.559773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-d896e651-7498-48bb-b6fe-5f22b86d43c4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for project 81e79e63a9054ad99bd6d0606be77417. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:48:10.564940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-d896e651-7498-48bb-b6fe-5f22b86d43c4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for user 28a14db16bcd4eceae66b74e8436ed82 and project 81e79e63a9054ad99bd6d0606be77417. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:48:10.592223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d896e651-7498-48bb-b6fe-5f22b86d43c4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053171 Sep 07 10:48:10.592819 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3538/7010] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:48:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:10.647219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-397469832", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2026681454", "networks": [{"uuid": "37f60241-7e66-4aea-b1af-d5df00d7c6ea"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:10.704292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] validate_networks() for [('37f60241-7e66-4aea-b1af-d5df00d7c6ea', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:48:11.088480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:48:11.088901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:48:11.089400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:48:11.089814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:48:11.090225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:48:11.099103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:11.099586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:11.100021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:11.100747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:11.101286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:11.101720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:11.118770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for project 81e79e63a9054ad99bd6d0606be77417. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:48:11.124821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for user 28a14db16bcd4eceae66b74e8436ed82 and project 81e79e63a9054ad99bd6d0606be77417. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:48:11.137877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:48:11.140274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:48:11.187246 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-981ab0fc-3713-4ae6-b3f2-6f25673df5f9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543884 Sep 07 10:48:11.187907 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3473/7011] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:48:11.199236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99e10086-fa10-4b5a-8f48-52f59aff6cf0 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:11.199987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99e10086-fa10-4b5a-8f48-52f59aff6cf0 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:11.259234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99e10086-fa10-4b5a-8f48-52f59aff6cf0 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:11.267295 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99e10086-fa10-4b5a-8f48-52f59aff6cf0 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1262 microversion: 2.1 time: 0.072178 Sep 07 10:48:11.267860 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3539/7012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:11 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:12.291771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:12.293217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:12.300435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:12.301047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:12.301524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:12.302266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:12.302730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:12.303195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:12.378385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:12.387162 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ec41503-f927-404a-9f93-3210cfc72bd4 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1314 microversion: 2.1 time: 0.100213 Sep 07 10:48:12.394013 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3474/7013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:12 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1314 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:13.410934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:13.411675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:13.419609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:13.420119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:13.420580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:13.421350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:13.421837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:13.422284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:13.665229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:13.673337 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-baf316ef-f7a3-4b4a-956d-6d55612a4ebd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1362 microversion: 2.1 time: 0.266555 Sep 07 10:48:13.673923 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3540/7014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:13 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:13.844480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-caa39900-61bf-4710-8e27-1de9e0807b54 req-df6057b7-7d17-4e0c-8f3d-3e8bc6c45c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af34a843-38e6-47b2-b2b4-d3cada589f1c", "tag": "db7dfdc1-972f-4fec-9e24-6ba89d0ef4bc"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:13.857656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caa39900-61bf-4710-8e27-1de9e0807b54 req-df6057b7-7d17-4e0c-8f3d-3e8bc6c45c2f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:13.858152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caa39900-61bf-4710-8e27-1de9e0807b54 req-df6057b7-7d17-4e0c-8f3d-3e8bc6c45c2f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:13.858589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-caa39900-61bf-4710-8e27-1de9e0807b54 req-df6057b7-7d17-4e0c-8f3d-3e8bc6c45c2f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:13.869905 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-caa39900-61bf-4710-8e27-1de9e0807b54 req-df6057b7-7d17-4e0c-8f3d-3e8bc6c45c2f service nova] Creating event network-changed:db7dfdc1-972f-4fec-9e24-6ba89d0ef4bc for instance af34a843-38e6-47b2-b2b4-d3cada589f1c on n-h2-836830-16 Sep 07 10:48:13.877201 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-caa39900-61bf-4710-8e27-1de9e0807b54 req-df6057b7-7d17-4e0c-8f3d-3e8bc6c45c2f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037892 Sep 07 10:48:13.878657 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3475/7015] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:14.697443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:14.698119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:14.705156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:14.705690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:14.706148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:14.706930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:14.707405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:14.707854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:14.837888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:14.845822 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e29e919d-12d6-4e00-b383-ab63e9e9c7a1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1362 microversion: 2.1 time: 0.152397 Sep 07 10:48:14.846395 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3541/7016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:14 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:15.870123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:15.870863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:15.877968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:15.878451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:15.878883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:15.879575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:15.880026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:15.880448 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:16.015541 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:16.023443 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-368aefef-9048-4a96-becd-529b5ba8f6e6 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1362 microversion: 2.1 time: 0.157586 Sep 07 10:48:16.024017 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3476/7017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:15 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:17.048411 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:17.049063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:17.055977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:17.056475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:17.056925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:17.057651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:17.058121 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:17.059206 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:17.199713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:17.207852 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a34ee1c-9ff9-4250-b76a-9f402f5b9887 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1362 microversion: 2.1 time: 0.163223 Sep 07 10:48:17.208674 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3542/7018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:17 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:18.232157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:18.232951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:18.240258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:18.240747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:18.241205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:18.241898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:18.242353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:18.242776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:18.375964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:18.383770 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-575a7189-cc6f-4130-bbff-7e49b1f09b18 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1362 microversion: 2.1 time: 0.156099 Sep 07 10:48:18.384344 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3477/7019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:18 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:18.834776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6adc290b-f019-4236-9b00-ab5e0f3b0f7a req-b93a3232-2611-484b-bde2-c44e4d70c5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af34a843-38e6-47b2-b2b4-d3cada589f1c", "name": "network-vif-plugged", "status": "completed", "tag": "db7dfdc1-972f-4fec-9e24-6ba89d0ef4bc"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:18.846014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6adc290b-f019-4236-9b00-ab5e0f3b0f7a req-b93a3232-2611-484b-bde2-c44e4d70c5bf service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:18.846513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6adc290b-f019-4236-9b00-ab5e0f3b0f7a req-b93a3232-2611-484b-bde2-c44e4d70c5bf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:18.846972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6adc290b-f019-4236-9b00-ab5e0f3b0f7a req-b93a3232-2611-484b-bde2-c44e4d70c5bf service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:18.858969 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6adc290b-f019-4236-9b00-ab5e0f3b0f7a req-b93a3232-2611-484b-bde2-c44e4d70c5bf service nova] Creating event network-vif-plugged:db7dfdc1-972f-4fec-9e24-6ba89d0ef4bc for instance af34a843-38e6-47b2-b2b4-d3cada589f1c on n-h2-836830-16 Sep 07 10:48:18.863913 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6adc290b-f019-4236-9b00-ab5e0f3b0f7a req-b93a3232-2611-484b-bde2-c44e4d70c5bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094270 Sep 07 10:48:18.864494 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3543/7020] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:19.406888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:19.407509 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:19.417411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:19.417896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:19.418331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:19.419417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:19.419872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:19.420299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:19.551964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:19.559830 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-590dc8a5-e6d9-46bf-9eef-84ed3943988c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1362 microversion: 2.1 time: 0.156855 Sep 07 10:48:19.560487 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3478/7021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:19 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:20.584668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:20.585458 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:20.592649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:20.593159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:20.593650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:20.594365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:20.594845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:20.595292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:20.736852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:20.744760 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-77da4ebf-9b8e-4a2f-ab55-642c385d505d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1554 microversion: 2.1 time: 0.165439 Sep 07 10:48:20.745365 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3544/7022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:20 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:20.768417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:20.769038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:20.775927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:20.776424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:20.776869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:20.777597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:20.778057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:20.778489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:20.914754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:20.923274 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-409178cf-39d0-4f19-a168-c48278446cf1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1554 microversion: 2.1 time: 0.158849 Sep 07 10:48:20.923862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3479/7023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:20 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:22.429494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8edbc98a-8e08-442d-b383-399f66d49660"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:22.431942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:22.433969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:22.441227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:22.441969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:22.442430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:22.443138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:22.443611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:22.444055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:22.717323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8fa1693c-28c9-4dbd-a443-bd6709b04ec9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291075 Sep 07 10:48:22.717990 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3545/7024] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:48:22 2022] POST /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:33.461130 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:33.461951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:33.464102 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:33.464778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:33.467221 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:33.467944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:33.476189 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:33.476726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:33.477279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:33.477985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:33.478446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:33.478877 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:33.564325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lazy-loading 'services' on Instance uuid af34a843-38e6-47b2-b2b4-d3cada589f1c {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:48:33.635589 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-436b7c66-debe-4e54-8c8a-f4961defd08c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments/8edbc98a-8e08-442d-b383-399f66d49660" status: 202 len: 0 microversion: 2.1 time: 0.178528 Sep 07 10:48:33.636257 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3480/7025] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:48:33 2022] DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments/8edbc98a-8e08-442d-b383-399f66d49660 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:48:33.645713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:33.648120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:33.651484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:33.652222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:33.659222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:33.659731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:33.660188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:33.660907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:33.661414 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:33.661859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:33.696033 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c1dd451-6c08-4ef8-b7cd-84657df99db3 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054697 Sep 07 10:48:33.696607 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3546/7026] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:33 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:34.710293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:34.712874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:34.719765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:34.720258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:34.720701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:34.721433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:34.721901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:34.722328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:34.754829 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8741fb0b-b13d-4cf9-8fc6-14858aa23b55 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049869 Sep 07 10:48:34.755417 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3481/7027] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:34 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:35.767973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:35.771230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:35.778499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:35.779722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:35.780178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:35.780978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:35.781474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:35.781913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:35.822488 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9715cc82-855b-4b68-813f-c847392e072b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058876 Sep 07 10:48:35.823091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3547/7028] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:35 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:36.835328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:36.837949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:36.845153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:36.845819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:36.846359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:36.847017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:36.847482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:36.847916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:36.879426 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-da53d6ce-135d-450f-848a-bcb0783d219f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048076 Sep 07 10:48:36.879924 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3482/7029] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:36 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:37.892645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:37.895080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:37.902467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:37.903122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:37.903587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:37.904496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:37.905168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:37.905647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:37.936901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-70a7830d-fe0b-455f-89ae-4616a977fe86 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Sep 07 10:48:37.937507 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3548/7030] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:37 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:38.948365 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:38.950626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:38.959385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:38.959873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:38.960315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:38.961009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:38.961761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:38.962192 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:38.993049 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5805da98-87d8-422c-9782-42098f2747d1 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048672 Sep 07 10:48:38.993639 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3483/7031] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:48:38 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:48:39.004435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:39.004991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:39.011909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:39.012408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:39.012866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:39.013609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:39.014594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:39.015037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:39.092949 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] HTTP exception thrown: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c is not attached to volume 8edbc98a-8e08-442d-b383-399f66d49660 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Request method failure captured: Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments/8edbc98a-8e08-442d-b383-399f66d49660 HTTP/1.1 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHa-a8IAl7_gMJ4N-UQbCH1ORRbEEGEHMyqEFl6K2t9hH2KcCSquOL99uvDHR7LA9QMxwOd8ixPFP1xpn89371PmmpTqQu83pUqgaUMvf9IX9pqw9702Wif90USlZcMn69h4p6NDvstaZImkTZctBcO80QcC3wI6PBVrastHNM3NJgs Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81e79e63a9054ad99bd6d0606be77417", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 28a14db16bcd4eceae66b74e8436ed82 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c is not attached to volume 8edbc98a-8e08-442d-b383-399f66d49660 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': 'af34a843-38e6-47b2-b2b4-d3cada589f1c', 'id': '8edbc98a-8e08-442d-b383-399f66d49660'} Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8edbc98a-8e08-442d-b383-399f66d49660. Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c is not attached to volume 8edbc98a-8e08-442d-b383-399f66d49660 Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:39.094640 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c is not attached to volume 8edbc98a-8e08-442d-b383-399f66d49660 Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Returning 404 to user: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c is not attached to volume 8edbc98a-8e08-442d-b383-399f66d49660 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7ebb1e60-2e5c-4582-b16e-5f9bc5606428 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments/8edbc98a-8e08-442d-b383-399f66d49660" status: 404 len: 154 microversion: 2.1 time: 0.095818 Sep 07 10:48:39.099113 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3549/7032] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:48:38 2022] DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c/os-volume_attachments/8edbc98a-8e08-442d-b383-399f66d49660 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 10:48:42.448478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:42.449077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:42.456387 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:42.456888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:42.457373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:42.458090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:42.458560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:42.458995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:42.487847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:48:42.571593 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-94888d8c-fc00-493d-8500-3e709550ff3c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 204 len: 0 microversion: 2.1 time: 0.126873 Sep 07 10:48:42.572428 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3484/7033] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:48:42 2022] DELETE /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:48:42.581447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:42.582096 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:42.590269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:42.590778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:42.591238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:42.591951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:42.593136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:42.593810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:42.734686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:42.742771 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-19b80050-9558-4d5a-9057-b7fc8a3c3950 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1560 microversion: 2.1 time: 0.166094 Sep 07 10:48:42.743280 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3550/7034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:42 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:43.767512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:43.768226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:43.777888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:43.778385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:43.778832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:43.779539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:43.780005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:43.780440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:43.917255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:43.925691 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e036fb96-5250-4b35-858d-856607324381 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1560 microversion: 2.1 time: 0.162751 Sep 07 10:48:43.926268 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3485/7035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:43 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:44.730115 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-1b9d6759-d09c-4881-abdc-59f6e09d9a30 req-b1303551-ae6d-4c98-8830-85ea3da3b96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af34a843-38e6-47b2-b2b4-d3cada589f1c", "name": "network-vif-deleted", "tag": "db7dfdc1-972f-4fec-9e24-6ba89d0ef4bc"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:44.743710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b9d6759-d09c-4881-abdc-59f6e09d9a30 req-b1303551-ae6d-4c98-8830-85ea3da3b96a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:44.744247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b9d6759-d09c-4881-abdc-59f6e09d9a30 req-b1303551-ae6d-4c98-8830-85ea3da3b96a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:44.744699 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-1b9d6759-d09c-4881-abdc-59f6e09d9a30 req-b1303551-ae6d-4c98-8830-85ea3da3b96a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:44.761988 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-1b9d6759-d09c-4881-abdc-59f6e09d9a30 req-b1303551-ae6d-4c98-8830-85ea3da3b96a service nova] Creating event network-vif-deleted:db7dfdc1-972f-4fec-9e24-6ba89d0ef4bc for instance af34a843-38e6-47b2-b2b4-d3cada589f1c on n-h2-836830-16 Sep 07 10:48:44.768582 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-1b9d6759-d09c-4881-abdc-59f6e09d9a30 req-b1303551-ae6d-4c98-8830-85ea3da3b96a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042543 Sep 07 10:48:44.769281 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3551/7036] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:44.947743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:44.948452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:44.956334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:44.956819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:44.957286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:44.957985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:44.958438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:44.958864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:44.990644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:44.991046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:44.991479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:44.991929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lazy-loading 'fault' on Instance uuid af34a843-38e6-47b2-b2b4-d3cada589f1c {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:48:45.033572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:45.041214 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d8327c02-f5d9-4271-9d3a-0a1398d010f5 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 200 len: 1352 microversion: 2.1 time: 0.097327 Sep 07 10:48:45.041779 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3486/7037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:44 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:46.064693 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:46.065465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: af34a843-38e6-47b2-b2b4-d3cada589f1c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:46.072494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:46.072986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:46.073461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:46.074157 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:46.074626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:46.075064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:46.089884 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] HTTP exception thrown: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c could not be found. Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Request method failure captured: Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c HTTP/1.1 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHa-a8IAl7_gMJ4N-UQbCH1ORRbEEGEHMyqEFl6K2t9hH2KcCSquOL99uvDHR7LA9QMxwOd8ixPFP1xpn89371PmmpTqQu83pUqgaUMvf9IX9pqw9702Wif90USlZcMn69h4p6NDvstaZImkTZctBcO80QcC3wI6PBVrastHNM3NJgs Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81e79e63a9054ad99bd6d0606be77417", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 28a14db16bcd4eceae66b74e8436ed82 Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c could not be found. Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'af34a843-38e6-47b2-b2b4-d3cada589f1c'} Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c could not be found. Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c could not be found. Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:48:46.091509 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c could not be found. Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Returning 404 to user: Instance af34a843-38e6-47b2-b2b4-d3cada589f1c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-700ada3d-dab7-4c3b-927c-1c15f79370c9 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c" status: 404 len: 111 microversion: 2.1 time: 0.033348 Sep 07 10:48:46.096156 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3552/7038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:46 2022] GET /compute/v2.1/servers/af34a843-38e6-47b2-b2b4-d3cada589f1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:48:46.101956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c02d75b6-6f46-4730-b2f1-0cd459030a4d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '.version_select at 0x7f14b226e550>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:46.121943 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c02d75b6-6f46-4730-b2f1-0cd459030a4d tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2026681454" status: 202 len: 0 microversion: 2.1 time: 0.023824 Sep 07 10:48:46.122509 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3487/7039] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 7 10:48:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2026681454 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:48:46.141046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f69da77b-5cb4-4ac6-9b16-32ddef7c92ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: .version_select at 0x7f14b5d95040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1975834045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPj00vLqivzz+AAefR++Addkquy2gYDqehrpfW60T702iNXupBJSFaVrAfxRq6Y22e5WCWeT++qTlZvvVbDjXD/4tTIK7uSH4tP3gvmxkO2UgFK+srNsV5NICIvFjIIsw=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:46.157424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f69da77b-5cb4-4ac6-9b16-32ddef7c92ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for project 81e79e63a9054ad99bd6d0606be77417. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:48:46.162571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-f69da77b-5cb4-4ac6-9b16-32ddef7c92ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for user 28a14db16bcd4eceae66b74e8436ed82 and project 81e79e63a9054ad99bd6d0606be77417. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:48:46.186415 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f69da77b-5cb4-4ac6-9b16-32ddef7c92ea tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049795 Sep 07 10:48:46.187010 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3553/7040] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:48:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:46.238359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-293330009", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1975834045", "networks": [{"uuid": "37f60241-7e66-4aea-b1af-d5df00d7c6ea"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:46.291995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] validate_networks() for [('37f60241-7e66-4aea-b1af-d5df00d7c6ea', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:48:47.004922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:48:47.005386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:48:47.005863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:48:47.006508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:48:47.007042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:48:47.016548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:47.017138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:47.017636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:47.018376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:47.018845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:47.019283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:47.038213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for project 81e79e63a9054ad99bd6d0606be77417. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:48:47.043630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Getting quotas for user 28a14db16bcd4eceae66b74e8436ed82 and project 81e79e63a9054ad99bd6d0606be77417. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:48:47.057230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:48:47.059525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:48:47.109493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b2525086-9c63-4721-b169-cd0d97945fcd tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875094 Sep 07 10:48:47.110932 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3488/7041] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:48:47.121592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ad84eb12-c59f-46e9-86ab-9f305acf2c4b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:47.122236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ad84eb12-c59f-46e9-86ab-9f305acf2c4b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:47.181653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ad84eb12-c59f-46e9-86ab-9f305acf2c4b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:47.189223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ad84eb12-c59f-46e9-86ab-9f305acf2c4b tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1262 microversion: 2.1 time: 0.071704 Sep 07 10:48:47.189798 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3554/7042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:47 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:48.212493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:48.213166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:48.221157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:48.221768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:48.222309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:48.223058 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:48.223585 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:48.224008 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:48.323492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:48.333040 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ea7cffc6-fc7f-4cb4-9d99-c54f27d9d9f7 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1322 microversion: 2.1 time: 0.124901 Sep 07 10:48:48.334451 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3489/7043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:48 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1322 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:49.357057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:49.358392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:49.365544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:49.366055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:49.366514 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:49.367236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:49.367714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:49.368162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:49.593712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:49.601853 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0a1ad263-d260-477b-beba-ac8a4d511cc2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1362 microversion: 2.1 time: 0.248787 Sep 07 10:48:49.602430 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3555/7044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:49 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:49.731504 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-a4b0c79e-ef14-4b8c-8946-243b638542e3 req-1b492243-eb97-466a-95d7-60ab4bae3c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917d710a-71ba-451e-8646-f635eed009ad", "tag": "358f0486-5d36-4dd0-8548-4cdad8cc90a8"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:49.745550 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a4b0c79e-ef14-4b8c-8946-243b638542e3 req-1b492243-eb97-466a-95d7-60ab4bae3c17 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:49.746036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a4b0c79e-ef14-4b8c-8946-243b638542e3 req-1b492243-eb97-466a-95d7-60ab4bae3c17 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:49.746536 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-a4b0c79e-ef14-4b8c-8946-243b638542e3 req-1b492243-eb97-466a-95d7-60ab4bae3c17 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:49.759217 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-a4b0c79e-ef14-4b8c-8946-243b638542e3 req-1b492243-eb97-466a-95d7-60ab4bae3c17 service nova] Creating event network-changed:358f0486-5d36-4dd0-8548-4cdad8cc90a8 for instance 917d710a-71ba-451e-8646-f635eed009ad on n-h2-836830-16 Sep 07 10:48:49.764939 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-a4b0c79e-ef14-4b8c-8946-243b638542e3 req-1b492243-eb97-466a-95d7-60ab4bae3c17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037185 Sep 07 10:48:49.765591 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3490/7045] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:50.626233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:50.626875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:50.634647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:50.635149 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:50.635604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:50.636313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:50.636784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:50.637254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:50.769610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:50.777269 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b59bfad4-205b-4ce8-be19-926e802bf9e8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1362 microversion: 2.1 time: 0.154895 Sep 07 10:48:50.777779 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3556/7046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:50 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:51.801738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:51.802644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:51.810296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:51.811636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:51.812315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:51.813149 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:51.813761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:51.814323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:51.948284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:51.956184 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e6cdff79-3c01-416e-81dc-888c5e997d59 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1362 microversion: 2.1 time: 0.159061 Sep 07 10:48:51.956767 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3491/7047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:51 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:52.979555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:52.980184 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:52.989034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:52.989798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:52.990499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:52.991371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:52.992122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:52.992706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:53.148368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:53.156674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-10052c01-ed9a-40ec-bcc8-b82398e4261c tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1362 microversion: 2.1 time: 0.181112 Sep 07 10:48:53.157270 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3557/7048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:52 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:54.180057 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:54.181423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:54.189782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:54.190281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:54.190721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:54.191458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:54.191914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:54.192345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:54.337200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:54.346499 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7601cb65-bbc8-4998-bd5e-ed62069a823f tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1362 microversion: 2.1 time: 0.170352 Sep 07 10:48:54.347102 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3492/7049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:54 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:54.986610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d517a36e-9cb8-4db6-a775-7002ea7796e7 req-1c84957d-32ca-49dd-81ad-04cfd60f1de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917d710a-71ba-451e-8646-f635eed009ad", "name": "network-vif-plugged", "status": "completed", "tag": "358f0486-5d36-4dd0-8548-4cdad8cc90a8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:54.997570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d517a36e-9cb8-4db6-a775-7002ea7796e7 req-1c84957d-32ca-49dd-81ad-04cfd60f1de1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:54.998825 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d517a36e-9cb8-4db6-a775-7002ea7796e7 req-1c84957d-32ca-49dd-81ad-04cfd60f1de1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:54.999332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d517a36e-9cb8-4db6-a775-7002ea7796e7 req-1c84957d-32ca-49dd-81ad-04cfd60f1de1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:55.011621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d517a36e-9cb8-4db6-a775-7002ea7796e7 req-1c84957d-32ca-49dd-81ad-04cfd60f1de1 service nova] Creating event network-vif-plugged:358f0486-5d36-4dd0-8548-4cdad8cc90a8 for instance 917d710a-71ba-451e-8646-f635eed009ad on n-h2-836830-16 Sep 07 10:48:55.017485 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d517a36e-9cb8-4db6-a775-7002ea7796e7 req-1c84957d-32ca-49dd-81ad-04cfd60f1de1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Sep 07 10:48:55.018094 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3558/7050] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:48:55.369420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:55.370043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:55.377702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:55.378194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:55.378635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:55.379334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:55.379797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:55.380232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:55.519778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:55.527554 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-23df0b8c-031f-4667-94ce-ea96f61b8a04 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1362 microversion: 2.1 time: 0.162218 Sep 07 10:48:55.528125 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3493/7051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:55 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:56.550911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:56.551641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:56.559639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:56.560134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:56.561120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:56.561963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:56.562532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:56.562972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:56.714391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:56.722464 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-00eca045-6a03-4773-b74e-b921a5e42367 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1555 microversion: 2.1 time: 0.175817 Sep 07 10:48:56.723035 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3559/7052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:56 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:56.746840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:48:56.747477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:56.754950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:56.755416 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:56.755850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:56.756540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:56.756991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:56.757457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:56.920592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:48:56.929840 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e0831e00-955a-47c4-8aa7-4edcbc6ffe87 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1555 microversion: 2.1 time: 0.186807 Sep 07 10:48:56.932288 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3494/7053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:48:56 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:48:58.476083 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7945a37-1140-42b3-9dd1-1399812a5949"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:48:58.478498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:48:58.480493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:48:58.488357 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:58.488859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:58.489354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:58.490069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:48:58.490544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:48:58.490989 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:48:58.763456 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5b27c795-7b06-4cc6-b41e-ac92b5e45f81 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "POST /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291240 Sep 07 10:48:58.764371 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3560/7054] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:48:58 2022] POST /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:09.483141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:09.483695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:09.486442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:09.487119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:09.487949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:09.488656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:09.495481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:09.495965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:09.496399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:09.497089 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:09.497570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:09.497996 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:09.583087 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lazy-loading 'services' on Instance uuid 917d710a-71ba-451e-8646-f635eed009ad {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:49:09.655982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-78377329-a822-4b34-a121-176a649e5d35 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments/c7945a37-1140-42b3-9dd1-1399812a5949" status: 202 len: 0 microversion: 2.1 time: 0.176186 Sep 07 10:49:09.656600 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3495/7055] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:49:09 2022] DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments/c7945a37-1140-42b3-9dd1-1399812a5949 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:49:09.663257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:09.664269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:09.668714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:09.671673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:09.680858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:09.681422 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:09.681875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:09.682595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:09.683060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:09.683498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:09.715412 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bebf71b8-efde-489d-b9e2-bb114f4210b2 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054120 Sep 07 10:49:09.716068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3561/7056] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:49:09 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:10.732878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:10.735951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:10.742440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:10.742938 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:10.743384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:10.744092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:10.744557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:10.744991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:10.779196 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b11a1493-ad3e-494f-8e85-0d4508833936 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051609 Sep 07 10:49:10.784289 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3496/7057] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:49:10 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:11.792434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:11.794670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:11.803396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:11.806496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:11.806496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:11.806496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:11.807221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:11.807994 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:11.846581 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8df17439-79ff-4aa1-b70d-3adde4980449 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058246 Sep 07 10:49:11.847171 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3562/7058] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:49:11 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:12.859127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:12.861549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:12.868501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:12.868993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:12.869472 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:12.870178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:12.870640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:12.871069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:12.903428 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-136ace0d-f1b9-4f68-a7a8-457e886e1415 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048442 Sep 07 10:49:12.903998 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3497/7059] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:49:12 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:13.916175 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:13.918472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:13.925498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:13.926003 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:13.926464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:13.927180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:13.927656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:13.928099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:13.960075 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54a765c6-bf3a-44e5-afa3-632ff70e0132 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047970 Sep 07 10:49:13.960654 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3563/7060] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:49:13 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:14.972598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:14.974889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:14.981697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:14.982182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:14.982631 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:14.983863 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:14.984285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:14.984714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:15.016899 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c0b7dbb-876a-46fe-8754-518c8e93a894 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048281 Sep 07 10:49:15.017508 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3498/7061] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:49:14 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 10:49:15.028151 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:15.028668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:15.035703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:15.036199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:15.036655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:15.037393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:15.037870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:15.038315 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:15.116386 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] HTTP exception thrown: Instance 917d710a-71ba-451e-8646-f635eed009ad is not attached to volume c7945a37-1140-42b3-9dd1-1399812a5949 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Request method failure captured: Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments/c7945a37-1140-42b3-9dd1-1399812a5949 HTTP/1.1 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHa-a8IAl7_gMJ4N-UQbCH1ORRbEEGEHMyqEFl6K2t9hH2KcCSquOL99uvDHR7LA9QMxwOd8ixPFP1xpn89371PmmpTqQu83pUqgaUMvf9IX9pqw9702Wif90USlZcMn69h4p6NDvstaZImkTZctBcO80QcC3wI6PBVrastHNM3NJgs Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81e79e63a9054ad99bd6d0606be77417", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 28a14db16bcd4eceae66b74e8436ed82 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 917d710a-71ba-451e-8646-f635eed009ad is not attached to volume c7945a37-1140-42b3-9dd1-1399812a5949 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': '917d710a-71ba-451e-8646-f635eed009ad', 'id': 'c7945a37-1140-42b3-9dd1-1399812a5949'} Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c7945a37-1140-42b3-9dd1-1399812a5949. Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917d710a-71ba-451e-8646-f635eed009ad is not attached to volume c7945a37-1140-42b3-9dd1-1399812a5949 Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:49:15.118059 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917d710a-71ba-451e-8646-f635eed009ad is not attached to volume c7945a37-1140-42b3-9dd1-1399812a5949 Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Returning 404 to user: Instance 917d710a-71ba-451e-8646-f635eed009ad is not attached to volume c7945a37-1140-42b3-9dd1-1399812a5949 {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac916dbf-91f7-4bc8-8c57-47fe91e97e9a tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments/c7945a37-1140-42b3-9dd1-1399812a5949" status: 404 len: 154 microversion: 2.1 time: 0.095405 Sep 07 10:49:15.122842 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3564/7062] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:49:15 2022] DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad/os-volume_attachments/c7945a37-1140-42b3-9dd1-1399812a5949 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:49:18.466474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:18.466974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:18.474776 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:18.475271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:18.475715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:18.476431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:18.476896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:18.477482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:18.506276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:49:18.589111 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f146f36-737e-4754-b8f8-12dcea9356dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 204 len: 0 microversion: 2.1 time: 0.126189 Sep 07 10:49:18.592993 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3499/7063] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:49:18 2022] DELETE /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:49:18.598611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:18.599171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:18.611860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:18.612393 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:18.612850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:18.613601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:18.614076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:18.614522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:18.751695 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:18.762136 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f0c9c614-1892-407a-8a4e-ddd302a94eec tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1561 microversion: 2.1 time: 0.167732 Sep 07 10:49:18.762708 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3565/7064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:18 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:19.787051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:19.787769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:19.794786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:19.795924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:19.796379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:19.797082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:19.797576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:19.798011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:19.932839 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:19.941391 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05aff47c-1284-4640-99ba-09089ec637dc tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1561 microversion: 2.1 time: 0.158690 Sep 07 10:49:19.941976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3500/7065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:19 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:20.814719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0f82b400-d8a6-43b5-97bd-0a25a063a16d req-852fda1e-23a9-466e-820b-30c76cbaf492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917d710a-71ba-451e-8646-f635eed009ad", "name": "network-vif-deleted", "tag": "358f0486-5d36-4dd0-8548-4cdad8cc90a8"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:49:20.830293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f82b400-d8a6-43b5-97bd-0a25a063a16d req-852fda1e-23a9-466e-820b-30c76cbaf492 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:20.830793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f82b400-d8a6-43b5-97bd-0a25a063a16d req-852fda1e-23a9-466e-820b-30c76cbaf492 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:20.831245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0f82b400-d8a6-43b5-97bd-0a25a063a16d req-852fda1e-23a9-466e-820b-30c76cbaf492 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:20.850634 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0f82b400-d8a6-43b5-97bd-0a25a063a16d req-852fda1e-23a9-466e-820b-30c76cbaf492 service nova] Creating event network-vif-deleted:358f0486-5d36-4dd0-8548-4cdad8cc90a8 for instance 917d710a-71ba-451e-8646-f635eed009ad on n-h2-836830-16 Sep 07 10:49:20.856518 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0f82b400-d8a6-43b5-97bd-0a25a063a16d req-852fda1e-23a9-466e-820b-30c76cbaf492 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046053 Sep 07 10:49:20.857156 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3566/7066] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:20.964403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:20.965049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:20.973668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:20.974167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:20.974700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:20.975450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:20.976101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:20.976546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:21.010232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:21.010727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:21.011169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:21.011624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lazy-loading 'fault' on Instance uuid 917d710a-71ba-451e-8646-f635eed009ad {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:49:21.054304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a14db16bcd4eceae66b74e8436ed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e79e63a9054ad99bd6d0606be77417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:21.062311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-71d544c2-78e4-4847-97fd-4cc5d36118a8 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 200 len: 1352 microversion: 2.1 time: 0.102326 Sep 07 10:49:21.062888 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3501/7067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:20 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:22.086906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:22.087640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] [instance: 917d710a-71ba-451e-8646-f635eed009ad] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:22.095518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:22.096040 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:22.096496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:22.097231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:22.097714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:22.098162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:22.112320 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] HTTP exception thrown: Instance 917d710a-71ba-451e-8646-f635eed009ad could not be found. Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Request method failure captured: Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad HTTP/1.1 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHa-a8IAl7_gMJ4N-UQbCH1ORRbEEGEHMyqEFl6K2t9hH2KcCSquOL99uvDHR7LA9QMxwOd8ixPFP1xpn89371PmmpTqQu83pUqgaUMvf9IX9pqw9702Wif90USlZcMn69h4p6NDvstaZImkTZctBcO80QcC3wI6PBVrastHNM3NJgs Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81e79e63a9054ad99bd6d0606be77417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81e79e63a9054ad99bd6d0606be77417", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 81e79e63a9054ad99bd6d0606be77417 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-185585406 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 28a14db16bcd4eceae66b74e8436ed82 Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestEncryptedCinderVolumes-185585406-project Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 917d710a-71ba-451e-8646-f635eed009ad could not be found. Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '917d710a-71ba-451e-8646-f635eed009ad'} Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917d710a-71ba-451e-8646-f635eed009ad could not be found. Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917d710a-71ba-451e-8646-f635eed009ad could not be found. Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:49:22.113992 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917d710a-71ba-451e-8646-f635eed009ad could not be found. Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Returning 404 to user: Instance 917d710a-71ba-451e-8646-f635eed009ad could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fd23dc6b-71ff-4a5d-a64a-65817524be19 tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad" status: 404 len: 111 microversion: 2.1 time: 0.033145 Sep 07 10:49:22.118730 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3567/7068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:22 2022] GET /compute/v2.1/servers/917d710a-71ba-451e-8646-f635eed009ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:49:22.124281 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05500790-2b20-42ec-94a6-bbb907b73aee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] Calling method '.version_select at 0x7f14b1b54940>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:22.144602 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05500790-2b20-42ec-94a6-bbb907b73aee tempest-TestEncryptedCinderVolumes-185585406 tempest-TestEncryptedCinderVolumes-185585406-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1975834045" status: 202 len: 0 microversion: 2.1 time: 0.024069 Sep 07 10:49:22.145109 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3502/7069] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 7 10:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1975834045 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:49:49.265671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-79c2e67d-38f9-439f-ac9d-bb7b9a1e9acb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'create', calling method: .version_select at 0x7f14b0b1f4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-516913307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCJCnTOi+5s3/+6g9/YYtzXCw+GEaBkjS8QPnmflWhX5tkO+p/z3n7gE9Al6oGPGxOVAbDq090CHrXJkhrDq77QEamyF5G9iM9KpNR6wvEQQHl6xhzou28r11Z+K27NSA=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:49:49.271652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:49.272503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=34 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:49.284402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-79c2e67d-38f9-439f-ac9d-bb7b9a1e9acb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:49:49.289676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-79c2e67d-38f9-439f-ac9d-bb7b9a1e9acb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for user 06be9a743fff4ba6ac1d91d5d0435d3a and project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:49:49.314607 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-79c2e67d-38f9-439f-ac9d-bb7b9a1e9acb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053254 Sep 07 10:49:49.315218 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3568/7070] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:49:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:49:49.366612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:49.367380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:49:49.371576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2115579849", "imageRef": "f76a2943-ee93-4fd8-807d-7496102e00da", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-516913307", "networks": [{"uuid": "a9a33345-99e5-4b5b-864f-64276f6ce160"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:49:49.428896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] validate_networks() for [('a9a33345-99e5-4b5b-864f-64276f6ce160', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:49:49.809207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:49:49.809651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:49:49.810633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:49:49.811626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:49:49.812053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:49:49.820982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:49.821525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:49.821962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:49.822696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:49.823157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:49.823595 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:49.842891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:49:49.848185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for user 06be9a743fff4ba6ac1d91d5d0435d3a and project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:49:49.861146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:49:49.863467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f76a2943-ee93-4fd8-807d-7496102e00da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:49:49.911036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1945da7b-39f0-410d-8394-5488b2b8e68f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546573 Sep 07 10:49:49.911915 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3503/7071] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:49:49.924501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5fa58e08-d8a4-4345-a4b5-7d24203bef68 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:49.925305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5fa58e08-d8a4-4345-a4b5-7d24203bef68 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:49.983391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5fa58e08-d8a4-4345-a4b5-7d24203bef68 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:49.990694 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5fa58e08-d8a4-4345-a4b5-7d24203bef68 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1258 microversion: 2.1 time: 0.071606 Sep 07 10:49:49.991163 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3569/7072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:49 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:51.016549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:51.017377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:51.032005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:51.032646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:51.033165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:51.034017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:51.034481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:51.034908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:51.111394 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:51.120980 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0fff111-05eb-4d55-ab1d-336f89adb9be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1318 microversion: 2.1 time: 0.110453 Sep 07 10:49:51.122720 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3504/7073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:51 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:49:52.145944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:52.146894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:52.159192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:52.160051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:52.161008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:52.163466 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:52.164309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:52.165193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:52.332278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:52.341506 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d4df562d-6811-45bf-ac42-750fc62c5877 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.199415 Sep 07 10:49:52.342504 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3570/7074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:52 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:53.365974 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:53.367219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:53.375216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:53.375935 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:53.376531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:53.377424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:53.378055 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:53.378636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:53.544799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:53.554890 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-68467d43-cde3-45bb-bd13-6ba05be8f256 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.192806 Sep 07 10:49:53.556728 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3505/7075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:53 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:54.581946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:54.582581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:54.589875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:54.590378 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:54.590838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:54.591548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:54.592023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:54.593034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:54.755895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:54.763906 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f363663b-a9fc-4be5-b9d0-9d0255297dc7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.186695 Sep 07 10:49:54.764619 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3571/7076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:54 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:55.789746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:55.790590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:55.799477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:55.800133 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:55.800679 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:55.801517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:55.802107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:55.802654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:55.949170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:55.957879 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-caf89b6f-9f92-4d0d-be63-8354d37250a4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.173949 Sep 07 10:49:55.958489 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3506/7077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:55 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:56.986397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:56.987148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:56.995219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:56.995726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:56.996379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:56.996958 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:56.997470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:56.997922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:57.177227 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:57.184333 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa95836c-bd3a-483c-a9e8-c07ee36c9b01 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.204209 Sep 07 10:49:57.185272 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3572/7078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:56 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:58.212184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:58.212830 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:58.220423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:58.220912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:58.221385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:58.222090 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:58.222547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:58.222976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:58.370582 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:58.380441 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b07590dc-8ded-4dc7-ac4f-624375dd96c1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.172099 Sep 07 10:49:58.381130 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3507/7079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:58 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:49:59.404605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:49:59.406212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:49:59.414299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:59.415353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:59.415353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:59.416007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:49:59.416483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:49:59.416930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:49:59.950310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:49:59.958037 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b6cc7be5-9889-4fb6-bbe8-646d4a012b08 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.557910 Sep 07 10:49:59.958608 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3573/7080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:49:59 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:00.275672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3b8d2843-3423-4648-9ef6-e81193f96258 req-8d2f7768-9179-49a7-8151-aacd55c78d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:50:00.284323 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:00.284986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:00.289975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b8d2843-3423-4648-9ef6-e81193f96258 req-8d2f7768-9179-49a7-8151-aacd55c78d4c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:00.290468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b8d2843-3423-4648-9ef6-e81193f96258 req-8d2f7768-9179-49a7-8151-aacd55c78d4c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:00.290909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3b8d2843-3423-4648-9ef6-e81193f96258 req-8d2f7768-9179-49a7-8151-aacd55c78d4c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:00.304225 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3b8d2843-3423-4648-9ef6-e81193f96258 req-8d2f7768-9179-49a7-8151-aacd55c78d4c service nova] Creating event network-changed:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:50:00.309553 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3b8d2843-3423-4648-9ef6-e81193f96258 req-8d2f7768-9179-49a7-8151-aacd55c78d4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037860 Sep 07 10:50:00.310537 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3508/7081] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:50:00.982657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:00.983346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:00.985289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:00.991964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:00.992457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:00.992906 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:00.993628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:00.994092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:00.994529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:01.123298 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:01.131445 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d27a5fc5-a986-47f7-a979-af20636e0a34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.152805 Sep 07 10:50:01.132013 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3574/7082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:00 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:50:02.158625 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:02.159358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:02.170623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:02.171169 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:02.171660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:02.172381 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:02.172949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:02.173420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:02.399033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:02.408954 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-04ddd421-915f-4c60-867b-2a35c5293162 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.258019 Sep 07 10:50:02.421455 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3509/7083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:02 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:03.431995 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:03.432629 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:03.439791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:03.440287 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:03.440741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:03.441476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:03.441953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:03.442395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:03.578981 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:03.586895 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5d7db8ab-c968-48c2-bee7-3a285feeb242 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.158708 Sep 07 10:50:03.587487 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3575/7084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:03 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:04.398902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2693f299-f35e-4424-809e-96249b336712 req-3fe53d6d-9248-46cc-afa9-9a540116026b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "name": "network-vif-plugged", "status": "completed", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:50:04.412843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2693f299-f35e-4424-809e-96249b336712 req-3fe53d6d-9248-46cc-afa9-9a540116026b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:04.413370 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2693f299-f35e-4424-809e-96249b336712 req-3fe53d6d-9248-46cc-afa9-9a540116026b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:04.413817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2693f299-f35e-4424-809e-96249b336712 req-3fe53d6d-9248-46cc-afa9-9a540116026b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:04.426872 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2693f299-f35e-4424-809e-96249b336712 req-3fe53d6d-9248-46cc-afa9-9a540116026b service nova] Creating event network-vif-plugged:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:50:04.432088 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2693f299-f35e-4424-809e-96249b336712 req-3fe53d6d-9248-46cc-afa9-9a540116026b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037145 Sep 07 10:50:04.432882 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3510/7085] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:50:04.610761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:04.611404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:04.617806 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:04.618306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:04.618763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:04.619473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:04.620039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:04.620490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:04.754567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:04.762301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b379d374-4c92-4c7a-8111-b3d6b291d872 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.156173 Sep 07 10:50:04.762877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3576/7086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:04 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:50:05.787032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:05.787895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:05.794868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:05.796010 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:05.796765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:05.797514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:05.798114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:05.798551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:05.938628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:05.946567 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d7fd0b1a-79e2-446d-bd5a-562742ce7d3c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1358 microversion: 2.1 time: 0.164026 Sep 07 10:50:05.947155 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3511/7087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:05 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:06.971196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:06.971830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:06.978766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:06.979268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:06.979722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:06.980427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:06.980900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:06.981371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.120408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:07.128497 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e6ed40eb-1301-4a44-a5d0-a37dd89bfb42 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1549 microversion: 2.1 time: 0.162110 Sep 07 10:50:07.129086 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3577/7088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:06 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:07.150616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:07.151237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:07.158749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:07.159234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:07.159674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.160366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:07.160827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:07.161284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.295546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:07.304150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-785671ad-dfc7-4326-b30c-cf93d189f229 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1549 microversion: 2.1 time: 0.157372 Sep 07 10:50:07.304709 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3512/7089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:07 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:07.327107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:07.332214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:07.333008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Searching by: {'deleted': False, 'project_id': '16c32a3b7223435b8fe8375e88caaf96'} {{(pid=128832) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:50:07.338692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:07.339188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:07.339640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.340377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:07.340841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:07.341307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.366368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.multi_cell_list [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:50:07.393374 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a6f7efdb-15c6-43e1-a2fd-6d6c67eec8f4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070814 Sep 07 10:50:07.393887 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3578/7090] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:50:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:50:07.406635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:07.407268 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:07.414002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:07.414131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:07.414561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.415266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:07.415730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:07.416165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:07.552363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:07.560319 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bdd05c40-82a4-41f8-8742-9d8e4303ddf7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1549 microversion: 2.1 time: 0.158207 Sep 07 10:50:07.560908 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3513/7091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:07 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:09.125875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61e24177-5c28-4ece-8944-ceff55fb487c"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:50:09.128290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:09.135164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:09.135655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:09.136103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:09.136807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:09.137301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:09.137738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:09.386971 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d251b9d4-0a4f-486c-9882-24293f7e3826 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265610 Sep 07 10:50:09.387678 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3579/7092] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:50:09 2022] POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:50:22.440453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:22.441078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:22.444623 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:22.445484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=54 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:22.453559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:22.454065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:22.454512 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:22.455219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:22.455681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:22.456114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:22.590632 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:22.599728 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a0b94f41-e2eb-4bb8-bc20-f927a1fca252 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1595 microversion: 2.1 time: 0.163335 Sep 07 10:50:22.600316 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3514/7093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:22 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:50:24.697815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:24.699313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:24.700136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:50:24.777547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-559082d2-5592-49f2-8404-a3c1209ec307 req-32b1d7dd-14eb-4570-a28d-8d70ab94dd51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:50:24.789611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-559082d2-5592-49f2-8404-a3c1209ec307 req-32b1d7dd-14eb-4570-a28d-8d70ab94dd51 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:24.790364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-559082d2-5592-49f2-8404-a3c1209ec307 req-32b1d7dd-14eb-4570-a28d-8d70ab94dd51 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:24.791008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-559082d2-5592-49f2-8404-a3c1209ec307 req-32b1d7dd-14eb-4570-a28d-8d70ab94dd51 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:24.803910 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-559082d2-5592-49f2-8404-a3c1209ec307 req-32b1d7dd-14eb-4570-a28d-8d70ab94dd51 service nova] Creating event network-changed:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:50:24.809953 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-559082d2-5592-49f2-8404-a3c1209ec307 req-32b1d7dd-14eb-4570-a28d-8d70ab94dd51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114991 Sep 07 10:50:24.810568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3580/7094] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:50:25.619717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-774714170"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:50:25.620423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:25.627754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:25.628239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:25.628681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:25.629413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:25.629870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:25.630317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:25.770126 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.network.security_group_api [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Adding security group 68076adc-fccd-4755-87d8-9194d8dc4892 to port 1c6065de-552d-4b96-bcfd-d5f388115378 Sep 07 10:50:26.106205 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-729ff3ac-d3ae-4d1e-8602-50c5a8980231 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action" status: 202 len: 0 microversion: 2.1 time: 0.490503 Sep 07 10:50:26.110858 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3515/7095] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:50:25 2022] POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:50:26.122272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-dd9aa572-f898-4faf-a333-ee16848e30c5 req-a5fa7cf1-c474-41cd-afba-0ce3b4479f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:50:26.128047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:50:26.128855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:50:26.137258 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dd9aa572-f898-4faf-a333-ee16848e30c5 req-a5fa7cf1-c474-41cd-afba-0ce3b4479f04 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:26.137998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dd9aa572-f898-4faf-a333-ee16848e30c5 req-a5fa7cf1-c474-41cd-afba-0ce3b4479f04 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:26.138438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dd9aa572-f898-4faf-a333-ee16848e30c5 req-a5fa7cf1-c474-41cd-afba-0ce3b4479f04 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:26.139235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:26.139776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:26.140300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:26.140997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:50:26.141562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:50:26.142013 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:50:26.157989 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-dd9aa572-f898-4faf-a333-ee16848e30c5 req-a5fa7cf1-c474-41cd-afba-0ce3b4479f04 service nova] Creating event network-changed:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:50:26.163557 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-dd9aa572-f898-4faf-a333-ee16848e30c5 req-a5fa7cf1-c474-41cd-afba-0ce3b4479f04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044857 Sep 07 10:50:26.164424 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3516/7096] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:50:26.407856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:50:26.417305 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8ca6b8f-df6d-41da-bb62-f9733c493a5a tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1759 microversion: 2.1 time: 0.304607 Sep 07 10:50:26.417986 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3581/7097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:50:26 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1759 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:52:10.886347 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 10:52:10.887384 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 10:52:10.887944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:52:10.888712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:52:10.889630 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:52:10.889771 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 10:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action (ip 10.222.0.60) !!! Sep 07 10:52:10.897315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:52:10.899659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:52:10.908092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:52:10.908576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:52:10.909009 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:52:10.909721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:52:10.910171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:52:10.910594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:52:10.982486 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9986e400-4e1b-4c19-a4fa-040a46edd153 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action" status: 202 len: 0 microversion: 2.1 time: 0.098074 Sep 07 10:52:10.983121 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3517/7098] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:52:10 2022] POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:52:10.989605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:52:10.990492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:52:10.992183 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:52:10.992338 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 (ip 10.222.0.60) !!! Sep 07 10:52:10.997134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:52:10.997847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:52:11.006735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:52:11.007444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:52:11.007886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:52:11.008644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:52:11.009118 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:52:11.009582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:52:11.259646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:52:11.268232 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a1f519a-7621-40fa-ad35-422b53f438d4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1761 microversion: 2.1 time: 0.280618 Sep 07 10:52:11.269063 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3582/7099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:52:10 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1761 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:52:12.297806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:52:12.298645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:52:12.312432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:52:12.312927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:52:12.313433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:52:12.314105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:52:12.314557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:52:12.314982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:52:12.320916 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 35128. Sep 07 10:52:12.321734 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 35130. Sep 07 10:52:12.474873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:52:12.483875 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1783d3c5-d8a0-4f0b-9588-6f34ef164f8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1759 microversion: 2.1 time: 0.195565 Sep 07 10:52:12.484451 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3518/7100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:52:12 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:53:33.334388 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 10:53:33.335224 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 10:53:33.335721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:53:33.336493 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:53:33.341130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-774714170"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:53:33.341804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:33.348753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:33.349323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:33.349781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:33.350489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:33.350967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:33.351409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:33.580304 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Removing security group 68076adc-fccd-4755-87d8-9194d8dc4892 from port 1c6065de-552d-4b96-bcfd-d5f388115378 Sep 07 10:53:33.888541 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5069978a-ef52-4a24-a3b0-b939c05ce016 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action" status: 202 len: 0 microversion: 2.1 time: 0.556026 Sep 07 10:53:33.889598 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3583/7101] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:53:33 2022] POST /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:53:33.900862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:53:33.901689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:53:34.037449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-1aaca3a2-e177-4735-9fed-3b8e75071731 req-aaf4f732-62b4-40e8-8f75-246f4c73248c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:53:34.048508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1aaca3a2-e177-4735-9fed-3b8e75071731 req-aaf4f732-62b4-40e8-8f75-246f4c73248c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:34.049278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1aaca3a2-e177-4735-9fed-3b8e75071731 req-aaf4f732-62b4-40e8-8f75-246f4c73248c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:34.049884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-1aaca3a2-e177-4735-9fed-3b8e75071731 req-aaf4f732-62b4-40e8-8f75-246f4c73248c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:34.063546 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-1aaca3a2-e177-4735-9fed-3b8e75071731 req-aaf4f732-62b4-40e8-8f75-246f4c73248c service nova] Creating event network-changed:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:53:34.069657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-1aaca3a2-e177-4735-9fed-3b8e75071731 req-aaf4f732-62b4-40e8-8f75-246f4c73248c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175204 Sep 07 10:53:34.071084 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3519/7102] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:35.075547 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 35188. Sep 07 10:53:35.081436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:53:35.095036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:35.095731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:35.096181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:35.104247 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 35190. Sep 07 10:53:35.113489 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] Creating event network-changed:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:53:35.117009 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] [a9d71291-042a-4de6-a592-54641b21570f] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 10:53:35.118178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:35.118809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:35.127277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:35.127768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:35.128215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:35.128922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:35.129415 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:35.129850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:35.315013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lazy-loading 'services' on Instance uuid 6c7955ef-fda9-4424-b30c-15442f7dee63 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:53:35.387701 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4ad99f47-7ae5-4997-8305-eacb8f626978 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments/61e24177-5c28-4ece-8944-ceff55fb487c" status: 202 len: 0 microversion: 2.1 time: 0.274449 Sep 07 10:53:35.388415 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3520/7103] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:53:35 2022] DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments/61e24177-5c28-4ece-8944-ceff55fb487c => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:53:35.397607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:35.400470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:35.407167 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:35.407747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:35.408312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:35.409174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:35.409820 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:35.410450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:35.447700 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-83a81f4a-5651-49bf-bd39-bc3409648eb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054481 Sep 07 10:53:35.448501 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3521/7104] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:53:35 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:53:36.125543 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] [a9d71291-042a-4de6-a592-54641b21570f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 35206. Sep 07 10:53:36.129379 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ee0e6c7c-708e-4ed4-b5dc-2210037d78ce req-d17c6b85-5f4a-47a6-b6cb-100a44f8d471 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.064337 Sep 07 10:53:36.130024 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3584/7105] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:36.461371 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:36.464126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:36.471759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:36.472630 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:36.473274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:36.474161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:36.474786 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:36.475388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:36.509007 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dbb7c994-a104-4a82-ba23-b30f8dcf54f2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051909 Sep 07 10:53:36.509632 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3522/7106] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:53:36 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:37.523900 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:37.526390 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:37.534109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:37.534610 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:37.535064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:37.535777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:37.536250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:37.536688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:37.569283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ac234062-417c-4bd5-a29a-53c297cbb54f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050663 Sep 07 10:53:37.569886 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3585/7107] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:53:37 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:38.582806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:38.585054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:38.592193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:38.592764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:38.593222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:38.593924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:38.594374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:38.594794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:38.625516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-473700d7-1506-41be-8cbf-97cfb872c6ea tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Sep 07 10:53:38.626002 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3523/7108] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:53:38 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:39.638221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:39.640983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:39.647969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:39.648473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:39.648932 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:39.649678 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:39.650154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:39.650600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:39.680969 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2c26d20b-0ada-4716-b956-47f50a709968 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046981 Sep 07 10:53:39.681564 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3586/7109] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:53:39 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:40.693688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:40.695870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:40.702904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:40.703389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:40.703831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:40.704525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:40.704981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:40.705439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:40.734877 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-af991c2c-5420-438d-a5d1-e9eab69cb496 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045330 Sep 07 10:53:40.735649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3524/7110] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:53:40 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:53:40.746517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:40.747065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:40.754856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:40.755360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:40.755816 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:40.756525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:40.756998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:40.757475 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:40.835599 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] HTTP exception thrown: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 is not attached to volume 61e24177-5c28-4ece-8944-ceff55fb487c Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Request method failure captured: Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments/61e24177-5c28-4ece-8944-ceff55fb487c HTTP/1.1 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHc-NMGACAZQYfOVi04olBHqFd0wnLNoAlo1hCzEV5QHlHQfbyUKDXOGn7dB3yX_JHS0ka_DvVPmp43ii1KWaTbR9mny8EZJgR0cNqCgu4ejqZ0gm-Z04WEQAg1-SbCVuQ9R9o-cbYy2LucoR-v8DBIrFhul4jd77mvj__SVJmbWTpg Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c32a3b7223435b8fe8375e88caaf96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 06be9a743fff4ba6ac1d91d5d0435d3a Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 is not attached to volume 61e24177-5c28-4ece-8944-ceff55fb487c Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': '6c7955ef-fda9-4424-b30c-15442f7dee63', 'id': '61e24177-5c28-4ece-8944-ceff55fb487c'} Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 61e24177-5c28-4ece-8944-ceff55fb487c. Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 is not attached to volume 61e24177-5c28-4ece-8944-ceff55fb487c Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:53:40.837238 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 is not attached to volume 61e24177-5c28-4ece-8944-ceff55fb487c Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Returning 404 to user: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 is not attached to volume 61e24177-5c28-4ece-8944-ceff55fb487c {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-de2c0661-7d5f-4513-ba90-1b978f4b535e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments/61e24177-5c28-4ece-8944-ceff55fb487c" status: 404 len: 154 microversion: 2.1 time: 0.096578 Sep 07 10:53:40.842380 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3587/7111] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:53:40 2022] DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63/os-volume_attachments/61e24177-5c28-4ece-8944-ceff55fb487c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:53:44.092267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:44.093285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:44.099991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:44.100837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:44.101309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:44.102018 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:44.102479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:44.102912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:44.129296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:53:44.214172 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dfe7b2b8-411f-4d11-9fd2-b0fa2818594f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 204 len: 0 microversion: 2.1 time: 0.125174 Sep 07 10:53:44.215048 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3525/7112] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:53:44 2022] DELETE /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:53:44.224540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:44.225215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:44.234093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:44.234608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:44.235069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:44.235793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:44.236266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:44.236713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:44.377824 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:53:44.385967 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d3a52e66-3993-4222-92f4-8cf40b3d9462 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1555 microversion: 2.1 time: 0.165471 Sep 07 10:53:44.386541 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3588/7113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:44 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:53:45.410763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:45.411471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:45.418377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:45.418859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:45.419297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:45.420692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:45.421118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:45.421468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:45.561765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:53:45.569538 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1c1dfdbd-4361-4087-bb0c-84ba54ebb8a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1555 microversion: 2.1 time: 0.163056 Sep 07 10:53:45.570111 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3526/7114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:45 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:53:46.563490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d5f88f69-36bd-4c7f-b623-7337c51802cc req-305dc138-4c11-4746-a0fa-533abb8af1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7955ef-fda9-4424-b30c-15442f7dee63", "name": "network-vif-deleted", "tag": "1c6065de-552d-4b96-bcfd-d5f388115378"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:53:46.578004 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d5f88f69-36bd-4c7f-b623-7337c51802cc req-305dc138-4c11-4746-a0fa-533abb8af1ac service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:46.578503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d5f88f69-36bd-4c7f-b623-7337c51802cc req-305dc138-4c11-4746-a0fa-533abb8af1ac service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:46.578950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d5f88f69-36bd-4c7f-b623-7337c51802cc req-305dc138-4c11-4746-a0fa-533abb8af1ac service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:46.593157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:46.593757 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d5f88f69-36bd-4c7f-b623-7337c51802cc req-305dc138-4c11-4746-a0fa-533abb8af1ac service nova] Creating event network-vif-deleted:1c6065de-552d-4b96-bcfd-d5f388115378 for instance 6c7955ef-fda9-4424-b30c-15442f7dee63 on n-h1-836830-16 Sep 07 10:53:46.594063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:46.599948 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d5f88f69-36bd-4c7f-b623-7337c51802cc req-305dc138-4c11-4746-a0fa-533abb8af1ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040592 Sep 07 10:53:46.600919 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3589/7115] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:46.601618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:46.602205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:46.602916 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:46.603962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:46.604479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:46.605002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:46.671794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:53:46.680109 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ce732977-9f5a-4842-8f84-8e91d5149e5c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 200 len: 1343 microversion: 2.1 time: 0.090902 Sep 07 10:53:46.680692 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3527/7116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:46 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 1343 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:53:47.706626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:47.707266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 6c7955ef-fda9-4424-b30c-15442f7dee63] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:47.714639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:47.715127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:47.715574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:47.716293 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:47.717243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:47.717686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:47.731141 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] HTTP exception thrown: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 could not be found. Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Request method failure captured: Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 HTTP/1.1 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHc-NMGACAZQYfOVi04olBHqFd0wnLNoAlo1hCzEV5QHlHQfbyUKDXOGn7dB3yX_JHS0ka_DvVPmp43ii1KWaTbR9mny8EZJgR0cNqCgu4ejqZ0gm-Z04WEQAg1-SbCVuQ9R9o-cbYy2LucoR-v8DBIrFhul4jd77mvj__SVJmbWTpg Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c32a3b7223435b8fe8375e88caaf96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 06be9a743fff4ba6ac1d91d5d0435d3a Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 could not be found. Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '6c7955ef-fda9-4424-b30c-15442f7dee63'} Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 could not be found. Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 could not be found. Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:53:47.733487 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 could not be found. Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Returning 404 to user: Instance 6c7955ef-fda9-4424-b30c-15442f7dee63 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5068f1cc-41b0-4d54-a942-e0a72ea92fac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63" status: 404 len: 111 microversion: 2.1 time: 0.032831 Sep 07 10:53:47.738582 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3590/7117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:47 2022] GET /compute/v2.1/servers/6c7955ef-fda9-4424-b30c-15442f7dee63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:53:47.743663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c2059f04-b58b-435a-a68b-30e6705890e4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '.version_select at 0x7f14b1c42670>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:47.768091 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c2059f04-b58b-435a-a68b-30e6705890e4 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-516913307" status: 202 len: 0 microversion: 2.1 time: 0.028292 Sep 07 10:53:47.768667 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3528/7118] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-516913307 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:53:57.103050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6c821827-dec2-4c67-bd8e-7bdd6895b1c8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'create', calling method: .version_select at 0x7f14b1a0b1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-887955333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtydSG3WrtZRqDeMJGDU4xQP8Pr6g2Rit1kusfhPtN6PtDl3Ns4AEhZpNyDnwgiL0U0L5hFX94liNLbY3X74QCh6/kWsG8ceyRmOrd6GGesA3KsTClTR+jWtaJHAYadYQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:53:57.109863 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:53:57.110013 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Sep 07 10:53:57.124247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6c821827-dec2-4c67-bd8e-7bdd6895b1c8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:53:57.129752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-6c821827-dec2-4c67-bd8e-7bdd6895b1c8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for user 06be9a743fff4ba6ac1d91d5d0435d3a and project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:53:57.158435 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6c821827-dec2-4c67-bd8e-7bdd6895b1c8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059334 Sep 07 10:53:57.159034 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3591/7119] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:53:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:53:57.207435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:53:57.211487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1362703416", "imageRef": "b6e030d6-deda-45ee-93ab-8f17adf72825", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-887955333", "networks": [{"uuid": "a9a33345-99e5-4b5b-864f-64276f6ce160"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:53:57.266088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] validate_networks() for [('a9a33345-99e5-4b5b-864f-64276f6ce160', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:53:57.699825 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:53:57.700252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:53:57.700771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:53:57.701222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:53:57.701613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:53:57.710298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:57.710779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:57.711211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:57.711930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:53:57.712382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:53:57.713070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:53:57.730116 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:53:57.735931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Getting quotas for user 06be9a743fff4ba6ac1d91d5d0435d3a and project 16c32a3b7223435b8fe8375e88caaf96. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:53:57.748689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:53:57.750910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b6e030d6-deda-45ee-93ab-8f17adf72825',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:53:57.797047 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5878235e-e2d5-4aaa-9545-fcf4f90379f1 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591956 Sep 07 10:53:57.797754 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3529/7120] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:53:57.805543 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=34 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:53:57.809585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c8ed2de-0746-4dee-a187-bef6bb5c9bb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:57.810840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c8ed2de-0746-4dee-a187-bef6bb5c9bb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:57.865518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c8ed2de-0746-4dee-a187-bef6bb5c9bb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:53:57.872686 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c8ed2de-0746-4dee-a187-bef6bb5c9bb3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1258 microversion: 2.1 time: 0.067794 Sep 07 10:53:57.873808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3592/7121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:57 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:53:58.895538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f45782c9-3651-4e57-8927-f7701ad3ad77 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:58.896270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f45782c9-3651-4e57-8927-f7701ad3ad77 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:53:58.952212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f45782c9-3651-4e57-8927-f7701ad3ad77 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:53:58.959299 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f45782c9-3651-4e57-8927-f7701ad3ad77 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1258 microversion: 2.1 time: 0.067615 Sep 07 10:53:58.959882 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3530/7122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:58 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:53:59.983548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-92786fd7-e61f-4e2f-b727-13ae731cec1d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:53:59.984199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-92786fd7-e61f-4e2f-b727-13ae731cec1d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:00.046159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-92786fd7-e61f-4e2f-b727-13ae731cec1d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:00.055269 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-92786fd7-e61f-4e2f-b727-13ae731cec1d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1258 microversion: 2.1 time: 0.076275 Sep 07 10:54:00.055927 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3593/7123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:53:59 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:01.080182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bba48dcd-36e1-4cf9-9eb0-b054db547e1c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:01.080807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bba48dcd-36e1-4cf9-9eb0-b054db547e1c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:01.139666 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bba48dcd-36e1-4cf9-9eb0-b054db547e1c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:01.148176 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bba48dcd-36e1-4cf9-9eb0-b054db547e1c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1258 microversion: 2.1 time: 0.072847 Sep 07 10:54:01.148764 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3531/7124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:01 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:02.171415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:02.172045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:02.179022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:02.179524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:02.179978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:02.180685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:02.181163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:02.181626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:02.243805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:02.251961 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6bf59d01-c037-46e8-88f6-4afe764d040f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1262 microversion: 2.1 time: 0.084817 Sep 07 10:54:02.252542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3594/7125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:02 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:54:03.275191 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:03.275806 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:03.284522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:03.285016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:03.286215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:03.286215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:03.286615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:03.287213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:03.369038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:03.381386 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dec8a85a-e8a4-4abb-ae36-497730f3ff9e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1316 microversion: 2.1 time: 0.109907 Sep 07 10:54:03.386337 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3532/7126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:03 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1316 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:04.416659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:04.417333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:04.420375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:04.427756 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:04.428535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:04.429164 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:04.430128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:04.430614 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:04.431064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:04.577207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:04.585515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5a962df6-bfb2-469d-ac24-66ae8c22e055 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.173234 Sep 07 10:54:04.586106 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3595/7127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:04 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:05.610183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:05.610826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:05.613597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:05.619073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:05.619570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:05.620014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:05.620726 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:05.621206 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:05.621837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:05.769226 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:05.778150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f77c67c2-a6a7-4574-ba66-c2ed0bd853b5 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.172532 Sep 07 10:54:05.779290 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3533/7128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:05 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:06.804050 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:06.805544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:06.813570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:06.814088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:06.814572 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:06.815297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:06.815775 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:06.816221 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:06.968361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:06.976917 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-91d194ad-d461-42af-9e83-bcadb80ba78d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.177366 Sep 07 10:54:06.977545 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3596/7129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:06 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:08.001586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:08.002333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:08.005389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:08.011403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:08.012054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:08.012500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:08.015210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:08.015717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:08.016153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:08.167840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:08.176826 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dcec2110-e8a1-4ec8-9247-dd8e66c98aee tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.179888 Sep 07 10:54:08.177590 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3534/7130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:07 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:09.201143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:09.201829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:09.211154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:09.211880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:09.212346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:09.213380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:09.213857 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:09.214309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:09.366352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:09.376141 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ea120779-134b-4df8-a0eb-0b212f8b427c tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.178942 Sep 07 10:54:09.376856 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3597/7131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:09 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:54:10.406687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:10.407322 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:10.415251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:10.415251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:10.415528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:10.416243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:10.416708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:10.417136 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:10.563143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:10.572811 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-028d83ed-600b-4af1-bc01-7fbf93c8880e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.172505 Sep 07 10:54:10.573959 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3535/7132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:10 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:11.597934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:11.598692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:11.600673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=8 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:11.608105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:11.608683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:11.609237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:11.609955 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:11.610436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:11.610875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:11.830222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:11.838704 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6ccb0450-0bac-4b6f-a664-a751f95146a2 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.244695 Sep 07 10:54:11.839299 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3598/7133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:11 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:12.152433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-227bf371-7d89-4d4e-9546-4a03fdc487ae req-0848f02e-eea6-4834-8f88-290e79f41425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:12.158667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=10 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:12.166296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-227bf371-7d89-4d4e-9546-4a03fdc487ae req-0848f02e-eea6-4834-8f88-290e79f41425 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:12.166851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-227bf371-7d89-4d4e-9546-4a03fdc487ae req-0848f02e-eea6-4834-8f88-290e79f41425 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:12.167369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-227bf371-7d89-4d4e-9546-4a03fdc487ae req-0848f02e-eea6-4834-8f88-290e79f41425 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:12.179335 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-227bf371-7d89-4d4e-9546-4a03fdc487ae req-0848f02e-eea6-4834-8f88-290e79f41425 service nova] Creating event network-changed:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:54:12.184365 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-227bf371-7d89-4d4e-9546-4a03fdc487ae req-0848f02e-eea6-4834-8f88-290e79f41425 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035628 Sep 07 10:54:12.185808 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3536/7134] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:54:12.863926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:12.864566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:12.871550 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:12.872057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:12.873200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:12.874128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:12.874608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:12.875060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:13.006095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:13.014221 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-14716eac-d753-43f6-9ff1-16f9e09cf44f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.154269 Sep 07 10:54:13.014794 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3599/7135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:12 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:14.038468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:14.039182 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:14.045495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:14.045984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:14.046426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:14.047129 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:14.047592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:14.048025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:14.185988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:14.193755 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0c93361c-3e6c-46f7-bce7-c5e0195114be tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.160527 Sep 07 10:54:14.194331 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3537/7136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:14 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:15.217704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:15.218348 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:15.225409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:15.225915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:15.226376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:15.227126 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:15.227599 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:15.228048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:15.432168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:15.440271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e775e4f2-7a98-437d-b987-38b05e502e9f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.227362 Sep 07 10:54:15.440854 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3600/7137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:15 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:16.463839 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:16.464611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:16.475264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2ba4e168-9c01-4d11-93b8-fe50135ebe24 req-57ebce38-e5c9-4a63-845f-614164cb684c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "name": "network-vif-plugged", "status": "completed", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:16.485133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:16.485676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:16.485987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2ba4e168-9c01-4d11-93b8-fe50135ebe24 req-57ebce38-e5c9-4a63-845f-614164cb684c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:16.486132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:16.486653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2ba4e168-9c01-4d11-93b8-fe50135ebe24 req-57ebce38-e5c9-4a63-845f-614164cb684c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:16.486852 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:16.487240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2ba4e168-9c01-4d11-93b8-fe50135ebe24 req-57ebce38-e5c9-4a63-845f-614164cb684c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:16.487342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:16.487760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:16.499358 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2ba4e168-9c01-4d11-93b8-fe50135ebe24 req-57ebce38-e5c9-4a63-845f-614164cb684c service nova] Creating event network-vif-plugged:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:54:16.504685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2ba4e168-9c01-4d11-93b8-fe50135ebe24 req-57ebce38-e5c9-4a63-845f-614164cb684c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092618 Sep 07 10:54:16.505362 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3538/7138] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:54:16.652177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:16.661450 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c5540163-c961-4f2e-ad96-ed41d11b38cc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1358 microversion: 2.1 time: 0.201689 Sep 07 10:54:16.662068 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3601/7139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:16 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:54:17.690424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:17.691046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:17.698125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:17.698609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:17.699052 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:17.699772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:17.700228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:17.700814 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:17.834946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:17.843476 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9ae008d8-6a74-4550-b419-6a621e7ae8cf tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1548 microversion: 2.1 time: 0.157401 Sep 07 10:54:17.844045 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3539/7140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:17 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:17.866707 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:17.867345 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:17.875225 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:17.875737 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:17.876198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:17.876918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:17.877461 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:17.877909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:18.011148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:18.019739 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8340f830-ba63-4ab9-b0af-87c24116b491 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1548 microversion: 2.1 time: 0.156940 Sep 07 10:54:18.020326 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3602/7141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:17 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:18.042208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:18.047064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:18.047849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Searching by: {'deleted': False, 'project_id': '16c32a3b7223435b8fe8375e88caaf96'} {{(pid=128833) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 10:54:18.053321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:18.053807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:18.054256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:18.054986 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:18.055449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:18.055878 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:18.080526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.multi_cell_list [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 10:54:18.112196 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb03dd0b-b0ef-4c6d-afc3-6747ddc42b7f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073712 Sep 07 10:54:18.112862 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3540/7142] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 7 10:54:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:54:18.124734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:18.125403 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:18.131456 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:18.131965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:18.132423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:18.133132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:18.133644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:18.134091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:18.268064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:18.275913 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8df19e7b-803c-447c-89fe-d1c7954a2e8d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1548 microversion: 2.1 time: 0.155200 Sep 07 10:54:18.276483 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3603/7143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:18 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:19.795831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54c6d2aa-0300-4a28-9f0f-2c740ddf93be"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:19.798250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:19.805165 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:19.805677 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:19.806118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:19.806818 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:19.807282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:19.807720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:20.071401 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-65bde674-82e4-4fc2-9e07-703802f0b715 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279932 Sep 07 10:54:20.072062 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3541/7144] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 7 10:54:19 2022] POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:54:30.852042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:30.852683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:30.855601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=17 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:30.856412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=60 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:30.862304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:30.862813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:30.863273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:30.863991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:30.864471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:30.864915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:30.999214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:31.007794 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6dfb96d-08a8-4147-9e73-9ac6c4c7a9bc tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1594 microversion: 2.1 time: 0.159614 Sep 07 10:54:31.008363 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3604/7145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:30 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:32.642197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:32.643043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=17 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:32.643766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:32.653872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6070bc0f-2f12-47ee-99d0-16e5198a5744 req-7694372d-dbd9-49b7-842f-1065d419281e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:32.667803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6070bc0f-2f12-47ee-99d0-16e5198a5744 req-7694372d-dbd9-49b7-842f-1065d419281e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:32.668208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6070bc0f-2f12-47ee-99d0-16e5198a5744 req-7694372d-dbd9-49b7-842f-1065d419281e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:32.668640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6070bc0f-2f12-47ee-99d0-16e5198a5744 req-7694372d-dbd9-49b7-842f-1065d419281e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:32.681833 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6070bc0f-2f12-47ee-99d0-16e5198a5744 req-7694372d-dbd9-49b7-842f-1065d419281e service nova] Creating event network-changed:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:54:32.687947 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6070bc0f-2f12-47ee-99d0-16e5198a5744 req-7694372d-dbd9-49b7-842f-1065d419281e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047390 Sep 07 10:54:32.688566 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3542/7146] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:54:34.060893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1514823414"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:34.061863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:34.068646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:34.069146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:34.069636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:34.070337 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:34.070803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:34.071250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:34.200637 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Adding security group 7cd41f39-d17f-4599-be09-a65770f8d9a3 to port c5b377bd-60c3-4a69-9481-eacbe2e17aa6 Sep 07 10:54:34.549953 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-34679048-ecf0-4fc7-8342-1a3f79be7f60 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/action" status: 202 len: 0 microversion: 2.1 time: 0.493572 Sep 07 10:54:34.550578 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3605/7147] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:54:34 2022] POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:54:34.559564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-99212c36-4f83-4a41-a5a0-2d90a79773c1 req-9499c5b1-0f38-4ce6-aead-73bc7f72475a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:34.560436 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:34.561933 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:34.569548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:34.570556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:34.570663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-99212c36-4f83-4a41-a5a0-2d90a79773c1 req-9499c5b1-0f38-4ce6-aead-73bc7f72475a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:34.570854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:34.571117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-99212c36-4f83-4a41-a5a0-2d90a79773c1 req-9499c5b1-0f38-4ce6-aead-73bc7f72475a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:34.571570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:34.571692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-99212c36-4f83-4a41-a5a0-2d90a79773c1 req-9499c5b1-0f38-4ce6-aead-73bc7f72475a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:34.572030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:34.572461 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:34.588517 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-99212c36-4f83-4a41-a5a0-2d90a79773c1 req-9499c5b1-0f38-4ce6-aead-73bc7f72475a service nova] Creating event network-changed:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:54:34.596021 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-99212c36-4f83-4a41-a5a0-2d90a79773c1 req-9499c5b1-0f38-4ce6-aead-73bc7f72475a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039212 Sep 07 10:54:34.596650 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3606/7148] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:54:34.865408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:34.874744 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca875ed4-94ed-4ad2-86a3-dc547a944548 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1760 microversion: 2.1 time: 0.319531 Sep 07 10:54:34.875332 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3543/7149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:34 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1760 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:54:49.835560 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:49.836349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:49.888549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:54:49.891294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:49.897724 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:49.898229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:49.898687 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:49.899402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:49.899954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:49.900402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:49.972944 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-06ab15d6-e71a-457d-986f-6d839498dcca tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/action" status: 202 len: 0 microversion: 2.1 time: 0.139307 Sep 07 10:54:49.973656 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3607/7150] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:54:49 2022] POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:54:49.982047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:49.982802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:49.986424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:49.987432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:54:49.993696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:49.994194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:49.994641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:49.995352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:49.995811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:49.996242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:50.238313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:50.246794 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f92af4ff-6251-4ea8-8d1b-07581eb99f32 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1752 microversion: 2.1 time: 0.268918 Sep 07 10:54:50.247381 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3544/7151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:49 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1752 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:51.270694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:51.271430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:51.278492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:51.278990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:51.279462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:51.280688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:51.281155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:51.281712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:51.437409 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:51.445793 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-69a609d6-90e5-4432-ba6c-5bfe19d2b8f7 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.179440 Sep 07 10:54:51.446572 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3608/7152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:51 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:52.470197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:52.470813 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:52.478613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:52.479135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:52.479889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:52.480560 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:52.481015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:52.481624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:52.626072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:52.634378 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7191531d-a0e6-4afc-82aa-0496416d37ff tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.168277 Sep 07 10:54:52.634959 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3545/7153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:52 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:53.658518 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:53.659343 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:53.666600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:53.667036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:53.667498 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:53.668233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:53.668712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:53.669216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:53.827832 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:53.836430 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6a90d7e7-b0be-4a58-b003-002eb71c74eb tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.182112 Sep 07 10:54:53.837098 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3609/7154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:53 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:54.860629 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:54.861255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:54.868229 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:54.868732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:54.869175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:54.869903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:54.870363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:54.870794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:55.014754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:55.023169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4eb03927-3d60-4ea4-91c6-de6c61c1b520 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.167182 Sep 07 10:54:55.023750 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3546/7155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:54 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:56.048044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:56.049318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:56.056158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:56.056651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:56.057103 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:56.057823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:56.058292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:56.058729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:56.207285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:56.216271 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8d82e9c-89c1-4a4f-af8b-610f8bd9f648 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.172412 Sep 07 10:54:56.217051 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3610/7156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:56 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:57.239556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:57.240184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:57.247249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:57.247740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:57.248187 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:57.249479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:57.250294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:57.250732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:57.400213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:57.409575 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-204ca83f-0f73-4faf-863c-1865aa6ce88d tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.174120 Sep 07 10:54:57.410166 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3547/7157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:57 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:58.433133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:58.433822 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:58.441505 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:58.442006 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:58.442459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:58.443168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:58.443638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:58.444080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:58.594585 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:58.602977 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-65ce7784-d52c-419f-8ba5-b0b72c345926 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.173764 Sep 07 10:54:58.603490 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3611/7158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:58 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:54:59.626389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:54:59.627012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:54:59.634138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:59.634624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:59.635068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:59.635770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:54:59.636235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:54:59.636668 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:54:59.791402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:54:59.800894 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f630ece2-14c4-48e4-92f9-bb00734ff75e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.178561 Sep 07 10:54:59.801521 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3548/7159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:54:59 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:55:00.824562 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:00.826014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:00.833502 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:00.834001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:00.834468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:00.835199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:00.835679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:00.836116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:01.014391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:55:01.023597 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-59561094-bcad-45dd-a037-1d6f74fd129b tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1757 microversion: 2.1 time: 0.202883 Sep 07 10:55:01.024192 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3612/7160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:55:00 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:55:02.048367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:02.049104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:02.056025 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:02.056515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:02.056954 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:02.057744 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:02.058168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:02.058604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:02.204386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:55:02.213130 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-659ef1d7-74f2-4887-a9ff-e324da81d2d0 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1760 microversion: 2.1 time: 0.168980 Sep 07 10:55:02.213749 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3549/7161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:55:02 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:55:34.628162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1514823414"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:55:34.628770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:34.631361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:55:34.632034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:55:34.637831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:34.638326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:34.638772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:34.639491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:34.639934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:34.640370 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:34.769818 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.network.security_group_api [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Removing security group 7cd41f39-d17f-4599-be09-a65770f8d9a3 from port c5b377bd-60c3-4a69-9481-eacbe2e17aa6 Sep 07 10:55:35.077611 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-37c69809-c958-4cda-8adf-effd4ed5d4c9 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/action" status: 202 len: 0 microversion: 2.1 time: 0.453292 Sep 07 10:55:35.078238 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3613/7162] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:55:34 2022] POST /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:55:35.088320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-37b631f1-5d5f-466c-82a6-142c47e17d24 req-3d0e4876-1337-45bc-8e46-783477d30775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:55:35.093773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:55:35.095015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=36 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:55:35.100782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-37b631f1-5d5f-466c-82a6-142c47e17d24 req-3d0e4876-1337-45bc-8e46-783477d30775 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:35.101297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-37b631f1-5d5f-466c-82a6-142c47e17d24 req-3d0e4876-1337-45bc-8e46-783477d30775 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:35.101738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-37b631f1-5d5f-466c-82a6-142c47e17d24 req-3d0e4876-1337-45bc-8e46-783477d30775 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:35.114304 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-37b631f1-5d5f-466c-82a6-142c47e17d24 req-3d0e4876-1337-45bc-8e46-783477d30775 service nova] Creating event network-changed:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:55:35.119657 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-37b631f1-5d5f-466c-82a6-142c47e17d24 req-3d0e4876-1337-45bc-8e46-783477d30775 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035649 Sep 07 10:55:35.120276 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3550/7163] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:55:36.440442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:36.440968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:36.447632 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:36.448132 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:36.448587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:36.449330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:36.449807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:36.450250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:36.534915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lazy-loading 'services' on Instance uuid 4a6ace34-a4e8-428d-a8c0-0dd47787450c {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:55:36.608799 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c9111e2-d932-46e0-8d75-f70730f623af tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments/54c6d2aa-0300-4a28-9f0f-2c740ddf93be" status: 202 len: 0 microversion: 2.1 time: 0.173090 Sep 07 10:55:36.609507 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3614/7164] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:55:36 2022] DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments/54c6d2aa-0300-4a28-9f0f-2c740ddf93be => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:55:36.619013 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:36.621432 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:36.630844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:36.631423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:36.631945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:36.632646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:36.633099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:36.633553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:36.664794 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3a1dec8-d330-45e5-aa7f-308925a59d87 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050515 Sep 07 10:55:36.665399 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3551/7165] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:55:36 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:55:37.141172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-8fe6fa50-dc8c-4184-8807-6b5ee5139fc4 req-8c50d87c-e7c2-4214-b79a-fed81293ff7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:55:37.153310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8fe6fa50-dc8c-4184-8807-6b5ee5139fc4 req-8c50d87c-e7c2-4214-b79a-fed81293ff7d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:37.153952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8fe6fa50-dc8c-4184-8807-6b5ee5139fc4 req-8c50d87c-e7c2-4214-b79a-fed81293ff7d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:37.154282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-8fe6fa50-dc8c-4184-8807-6b5ee5139fc4 req-8c50d87c-e7c2-4214-b79a-fed81293ff7d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:37.166521 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-8fe6fa50-dc8c-4184-8807-6b5ee5139fc4 req-8c50d87c-e7c2-4214-b79a-fed81293ff7d service nova] Creating event network-changed:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:55:37.172543 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-8fe6fa50-dc8c-4184-8807-6b5ee5139fc4 req-8c50d87c-e7c2-4214-b79a-fed81293ff7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035283 Sep 07 10:55:37.173664 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3615/7166] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:55:37.678747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:37.680897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:37.689440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:37.689983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:37.690429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:37.691146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:37.691884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:37.692348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:37.724895 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-93e50791-b389-4191-a2cc-6fb47496681f tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051013 Sep 07 10:55:37.725694 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3552/7167] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:55:37 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:55:38.739432 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:38.741860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:38.748260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:38.748766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:38.749239 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:38.749963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:38.750433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:38.750876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:38.782688 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-09c3d903-b0f2-4915-b9ec-979c3eb13ff8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048758 Sep 07 10:55:38.783263 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3616/7168] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:55:38 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:55:39.796160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:39.798344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:39.805492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:39.805991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:39.806438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:39.807148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:39.807616 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:39.808050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:39.839843 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e85f148c-c81f-47e5-ae7d-bb0bd43c7b34 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047768 Sep 07 10:55:39.840418 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3553/7169] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:55:39 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:55:40.852186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:40.854465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:40.861418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:40.861919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:40.862376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:40.863085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:40.863582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:40.864027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:40.897713 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fb09a31a-7da3-4a65-8673-c6f6b5fcbb40 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049469 Sep 07 10:55:40.898286 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3617/7170] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:55:40 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:55:41.911110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:41.913449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:41.920209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:41.920696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:41.921139 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:41.921856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:41.922314 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:41.922746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:41.952284 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c68ae86e-ea0a-40f2-a008-3d20574095e3 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046034 Sep 07 10:55:41.952907 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3554/7171] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 7 10:55:41 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 10:55:41.964424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:41.964944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:41.971838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:41.972360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:41.973548 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:41.974237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:41.974715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:41.975165 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:42.048825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] HTTP exception thrown: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c is not attached to volume 54c6d2aa-0300-4a28-9f0f-2c740ddf93be Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Request method failure captured: Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: request: DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments/54c6d2aa-0300-4a28-9f0f-2c740ddf93be HTTP/1.1 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHc-NMGACAZQYfOVi04olBHqFd0wnLNoAlo1hCzEV5QHlHQfbyUKDXOGn7dB3yX_JHS0ka_DvVPmp43ii1KWaTbR9mny8EZJgR0cNqCgu4ejqZ0gm-Z04WEQAg1-SbCVuQ9R9o-cbYy2LucoR-v8DBIrFhul4jd77mvj__SVJmbWTpg Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c32a3b7223435b8fe8375e88caaf96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 06be9a743fff4ba6ac1d91d5d0435d3a Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c is not attached to volume 54c6d2aa-0300-4a28-9f0f-2c740ddf93be Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'server_id': '4a6ace34-a4e8-428d-a8c0-0dd47787450c', 'id': '54c6d2aa-0300-4a28-9f0f-2c740ddf93be'} Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 54c6d2aa-0300-4a28-9f0f-2c740ddf93be. Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c is not attached to volume 54c6d2aa-0300-4a28-9f0f-2c740ddf93be Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:55:42.050525 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c is not attached to volume 54c6d2aa-0300-4a28-9f0f-2c740ddf93be Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Returning 404 to user: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c is not attached to volume 54c6d2aa-0300-4a28-9f0f-2c740ddf93be {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9df03ea4-9bde-41e5-8373-5aae7afa2dac tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments/54c6d2aa-0300-4a28-9f0f-2c740ddf93be" status: 404 len: 154 microversion: 2.1 time: 0.092125 Sep 07 10:55:42.055516 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3618/7172] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 7 10:55:41 2022] DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c/os-volume_attachments/54c6d2aa-0300-4a28-9f0f-2c740ddf93be => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:55:45.309759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:45.310339 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:45.317851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:45.318419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:45.318981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:45.319669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:45.320131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:45.320566 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:45.350662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:55:45.431684 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4e8d9473-efca-4cee-9163-7dc2b8f3e695 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 204 len: 0 microversion: 2.1 time: 0.125443 Sep 07 10:55:45.432794 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3555/7173] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:55:45 2022] DELETE /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:55:45.443405 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:45.444795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:45.453742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:45.454371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:45.454905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:45.455703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:45.456252 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:45.456772 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:45.598264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:55:45.606811 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-46d7eb09-5c6c-49dd-ae88-7de2374c9b2e tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1554 microversion: 2.1 time: 0.168782 Sep 07 10:55:45.607391 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3619/7174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:55:45 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:55:46.631269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:46.632002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:46.638862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:46.639349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:46.639793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:46.640482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:46.640943 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:46.641405 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:46.774277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:55:46.782229 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8c2ba340-c3a5-4764-94f3-aaf34a0d3124 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1554 microversion: 2.1 time: 0.155589 Sep 07 10:55:46.782803 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3556/7175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:55:46 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:55:47.631307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-d7e88201-7fe9-4e0f-8db2-427239d5ce55 req-3f982edb-2976-48f8-bd0f-bf2c6064c26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ace34-a4e8-428d-a8c0-0dd47787450c", "name": "network-vif-deleted", "tag": "c5b377bd-60c3-4a69-9481-eacbe2e17aa6"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:55:47.643933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d7e88201-7fe9-4e0f-8db2-427239d5ce55 req-3f982edb-2976-48f8-bd0f-bf2c6064c26a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:47.645231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d7e88201-7fe9-4e0f-8db2-427239d5ce55 req-3f982edb-2976-48f8-bd0f-bf2c6064c26a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:47.646515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-d7e88201-7fe9-4e0f-8db2-427239d5ce55 req-3f982edb-2976-48f8-bd0f-bf2c6064c26a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:47.659202 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-d7e88201-7fe9-4e0f-8db2-427239d5ce55 req-3f982edb-2976-48f8-bd0f-bf2c6064c26a service nova] Creating event network-vif-deleted:c5b377bd-60c3-4a69-9481-eacbe2e17aa6 for instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c on n-h2-836830-16 Sep 07 10:55:47.666005 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-d7e88201-7fe9-4e0f-8db2-427239d5ce55 req-3f982edb-2976-48f8-bd0f-bf2c6064c26a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039308 Sep 07 10:55:47.666623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3620/7176] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:55:47.806061 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:47.806686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:47.814142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:47.814636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:47.815082 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:47.815784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:47.816399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:47.816845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:47.850775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:47.851271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:47.851714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:47.852174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lazy-loading 'fault' on Instance uuid 4a6ace34-a4e8-428d-a8c0-0dd47787450c {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:55:47.892942 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be9a743fff4ba6ac1d91d5d0435d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c32a3b7223435b8fe8375e88caaf96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:55:47.901957 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8639a974-7fbe-479f-8a38-c820d6653885 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 200 len: 1348 microversion: 2.1 time: 0.099786 Sep 07 10:55:47.902928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3557/7177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:55:47 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:55:48.928071 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:48.928830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] [instance: 4a6ace34-a4e8-428d-a8c0-0dd47787450c] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:55:48.935971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:48.936471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:48.936931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:48.937662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:55:48.938134 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:55:48.938576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:55:48.952384 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] HTTP exception thrown: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c could not be found. Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Request method failure captured: Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c HTTP/1.1 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHc-NMGACAZQYfOVi04olBHqFd0wnLNoAlo1hCzEV5QHlHQfbyUKDXOGn7dB3yX_JHS0ka_DvVPmp43ii1KWaTbR9mny8EZJgR0cNqCgu4ejqZ0gm-Z04WEQAg1-SbCVuQ9R9o-cbYy2LucoR-v8DBIrFhul4jd77mvj__SVJmbWTpg Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16c32a3b7223435b8fe8375e88caaf96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16c32a3b7223435b8fe8375e88caaf96", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 16c32a3b7223435b8fe8375e88caaf96 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-963086239 Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 06be9a743fff4ba6ac1d91d5d0435d3a Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestMinimumBasicScenario-963086239-project Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c could not be found. Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '4a6ace34-a4e8-428d-a8c0-0dd47787450c'} Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c could not be found. Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c could not be found. Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:55:48.954038 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c could not be found. Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Returning 404 to user: Instance 4a6ace34-a4e8-428d-a8c0-0dd47787450c could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fcd1d788-ed62-44cc-89b2-092c03872852 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c" status: 404 len: 111 microversion: 2.1 time: 0.032799 Sep 07 10:55:48.959244 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3621/7178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:55:48 2022] GET /compute/v2.1/servers/4a6ace34-a4e8-428d-a8c0-0dd47787450c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:55:48.964739 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ff946ba-f1dc-431c-936a-215d96a7f4f8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] Calling method '.version_select at 0x7f14b180f160>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:55:48.985381 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ff946ba-f1dc-431c-936a-215d96a7f4f8 tempest-TestMinimumBasicScenario-963086239 tempest-TestMinimumBasicScenario-963086239-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-887955333" status: 202 len: 0 microversion: 2.1 time: 0.024665 Sep 07 10:55:48.985942 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3558/7179] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 7 10:55:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-887955333 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:55:58.254886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dc857ae9-42e5-422c-9623-0fa3e00c4f6a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: .version_select at 0x7f14b0843ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-703190564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDEpF6MsSbKYIO3oNH8CTyvQVI+7YiKk6knpm3aTf72wwLiblx6qya95d6kLCy0OLwmSo9EMTT/MXAdPSxof4t4MaN+VlERJdDB9moIEjhBO+IWD5SPfZdgbOpO7VNVAA=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:55:58.271759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dc857ae9-42e5-422c-9623-0fa3e00c4f6a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:55:58.276924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dc857ae9-42e5-422c-9623-0fa3e00c4f6a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:55:58.302476 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dc857ae9-42e5-422c-9623-0fa3e00c4f6a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.214455 Sep 07 10:55:58.303082 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3622/7180] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:55:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:56:04.526906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:04.527882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:04.532349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-851397851", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "8a3f613a-f826-48b7-9300-bedaba518829"}], "key_name": "tempest-TestNetworkAdvancedServerOps-703190564", "security_groups": [{"name": "tempest-secgroup-smoke-1407911874"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:04.650319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] validate_networks() for [('8a3f613a-f826-48b7-9300-bedaba518829', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:56:05.110720 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:56:05.111729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:56:05.112455 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:56:05.113026 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:56:05.113689 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:56:05.131377 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:05.132294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:05.132946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:05.135558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:05.137724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:05.138364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:05.171922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:56:05.178795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:56:05.194423 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:56:05.196962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:56:05.253001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a1ab481e-ef26-45c9-9bba-d00ebe4f0db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727671 Sep 07 10:56:05.260952 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3559/7181] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:56:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:56:05.264549 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:05.271489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0f397391-1312-45ed-bb81-a98d78deb90f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:05.272513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0f397391-1312-45ed-bb81-a98d78deb90f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:05.276448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:05.351105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0f397391-1312-45ed-bb81-a98d78deb90f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:05.358535 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0f397391-1312-45ed-bb81-a98d78deb90f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1265 microversion: 2.1 time: 0.094800 Sep 07 10:56:05.373997 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3623/7182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:05 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:06.384223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:06.384840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:06.392862 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:06.393491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:06.393934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:06.395256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:06.395719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:06.396152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:06.515638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:06.525936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b5829442-4d88-4cfe-b84f-707bcf829270 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1317 microversion: 2.1 time: 0.145496 Sep 07 10:56:06.527004 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3560/7183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:06 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:07.552970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:07.553663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:07.562066 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:07.562579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:07.563311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:07.564045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:07.564580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:07.565033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:08.134479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:08.142858 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-54b2e442-ee74-4419-90cf-e3d9cf275c37 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.594577 Sep 07 10:56:08.143652 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3624/7184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:07 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:08.510809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-732a03e5-772f-4104-8002-6a13c14c43c4 req-c50c1e4f-9ed3-4482-96b3-e027b55e5574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70fda8c-8650-444c-8a15-c6c5f1e474a7", "tag": "eceed48f-738e-44b3-bd78-d311ab68bb0f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:08.523511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-732a03e5-772f-4104-8002-6a13c14c43c4 req-c50c1e4f-9ed3-4482-96b3-e027b55e5574 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:08.523897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-732a03e5-772f-4104-8002-6a13c14c43c4 req-c50c1e4f-9ed3-4482-96b3-e027b55e5574 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:08.524330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-732a03e5-772f-4104-8002-6a13c14c43c4 req-c50c1e4f-9ed3-4482-96b3-e027b55e5574 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:08.537303 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-732a03e5-772f-4104-8002-6a13c14c43c4 req-c50c1e4f-9ed3-4482-96b3-e027b55e5574 service nova] Creating event network-changed:eceed48f-738e-44b3-bd78-d311ab68bb0f for instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 on n-h1-836830-16 Sep 07 10:56:08.542588 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-732a03e5-772f-4104-8002-6a13c14c43c4 req-c50c1e4f-9ed3-4482-96b3-e027b55e5574 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036232 Sep 07 10:56:08.543204 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3561/7185] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:56:09.167223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:09.167781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:09.174748 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:09.175258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:09.175990 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:09.176730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:09.177273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:09.177685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:09.311056 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:09.319647 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8c79c6a-b5c9-4aa7-b3ea-bde8f20fb77f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.156503 Sep 07 10:56:09.320230 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3625/7186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:09 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:10.344462 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:10.345372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:10.352275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:10.352771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:10.353235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:10.353939 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:10.354747 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:10.355184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:10.557742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:10.565912 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-866cc06a-8936-4d2a-b3f0-f15db3ebfd5a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.226511 Sep 07 10:56:10.566512 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3562/7187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:10 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:11.589295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:11.589924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:11.596754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:11.597371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:11.597858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:11.598567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:11.599038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:11.599479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:11.741433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:11.749098 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b8e33dcd-3cfb-47a5-9e4c-39256ca09242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.164065 Sep 07 10:56:11.749717 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3626/7188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:11 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:12.773501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:12.774119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:12.780357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:12.780848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:12.781319 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:12.782017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:12.782483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:12.782944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:12.913664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:12.921495 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0a8f6451-688f-4aa5-8a95-dc39e4bfaeb0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.152354 Sep 07 10:56:12.922081 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3563/7189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:12 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:13.944615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:13.945300 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:13.952162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:13.952659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:13.953111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:13.953842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:13.954314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:13.954754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:14.095270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:14.104583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cb55aa73-5616-4b80-afab-fad9c528e591 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.164064 Sep 07 10:56:14.105173 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3627/7190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:13 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:14.211230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-9e4d611c-baac-4e6c-9720-293e785642be req-81fdfa7d-1b26-46f9-8353-4699261fdd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70fda8c-8650-444c-8a15-c6c5f1e474a7", "name": "network-vif-plugged", "status": "completed", "tag": "eceed48f-738e-44b3-bd78-d311ab68bb0f"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:14.225373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9e4d611c-baac-4e6c-9720-293e785642be req-81fdfa7d-1b26-46f9-8353-4699261fdd1e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:14.225867 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9e4d611c-baac-4e6c-9720-293e785642be req-81fdfa7d-1b26-46f9-8353-4699261fdd1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:14.226309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-9e4d611c-baac-4e6c-9720-293e785642be req-81fdfa7d-1b26-46f9-8353-4699261fdd1e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:14.238763 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-9e4d611c-baac-4e6c-9720-293e785642be req-81fdfa7d-1b26-46f9-8353-4699261fdd1e service nova] Creating event network-vif-plugged:eceed48f-738e-44b3-bd78-d311ab68bb0f for instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 on n-h1-836830-16 Sep 07 10:56:14.244061 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-9e4d611c-baac-4e6c-9720-293e785642be req-81fdfa7d-1b26-46f9-8353-4699261fdd1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036578 Sep 07 10:56:14.244838 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3564/7191] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:56:15.128506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:15.129108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:15.136148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:15.136653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:15.137114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:15.137936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:15.138415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:15.138870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:15.272350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:15.280281 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4bfb1f56-e52e-474f-941a-fc4c5537f7bf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1391 microversion: 2.1 time: 0.155775 Sep 07 10:56:15.280869 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3628/7192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:15 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:16.304217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:16.304927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:16.307953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:16.308764 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:16.314653 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:16.315146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:16.315604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:16.316896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:16.317636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:16.318068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:16.464231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:16.472029 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b94912e3-3bc2-4999-9afe-7f7b8f931695 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1563 microversion: 2.1 time: 0.172471 Sep 07 10:56:16.473116 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3565/7193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:16 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:16.495742 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:16.496380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:16.498344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:16.505541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:16.506049 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:16.506530 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:16.507251 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:16.507725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:16.508172 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:16.645679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:16.653389 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd57bf6e-90fc-412b-95c2-d537d08efde6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1563 microversion: 2.1 time: 0.161556 Sep 07 10:56:16.653963 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3629/7194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:16 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:18.263492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5693674a-3b13-4fc2-a78b-3b95aee37180 req-43226fe3-4efc-4949-ba84-d6883cd3945a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70fda8c-8650-444c-8a15-c6c5f1e474a7", "tag": "eceed48f-738e-44b3-bd78-d311ab68bb0f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:18.267700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:18.276457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:18.279602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5693674a-3b13-4fc2-a78b-3b95aee37180 req-43226fe3-4efc-4949-ba84-d6883cd3945a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:18.280168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5693674a-3b13-4fc2-a78b-3b95aee37180 req-43226fe3-4efc-4949-ba84-d6883cd3945a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:18.280626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5693674a-3b13-4fc2-a78b-3b95aee37180 req-43226fe3-4efc-4949-ba84-d6883cd3945a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:18.283542 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:18.284036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:18.285308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:18.286342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:18.286812 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:18.287245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:18.293323 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5693674a-3b13-4fc2-a78b-3b95aee37180 req-43226fe3-4efc-4949-ba84-d6883cd3945a service nova] Creating event network-changed:eceed48f-738e-44b3-bd78-d311ab68bb0f for instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 on n-h1-836830-16 Sep 07 10:56:18.298442 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5693674a-3b13-4fc2-a78b-3b95aee37180 req-43226fe3-4efc-4949-ba84-d6883cd3945a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038750 Sep 07 10:56:18.299346 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3630/7195] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:56:18.540465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:18.548595 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-adeb4dd8-7afd-426a-9f67-d2f7e927617d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1563 microversion: 2.1 time: 0.291997 Sep 07 10:56:18.549507 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3566/7196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:18 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1563 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:41.879398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=17 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:41.880170 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=38 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:41.884843 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:41.887173 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:41.895123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:41.895627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:41.896084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:41.896792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:41.897299 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:41.897745 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:41.951008 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebc47aa9-b480-4e3d-840a-32fd5e6d7cd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action" status: 200 len: 24566 microversion: 2.1 time: 0.073891 Sep 07 10:56:41.951634 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3631/7197] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:56:41 2022] POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action => generated 24566 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:56:52.989674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:52.990303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:52.992382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:52.993045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=36 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:53.000936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:53.001452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:53.001894 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:53.003678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:53.004143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:53.004578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:53.074031 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c116cb1-cc30-4223-9f54-8a58642ebe81 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action" status: 202 len: 0 microversion: 2.1 time: 0.089333 Sep 07 10:56:53.075029 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3567/7198] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:56:52 2022] POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:56:53.084032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:53.084753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:53.087710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:53.088681 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:56:53.095538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:53.096214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:53.096705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:53.097392 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:53.097861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:53.098304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:53.254129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:53.263222 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e1b8c8e-4bff-4357-a2d7-b4b905617192 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1687 microversion: 2.1 time: 0.183413 Sep 07 10:56:53.264208 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3632/7199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:53 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:54.290743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:54.291471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:54.298944 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:54.299571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:54.299990 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:54.300671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:54.301122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:54.301572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:54.444795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:54.452615 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ffbdb790-d607-45ff-b868-124596ad2db3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1667 microversion: 2.1 time: 0.166201 Sep 07 10:56:54.453686 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3568/7200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:54 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:55.552740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:55.554931 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:55.566740 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:55.567260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:55.567722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:55.568450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:55.568924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:55.569407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:55.630674 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7a2776fd-ec06-42b3-b043-c7b72e5a7c0c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action" status: 200 len: 32637 microversion: 2.1 time: 0.081862 Sep 07 10:56:55.631608 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3633/7201] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:56:55 2022] POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action => generated 32637 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:56:55.643795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:55.644389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:55.651451 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:55.651934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:55.652366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:55.653053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:55.653534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:55.653957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:55.723840 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c6df77d1-d6c7-4228-8937-f54a04b2769f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action" status: 202 len: 0 microversion: 2.1 time: 0.084540 Sep 07 10:56:55.724516 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3569/7202] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:56:55 2022] POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:56:55.733473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:55.734202 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:55.741590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:55.742122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:55.742566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:55.743288 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:55.743770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:55.744285 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:55.880944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:55.889047 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4a7762f0-d420-493f-8b29-f5b6ecfa3c02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1674 microversion: 2.1 time: 0.159886 Sep 07 10:56:55.889658 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3634/7203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:55 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:56.916342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:56.917054 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:56.923302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:56.923798 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:56.924325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:56.925270 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:56.925672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:56.926105 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:57.061412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:57.070122 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69a9b653-2743-47a9-b4b2-b02d6f7ce5be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1682 microversion: 2.1 time: 0.158897 Sep 07 10:56:57.070735 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3570/7204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:56 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:57.172733 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:57.175399 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:57.183155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:57.183653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:57.184107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:57.184817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:57.185397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:57.185838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:57.237659 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c09f5f3d-6048-4343-afea-cd7ab4a8c3a2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action" status: 200 len: 36291 microversion: 2.1 time: 0.068722 Sep 07 10:56:57.238306 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3635/7205] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:56:57 2022] POST /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7/action => generated 36291 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:56:58.613452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:58.613952 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:58.621665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:58.622250 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:58.622783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:58.623552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5b24468a-71d7-40ad-a46f-72b32d48db86 req-6c6002ff-5753-49c1-af53-4db5301fa690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70fda8c-8650-444c-8a15-c6c5f1e474a7", "tag": "eceed48f-738e-44b3-bd78-d311ab68bb0f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:56:58.623989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:58.623989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:58.624537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:58.635332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b24468a-71d7-40ad-a46f-72b32d48db86 req-6c6002ff-5753-49c1-af53-4db5301fa690 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:58.635820 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b24468a-71d7-40ad-a46f-72b32d48db86 req-6c6002ff-5753-49c1-af53-4db5301fa690 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:58.636280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5b24468a-71d7-40ad-a46f-72b32d48db86 req-6c6002ff-5753-49c1-af53-4db5301fa690 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:58.648509 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5b24468a-71d7-40ad-a46f-72b32d48db86 req-6c6002ff-5753-49c1-af53-4db5301fa690 service nova] Creating event network-changed:eceed48f-738e-44b3-bd78-d311ab68bb0f for instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 on n-h1-836830-16 Sep 07 10:56:58.654456 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5b24468a-71d7-40ad-a46f-72b32d48db86 req-6c6002ff-5753-49c1-af53-4db5301fa690 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034888 Sep 07 10:56:58.654893 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:56:58.655411 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3636/7206] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:56:58.741966 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3c38b2fd-0c6e-44e8-aad4-82e2e42b59e3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 204 len: 0 microversion: 2.1 time: 0.132157 Sep 07 10:56:58.742940 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3571/7207] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:56:58 2022] DELETE /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:56:58.753886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:58.754620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:58.761620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:58.762131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:58.762784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:58.763849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:58.764517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:58.764968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:58.901590 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:56:58.909652 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bdcbcd82-4e65-4ad9-9da4-6921cd1fa688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1688 microversion: 2.1 time: 0.161980 Sep 07 10:56:58.910237 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3637/7208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:58 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:56:59.934650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:56:59.935353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:56:59.943231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:59.943761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:59.944209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:56:59.944911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:56:59.945417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:56:59.945887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:00.087969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:00.096727 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8dd0df52-e08b-47a5-97c2-f1ea4f630786 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1688 microversion: 2.1 time: 0.165759 Sep 07 10:57:00.097331 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3572/7209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:56:59 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:01.081833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-242cf953-3bcc-4e92-95e5-02b1deb1c922 req-79427c51-57f8-446e-9cdc-5df477adfdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70fda8c-8650-444c-8a15-c6c5f1e474a7", "name": "network-vif-deleted", "tag": "eceed48f-738e-44b3-bd78-d311ab68bb0f"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:01.093759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-242cf953-3bcc-4e92-95e5-02b1deb1c922 req-79427c51-57f8-446e-9cdc-5df477adfdcc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:01.094275 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-242cf953-3bcc-4e92-95e5-02b1deb1c922 req-79427c51-57f8-446e-9cdc-5df477adfdcc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:01.094705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-242cf953-3bcc-4e92-95e5-02b1deb1c922 req-79427c51-57f8-446e-9cdc-5df477adfdcc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:01.106428 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-242cf953-3bcc-4e92-95e5-02b1deb1c922 req-79427c51-57f8-446e-9cdc-5df477adfdcc service nova] Creating event network-vif-deleted:eceed48f-738e-44b3-bd78-d311ab68bb0f for instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 on n-h1-836830-16 Sep 07 10:57:01.112912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-242cf953-3bcc-4e92-95e5-02b1deb1c922 req-79427c51-57f8-446e-9cdc-5df477adfdcc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096877 Sep 07 10:57:01.113555 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3638/7210] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:57:01.121200 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:01.121926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:01.128924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:01.129446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:01.129884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:01.130782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:01.131240 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:01.131851 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:01.165429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:01.165843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:01.166276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:01.166724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lazy-loading 'fault' on Instance uuid b70fda8c-8650-444c-8a15-c6c5f1e474a7 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:57:01.210887 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:01.218963 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a45fed77-3f2a-4c5c-a804-f603929ab701 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 200 len: 1355 microversion: 2.1 time: 0.101668 Sep 07 10:57:01.219529 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3573/7211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:01 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:02.244110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:02.244973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: b70fda8c-8650-444c-8a15-c6c5f1e474a7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:02.251680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:02.252187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:02.252758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:02.254236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:02.254752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:02.255214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:02.270589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] HTTP exception thrown: Instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 could not be found. Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Request method failure captured: Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 HTTP/1.1 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHi9iU-L6cjlK-hjWjcdlhQTli_6SShNzQUF26Z4ezprDGeB_fv2KnIj4ueFy289V6yJDVxhk2q9-0hRwzfRGtuDwqZNAuSTKxuWbH5AcTcuFFP0lKPtGPDn3pb4TfxXDAhL7GbN4OsKPPHuu2m_nzEwvQ0Lh4F08pIoSNpQwZ8nqbg Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/119f90dc19664b8585a9d023412579e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_119f90dc19664b8585a9d023412579e8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0549286f11854aafa51c69156e01afe4 Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 could not be found. Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'b70fda8c-8650-444c-8a15-c6c5f1e474a7'} Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 could not be found. Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 could not be found. Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:57:02.272267 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 could not be found. Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Returning 404 to user: Instance b70fda8c-8650-444c-8a15-c6c5f1e474a7 could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e1f96178-06a8-4479-9f74-e149ad25df2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7" status: 404 len: 111 microversion: 2.1 time: 0.034892 Sep 07 10:57:02.279750 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3639/7212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:02 2022] GET /compute/v2.1/servers/b70fda8c-8650-444c-8a15-c6c5f1e474a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:57:05.473376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2ba311fe-14ff-46cd-b536-403ee7d1c005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '.version_select at 0x7f14b1848310>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:05.501674 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2ba311fe-14ff-46cd-b536-403ee7d1c005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-703190564" status: 202 len: 0 microversion: 2.1 time: 0.033639 Sep 07 10:57:05.502473 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3574/7213] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 10:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-703190564 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:57:05.527420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-66b181af-b694-4a19-81cc-7e0a4d52b7e2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: .version_select at 0x7f14b0c2c1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1123556319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyGVQtatGFadJx8rNNOgmnCzusKmx973HP3S1ioF8Td4IGLYFlc89pbwLKDAlSG7l+QOEN87BZz8A45RSGt9Tz2hkcNReDEBehtUhBXuSVdvSrD57BLwNJa/t9feFzp/Q=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:05.544869 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-66b181af-b694-4a19-81cc-7e0a4d52b7e2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:57:05.552015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-66b181af-b694-4a19-81cc-7e0a4d52b7e2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:57:05.577561 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-66b181af-b694-4a19-81cc-7e0a4d52b7e2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054263 Sep 07 10:57:05.578173 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3640/7214] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:57:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:57:11.249114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:11.255956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-222037177", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "c08383ba-366a-4c9a-bf53-3a525fc0d53a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1123556319", "security_groups": [{"name": "tempest-secgroup-smoke-1765464562"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:11.384558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] validate_networks() for [('c08383ba-366a-4c9a-bf53-3a525fc0d53a', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:57:11.826216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:57:11.827001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:57:11.827491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:57:11.828047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:57:11.828639 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:57:11.840658 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:11.841627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:11.842517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:11.843313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:11.843782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:11.844220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:11.874117 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:57:11.880438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:57:11.895312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:57:11.897823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:57:11.946887 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5cac0313-f399-4b23-a457-71cca38393c0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699500 Sep 07 10:57:11.947768 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3575/7215] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:57:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:57:11.961604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d0218b83-35d2-423e-bf78-a865dfd670ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:11.963313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d0218b83-35d2-423e-bf78-a865dfd670ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:12.036565 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d0218b83-35d2-423e-bf78-a865dfd670ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:12.045384 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d0218b83-35d2-423e-bf78-a865dfd670ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1266 microversion: 2.1 time: 0.089051 Sep 07 10:57:12.046032 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3641/7216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:11 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:13.069802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:13.071083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:13.077525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:13.078336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:13.078838 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:13.079609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:13.080844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:13.081445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:13.197780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:13.210902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2e2acc81-c76b-4c38-9c1c-990bfb84de24 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1326 microversion: 2.1 time: 0.146499 Sep 07 10:57:13.211895 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3576/7217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:13 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:14.236849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:14.237929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:14.240187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=32 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:14.250686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:14.251342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:14.251907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:14.252691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:14.253279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:14.253790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:14.497159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:14.510349 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e3a490b-61b6-4b19-8498-e448f6210e46 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1392 microversion: 2.1 time: 0.278816 Sep 07 10:57:14.511232 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3642/7218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:14 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:14.836015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-16bf9b9d-b216-4cd2-91fd-b3ea66a15d20 req-3d4f89bf-e318-4899-a383-ac77619124dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe15e07b-344a-45ad-b60b-704b1214e4c7", "tag": "617bbf1e-2a02-409a-8947-066cb8f23099"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:14.848152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-16bf9b9d-b216-4cd2-91fd-b3ea66a15d20 req-3d4f89bf-e318-4899-a383-ac77619124dc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:14.848748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-16bf9b9d-b216-4cd2-91fd-b3ea66a15d20 req-3d4f89bf-e318-4899-a383-ac77619124dc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:14.849927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-16bf9b9d-b216-4cd2-91fd-b3ea66a15d20 req-3d4f89bf-e318-4899-a383-ac77619124dc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:14.861264 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-16bf9b9d-b216-4cd2-91fd-b3ea66a15d20 req-3d4f89bf-e318-4899-a383-ac77619124dc service nova] Creating event network-changed:617bbf1e-2a02-409a-8947-066cb8f23099 for instance fe15e07b-344a-45ad-b60b-704b1214e4c7 on n-h2-836830-16 Sep 07 10:57:14.866530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-16bf9b9d-b216-4cd2-91fd-b3ea66a15d20 req-3d4f89bf-e318-4899-a383-ac77619124dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034197 Sep 07 10:57:14.867228 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3577/7219] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:57:15.534885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:15.535520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:15.544313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:15.545278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:15.546107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:15.547408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:15.549109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:15.549949 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:15.718032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:15.725962 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-692fb892-6319-4f8d-a025-b0da88496e70 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1392 microversion: 2.1 time: 0.195156 Sep 07 10:57:15.726542 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3643/7220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:15 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:16.750903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:16.752093 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:16.758843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:16.759330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:16.759775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:16.760485 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:16.760929 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:16.761454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:16.978230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:16.986550 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fee47c94-e806-45c9-8f63-3af062d5888d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1392 microversion: 2.1 time: 0.240387 Sep 07 10:57:16.987408 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3578/7221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:16 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:18.009966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:18.010602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:18.013756 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 10:57:18.013905 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 10:57:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 (ip 10.222.0.60) !!! Sep 07 10:57:18.021545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:18.022053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:18.022510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:18.023233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:18.023765 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:18.024211 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:18.161808 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:18.169586 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-eb4f116e-764a-4df8-876a-0d8f4a0044c5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1392 microversion: 2.1 time: 0.163590 Sep 07 10:57:18.170166 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3644/7222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:18 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:19.182193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-6265d651-2149-4486-9b7c-348ba06b0989 req-a0f503a8-88be-4155-a140-0eb0e6381a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe15e07b-344a-45ad-b60b-704b1214e4c7", "name": "network-vif-plugged", "status": "completed", "tag": "617bbf1e-2a02-409a-8947-066cb8f23099"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:19.193804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6265d651-2149-4486-9b7c-348ba06b0989 req-a0f503a8-88be-4155-a140-0eb0e6381a4e service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:19.194127 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:19.194872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6265d651-2149-4486-9b7c-348ba06b0989 req-a0f503a8-88be-4155-a140-0eb0e6381a4e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:19.195177 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-6265d651-2149-4486-9b7c-348ba06b0989 req-a0f503a8-88be-4155-a140-0eb0e6381a4e service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:19.195878 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:19.203970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:19.205292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:19.205993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:19.207026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:19.207621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:19.208281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:19.214435 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-6265d651-2149-4486-9b7c-348ba06b0989 req-a0f503a8-88be-4155-a140-0eb0e6381a4e service nova] Creating event network-vif-plugged:617bbf1e-2a02-409a-8947-066cb8f23099 for instance fe15e07b-344a-45ad-b60b-704b1214e4c7 on n-h2-836830-16 Sep 07 10:57:19.219975 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-6265d651-2149-4486-9b7c-348ba06b0989 req-a0f503a8-88be-4155-a140-0eb0e6381a4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041198 Sep 07 10:57:19.221129 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3579/7223] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:57:19.383290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:19.391165 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-97edb69b-800b-420c-83f1-2868ddec7005 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1392 microversion: 2.1 time: 0.203034 Sep 07 10:57:19.391745 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3645/7224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:19 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:20.418651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:20.420190 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:20.427640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:20.428172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:20.428617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:20.429368 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:20.429837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:20.430278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:20.573374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:20.581538 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b319146f-74ea-44c8-82e7-6dfc1c5aad2f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1563 microversion: 2.1 time: 0.169358 Sep 07 10:57:20.582120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3580/7225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:20 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:20.604645 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:20.605304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:20.612418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:20.612922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:20.613412 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:20.614125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:20.614601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:20.615047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:20.753837 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:20.761728 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a100986d-0f46-4d72-a35c-e4252eeff2fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1563 microversion: 2.1 time: 0.160867 Sep 07 10:57:20.762303 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3646/7226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:20 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:22.406602 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a91fe652-46fe-48ec-818f-4cd7c064bb8f req-b32a6890-44b9-46f1-b473-a488436bab34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe15e07b-344a-45ad-b60b-704b1214e4c7", "tag": "617bbf1e-2a02-409a-8947-066cb8f23099"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:22.407800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:22.409389 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:22.417513 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:22.418338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:22.419917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:22.420488 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:22.421152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:22.421985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:22.422468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:22.423011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:22.426272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:22.433255 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a91fe652-46fe-48ec-818f-4cd7c064bb8f req-b32a6890-44b9-46f1-b473-a488436bab34 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:22.433786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a91fe652-46fe-48ec-818f-4cd7c064bb8f req-b32a6890-44b9-46f1-b473-a488436bab34 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:22.434231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a91fe652-46fe-48ec-818f-4cd7c064bb8f req-b32a6890-44b9-46f1-b473-a488436bab34 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:22.446661 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a91fe652-46fe-48ec-818f-4cd7c064bb8f req-b32a6890-44b9-46f1-b473-a488436bab34 service nova] Creating event network-changed:617bbf1e-2a02-409a-8947-066cb8f23099 for instance fe15e07b-344a-45ad-b60b-704b1214e4c7 on n-h2-836830-16 Sep 07 10:57:22.452558 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a91fe652-46fe-48ec-818f-4cd7c064bb8f req-b32a6890-44b9-46f1-b473-a488436bab34 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056680 Sep 07 10:57:22.453199 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3647/7227] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:57:22.623849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:22.633136 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d5eab178-d259-4bbd-aeed-f461d6041341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1563 microversion: 2.1 time: 0.243791 Sep 07 10:57:22.633761 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3581/7228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:22 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:45.883848 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:45.886180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:45.888633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:45.889556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=32 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:45.896186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:45.896691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:45.897148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:45.897886 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:45.898367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:45.898811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:45.969060 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b61cdeeb-5c94-40ce-af18-74fe185e4334 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7/action" status: 200 len: 24567 microversion: 2.1 time: 0.089738 Sep 07 10:57:45.969764 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3648/7229] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:57:45 2022] POST /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7/action => generated 24567 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:57:52.346885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:57:52.349287 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:52.352435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:52.353222 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=30 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:57:52.359039 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:52.359523 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:52.359956 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:52.360659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:52.361109 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:52.361558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:52.444144 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-935f7c20-c6fd-4915-b634-d86bd155db2a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.101029 Sep 07 10:57:52.444802 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3582/7230] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:57:52 2022] POST /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:57:52.453517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:52.454335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:52.463268 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:52.464153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:52.464710 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:52.465625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:52.466095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:52.466542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:52.672273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:52.680170 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7b6f60e6-0300-451f-a3ac-d168fe8a327c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1674 microversion: 2.1 time: 0.230898 Sep 07 10:57:52.680741 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3649/7231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:52 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:53.705773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:53.706495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:53.714199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:53.714702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:53.715144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:53.715858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:53.716331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:53.716766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:53.859757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:53.867811 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-34902f33-6987-4002-a07a-2c766f71aba7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.167333 Sep 07 10:57:53.868384 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3583/7232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:53 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:54.892305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:54.892938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:54.899927 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:54.900426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:54.900883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:54.901617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:54.902097 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:54.902547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:55.034413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:55.042941 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3e138eba-e84d-41bb-bb8f-554386d2f3cd tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.154629 Sep 07 10:57:55.043512 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3650/7233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:54 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:56.066742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:56.067363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:56.074607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:56.075092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:56.075534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:56.076223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:56.076682 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:56.077111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:56.208701 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:56.216494 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bb955d42-90ca-4697-ac24-b5bb52ff07c1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.153892 Sep 07 10:57:56.217066 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3584/7234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:56 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:57.241364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:57.242007 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:57.248953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:57.249483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:57.249934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:57.250633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:57.251099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:57.251535 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:57.388909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:57.397024 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-807c64a3-294a-428b-ae11-0513b4677eaa tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.159749 Sep 07 10:57:57.397626 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3651/7235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:57 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:58.420021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:58.420647 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:58.427724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:58.428212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:58.428660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:58.429404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:58.429860 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:58.430292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:58.566267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:58.575036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7df34145-7bca-4a23-bf33-6175455217f1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.158993 Sep 07 10:57:58.575624 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3585/7236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:58 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:57:59.598552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:57:59.599973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:57:59.606738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:59.607246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:59.607711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:59.608421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:57:59.608901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:57:59.609395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:57:59.743965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:57:59.751709 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-24a5f35b-fe92-4007-9462-3b2cb686e955 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.157170 Sep 07 10:57:59.752291 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3652/7237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:57:59 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:00.775108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:00.775723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:00.782494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:00.782978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:00.783425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:00.784104 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:00.784557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:00.784979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:00.921600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:00.930411 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-76c11684-baf1-455d-ba09-02ec9b69ab05 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.159177 Sep 07 10:58:00.930999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3586/7238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:00 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:01.954233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:01.954887 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:01.962561 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:01.963057 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:01.963509 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:01.964464 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:01.964928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:01.965396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:02.110017 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:02.117849 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-66c5238e-4ad3-4748-a929-c5b0513b1f6e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.167570 Sep 07 10:58:02.118426 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3653/7239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:01 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:03.140734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:03.141382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:03.148612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:03.149096 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:03.149567 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:03.150266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:03.150751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:03.151188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:03.610477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:03.618496 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b710e479-5293-4587-a1cb-e2119087f993 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1679 microversion: 2.1 time: 0.481668 Sep 07 10:58:03.619061 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3587/7240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:03 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1679 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:04.642113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:04.642892 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:04.650301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:04.650803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:04.651259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:04.651976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:04.652448 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:04.652903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:04.795933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:04.807109 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1b3c23b7-ea96-49f7-85a8-f8b461ccc22f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1682 microversion: 2.1 time: 0.168934 Sep 07 10:58:04.807708 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3654/7241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:04 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:29.018399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:29.020773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:29.023329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:29.024151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:29.030231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:29.030722 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:29.031171 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:29.031868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:29.032332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:29.032768 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:29.109134 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15745f11-0e7c-466d-9577-1b3f35c8cae7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7/action" status: 200 len: 69096 microversion: 2.1 time: 0.094580 Sep 07 10:58:29.110308 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3588/7242] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:58:29 2022] POST /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7/action => generated 69096 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:58:36.455273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:36.455805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:36.462692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-0aa54f08-d5a7-46ec-ae4a-ce51cae469e5 req-37b6b265-0bbd-4d95-b884-df1b9f82bec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe15e07b-344a-45ad-b60b-704b1214e4c7", "tag": "617bbf1e-2a02-409a-8947-066cb8f23099"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:36.468998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=14 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:36.470673 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=40 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:36.476600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:36.477111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:36.477639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:36.478363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:36.479014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:36.479462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:36.480027 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0aa54f08-d5a7-46ec-ae4a-ce51cae469e5 req-37b6b265-0bbd-4d95-b884-df1b9f82bec5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:36.480531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0aa54f08-d5a7-46ec-ae4a-ce51cae469e5 req-37b6b265-0bbd-4d95-b884-df1b9f82bec5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:36.480978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-0aa54f08-d5a7-46ec-ae4a-ce51cae469e5 req-37b6b265-0bbd-4d95-b884-df1b9f82bec5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:36.497267 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-0aa54f08-d5a7-46ec-ae4a-ce51cae469e5 req-37b6b265-0bbd-4d95-b884-df1b9f82bec5 service nova] Creating event network-changed:617bbf1e-2a02-409a-8947-066cb8f23099 for instance fe15e07b-344a-45ad-b60b-704b1214e4c7 on n-h2-836830-16 Sep 07 10:58:36.504702 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-0aa54f08-d5a7-46ec-ae4a-ce51cae469e5 req-37b6b265-0bbd-4d95-b884-df1b9f82bec5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045979 Sep 07 10:58:36.506521 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3589/7243] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:58:36.520199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 10:58:36.606955 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-83334842-5566-408e-a4dc-43509d81c1b7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 204 len: 0 microversion: 2.1 time: 0.155429 Sep 07 10:58:36.607707 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3655/7244] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 10:58:36 2022] DELETE /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 10:58:36.618134 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:36.619808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:36.626538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:36.627023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:36.627484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:36.628344 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:36.629487 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:36.629926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:36.876477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:36.885360 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bc6caa69-9f6e-4d38-b813-4a15e3873335 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1688 microversion: 2.1 time: 0.272872 Sep 07 10:58:36.885952 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3590/7245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:36 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1688 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:58:37.910759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:37.911486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:37.918788 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:37.919297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:37.919763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:37.920481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:37.920954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:37.921433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:38.155329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:38.163787 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93c9bcfd-baae-4cbd-8f56-e68c5cb97593 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1688 microversion: 2.1 time: 0.257340 Sep 07 10:58:38.164419 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3656/7246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:37 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:38.698343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f4a1dd5b-d83a-4c26-a6e4-1c5a4540e778 req-9a1104d3-a60d-48c4-96b7-06fe3c829bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe15e07b-344a-45ad-b60b-704b1214e4c7", "name": "network-vif-deleted", "tag": "617bbf1e-2a02-409a-8947-066cb8f23099"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:38.710354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f4a1dd5b-d83a-4c26-a6e4-1c5a4540e778 req-9a1104d3-a60d-48c4-96b7-06fe3c829bd1 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:38.710842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f4a1dd5b-d83a-4c26-a6e4-1c5a4540e778 req-9a1104d3-a60d-48c4-96b7-06fe3c829bd1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:38.711346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f4a1dd5b-d83a-4c26-a6e4-1c5a4540e778 req-9a1104d3-a60d-48c4-96b7-06fe3c829bd1 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:38.723936 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f4a1dd5b-d83a-4c26-a6e4-1c5a4540e778 req-9a1104d3-a60d-48c4-96b7-06fe3c829bd1 service nova] Creating event network-vif-deleted:617bbf1e-2a02-409a-8947-066cb8f23099 for instance fe15e07b-344a-45ad-b60b-704b1214e4c7 on n-h2-836830-16 Sep 07 10:58:38.732346 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f4a1dd5b-d83a-4c26-a6e4-1c5a4540e778 req-9a1104d3-a60d-48c4-96b7-06fe3c829bd1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Sep 07 10:58:38.733078 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3591/7247] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 10:58:39.187962 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:39.188630 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:39.195647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:39.196155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:39.196616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:39.197361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:39.197841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:39.198291 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:39.231928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:39.232452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:39.232908 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:39.233415 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lazy-loading 'fault' on Instance uuid fe15e07b-344a-45ad-b60b-704b1214e4c7 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 10:58:39.277034 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:39.284684 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd497145-febc-49a1-92c4-456c68b5e003 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 200 len: 1356 microversion: 2.1 time: 0.100669 Sep 07 10:58:39.285264 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3657/7248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:39 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:40.311064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:40.311780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: fe15e07b-344a-45ad-b60b-704b1214e4c7] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:40.318790 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:40.319286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:40.319732 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:40.320439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:40.320900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:40.321369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:40.334802 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] HTTP exception thrown: Instance fe15e07b-344a-45ad-b60b-704b1214e4c7 could not be found. Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Request method failure captured: Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 HTTP/1.1 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHi9iU-L6cjlK-hjWjcdlhQTli_6SShNzQUF26Z4ezprDGeB_fv2KnIj4ueFy289V6yJDVxhk2q9-0hRwzfRGtuDwqZNAuSTKxuWbH5AcTcuFFP0lKPtGPDn3pb4TfxXDAhL7GbN4OsKPPHuu2m_nzEwvQ0Lh4F08pIoSNpQwZ8nqbg Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/119f90dc19664b8585a9d023412579e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_119f90dc19664b8585a9d023412579e8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0549286f11854aafa51c69156e01afe4 Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance fe15e07b-344a-45ad-b60b-704b1214e4c7 could not be found. Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'fe15e07b-344a-45ad-b60b-704b1214e4c7'} Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe15e07b-344a-45ad-b60b-704b1214e4c7 could not be found. Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe15e07b-344a-45ad-b60b-704b1214e4c7 could not be found. Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:58:40.336468 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe15e07b-344a-45ad-b60b-704b1214e4c7 could not be found. Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Returning 404 to user: Instance fe15e07b-344a-45ad-b60b-704b1214e4c7 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d9966a8f-9b5b-4006-98b1-01994bedfe00 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7" status: 404 len: 111 microversion: 2.1 time: 0.032145 Sep 07 10:58:40.341809 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3592/7249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:40 2022] GET /compute/v2.1/servers/fe15e07b-344a-45ad-b60b-704b1214e4c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 10:58:43.402117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28a7345f-1e8f-4913-80b6-6c0a6ab111be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '.version_select at 0x7f14b27ad9d0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:43.434655 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28a7345f-1e8f-4913-80b6-6c0a6ab111be tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1123556319" status: 202 len: 0 microversion: 2.1 time: 0.037690 Sep 07 10:58:43.435887 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3658/7250] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 7 10:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1123556319 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 10:58:43.460170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-570de1f2-98d1-46b1-81ea-d46041a67e08 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: .version_select at 0x7f14b1b81940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-318997121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGx3yOCWgmZ81w2Gl0DaE4q38L8JwlwgQxwK4/BZhUScUcWjezoLrjhqh++hP8Sk9Fi4nc63H6Qj4e4iziPBYnsqw4Y4RRvCPfbmnlO+5Ik6EtdC61zy/1XKt24id6aTxg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:43.480029 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-570de1f2-98d1-46b1-81ea-d46041a67e08 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:58:43.486420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-570de1f2-98d1-46b1-81ea-d46041a67e08 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:58:43.510379 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-570de1f2-98d1-46b1-81ea-d46041a67e08 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054916 Sep 07 10:58:43.510981 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3593/7251] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 10:58:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:58:49.184383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1320840821", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "603d3369-ce34-43c0-87fe-3833f93dcbd3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-318997121", "security_groups": [{"name": "tempest-secgroup-smoke-158162176"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:49.281653 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:49.306471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] validate_networks() for [('603d3369-ce34-43c0-87fe-3833f93dcbd3', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 10:58:50.208752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:58:50.210319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:58:50.210980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:58:50.212129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:58:50.213047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:58:50.227113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:50.227679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:50.228139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:50.229295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:50.229781 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:50.230324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:50.249893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 10:58:50.256051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 10:58:50.270069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 10:58:50.272460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 10:58:50.329012 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d521257c-e2ac-49fb-994d-40bb92abaaa7 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.149557 Sep 07 10:58:50.330634 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3659/7252] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 10:58:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 10:58:50.343065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-63f3618b-2555-43e6-831f-a2015585c994 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:50.343803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-63f3618b-2555-43e6-831f-a2015585c994 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:50.347430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=16 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:50.439821 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-63f3618b-2555-43e6-831f-a2015585c994 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:50.449011 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-63f3618b-2555-43e6-831f-a2015585c994 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1266 microversion: 2.1 time: 0.110255 Sep 07 10:58:50.450604 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3594/7253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:50 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:51.475111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:51.476113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:51.497792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:51.498729 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:51.499203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:51.501641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:51.503177 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:51.511369 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:51.592333 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:51.624206 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2140d3d4-7136-46fe-b7bf-57d411b28428 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1318 microversion: 2.1 time: 0.154229 Sep 07 10:58:51.625352 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3660/7254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:51 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:52.665549 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:52.667620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:52.679106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:52.679605 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:52.680267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:52.681688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:52.684038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:52.684446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:52.857834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:52.867804 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-85364875-7099-4e98-a656-84b60b1fa697 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.208610 Sep 07 10:58:52.868614 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3595/7255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:52 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:53.199015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-83e98082-3b93-4807-9806-de03c4d34204 req-df4f07eb-445f-4d96-94b5-77f74eed1527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:53.220044 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-83e98082-3b93-4807-9806-de03c4d34204 req-df4f07eb-445f-4d96-94b5-77f74eed1527 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:53.221009 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-83e98082-3b93-4807-9806-de03c4d34204 req-df4f07eb-445f-4d96-94b5-77f74eed1527 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:53.221669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-83e98082-3b93-4807-9806-de03c4d34204 req-df4f07eb-445f-4d96-94b5-77f74eed1527 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:53.235589 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-83e98082-3b93-4807-9806-de03c4d34204 req-df4f07eb-445f-4d96-94b5-77f74eed1527 service nova] Creating event network-changed:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h1-836830-16 Sep 07 10:58:53.242429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-83e98082-3b93-4807-9806-de03c4d34204 req-df4f07eb-445f-4d96-94b5-77f74eed1527 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047108 Sep 07 10:58:53.243262 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3661/7256] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:58:53.891578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:53.892143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:53.899779 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:53.900271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:53.900717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:53.901453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:53.901915 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:53.902346 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:54.037735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:54.045604 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf5945f0-31fa-4223-a41a-70693fafcadb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.157995 Sep 07 10:58:54.046191 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3596/7257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:53 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:55.070112 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:55.070873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:55.078145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:55.078649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:55.079105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:55.079829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:55.080305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:55.080749 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:55.225070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:55.232909 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94d0f8d4-16f9-4ae9-8485-6f9ae45ce191 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.167491 Sep 07 10:58:55.233536 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3662/7258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:55 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:56.256161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:56.256762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:56.263670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:56.264159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:56.264600 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:56.265318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:56.265775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:56.266205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:56.400754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:56.408637 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c8932473-ba2c-4da1-84df-c5e08027775e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.156407 Sep 07 10:58:56.409233 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3597/7259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:56 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:57.432552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:57.433167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:57.440341 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:57.440858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:57.441350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:57.442075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:57.442551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:57.443719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:57.583139 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:57.591420 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-58af5682-71d1-4b69-b964-50d7b0839672 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.162853 Sep 07 10:58:57.591990 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3663/7260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:57 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:58.614528 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:58.615144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:58.622659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:58.623143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:58.623580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:58.624277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:58.624734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:58.625159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:58.767912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:58.777068 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d552b011-2712-4049-bd3e-b2062dd66148 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.166383 Sep 07 10:58:58.777911 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3598/7261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:58 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:58:58.891758 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-6348182c-a3b2-48f8-845f-83e50fc964e5 req-d6441195-a126-4ae8-bf0e-b819e67a12f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "name": "network-vif-plugged", "status": "completed", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:58:58.903672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6348182c-a3b2-48f8-845f-83e50fc964e5 req-d6441195-a126-4ae8-bf0e-b819e67a12f5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:58.904048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6348182c-a3b2-48f8-845f-83e50fc964e5 req-d6441195-a126-4ae8-bf0e-b819e67a12f5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:58.904499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-6348182c-a3b2-48f8-845f-83e50fc964e5 req-d6441195-a126-4ae8-bf0e-b819e67a12f5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:58.916096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-6348182c-a3b2-48f8-845f-83e50fc964e5 req-d6441195-a126-4ae8-bf0e-b819e67a12f5 service nova] Creating event network-vif-plugged:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h1-836830-16 Sep 07 10:58:58.921378 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-6348182c-a3b2-48f8-845f-83e50fc964e5 req-d6441195-a126-4ae8-bf0e-b819e67a12f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Sep 07 10:58:58.922141 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3664/7262] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:58:59.802628 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:58:59.803303 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:58:59.806936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:58:59.812463 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:59.812950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:59.813433 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:59.814142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:58:59.814608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:58:59.815042 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:58:59.948609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:58:59.956392 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-351213af-aa28-4ed0-b107-10198d76d24f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1391 microversion: 2.1 time: 0.157722 Sep 07 10:58:59.956966 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3599/7263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:58:59 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:00.978490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:00.979346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:00.983437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:00.984161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:00.991490 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:00.991993 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:00.992452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:00.993163 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:00.993666 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:00.994138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:01.139616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:01.148010 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd8a4ae2-b692-4644-a0f5-386fce6d9c31 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1563 microversion: 2.1 time: 0.170722 Sep 07 10:59:01.148750 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3665/7264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:00 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:01.173053 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:01.173725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:01.175665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:01.181957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:01.182440 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:01.182876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:01.183570 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:01.184024 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:01.184450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:01.317799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:01.325784 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b5c41bd3-5029-4fd1-a15d-18e4ee152216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1563 microversion: 2.1 time: 0.156560 Sep 07 10:59:01.326320 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3600/7265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:01 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:02.967416 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:02.968052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:02.976474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:02.976974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:02.977457 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:02.978197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:02.978997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:02.979106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:03.042596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-2857a0cb-168b-4612-b717-58c6d2ef67cb req-38e07b3b-e356-4723-afb4-d00f02a44522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:59:03.053310 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2857a0cb-168b-4612-b717-58c6d2ef67cb req-38e07b3b-e356-4723-afb4-d00f02a44522 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:03.054751 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2857a0cb-168b-4612-b717-58c6d2ef67cb req-38e07b3b-e356-4723-afb4-d00f02a44522 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:03.055427 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-2857a0cb-168b-4612-b717-58c6d2ef67cb req-38e07b3b-e356-4723-afb4-d00f02a44522 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:03.068848 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-2857a0cb-168b-4612-b717-58c6d2ef67cb req-38e07b3b-e356-4723-afb4-d00f02a44522 service nova] Creating event network-changed:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h1-836830-16 Sep 07 10:59:03.076282 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-2857a0cb-168b-4612-b717-58c6d2ef67cb req-38e07b3b-e356-4723-afb4-d00f02a44522 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109215 Sep 07 10:59:03.076976 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3601/7266] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 10:59:03.130069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:03.138430 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c010fac4-9a4f-4438-843d-a3246a93510c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1563 microversion: 2.1 time: 0.175140 Sep 07 10:59:03.139023 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3666/7267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:02 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:28.434224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=5 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:28.434985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=38 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:28.439235 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:59:28.441674 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:28.448904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:28.449424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:28.449869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:28.450568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:28.451033 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:28.451466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:28.509107 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c1965b9f-877a-4cce-ae6e-16f942b9eaee tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action" status: 200 len: 24570 microversion: 2.1 time: 0.076714 Sep 07 10:59:28.509806 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3602/7268] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:59:28 2022] POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 10:59:39.498919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:59:39.501249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:39.503672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:39.504344 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=36 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:39.511698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:39.512192 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:39.512646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:39.513497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:39.513967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:39.514406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:39.555940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:39.562200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Old instance type m1.heat2, new instance type m1.heat {{(pid=128832) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 10:59:39.568639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 10:59:39.569786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 10:59:39.570282 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 10:59:39.570698 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 10:59:39.571222 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 10:59:39.633579 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d1f0c7e-bf70-43ff-b0d3-9fd869ca7d02 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action" status: 202 len: 0 microversion: 2.1 time: 0.138400 Sep 07 10:59:39.634382 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3667/7269] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 10:59:39 2022] POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 10:59:39.643094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:39.644160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:39.648163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:39.648828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=4 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 10:59:39.655729 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:39.656234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:39.656638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:39.657372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:39.657823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:39.658239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:39.799525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:39.808493 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-27fa07cd-8418-46a3-846c-c1742d4bc86b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1690 microversion: 2.1 time: 0.169840 Sep 07 10:59:39.809087 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3603/7270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:39 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:40.834257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:40.835117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:40.842563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:40.843068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:40.843529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:40.844245 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:40.844723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:40.845171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:40.991376 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:40.999356 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0149839a-755a-427f-ac33-5e78cc19f299 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1690 microversion: 2.1 time: 0.169633 Sep 07 10:59:40.999927 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3668/7271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:40 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:42.028184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:42.028815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:42.039843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:42.040340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:42.040787 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:42.041537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:42.042005 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:42.042438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:42.184587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:42.192544 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-dc4239a8-08c2-41a5-94fb-e7605942f17f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1690 microversion: 2.1 time: 0.168292 Sep 07 10:59:42.193132 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3604/7272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:42 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:43.218237 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:43.218870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:43.226000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:43.227477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:43.227934 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:43.228647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:43.229119 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:43.229587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:43.371652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:43.379594 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-25babd65-9d0e-4f8f-b95b-91a9524b18a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.165544 Sep 07 10:59:43.380170 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3669/7273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:43 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:44.404045 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:44.404657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:44.411373 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:44.411864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:44.412306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:44.413869 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:44.414408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:44.414840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:44.552077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:44.560308 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-84c09b02-94b6-4950-ad50-da17dfa16cc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.160378 Sep 07 10:59:44.560884 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3605/7274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:44 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:45.583528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:45.584161 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:45.592295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:45.592798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:45.593283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:45.593991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:45.594467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:45.594913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:45.735193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:45.743026 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9adf3ae6-eac9-4d08-ac9b-7d2de060bcc2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.163435 Sep 07 10:59:45.743640 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3670/7275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:45 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:46.767174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:46.767783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:46.775232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:46.775714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:46.776150 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:46.776836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:46.777358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:46.777785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:46.916059 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:46.923761 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-223744bc-8db9-4446-a69d-fbd783c2aa6c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.160582 Sep 07 10:59:46.924333 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3606/7276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:46 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:47.948146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:47.948778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:47.956030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:47.956532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:47.956984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:47.957714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:47.958186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:47.958635 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:48.095442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:48.103515 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7d60f2cb-1a1b-428e-ae6d-65165561d712 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.160081 Sep 07 10:59:48.104113 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3671/7277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:47 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:49.127883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:49.128500 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:49.135695 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:49.136178 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:49.136614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:49.137327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:49.137782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:49.138255 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:49.276803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:49.284575 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31cca7d6-e270-474c-b824-2b841da249ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.160589 Sep 07 10:59:49.285139 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3607/7278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:49 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:50.310356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:50.310991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:50.318249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:50.318753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:50.319204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:50.319903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:50.320366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:50.320803 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:50.461884 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:50.469904 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5d5fed9-484f-435e-9db3-8c85a174218b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.163470 Sep 07 10:59:50.470482 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3672/7279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:50 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:51.493945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:51.494555 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:51.501865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:51.502348 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:51.502783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:51.503470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:51.503926 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:51.504347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:51.650972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:51.658734 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de49490c-febf-4b5d-be00-e6e78a03d611 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.168823 Sep 07 10:59:51.659312 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3608/7280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:51 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:52.683533 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:52.684104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:52.691077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:52.691573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:52.692028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:52.692727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:52.693220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:52.694220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:52.826180 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:52.833950 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-21778e16-b286-49af-9f20-eeea580b6ecb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.154509 Sep 07 10:59:52.835079 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3673/7281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:52 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 10:59:53.858958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:53.859577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:53.867438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:53.867927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:53.868369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:53.869078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:53.869561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:53.869993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:54.011699 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:54.019571 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-24da4136-5b04-4a87-a837-23fe24a1d434 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.164668 Sep 07 10:59:54.020143 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3609/7282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:53 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:55.044795 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:55.045474 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:55.052386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:55.056559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:55.057067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:55.059212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:55.059722 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:55.060183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:55.202391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:55.210655 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1edc02d0-f7b0-41ea-9734-c21edde42124 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.169818 Sep 07 10:59:55.211239 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3674/7283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:55 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:56.234714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:56.235320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:56.242837 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:56.243341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:56.243774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:56.244457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:56.244912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:56.245369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:56.381299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:56.389169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-30294ec0-2286-4a00-a8df-b29df3db1b9a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.158323 Sep 07 10:59:56.389803 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3610/7284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:56 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:57.411957 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:57.412639 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:57.419551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:57.420045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:57.420494 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:57.421219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:57.421694 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:57.422135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:57.560805 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:57.569429 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bc853e5b-e1ab-4e46-9192-f81c04ff4a11 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.160773 Sep 07 10:59:57.570008 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3675/7285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:57 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:58.593263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:58.593910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:58.601275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:58.601708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:58.602153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:58.602846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:58.603308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:58.603736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:58.737304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:58.745822 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-121e0e94-25e0-4510-958e-adb821f6461b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1695 microversion: 2.1 time: 0.156799 Sep 07 10:59:58.746403 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3611/7286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:58 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:59.770542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 10:59:59.771234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 10:59:59.778936 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:59.779430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:59.779891 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:59.780595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:59.781064 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:59.781528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:59.920156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 10:59:59.927932 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8fc00909-cf40-40b9-b3c2-f84133164242 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1694 microversion: 2.1 time: 0.161479 Sep 07 10:59:59.928526 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3676/7287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 10:59:59 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 10:59:59.961071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "name": "network-vif-unplugged", "status": "completed", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 10:59:59.971868 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 10:59:59.972357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 10:59:59.972834 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 10:59:59.985850 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] Creating event network-vif-unplugged:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h2-836830-16 Sep 07 10:59:59.992017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] Instance 690f89e8-0770-49a8-81d7-759577cec82b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 11:00:00.004398 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-f7da9c4d-b9fa-4783-96e6-fafa873b3dc2 req-5ca7094a-a4c0-45b4-a201-b9162418c2bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047271 Sep 07 11:00:00.005020 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3612/7288] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 10:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:00.952047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:00.952838 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:00.960048 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:00.960794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:00.961286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:00.962012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:00.962495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:00.962946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:01.105804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:01.114937 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-52e7eeef-a7f0-4f62-b417-a134e6a9716d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1694 microversion: 2.1 time: 0.166859 Sep 07 11:00:01.115516 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3677/7289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:00 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:02.021664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:02.031086 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:02.031561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:02.031988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:02.043509 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] Creating event network-changed:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h2-836830-16 Sep 07 11:00:02.048626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] Instance 690f89e8-0770-49a8-81d7-759577cec82b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-16', 'n-h1-836830-16'} {{(pid=128833) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 11:00:02.060126 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-62b649fd-5576-462d-95e4-84eeb2d3b308 req-9141c5f7-9fba-43f2-b1c6-80c3cf55d3c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043493 Sep 07 11:00:02.060703 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3613/7290] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:00:02.138819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:02.139523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:02.146524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:02.147033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:02.147491 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:02.148214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:02.148692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:02.149142 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:02.286719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:02.295254 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e84dfc84-286c-4779-a26b-8c1fbb71b688 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1692 microversion: 2.1 time: 0.160351 Sep 07 11:00:02.295849 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3678/7291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:02 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:03.322355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:03.323066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:03.329352 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.329843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.330284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.330976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.331434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.331865 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.472304 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:03.480409 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e5d58f1c-7d99-441e-a4c9-94989cad5fed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1689 microversion: 2.1 time: 0.164248 Sep 07 11:00:03.480987 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3614/7292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:03 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:03.503948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:03.504500 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:03.511982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.512476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.512926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.513656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.514128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.514563 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.581875 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ab2c4eb0-9a2e-4c91-ae3a-c96e4b4d05ab tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action" status: 204 len: 0 microversion: 2.1 time: 0.082001 Sep 07 11:00:03.582439 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3679/7293] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:00:03 2022] POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:00:03.590899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:03.591517 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:03.597792 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.598289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.598740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.599441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.599901 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.600853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.742158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:03.750078 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c190ac73-d4a2-4b6c-bc61-5972326290ec tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1689 microversion: 2.1 time: 0.163310 Sep 07 11:00:03.751039 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3615/7294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:03 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:00:03.773991 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:03.774720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:03.781099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.781636 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.782092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.782799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:03.783271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:03.783717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:03.930109 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:03.938767 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93659a77-457b-48bd-9e93-b540a58bba6b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1689 microversion: 2.1 time: 0.169824 Sep 07 11:00:03.939586 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3680/7295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:03 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:04.963431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:04.964047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:04.971422 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:04.972219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:04.972788 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:04.973535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:04.974707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:04.975050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:05.111464 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:05.120409 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fed0c100-48e2-48e6-b8b8-db7548ae1977 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1689 microversion: 2.1 time: 0.161185 Sep 07 11:00:05.120989 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3616/7296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:04 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:06.144230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:06.144851 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:06.151575 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:06.152079 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:06.152544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:06.153312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:06.153789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:06.154235 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:06.156997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:06.295815 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:06.305216 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-121f3ee9-e936-4acd-88a9-6dd763517a57 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1681 microversion: 2.1 time: 0.164316 Sep 07 11:00:06.305803 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3681/7297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:06 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:08.019327 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-36a2fa03-d202-4c9c-8d1c-3ca42fb0c56a req-d310e34c-3be9-4f9a-b703-0fc2c45fa7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "name": "network-vif-plugged", "status": "completed", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:08.029593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-36a2fa03-d202-4c9c-8d1c-3ca42fb0c56a req-d310e34c-3be9-4f9a-b703-0fc2c45fa7f7 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:08.030014 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-36a2fa03-d202-4c9c-8d1c-3ca42fb0c56a req-d310e34c-3be9-4f9a-b703-0fc2c45fa7f7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:08.030441 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-36a2fa03-d202-4c9c-8d1c-3ca42fb0c56a req-d310e34c-3be9-4f9a-b703-0fc2c45fa7f7 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:08.045119 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-36a2fa03-d202-4c9c-8d1c-3ca42fb0c56a req-d310e34c-3be9-4f9a-b703-0fc2c45fa7f7 service nova] Creating event network-vif-plugged:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h2-836830-16 Sep 07 11:00:08.050184 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-36a2fa03-d202-4c9c-8d1c-3ca42fb0c56a req-d310e34c-3be9-4f9a-b703-0fc2c45fa7f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108833 Sep 07 11:00:08.050842 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3617/7298] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:26.488417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:26.490792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:26.493750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=34 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:26.494431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=5 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:26.500882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:26.501480 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:26.501970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:26.502723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:26.503199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:26.503652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:26.570608 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bbe6bb1c-ee1b-449e-a647-1241d7c092d0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action" status: 200 len: 24581 microversion: 2.1 time: 0.085986 Sep 07 11:00:26.571299 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3682/7299] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:00:26 2022] POST /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b/action => generated 24581 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 11:00:33.789784 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=30 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:33.791012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=82 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:33.795704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-82a61e2e-32e6-4525-a137-44d7e902b6fa req-32f03e01-818d-4a60-b8a7-cb28bef836cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:33.796160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:33.796501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:33.803984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:33.804477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:33.805132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:33.805875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:33.806375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:33.806808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:33.807283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-82a61e2e-32e6-4525-a137-44d7e902b6fa req-32f03e01-818d-4a60-b8a7-cb28bef836cb service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:33.808021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-82a61e2e-32e6-4525-a137-44d7e902b6fa req-32f03e01-818d-4a60-b8a7-cb28bef836cb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:33.808497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-82a61e2e-32e6-4525-a137-44d7e902b6fa req-32f03e01-818d-4a60-b8a7-cb28bef836cb service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:33.820944 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-82a61e2e-32e6-4525-a137-44d7e902b6fa req-32f03e01-818d-4a60-b8a7-cb28bef836cb service nova] Creating event network-changed:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h2-836830-16 Sep 07 11:00:33.827087 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-82a61e2e-32e6-4525-a137-44d7e902b6fa req-32f03e01-818d-4a60-b8a7-cb28bef836cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036407 Sep 07 11:00:33.828258 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3683/7300] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:33.834731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:00:33.924413 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8db5cb8a-0a6d-4dbb-982a-87df92fb5451 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 204 len: 0 microversion: 2.1 time: 0.136536 Sep 07 11:00:33.925441 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3618/7301] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:00:33 2022] DELETE /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:00:33.937198 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:33.937942 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:33.944307 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:33.944819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:33.945332 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:33.946058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:33.946882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:33.947336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:34.089451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:34.097820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d1d03738-15f9-4b80-a64b-4833e4750292 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1687 microversion: 2.1 time: 0.168035 Sep 07 11:00:34.098401 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3684/7302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:33 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:35.123614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:35.124431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:35.131312 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:35.131800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:35.132236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:35.133062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:35.133547 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:35.133972 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:35.273924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:35.282050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2c6f60a5-d25b-4bde-a3a5-710e81f55136 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1687 microversion: 2.1 time: 0.162992 Sep 07 11:00:35.282626 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3619/7303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:35 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:35.913428 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-7d2d76a1-0361-484f-b75d-5ff4f7dc0558 req-27309712-b4b7-45d7-a3b5-48b9bc904a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f89e8-0770-49a8-81d7-759577cec82b", "name": "network-vif-deleted", "tag": "589e3434-28b3-448f-9b0c-021958a66657"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:35.925398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7d2d76a1-0361-484f-b75d-5ff4f7dc0558 req-27309712-b4b7-45d7-a3b5-48b9bc904a70 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:35.925890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7d2d76a1-0361-484f-b75d-5ff4f7dc0558 req-27309712-b4b7-45d7-a3b5-48b9bc904a70 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:35.926336 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-7d2d76a1-0361-484f-b75d-5ff4f7dc0558 req-27309712-b4b7-45d7-a3b5-48b9bc904a70 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:35.938826 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-7d2d76a1-0361-484f-b75d-5ff4f7dc0558 req-27309712-b4b7-45d7-a3b5-48b9bc904a70 service nova] Creating event network-vif-deleted:589e3434-28b3-448f-9b0c-021958a66657 for instance 690f89e8-0770-49a8-81d7-759577cec82b on n-h2-836830-16 Sep 07 11:00:35.945945 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-7d2d76a1-0361-484f-b75d-5ff4f7dc0558 req-27309712-b4b7-45d7-a3b5-48b9bc904a70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Sep 07 11:00:35.946544 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3685/7304] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:36.306925 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:36.308126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:36.316063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:36.316680 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:36.317131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:36.317906 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:36.318369 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:36.318801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:36.352119 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:36.352606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:36.353050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:36.353525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lazy-loading 'fault' on Instance uuid 690f89e8-0770-49a8-81d7-759577cec82b {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:00:36.401888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:36.411887 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-91c6f76b-dacd-4ea1-8f68-3071b4126647 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 200 len: 1356 microversion: 2.1 time: 0.109052 Sep 07 11:00:36.412585 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3620/7305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:36 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:37.438644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:37.439372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 690f89e8-0770-49a8-81d7-759577cec82b] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:37.445692 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:37.446196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:37.446656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:37.447367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:37.447845 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:37.448294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:37.462011 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] HTTP exception thrown: Instance 690f89e8-0770-49a8-81d7-759577cec82b could not be found. Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Request method failure captured: Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b HTTP/1.1 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHi9iU-L6cjlK-hjWjcdlhQTli_6SShNzQUF26Z4ezprDGeB_fv2KnIj4ueFy289V6yJDVxhk2q9-0hRwzfRGtuDwqZNAuSTKxuWbH5AcTcuFFP0lKPtGPDn3pb4TfxXDAhL7GbN4OsKPPHuu2m_nzEwvQ0Lh4F08pIoSNpQwZ8nqbg Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/119f90dc19664b8585a9d023412579e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_119f90dc19664b8585a9d023412579e8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 0549286f11854aafa51c69156e01afe4 Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 690f89e8-0770-49a8-81d7-759577cec82b could not be found. Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '690f89e8-0770-49a8-81d7-759577cec82b'} Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 690f89e8-0770-49a8-81d7-759577cec82b could not be found. Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 690f89e8-0770-49a8-81d7-759577cec82b could not be found. Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:00:37.463664 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 690f89e8-0770-49a8-81d7-759577cec82b could not be found. Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Returning 404 to user: Instance 690f89e8-0770-49a8-81d7-759577cec82b could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a47f626d-8897-4f31-aff1-3104ba5edf27 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b" status: 404 len: 111 microversion: 2.1 time: 0.032493 Sep 07 11:00:37.469160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3686/7306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:37 2022] GET /compute/v2.1/servers/690f89e8-0770-49a8-81d7-759577cec82b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 11:00:41.185194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3e812e6f-43a0-43d7-85d8-e4401a72c886 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '.version_select at 0x7f14b1b4eee0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:41.208404 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3e812e6f-43a0-43d7-85d8-e4401a72c886 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-318997121" status: 202 len: 0 microversion: 2.1 time: 0.027191 Sep 07 11:00:41.217727 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3621/7307] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 7 11:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-318997121 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:00:41.238888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-05193109-e59c-4118-b3c0-42dd4974bf78 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: .version_select at 0x7f14b0c0c280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2129875522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvVoKW71md15VKq209kUPTGqGpfzImnrzub9t9cwKxvhTnE6dsgDFVmF7a0cDW8Ma+Kp1v0CcQ9DEJmAn7CMemISU5X6ZlpEdoXgolqfSTb9hTMrO5r0/iUTJPIZD3CvQ=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:41.256944 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-05193109-e59c-4118-b3c0-42dd4974bf78 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:00:41.262814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-05193109-e59c-4118-b3c0-42dd4974bf78 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:00:41.286410 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-05193109-e59c-4118-b3c0-42dd4974bf78 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051510 Sep 07 11:00:41.287053 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3687/7308] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 11:00:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:46.882457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:46.893194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2077038857", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "1e100979-3714-4fba-b80e-12859d429c14"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2129875522", "security_groups": [{"name": "tempest-secgroup-smoke-1796715036"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:47.046507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] validate_networks() for [('1e100979-3714-4fba-b80e-12859d429c14', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 11:00:47.527757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 11:00:47.528176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 11:00:47.528681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 11:00:47.529094 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 11:00:47.529563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 11:00:47.538844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:47.539338 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:47.539783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:47.540665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:47.541138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:47.541635 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:47.561530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:00:47.567030 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:00:47.580234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 11:00:47.582852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 11:00:47.630851 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5926e5ea-3e24-48d7-982f-c7230943748d tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751437 Sep 07 11:00:47.631697 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3622/7309] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 11:00:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 11:00:47.641397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:47.645761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-942e881d-7472-4b32-b279-41a5ed0297c6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:47.646661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-942e881d-7472-4b32-b279-41a5ed0297c6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:47.707889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-942e881d-7472-4b32-b279-41a5ed0297c6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:47.716337 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-942e881d-7472-4b32-b279-41a5ed0297c6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1267 microversion: 2.1 time: 0.076627 Sep 07 11:00:47.716925 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3688/7310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:47 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:48.740936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:48.741811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:48.751041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:48.751826 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:48.752770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:48.753727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:48.754354 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:48.755068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:48.888118 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:48.907934 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c72f7ab9-6d48-4d07-aed4-9ad37d5cc5a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1327 microversion: 2.1 time: 0.171422 Sep 07 11:00:48.908527 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3623/7311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:48 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:00:49.932449 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:49.933217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:49.944571 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:49.945809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:49.946586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:49.947684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:49.948368 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:49.949363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:50.227704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:50.236293 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c287cd0c-cf65-4b4c-a166-df59c5e362fc tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1393 microversion: 2.1 time: 0.307792 Sep 07 11:00:50.236877 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3689/7312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:49 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1393 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:50.498691 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ddb0571c-6114-4ea5-b97c-18a4ce1b9d93 req-01039e11-391e-43ae-8d48-1165a6a8dfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164e0779-0113-4a62-9eaa-c8a070126551", "tag": "daa0e7cd-828d-405c-a22f-d50f08fb1dd1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:50.512062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ddb0571c-6114-4ea5-b97c-18a4ce1b9d93 req-01039e11-391e-43ae-8d48-1165a6a8dfc5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:50.512734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ddb0571c-6114-4ea5-b97c-18a4ce1b9d93 req-01039e11-391e-43ae-8d48-1165a6a8dfc5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:50.513282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ddb0571c-6114-4ea5-b97c-18a4ce1b9d93 req-01039e11-391e-43ae-8d48-1165a6a8dfc5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:50.529207 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ddb0571c-6114-4ea5-b97c-18a4ce1b9d93 req-01039e11-391e-43ae-8d48-1165a6a8dfc5 service nova] Creating event network-changed:daa0e7cd-828d-405c-a22f-d50f08fb1dd1 for instance 164e0779-0113-4a62-9eaa-c8a070126551 on n-h2-836830-16 Sep 07 11:00:50.534311 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ddb0571c-6114-4ea5-b97c-18a4ce1b9d93 req-01039e11-391e-43ae-8d48-1165a6a8dfc5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040246 Sep 07 11:00:50.535142 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3624/7313] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:00:51.260182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:51.260946 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:51.268735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:51.269271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:51.269731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:51.270439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:51.270951 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:51.271396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:51.407420 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:51.415925 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a455f77c-94bd-4640-8dca-2051e5f56bfb tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1393 microversion: 2.1 time: 0.159747 Sep 07 11:00:51.416514 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3690/7314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:51 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:52.440782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:52.441592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:52.447849 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:52.448342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:52.448937 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:52.449992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:52.450458 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:52.450889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:52.678245 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:52.687519 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7a5dbe97-8387-4633-aa25-c3dab450bb86 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1393 microversion: 2.1 time: 0.251099 Sep 07 11:00:52.688610 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3625/7315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:52 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1393 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:53.711171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:53.711738 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:53.719871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:53.720360 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:53.720812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:53.721559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:53.722037 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:53.722476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:53.863199 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:53.871244 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c02eaf9d-a38e-4e12-835f-f68847fa0d87 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1393 microversion: 2.1 time: 0.164140 Sep 07 11:00:53.871816 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3691/7316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:53 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:54.894800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:54.895426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:54.902907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:54.903400 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:54.903846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:54.904543 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:54.905007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:54.905467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:55.048723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:55.056484 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7fa04849-3a80-42f6-a2a2-455f5aa5bf3f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1393 microversion: 2.1 time: 0.165662 Sep 07 11:00:55.057057 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3626/7317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:54 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:56.059605 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5d61aaba-a54d-4055-bcf6-e8fed4800923 req-5c218166-e2ae-44f1-871a-bec989e5dd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164e0779-0113-4a62-9eaa-c8a070126551", "name": "network-vif-plugged", "status": "completed", "tag": "daa0e7cd-828d-405c-a22f-d50f08fb1dd1"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:56.072174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5d61aaba-a54d-4055-bcf6-e8fed4800923 req-5c218166-e2ae-44f1-871a-bec989e5dd6a service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:56.074338 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5d61aaba-a54d-4055-bcf6-e8fed4800923 req-5c218166-e2ae-44f1-871a-bec989e5dd6a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:56.074811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5d61aaba-a54d-4055-bcf6-e8fed4800923 req-5c218166-e2ae-44f1-871a-bec989e5dd6a service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:56.079147 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:56.080331 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:56.086551 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5d61aaba-a54d-4055-bcf6-e8fed4800923 req-5c218166-e2ae-44f1-871a-bec989e5dd6a service nova] Creating event network-vif-plugged:daa0e7cd-828d-405c-a22f-d50f08fb1dd1 for instance 164e0779-0113-4a62-9eaa-c8a070126551 on n-h2-836830-16 Sep 07 11:00:56.087172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:56.087874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:56.088324 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:56.089036 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:56.089524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:56.090164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:56.092440 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5d61aaba-a54d-4055-bcf6-e8fed4800923 req-5c218166-e2ae-44f1-871a-bec989e5dd6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Sep 07 11:00:56.093057 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3692/7318] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:56.288846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:56.297699 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-49a1667b-46d5-49ad-b633-e78618a682b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1393 microversion: 2.1 time: 0.222577 Sep 07 11:00:56.298405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3627/7319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:56 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1393 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:00:57.323460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:57.324890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:57.327711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:57.334471 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:57.334980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:57.335468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:57.336186 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:57.336657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:57.337111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:57.528871 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:57.536943 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2beaa93-418d-453f-a2fe-7e0477b339b8 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1564 microversion: 2.1 time: 0.217962 Sep 07 11:00:57.537572 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3693/7320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:57 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1564 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:57.561251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:57.561874 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:57.564763 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:57.570453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:57.570882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:57.571326 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:57.572017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:57.572475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:57.572904 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:57.573538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:57.708480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:57.716806 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc148e69-8c87-42fd-aa3b-19f3d3a86683 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1564 microversion: 2.1 time: 0.160172 Sep 07 11:00:57.717431 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3628/7321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:57 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:00:59.366700 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-51ed830a-7d32-44b5-b480-0f1e8ba2b762 req-543f01ae-b254-4e54-a620-efeffcc909ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164e0779-0113-4a62-9eaa-c8a070126551", "tag": "daa0e7cd-828d-405c-a22f-d50f08fb1dd1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:00:59.373203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:00:59.373842 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:00:59.375819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:00:59.386761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:59.387264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:59.387715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:59.388427 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:59.388919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:59.389385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:59.396899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-51ed830a-7d32-44b5-b480-0f1e8ba2b762 req-543f01ae-b254-4e54-a620-efeffcc909ff service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:00:59.397429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-51ed830a-7d32-44b5-b480-0f1e8ba2b762 req-543f01ae-b254-4e54-a620-efeffcc909ff service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:00:59.397861 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-51ed830a-7d32-44b5-b480-0f1e8ba2b762 req-543f01ae-b254-4e54-a620-efeffcc909ff service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:00:59.415468 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-51ed830a-7d32-44b5-b480-0f1e8ba2b762 req-543f01ae-b254-4e54-a620-efeffcc909ff service nova] Creating event network-changed:daa0e7cd-828d-405c-a22f-d50f08fb1dd1 for instance 164e0779-0113-4a62-9eaa-c8a070126551 on n-h2-836830-16 Sep 07 11:00:59.422617 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-51ed830a-7d32-44b5-b480-0f1e8ba2b762 req-543f01ae-b254-4e54-a620-efeffcc909ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059397 Sep 07 11:00:59.423141 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3629/7322] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:00:59.601977 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:00:59.611260 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31fcc6d3-8085-46c1-adf1-6fcf6d13f262 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1564 microversion: 2.1 time: 0.250521 Sep 07 11:00:59.611843 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3694/7323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:00:59 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:22.859669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:01:22.860364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=36 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:01:22.864609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:01:22.867126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:22.875336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:22.875845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:22.876273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:22.876969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:22.877452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:22.877883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:22.947801 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-06ddd93d-4a17-4466-bf9e-c36b93c19d4a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action" status: 200 len: 24574 microversion: 2.1 time: 0.090213 Sep 07 11:01:22.948471 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3630/7324] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:01:22 2022] POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action => generated 24574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 11:01:29.363655 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-31e785a0-8c12-4f49-9073-9ce028eb192a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:01:29.366072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:01:29.366800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=32 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:01:29.372726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e785a0-8c12-4f49-9073-9ce028eb192a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:29.373915 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e785a0-8c12-4f49-9073-9ce028eb192a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:29.374408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-31e785a0-8c12-4f49-9073-9ce028eb192a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:29.400609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-31e785a0-8c12-4f49-9073-9ce028eb192a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Going to try to stop instance {{(pid=128832) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 11:01:29.444812 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-31e785a0-8c12-4f49-9073-9ce028eb192a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action" status: 202 len: 0 microversion: 2.1 time: 0.084844 Sep 07 11:01:29.445464 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3695/7325] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:01:29 2022] POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:01:29.455145 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:29.455853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:29.464681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:29.465772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:29.466217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:29.468481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:29.468970 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:29.469431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:29.618817 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:29.626759 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3fd3413c-dfb0-44cf-8db3-981db9add0ce tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.176824 Sep 07 11:01:29.627335 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3631/7326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:29 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:30.650786 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:30.651519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:30.658899 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:30.659406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:30.659867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:30.660580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:30.661089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:30.661564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:30.795612 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:30.803499 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-43017e1f-2a4f-4afb-924d-741ac7bd146c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.156989 Sep 07 11:01:30.804080 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3696/7327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:30 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:31.828519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:31.829143 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:31.836124 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:31.836617 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:31.837064 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:31.837800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:31.838263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:31.838698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:31.979799 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:31.988628 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15de216e-e2eb-4309-8264-a7f5e781c4ca tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.164928 Sep 07 11:01:31.989205 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3632/7328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:31 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:33.012713 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:33.013383 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:33.021075 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:33.021609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:33.022070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:33.022784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:33.023262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:33.023715 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:33.161997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:33.169778 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-52783f58-4137-4553-b22e-193a17e62bb6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.161053 Sep 07 11:01:33.170653 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3697/7329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:33 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:34.193903 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:34.194521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:34.202347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:34.202841 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:34.203283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:34.203989 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:34.204477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:34.204910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:34.340349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:34.348988 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6f0fce39-b006-4a91-9e56-66b71f6cca2b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.159079 Sep 07 11:01:34.349577 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3633/7330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:34 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:35.371889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:35.372531 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:35.379047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:35.379536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:35.379982 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:35.380677 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:35.381141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:35.381606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:35.522644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:35.530919 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f467ace0-b5d9-4798-aa20-2b15e0910795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.162972 Sep 07 11:01:35.531501 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3698/7331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:35 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:36.554760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:36.555380 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:36.563627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:36.564113 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:36.564552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:36.565274 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:36.565735 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:36.566168 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:36.707290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:36.715067 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-de96d382-36c5-4b9e-8ea9-7615bdbc34f0 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.164279 Sep 07 11:01:36.715629 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3634/7332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:36 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:37.738757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:37.739434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:37.746643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:37.747153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:37.747650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:37.748978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:37.749521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:37.750022 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:37.886735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:37.895521 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cc197d08-7e2a-47fe-9017-f714db6b86f2 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.160870 Sep 07 11:01:37.896091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3699/7333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:37 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:38.919374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:38.919969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:38.927524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:38.928001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:38.928434 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:38.929115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:38.929596 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:38.930021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:39.063249 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:39.071051 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f76eac25-d437-4743-a6a5-3b77eb4d5b7c tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1693 microversion: 2.1 time: 0.155549 Sep 07 11:01:39.071643 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3635/7334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:38 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:40.094923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:40.095544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:40.102591 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:40.103085 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:40.103542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:40.104243 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:40.104711 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:40.105150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:40.237598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:40.245288 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f966bbbf-c68f-43e4-a450-28c2b14e6182 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1670 microversion: 2.1 time: 0.154541 Sep 07 11:01:40.245859 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3700/7335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:40 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:41.347697 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:01:41.349959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:41.357173 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:41.357705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:41.358757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:41.359457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:41.359919 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:41.360349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:41.423170 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c9d0d3dc-ae74-49a5-8f63-6f2dbd989243 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action" status: 200 len: 36161 microversion: 2.1 time: 0.083925 Sep 07 11:01:41.423841 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3636/7336] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:01:41 2022] POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action => generated 36161 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 11:01:41.435587 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-48070c06-6b98-47c4-802a-25672b45169b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:01:41.443257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48070c06-6b98-47c4-802a-25672b45169b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:41.443760 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48070c06-6b98-47c4-802a-25672b45169b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:41.444219 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48070c06-6b98-47c4-802a-25672b45169b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:41.467032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-48070c06-6b98-47c4-802a-25672b45169b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Going to try to start instance {{(pid=128832) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 11:01:41.512398 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-48070c06-6b98-47c4-802a-25672b45169b tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action" status: 202 len: 0 microversion: 2.1 time: 0.080414 Sep 07 11:01:41.512936 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3701/7337] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:01:41 2022] POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:01:41.522469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:41.523183 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:41.530762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:41.531260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:41.531708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:41.532494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:41.532960 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:41.533431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:41.734107 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:41.742169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52ae9ef2-5eea-4eca-aef4-524f6bd25290 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1679 microversion: 2.1 time: 0.223910 Sep 07 11:01:41.742945 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3637/7338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:41 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1679 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:01:42.769582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:01:42.770304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:01:42.776544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:42.777045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:42.777528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:42.778233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:01:42.778708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:01:42.779147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:01:42.917524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:01:42.925250 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a3d86849-5acc-47ec-8798-2ac233b8929f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1683 microversion: 2.1 time: 0.161597 Sep 07 11:01:42.925821 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3702/7339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:01:42 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:07.113276 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:07.115514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:07.118320 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=16 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:07.118987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=44 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:07.124738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:07.125265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:07.125714 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:07.126411 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:07.126936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:07.127454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:07.202593 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-231df22d-50d1-42c1-a360-595229e7737a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action" status: 200 len: 60729 microversion: 2.1 time: 0.093604 Sep 07 11:02:07.203215 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3638/7340] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:02:07 2022] POST /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551/action => generated 60729 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 11:02:14.588719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:14.588719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:14.589569 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8753d539-2da1-4e9e-8e32-652582f5db2c req-3fc81a15-7283-449b-8dd9-78bedb8479ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164e0779-0113-4a62-9eaa-c8a070126551", "tag": "daa0e7cd-828d-405c-a22f-d50f08fb1dd1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:14.592241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=16 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:14.593047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:14.600339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:14.600817 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:14.601314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:14.602229 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:14.602520 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:14.602969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:14.603946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8753d539-2da1-4e9e-8e32-652582f5db2c req-3fc81a15-7283-449b-8dd9-78bedb8479ef service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:14.604740 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8753d539-2da1-4e9e-8e32-652582f5db2c req-3fc81a15-7283-449b-8dd9-78bedb8479ef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:14.605195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8753d539-2da1-4e9e-8e32-652582f5db2c req-3fc81a15-7283-449b-8dd9-78bedb8479ef service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:14.618796 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8753d539-2da1-4e9e-8e32-652582f5db2c req-3fc81a15-7283-449b-8dd9-78bedb8479ef service nova] Creating event network-changed:daa0e7cd-828d-405c-a22f-d50f08fb1dd1 for instance 164e0779-0113-4a62-9eaa-c8a070126551 on n-h2-836830-16 Sep 07 11:02:14.624348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8753d539-2da1-4e9e-8e32-652582f5db2c req-3fc81a15-7283-449b-8dd9-78bedb8479ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039096 Sep 07 11:02:14.626056 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3639/7341] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:02:14.642356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:02:14.732291 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2383eae1-73fe-48bc-94e1-f5f2a02a582a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 204 len: 0 microversion: 2.1 time: 0.148725 Sep 07 11:02:14.737861 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3703/7342] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:02:14 2022] DELETE /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:02:14.748760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:14.749908 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:14.758128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:14.758624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:14.759070 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:14.759807 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:14.760271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:14.760703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:14.904959 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:14.913325 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-206b9f22-db0b-424d-9095-3f994166297e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1689 microversion: 2.1 time: 0.173296 Sep 07 11:02:14.913948 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3640/7343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:14 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:15.938721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:15.939355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:15.949267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:15.949854 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:15.950356 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:15.951091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:15.951568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:15.952008 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:16.135220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:16.143556 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-adef67cc-3e8e-4def-b9f0-71ad71f4e53a tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1689 microversion: 2.1 time: 0.208760 Sep 07 11:02:16.144128 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3704/7344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:15 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:16.862983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-46eeaac5-78e6-49b5-bc61-5fe997c7a0e2 req-858d876b-9af2-4834-b913-d97b32f2c77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164e0779-0113-4a62-9eaa-c8a070126551", "name": "network-vif-deleted", "tag": "daa0e7cd-828d-405c-a22f-d50f08fb1dd1"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:16.873497 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-46eeaac5-78e6-49b5-bc61-5fe997c7a0e2 req-858d876b-9af2-4834-b913-d97b32f2c77b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:16.873985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-46eeaac5-78e6-49b5-bc61-5fe997c7a0e2 req-858d876b-9af2-4834-b913-d97b32f2c77b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:16.874426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-46eeaac5-78e6-49b5-bc61-5fe997c7a0e2 req-858d876b-9af2-4834-b913-d97b32f2c77b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:16.885530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-46eeaac5-78e6-49b5-bc61-5fe997c7a0e2 req-858d876b-9af2-4834-b913-d97b32f2c77b service nova] Creating event network-vif-deleted:daa0e7cd-828d-405c-a22f-d50f08fb1dd1 for instance 164e0779-0113-4a62-9eaa-c8a070126551 on n-h2-836830-16 Sep 07 11:02:16.891318 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-46eeaac5-78e6-49b5-bc61-5fe997c7a0e2 req-858d876b-9af2-4834-b913-d97b32f2c77b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083162 Sep 07 11:02:16.891958 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3641/7345] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:02:17.168228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:17.168855 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:17.176195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:17.177067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:17.177569 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:17.178297 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:17.178771 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:17.179212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:17.214559 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:17.215159 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:17.215616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:17.216228 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lazy-loading 'fault' on Instance uuid 164e0779-0113-4a62-9eaa-c8a070126551 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:02:17.260231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:17.270006 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-076f2b0f-c380-46cc-a0f3-29bc12825edf tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 200 len: 1357 microversion: 2.1 time: 0.105851 Sep 07 11:02:17.270594 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3705/7346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:17 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:18.296007 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:18.296749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: 164e0779-0113-4a62-9eaa-c8a070126551] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:18.304125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:18.304612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:18.305047 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:18.305766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:18.306223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:18.306650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:18.320741 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] HTTP exception thrown: Instance 164e0779-0113-4a62-9eaa-c8a070126551 could not be found. Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Request method failure captured: Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 HTTP/1.1 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHi9iU-L6cjlK-hjWjcdlhQTli_6SShNzQUF26Z4ezprDGeB_fv2KnIj4ueFy289V6yJDVxhk2q9-0hRwzfRGtuDwqZNAuSTKxuWbH5AcTcuFFP0lKPtGPDn3pb4TfxXDAhL7GbN4OsKPPHuu2m_nzEwvQ0Lh4F08pIoSNpQwZ8nqbg Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/119f90dc19664b8585a9d023412579e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_119f90dc19664b8585a9d023412579e8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0549286f11854aafa51c69156e01afe4 Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 164e0779-0113-4a62-9eaa-c8a070126551 could not be found. Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '164e0779-0113-4a62-9eaa-c8a070126551'} Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164e0779-0113-4a62-9eaa-c8a070126551 could not be found. Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164e0779-0113-4a62-9eaa-c8a070126551 could not be found. Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:02:18.322406 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164e0779-0113-4a62-9eaa-c8a070126551 could not be found. Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Returning 404 to user: Instance 164e0779-0113-4a62-9eaa-c8a070126551 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ad1508cf-6985-458f-b164-81ae49f6d921 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551" status: 404 len: 111 microversion: 2.1 time: 0.033156 Sep 07 11:02:18.326953 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3642/7347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:18 2022] GET /compute/v2.1/servers/164e0779-0113-4a62-9eaa-c8a070126551 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 11:02:21.415189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-862e0c1e-eb58-44bd-94c0-ecb80827d218 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '.version_select at 0x7f14b065eb80>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:21.429236 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:02:21.429442 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:02:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2129875522 (ip 10.222.0.60) !!! Sep 07 11:02:21.442918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-862e0c1e-eb58-44bd-94c0-ecb80827d218 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2129875522" status: 202 len: 0 microversion: 2.1 time: 0.031518 Sep 07 11:02:21.443612 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3706/7348] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 7 11:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2129875522 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:02:21.474049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e88364c1-678e-4a01-b7a3-8dd43fb379f6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: .version_select at 0x7f14b2ae9e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1443632414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7k0Y5g7oi2uLmE1vEe3fnE+rLYUcaRbDgb6QEdCjvYFNFvTqEMMK7Ip9HfmJDZblhJaHnnYLJzkVe4zLwbFtyk62DsRCbEYhvGEKXPo3jV2z7AMwahQLoPEneNDfQtBg=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:21.492374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e88364c1-678e-4a01-b7a3-8dd43fb379f6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:02:21.497931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-e88364c1-678e-4a01-b7a3-8dd43fb379f6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:02:21.522101 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e88364c1-678e-4a01-b7a3-8dd43fb379f6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052110 Sep 07 11:02:21.522630 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3643/7349] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 11:02:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:02:27.615658 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:27.621576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1334941045", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "networks": [{"uuid": "8e38bc73-1423-477f-ba7b-31be77ed3e08"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1443632414", "security_groups": [{"name": "tempest-secgroup-smoke-335527804"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:27.745102 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] validate_networks() for [('8e38bc73-1423-477f-ba7b-31be77ed3e08', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 11:02:28.192983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 11:02:28.193445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 11:02:28.193933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 11:02:28.194353 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 11:02:28.194782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 11:02:28.205125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:28.205656 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:28.206106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:28.207106 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:28.207821 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:28.208274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:28.228012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:02:28.233576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Getting quotas for user 0549286f11854aafa51c69156e01afe4 and project 119f90dc19664b8585a9d023412579e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:02:28.248053 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 11:02:28.250492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 11:02:28.305262 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4730e0f8-e15a-40d2-ae73-ecc32c4c6ea6 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691214 Sep 07 11:02:28.312336 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3707/7350] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 11:02:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 11:02:28.315378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=16 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:28.322160 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-137d0c28-1e03-4bba-adc6-84c2f013dfe3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:28.323655 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-137d0c28-1e03-4bba-adc6-84c2f013dfe3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:28.398115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-137d0c28-1e03-4bba-adc6-84c2f013dfe3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:28.406019 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-137d0c28-1e03-4bba-adc6-84c2f013dfe3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1267 microversion: 2.1 time: 0.092427 Sep 07 11:02:28.406711 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3644/7351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:28 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:02:29.428205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-16a4d05a-47bb-454a-b57e-3811efa62217 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:29.428847 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-16a4d05a-47bb-454a-b57e-3811efa62217 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:29.493499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-16a4d05a-47bb-454a-b57e-3811efa62217 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:29.507336 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-16a4d05a-47bb-454a-b57e-3811efa62217 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1267 microversion: 2.1 time: 0.083252 Sep 07 11:02:29.507961 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3708/7352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:29 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:30.531391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-99a9e7a2-da9b-4740-85aa-700914a72c22 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:30.532006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-99a9e7a2-da9b-4740-85aa-700914a72c22 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:30.594146 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-99a9e7a2-da9b-4740-85aa-700914a72c22 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:30.601779 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-99a9e7a2-da9b-4740-85aa-700914a72c22 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1267 microversion: 2.1 time: 0.074223 Sep 07 11:02:30.602347 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3645/7353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:30 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:31.625686 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7f1d66aa-63de-4e74-8662-1681fd3ef216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:31.626483 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7f1d66aa-63de-4e74-8662-1681fd3ef216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:31.682400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7f1d66aa-63de-4e74-8662-1681fd3ef216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:31.689295 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7f1d66aa-63de-4e74-8662-1681fd3ef216 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1267 microversion: 2.1 time: 0.067478 Sep 07 11:02:31.689864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3709/7354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:31 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1267 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:32.712848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:32.713592 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:32.720843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:32.721711 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:32.722854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:32.723748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:32.724180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:32.724618 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:32.789019 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:32.796928 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-87c5041f-1cf3-4952-81ae-1d2d745980b4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1271 microversion: 2.1 time: 0.087956 Sep 07 11:02:32.797658 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3646/7355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:32 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:02:33.820828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:33.821492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:33.829407 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:33.829913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:33.830377 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:33.831092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:33.831568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:33.832521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:33.898210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:33.906063 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b520d1d8-9ddb-4dd3-9f29-93249e106ef3 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1325 microversion: 2.1 time: 0.089876 Sep 07 11:02:33.906635 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3710/7356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:33 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:34.865709 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-259710a0-4d2d-4c7d-b693-1a3ab61c2b30 req-4117b7bc-50ea-438f-9e43-10e85724820f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f99e7e-730f-4402-9fd9-41c60b1d2f58", "tag": "c916c452-7e54-43cf-b076-17c6ea9a6505"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:34.876142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-259710a0-4d2d-4c7d-b693-1a3ab61c2b30 req-4117b7bc-50ea-438f-9e43-10e85724820f service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:34.876795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-259710a0-4d2d-4c7d-b693-1a3ab61c2b30 req-4117b7bc-50ea-438f-9e43-10e85724820f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:34.877435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-259710a0-4d2d-4c7d-b693-1a3ab61c2b30 req-4117b7bc-50ea-438f-9e43-10e85724820f service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:34.892376 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-259710a0-4d2d-4c7d-b693-1a3ab61c2b30 req-4117b7bc-50ea-438f-9e43-10e85724820f service nova] Creating event network-changed:c916c452-7e54-43cf-b076-17c6ea9a6505 for instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 on n-h2-836830-16 Sep 07 11:02:34.898145 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-259710a0-4d2d-4c7d-b693-1a3ab61c2b30 req-4117b7bc-50ea-438f-9e43-10e85724820f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036890 Sep 07 11:02:34.898778 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3647/7357] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:02:34.929714 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:34.930349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:34.937397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:34.937895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:34.938349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:34.939058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:34.939524 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:34.939966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:35.080468 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:35.089394 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-376c6c57-8425-4073-94b8-2d8356cb6a99 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1392 microversion: 2.1 time: 0.163329 Sep 07 11:02:35.089900 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3711/7358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:34 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:36.116290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:36.117012 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:36.123407 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:36.123891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:36.124425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:36.125126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:36.125611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:36.126041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:36.266832 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:36.274962 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c947ba2d-cd0d-450b-9092-de27f110d14f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1392 microversion: 2.1 time: 0.164939 Sep 07 11:02:36.275551 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3648/7359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:36 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:37.303976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:37.304615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:37.311113 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:37.311622 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:37.312084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:37.312827 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:37.313340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:37.313796 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:37.455552 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:37.463640 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-521f5416-2ba1-424c-a56b-1ab74dc24889 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1392 microversion: 2.1 time: 0.164467 Sep 07 11:02:37.464233 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3712/7360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:37 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:38.486494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:38.487114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:38.490284 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:38.495845 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:38.496345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:38.496794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:38.497533 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:38.497998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:38.498435 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:38.636511 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:38.644876 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-58521255-cb99-4a74-9359-c9a256e857c4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1392 microversion: 2.1 time: 0.161736 Sep 07 11:02:38.645563 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3649/7361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:38 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:39.668342 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:39.668898 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:39.670831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:39.677705 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:39.678215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:39.678675 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:39.679391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:39.679870 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:39.680319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:39.816813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:39.826124 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-027c705c-34f9-41e5-bb7a-b0d46ec01528 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1392 microversion: 2.1 time: 0.160381 Sep 07 11:02:39.826722 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3713/7362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:39 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:40.671770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-02066096-7384-444f-a660-3f3389671446 req-5d02e89e-0183-4dba-a4b4-1c95d94122f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f99e7e-730f-4402-9fd9-41c60b1d2f58", "name": "network-vif-plugged", "status": "completed", "tag": "c916c452-7e54-43cf-b076-17c6ea9a6505"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:40.678875 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=8 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:40.684958 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-02066096-7384-444f-a660-3f3389671446 req-5d02e89e-0183-4dba-a4b4-1c95d94122f9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:40.685474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-02066096-7384-444f-a660-3f3389671446 req-5d02e89e-0183-4dba-a4b4-1c95d94122f9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:40.685913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-02066096-7384-444f-a660-3f3389671446 req-5d02e89e-0183-4dba-a4b4-1c95d94122f9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:40.698050 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-02066096-7384-444f-a660-3f3389671446 req-5d02e89e-0183-4dba-a4b4-1c95d94122f9 service nova] Creating event network-vif-plugged:c916c452-7e54-43cf-b076-17c6ea9a6505 for instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 on n-h2-836830-16 Sep 07 11:02:40.703036 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-02066096-7384-444f-a660-3f3389671446 req-5d02e89e-0183-4dba-a4b4-1c95d94122f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034994 Sep 07 11:02:40.703643 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3650/7363] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:02:40.852027 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:40.852662 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:40.859588 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:40.860091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:40.860546 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:40.861286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:40.861763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:40.862208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:40.999054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:41.006993 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-67f71152-a10d-4ce8-8c39-32ad7b64ecd4 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1392 microversion: 2.1 time: 0.159936 Sep 07 11:02:41.007572 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3714/7364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:40 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:42.031738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:42.032450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:42.039289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:42.039772 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:42.040208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:42.040900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:42.041384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:42.041811 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:42.183038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:42.190880 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e79cc5cf-f48f-4257-9fb0-aba77f1b3341 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1563 microversion: 2.1 time: 0.164251 Sep 07 11:02:42.191587 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3651/7365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:42 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:42.213521 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:42.214181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:42.216076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=10 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:02:42.223144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:42.223731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:42.224077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:42.224790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:42.225966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:42.225966 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:42.363196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:42.371678 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-9561f3b1-3261-4501-8a72-8332986dc3ac tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1563 microversion: 2.1 time: 0.162243 Sep 07 11:02:42.372241 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3715/7366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:42 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:02:43.965654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:02:43.966301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:02:43.974294 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-758dba71-7083-446c-8c6f-cd7d6d16f66e req-bb9b71c0-c2a5-4a5a-8b19-66c5c65f3dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f99e7e-730f-4402-9fd9-41c60b1d2f58", "tag": "c916c452-7e54-43cf-b076-17c6ea9a6505"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:02:43.982074 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:43.982973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:43.983446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:43.984153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:43.984664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:43.985330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:43.986302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-758dba71-7083-446c-8c6f-cd7d6d16f66e req-bb9b71c0-c2a5-4a5a-8b19-66c5c65f3dd6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:02:43.986799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-758dba71-7083-446c-8c6f-cd7d6d16f66e req-bb9b71c0-c2a5-4a5a-8b19-66c5c65f3dd6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:02:43.987247 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-758dba71-7083-446c-8c6f-cd7d6d16f66e req-bb9b71c0-c2a5-4a5a-8b19-66c5c65f3dd6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:02:43.999471 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-758dba71-7083-446c-8c6f-cd7d6d16f66e req-bb9b71c0-c2a5-4a5a-8b19-66c5c65f3dd6 service nova] Creating event network-changed:c916c452-7e54-43cf-b076-17c6ea9a6505 for instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 on n-h2-836830-16 Sep 07 11:02:44.005443 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-758dba71-7083-446c-8c6f-cd7d6d16f66e req-bb9b71c0-c2a5-4a5a-8b19-66c5c65f3dd6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 Sep 07 11:02:44.006475 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3716/7367] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:02:44.136156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:02:44.145115 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-60babb86-83db-4cdb-b3d8-94550e9d40ed tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1563 microversion: 2.1 time: 0.183040 Sep 07 11:02:44.146114 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3652/7368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:02:43 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:07.400418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:07.401208 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=40 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:07.406209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:07.408594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:07.417364 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:07.417873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:07.418329 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:07.419052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:07.419526 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:07.419971 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:07.493189 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1b06cde3-abd1-4b37-bdbb-5fc2ceda6e6f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action" status: 200 len: 24576 microversion: 2.1 time: 0.094609 Sep 07 11:03:07.493889 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3717/7369] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:03:07 2022] POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action => generated 24576 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 11:03:13.941153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:13.941836 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:13.943961 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=7 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:13.944638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=34 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:13.950669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:13.951159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:13.951597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:13.952293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:13.952757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:13.953213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:13.977833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lazy-loading 'flavor' on Instance uuid d8f99e7e-730f-4402-9fd9-41c60b1d2f58 {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:03:14.048219 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-351f532f-80c5-4240-9193-917b8c31fb2e tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action" status: 202 len: 0 microversion: 2.1 time: 0.111231 Sep 07 11:03:14.048872 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3653/7370] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:03:13 2022] POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:03:14.057922 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:14.058650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:14.066907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:14.067556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:14.068043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:14.068766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:14.069259 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:14.069763 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:14.205120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:14.213820 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b0edcacb-4cbd-4fc9-a71d-8df2106facd5 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1689 microversion: 2.1 time: 0.160463 Sep 07 11:03:14.214388 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3718/7371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:14 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:15.240425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:15.241137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:15.247498 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:15.247988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:15.248431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:15.249127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:15.249615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:15.250043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:15.388399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:15.396176 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-71afc99b-9275-4626-9bc6-1ca516d8a592 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1672 microversion: 2.1 time: 0.161070 Sep 07 11:03:15.396747 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3654/7372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:15 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:16.493700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:16.495916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:16.506305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:16.506804 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:16.507901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:16.508606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:16.509077 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:16.509545 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:16.572020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b5da777b-6fb2-4ebb-9b68-1714a37c1ed1 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action" status: 200 len: 35853 microversion: 2.1 time: 0.082855 Sep 07 11:03:16.572666 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3719/7373] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:03:16 2022] POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action => generated 35853 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 11:03:16.584306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:16.584842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:16.592499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:16.592973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:16.593430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:16.594106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:16.594552 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:16.594976 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:16.663723 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bec7d20f-0579-41b5-916e-6881e9975fb9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action" status: 202 len: 0 microversion: 2.1 time: 0.082544 Sep 07 11:03:16.664470 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3655/7374] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:03:16 2022] POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:03:16.673280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:16.673948 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:16.682525 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:16.683117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:16.683573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:16.684391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:16.684866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:16.685352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:16.832924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:16.841379 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f6033147-dd45-4409-95b5-e18225bc9c69 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1678 microversion: 2.1 time: 0.172301 Sep 07 11:03:16.841962 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3720/7375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:16 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:17.867108 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:17.867964 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:17.875205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:17.875698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:17.876153 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:17.876847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:17.877336 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:17.877774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:18.030180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:18.038888 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-70dd9932-cc0d-4eb1-84f4-a8cb26e64a85 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1678 microversion: 2.1 time: 0.176449 Sep 07 11:03:18.039735 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3656/7376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:17 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:19.063503 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:19.064140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:19.074913 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:19.075417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:19.075880 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:19.076593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:19.077070 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:19.077544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:19.224073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:19.232141 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5bf5ed16-fa7f-437e-b43a-2e4dd336d825 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1681 microversion: 2.1 time: 0.172640 Sep 07 11:03:19.232715 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3721/7377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:19 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:19.334188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:19.337445 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:19.344589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:19.345075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:19.345577 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:19.346271 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:19.346727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:19.347152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:19.411485 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7d3565f4-28a8-4b34-90f5-6c913ad28053 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action" status: 200 len: 35853 microversion: 2.1 time: 0.081016 Sep 07 11:03:19.412449 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3657/7378] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:03:19 2022] POST /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58/action => generated 35853 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 11:03:20.474581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:20.475125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:20.478175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5a2579db-65f0-4968-955a-fb65929a05fb req-31db2dea-8a11-4873-bece-eaeddc52d8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f99e7e-730f-4402-9fd9-41c60b1d2f58", "tag": "c916c452-7e54-43cf-b076-17c6ea9a6505"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:20.482506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:20.483019 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:20.483470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:20.484324 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:20.484799 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:20.485421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:20.489833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a2579db-65f0-4968-955a-fb65929a05fb req-31db2dea-8a11-4873-bece-eaeddc52d8d9 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:20.490591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a2579db-65f0-4968-955a-fb65929a05fb req-31db2dea-8a11-4873-bece-eaeddc52d8d9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:20.491041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5a2579db-65f0-4968-955a-fb65929a05fb req-31db2dea-8a11-4873-bece-eaeddc52d8d9 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:20.503060 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5a2579db-65f0-4968-955a-fb65929a05fb req-31db2dea-8a11-4873-bece-eaeddc52d8d9 service nova] Creating event network-changed:c916c452-7e54-43cf-b076-17c6ea9a6505 for instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 on n-h2-836830-16 Sep 07 11:03:20.508734 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5a2579db-65f0-4968-955a-fb65929a05fb req-31db2dea-8a11-4873-bece-eaeddc52d8d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035464 Sep 07 11:03:20.509366 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3658/7379] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:03:20.517304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:03:20.605345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6836676d-23bc-4b98-bd6e-5ed80f6e8473 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 204 len: 0 microversion: 2.1 time: 0.134374 Sep 07 11:03:20.609514 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3722/7380] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:03:20 2022] DELETE /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:03:20.616084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:20.617705 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:20.624318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:20.624803 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:20.625474 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:20.626199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:20.626659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:20.627092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:20.768038 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:20.776588 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1b248c82-14f8-4957-a22e-931a0ec50311 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1687 microversion: 2.1 time: 0.165023 Sep 07 11:03:20.777168 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3659/7381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:20 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:21.802492 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:21.803220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:21.810123 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:21.810626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:21.811080 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:21.811789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:21.812264 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:21.812706 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:21.948072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:21.956054 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f88c1755-1b7d-4600-92e7-85b386dfd8a9 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1687 microversion: 2.1 time: 0.157910 Sep 07 11:03:21.956642 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3723/7382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:21 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:22.906112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-8d140b0f-e0de-4402-b416-fdfd247f85ae req-41667cf7-ed07-4898-b0a9-056c8c6511fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f99e7e-730f-4402-9fd9-41c60b1d2f58", "name": "network-vif-deleted", "tag": "c916c452-7e54-43cf-b076-17c6ea9a6505"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:22.918495 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d140b0f-e0de-4402-b416-fdfd247f85ae req-41667cf7-ed07-4898-b0a9-056c8c6511fc service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:22.918979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d140b0f-e0de-4402-b416-fdfd247f85ae req-41667cf7-ed07-4898-b0a9-056c8c6511fc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:22.919437 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-8d140b0f-e0de-4402-b416-fdfd247f85ae req-41667cf7-ed07-4898-b0a9-056c8c6511fc service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:22.930584 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-8d140b0f-e0de-4402-b416-fdfd247f85ae req-41667cf7-ed07-4898-b0a9-056c8c6511fc service nova] Creating event network-vif-deleted:c916c452-7e54-43cf-b076-17c6ea9a6505 for instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 on n-h2-836830-16 Sep 07 11:03:22.936682 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-8d140b0f-e0de-4402-b416-fdfd247f85ae req-41667cf7-ed07-4898-b0a9-056c8c6511fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Sep 07 11:03:22.937308 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3660/7383] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:03:22.985592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:22.986709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:22.998074 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:22.998988 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:22.999802 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:23.001042 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:23.001929 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:23.002734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:23.087597 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549286f11854aafa51c69156e01afe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119f90dc19664b8585a9d023412579e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:23.095753 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c6a528f0-5702-408d-998e-5d710d433748 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 200 len: 1352 microversion: 2.1 time: 0.117430 Sep 07 11:03:23.096331 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3724/7384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:22 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:24.125103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:24.125828 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] [instance: d8f99e7e-730f-4402-9fd9-41c60b1d2f58] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:24.133131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:24.133703 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:24.134142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:24.134827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:24.135285 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:24.135707 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:24.149005 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] HTTP exception thrown: Instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 could not be found. Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Request method failure captured: Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 HTTP/1.1 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHi9iU-L6cjlK-hjWjcdlhQTli_6SShNzQUF26Z4ezprDGeB_fv2KnIj4ueFy289V6yJDVxhk2q9-0hRwzfRGtuDwqZNAuSTKxuWbH5AcTcuFFP0lKPtGPDn3pb4TfxXDAhL7GbN4OsKPPHuu2m_nzEwvQ0Lh4F08pIoSNpQwZ8nqbg Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/119f90dc19664b8585a9d023412579e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/119f90dc19664b8585a9d023412579e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_119f90dc19664b8585a9d023412579e8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 119f90dc19664b8585a9d023412579e8 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1255686425 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: 0549286f11854aafa51c69156e01afe4 Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1255686425-project Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 could not be found. Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': 'd8f99e7e-730f-4402-9fd9-41c60b1d2f58'} Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 could not be found. Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 could not be found. Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:03:24.150642 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 could not be found. Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Returning 404 to user: Instance d8f99e7e-730f-4402-9fd9-41c60b1d2f58 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5d3f2245-3415-48d3-b90f-9ed040264795 tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58" status: 404 len: 111 microversion: 2.1 time: 0.031155 Sep 07 11:03:24.156135 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3661/7385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:24 2022] GET /compute/v2.1/servers/d8f99e7e-730f-4402-9fd9-41c60b1d2f58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 11:03:27.532964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd391221-2b8e-473a-bfa7-462b21782b5f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] Calling method '.version_select at 0x7f14b077d820>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:27.559156 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd391221-2b8e-473a-bfa7-462b21782b5f tempest-TestNetworkAdvancedServerOps-1255686425 tempest-TestNetworkAdvancedServerOps-1255686425-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1443632414" status: 202 len: 0 microversion: 2.1 time: 0.030072 Sep 07 11:03:27.559990 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3725/7386] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 7 11:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1443632414 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:03:39.144357 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=18 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:39.145734 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:39.370995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6277fcb4-9728-45f1-907f-e8b273b14302 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'create', calling method: .version_select at 0x7f14b06f4a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-78201342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaD7zC7/KcutDz+nWw9fDJ4wLfwTna3BBD+AhOBqqz9LEvPVBsirR5jUrzCGGH5cGzGQPDnu1YipDNfLE552WxI7m2cJhWpTC/LKLq3SdrdxnB7szhhSh4gOHwqexwS7w=="}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:39.393750 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6277fcb4-9728-45f1-907f-e8b273b14302 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for project e70148abf962420bbcbaeb2ad311e574. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:03:39.400213 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-6277fcb4-9728-45f1-907f-e8b273b14302 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for user 3f4cf7b2cefd478a9f41c45becc3acd8 and project e70148abf962420bbcbaeb2ad311e574. Resources: {'key_pairs'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:03:39.439749 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6277fcb4-9728-45f1-907f-e8b273b14302 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.301260 Sep 07 11:03:39.440603 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3662/7387] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 11:03:39 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:03:40.443889 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:40.444787 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:40.449145 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-609650713", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-78201342", "security_groups": [{"name": "tempest-secgroup-smoke-472794373"}], "networks": [{"uuid": "d274e778-27e7-4994-966f-f61c16ea9ccd"}]}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:40.693063 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.network.neutron [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] validate_networks() for [('d274e778-27e7-4994-966f-f61c16ea9ccd', None, None, None, None, None)] {{(pid=128832) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 11:03:41.097217 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Flavor limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 11:03:41.097767 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Image limits 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 11:03:41.098643 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Flavor pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 11:03:41.099269 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Image pref 0:0:0 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 11:03:41.100046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.virt.hardware [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 11:03:41.110355 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:41.110926 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:41.111446 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:41.112254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:41.112793 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:41.113375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:41.130384 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for project e70148abf962420bbcbaeb2ad311e574. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:03:41.136091 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for user 3f4cf7b2cefd478a9f41c45becc3acd8 and project e70148abf962420bbcbaeb2ad311e574. Resources: {'cores', 'instances', 'ram'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:03:41.149580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Going to run 1 instances... {{(pid=128832) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 11:03:41.151986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 11:03:41.199918 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-72973295-3d84-4b30-b793-a7a843ac7d1a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.757789 Sep 07 11:03:41.200936 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3726/7388] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 11:03:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 11:03:41.213946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2f049f72-a5ec-4717-9f5f-2ba1dedc877c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:41.215127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2f049f72-a5ec-4717-9f5f-2ba1dedc877c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:41.419622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2f049f72-a5ec-4717-9f5f-2ba1dedc877c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:41.427823 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2f049f72-a5ec-4717-9f5f-2ba1dedc877c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1244 microversion: 2.1 time: 0.219840 Sep 07 11:03:41.428538 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3663/7389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:41 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1244 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:42.452704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:42.453354 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:42.460476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:42.460968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:42.461439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:42.462148 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:42.462615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:42.463055 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:42.555920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:42.563908 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f22b21d9-2546-4997-ac9c-416221af0ef6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1304 microversion: 2.1 time: 0.115958 Sep 07 11:03:42.569284 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3727/7390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:42 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:43.591043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:43.592275 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:43.600230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:43.600934 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:43.601640 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:43.602664 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:43.603016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:43.603449 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:43.841110 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:43.849014 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-945e579b-c7c1-4986-be0d-067935fd9e89 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.263143 Sep 07 11:03:43.849884 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3664/7391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:43 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:44.171479 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-a39ac865-7e22-4c15-b378-02e8c13881f8 req-39157033-3a2d-4acb-b8ec-307dc8dfaeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:44.186375 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a39ac865-7e22-4c15-b378-02e8c13881f8 req-39157033-3a2d-4acb-b8ec-307dc8dfaeb0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:44.187241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a39ac865-7e22-4c15-b378-02e8c13881f8 req-39157033-3a2d-4acb-b8ec-307dc8dfaeb0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:44.187877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-a39ac865-7e22-4c15-b378-02e8c13881f8 req-39157033-3a2d-4acb-b8ec-307dc8dfaeb0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:44.200681 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-a39ac865-7e22-4c15-b378-02e8c13881f8 req-39157033-3a2d-4acb-b8ec-307dc8dfaeb0 service nova] Creating event network-changed:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h2-836830-16 Sep 07 11:03:44.207301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-a39ac865-7e22-4c15-b378-02e8c13881f8 req-39157033-3a2d-4acb-b8ec-307dc8dfaeb0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041263 Sep 07 11:03:44.208095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3728/7392] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:03:44.873257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:44.873912 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:44.880897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:44.881431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:44.881876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:44.882572 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:44.883243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:44.883946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:45.029773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:45.037516 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1289ff10-c274-46b2-8100-7822a5946fdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.168231 Sep 07 11:03:45.038120 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3665/7393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:44 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:46.061684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:46.062408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:46.069727 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:46.070257 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:46.070835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:46.071551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:46.072029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:46.072486 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:46.208319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:46.217248 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2feb583b-dc65-4302-bace-cdad98ce2970 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.159915 Sep 07 11:03:46.217825 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3729/7394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:46 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:47.244978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:47.245612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:47.252496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:47.252984 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:47.253457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:47.254156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:47.254619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:47.255049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:47.392886 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:47.401333 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ca05305a-645e-4254-8048-9862aecc1b6a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.161090 Sep 07 11:03:47.401919 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3666/7395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:47 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:48.424146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:48.424779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:48.432766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:48.433286 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:48.433739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:48.434451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:48.434925 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:48.435396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:48.574212 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:48.581932 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4e0c9fc4-009e-47aa-8dff-4e980a9a62b7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.161703 Sep 07 11:03:48.582503 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3730/7396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:48 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:49.605482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:49.606051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:49.612971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:49.613496 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:49.613941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:49.614641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:49.615100 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:49.615534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:49.753872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:49.762080 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3d133495-49f8-499f-bf64-5fb9369a5625 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.160932 Sep 07 11:03:49.762644 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3667/7397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:49 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:50.787033 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:50.788280 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:50.795867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:50.796573 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:50.797171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:50.798325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:50.799214 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:50.799679 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:50.941258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:50.949831 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-93b4f2cf-e50b-487f-bb17-22f540771289 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.167894 Sep 07 11:03:50.950414 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3731/7398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:50 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:51.068694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-211e310e-9e8e-4e13-b0ae-5b2648ab86c7 req-ef19b577-a785-47cc-ad84-ab5b57e07342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "name": "network-vif-plugged", "status": "completed", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:51.080128 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-211e310e-9e8e-4e13-b0ae-5b2648ab86c7 req-ef19b577-a785-47cc-ad84-ab5b57e07342 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:51.080607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-211e310e-9e8e-4e13-b0ae-5b2648ab86c7 req-ef19b577-a785-47cc-ad84-ab5b57e07342 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:51.081034 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-211e310e-9e8e-4e13-b0ae-5b2648ab86c7 req-ef19b577-a785-47cc-ad84-ab5b57e07342 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:51.093530 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-211e310e-9e8e-4e13-b0ae-5b2648ab86c7 req-ef19b577-a785-47cc-ad84-ab5b57e07342 service nova] Creating event network-vif-plugged:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h2-836830-16 Sep 07 11:03:51.098578 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-211e310e-9e8e-4e13-b0ae-5b2648ab86c7 req-ef19b577-a785-47cc-ad84-ab5b57e07342 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033816 Sep 07 11:03:51.099183 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3668/7399] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:03:51.974743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:51.975650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:51.978712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:51.979402 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:51.986697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:51.987195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:51.987647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:51.988391 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:51.989283 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:51.989741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:52.135144 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:52.142920 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-602680a1-b70d-4162-a6c6-9fbfe1644413 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1369 microversion: 2.1 time: 0.173246 Sep 07 11:03:52.143506 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3732/7400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:51 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:53.165575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:03:53.170963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:53.171670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:53.178515 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:53.179002 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:53.179471 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:53.181004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:53.181502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:53.181924 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:53.320576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:53.330444 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c759a417-5109-44c8-b9a2-5ddd45c4ee0e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1553 microversion: 2.1 time: 0.166430 Sep 07 11:03:53.331365 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3669/7401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:53 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:53.353853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:03:53.354613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:03:53.362905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:53.363460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:53.364309 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:53.365818 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:53.366372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:53.366826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:53.521325 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:03:53.530040 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-36874902-1db5-4042-9650-fe1e49e17232 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1553 microversion: 2.1 time: 0.181162 Sep 07 11:03:53.530623 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3733/7402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:03:53 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:03:55.606646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-df872d37-681c-44cb-9eaa-6f1b318b979a req-44212001-c344-42bc-86b6-7f701de543e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:03:55.617207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df872d37-681c-44cb-9eaa-6f1b318b979a req-44212001-c344-42bc-86b6-7f701de543e0 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:03:55.617789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df872d37-681c-44cb-9eaa-6f1b318b979a req-44212001-c344-42bc-86b6-7f701de543e0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:03:55.618234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-df872d37-681c-44cb-9eaa-6f1b318b979a req-44212001-c344-42bc-86b6-7f701de543e0 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:03:55.632673 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-df872d37-681c-44cb-9eaa-6f1b318b979a req-44212001-c344-42bc-86b6-7f701de543e0 service nova] Creating event network-changed:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h2-836830-16 Sep 07 11:03:55.638761 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-df872d37-681c-44cb-9eaa-6f1b318b979a req-44212001-c344-42bc-86b6-7f701de543e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035713 Sep 07 11:03:55.639411 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3670/7403] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:05:50.772934 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 11:05:50.773880 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 11:05:50.775873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:05:50.776625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=40 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:05:50.781117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:05:50.781703 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:50.789625 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:50.791030 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:50.791770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:50.792481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:50.792950 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:50.793417 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:50.816460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lazy-loading 'flavor' on Instance uuid c08ef21f-c40a-4e63-96d1-996d8ea6596e {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:05:51.009208 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8e72511-b608-4b6b-a3f1-7a5fd78a5a83 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e/action" status: 202 len: 0 microversion: 2.1 time: 0.237437 Sep 07 11:05:51.009856 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3734/7404] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:05:50 2022] POST /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:05:51.017295 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:05:51.017834 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 11:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e (ip 10.222.0.60) !!! Sep 07 11:05:51.018815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:05:51.019562 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=34 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:05:51.023922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:51.025347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:51.034581 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:51.035077 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:51.035526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:51.036234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:51.036698 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:51.037131 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:51.174502 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:51.183992 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a95e5211-33d9-403c-9a3c-abc5801a2d02 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.169175 Sep 07 11:05:51.184595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3671/7405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:51 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:05:52.212841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:52.213512 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:52.222667 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36908. Sep 07 11:05:52.232836 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36910. Sep 07 11:05:52.234628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:52.235128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:52.235607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:52.236372 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:52.236840 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:52.237320 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:52.375169 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:52.382974 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-28ec5ced-fc32-4b04-a155-49c4f2e28bbe tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.177866 Sep 07 11:05:52.383881 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3735/7406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:52 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:05:53.409207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:53.410398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:53.419347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:53.419771 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:53.420232 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:53.420940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:53.421417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:53.421843 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:53.558746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:53.566767 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd94c823-a07b-45e4-a809-247bd363d4d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.161563 Sep 07 11:05:53.567345 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3672/7407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:53 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:05:54.592231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:54.592789 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:54.599633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:54.600128 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:54.600580 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:54.601313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:54.601779 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:54.602215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:54.739326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:54.748299 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f7565427-acd7-4645-a32f-0cb69ee5924b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.160563 Sep 07 11:05:54.749095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3736/7408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:54 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:05:55.773659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:55.774292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:55.781359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:55.781858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:55.782302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:55.783001 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:55.783466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:55.783898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:55.930283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:55.938101 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-412bbbd4-1a77-4eea-9bb9-0011bdde1fef tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.168638 Sep 07 11:05:55.938669 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3673/7409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:55 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:05:56.960980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:56.961650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:56.968785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:56.969326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:56.969791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:56.970506 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:56.970983 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:56.971431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:57.107331 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:57.114998 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-63724f1d-4d38-4a6c-a0e9-3e8898276e88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.157990 Sep 07 11:05:57.115562 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3737/7410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:56 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:05:58.139884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:58.140534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:58.147553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:58.148044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:58.148484 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:58.149174 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:58.149681 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:58.150413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:58.286115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:58.294470 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a8db09b3-8888-425e-9da1-8473a21da77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.158568 Sep 07 11:05:58.295052 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3674/7411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:58 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:05:59.319224 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:05:59.319859 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:05:59.329073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:59.329617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:59.330072 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:59.330791 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:05:59.331292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:05:59.331734 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:05:59.467633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:05:59.475393 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e7ca6ec4-44ba-4f47-9ac8-7224677a480a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.160175 Sep 07 11:05:59.475966 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3738/7412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:05:59 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:00.498638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:00.499263 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:00.506309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:00.506804 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:00.507248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:00.507940 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:00.508396 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:00.508844 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:00.649426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:00.657822 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-57f9b168-414a-4569-a86e-c8c23e042ef0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.163146 Sep 07 11:06:00.658405 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3675/7413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:00 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:01.683444 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:01.684029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:01.691046 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:01.691540 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:01.691987 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:01.692683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:01.693150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:01.693617 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:01.835181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:01.842930 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-71ac913d-b176-422f-aad5-f8af8f938cc0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1699 microversion: 2.1 time: 0.163657 Sep 07 11:06:01.843494 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3739/7414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:01 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:02.867657 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:02.868279 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:02.876317 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:02.876808 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:02.877290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:02.877995 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:02.878459 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:02.878892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:03.014574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:03.022348 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4f94f815-f74f-4e41-a5a0-a6c53ea23217 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1699 microversion: 2.1 time: 0.158576 Sep 07 11:06:03.022928 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3676/7415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:02 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:04.046408 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:04.047762 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:04.056116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:04.057477 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:04.058555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:04.059363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:04.060497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:04.061210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:04.226439 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:04.236223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f080501e-a8a0-4500-bee5-80ab8cbea215 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.193642 Sep 07 11:06:04.249221 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3740/7416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:04 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:05.263992 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:05.264898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:05.272335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:05.272831 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:05.273305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:05.274015 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:05.274480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:05.275774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:05.427690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:05.436541 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a27e42b1-c81c-44ba-93aa-ac7387dbb667 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.177978 Sep 07 11:06:05.437144 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3677/7417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:05 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:05.786478 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-82f8d716-e7d7-4082-bf45-95daa5a30381 req-f93d8e00-dbc5-45a7-868b-de0df40548a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "name": "network-vif-plugged", "status": "completed", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:06:05.798187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-82f8d716-e7d7-4082-bf45-95daa5a30381 req-f93d8e00-dbc5-45a7-868b-de0df40548a5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:05.798963 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-82f8d716-e7d7-4082-bf45-95daa5a30381 req-f93d8e00-dbc5-45a7-868b-de0df40548a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:05.799708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-82f8d716-e7d7-4082-bf45-95daa5a30381 req-f93d8e00-dbc5-45a7-868b-de0df40548a5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:05.812898 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-82f8d716-e7d7-4082-bf45-95daa5a30381 req-f93d8e00-dbc5-45a7-868b-de0df40548a5 service nova] Creating event network-vif-plugged:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h2-836830-16 Sep 07 11:06:05.819146 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-82f8d716-e7d7-4082-bf45-95daa5a30381 req-f93d8e00-dbc5-45a7-868b-de0df40548a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113465 Sep 07 11:06:05.820160 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3741/7418] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:06:06.460399 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:06.461936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:06.470071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:06.470760 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:06.471638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:06.472521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:06.473408 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:06.474003 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:06.641111 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:06.649666 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-1ec795f1-0cb2-4976-a6ce-b39948b0e0f8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.193452 Sep 07 11:06:06.650649 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3678/7419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:06 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:07.675882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:07.676516 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:07.685136 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:07.685778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:07.686303 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:07.687107 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:07.687650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:07.688511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:07.851039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:07.860161 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bdeeb54a-4361-4b0b-9868-0f7a3d301868 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.188604 Sep 07 11:06:07.861009 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3742/7420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:07 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:06:08.884816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:08.886430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:08.893715 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:08.894207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:08.894651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:08.895525 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:08.895993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:08.896526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:09.057492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:09.066583 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a9561f92-9680-4903-a2ed-491f13701624 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.186369 Sep 07 11:06:09.067595 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3679/7421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:08 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:10.091598 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:10.092363 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:10.100352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:10.101133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:10.101776 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:10.102732 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:10.103835 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:10.104626 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:10.255060 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:10.264283 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-fe858b3d-924d-459c-849f-966a8034add1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.177046 Sep 07 11:06:10.264864 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3743/7422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:10 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:11.287949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:11.288579 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:11.297846 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:11.301615 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:11.302417 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:11.303388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:11.304126 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:11.304754 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:11.467188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:11.475349 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-f3984d05-064d-4e38-a498-a170634a05fa tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.191259 Sep 07 11:06:11.475904 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3680/7423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:11 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:12.503249 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:12.504730 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:12.515311 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:12.515965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:12.516433 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:12.517210 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:12.517691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:12.518138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:12.666295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:12.675160 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b9ecf96e-cfc9-48c4-9b86-4bf8132c6696 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1694 microversion: 2.1 time: 0.175456 Sep 07 11:06:12.681858 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3744/7424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:12 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:13.700731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:13.701419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:13.707752 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:13.708242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:13.708692 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:13.709442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:13.709923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:13.710385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:13.956646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:13.968135 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd38ebbb-7d94-45f9-804b-b07ba132d455 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1676 microversion: 2.1 time: 0.272563 Sep 07 11:06:13.968999 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3681/7425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:13 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1676 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:06:14.994826 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:14.995463 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:15.002671 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:15.003114 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:15.003570 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:15.004292 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:15.004773 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:15.005256 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:15.146201 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:15.154979 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f93026f1-4486-4eb6-8bae-0861fa2f53d6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1676 microversion: 2.1 time: 0.164138 Sep 07 11:06:15.155567 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3745/7426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:14 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:16.183892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:16.184683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:16.191911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:16.192426 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:16.192897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:16.193610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:16.194066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:16.194489 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:16.331557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:16.340425 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-735016a2-3c63-461a-85c6-a797008a690e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1679 microversion: 2.1 time: 0.163986 Sep 07 11:06:16.341041 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3682/7427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:16 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:16.364023 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:06:16.364647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:16.371683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:16.372193 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:16.372652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:16.373406 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:16.373888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:16.374334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:16.460888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128832) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 11:06:16.538689 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1aa3d2b8-8ebb-4cd3-8677-bbdd1038b188 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e/action" status: 202 len: 0 microversion: 2.1 time: 0.178583 Sep 07 11:06:16.539525 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3746/7428] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:06:16 2022] POST /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:06:16.547725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:16.548359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:16.554341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:16.554835 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:16.555278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:16.555985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:16.556467 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:16.557037 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:16.700424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:16.708953 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-31626b1d-f5de-40c7-9bdd-7bf939f7e076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1627 microversion: 2.1 time: 0.165116 Sep 07 11:06:16.709569 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3683/7429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:16 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1627 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:17.734292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-440cb972-7470-4592-9e35-a48b38e325fd req-d451560b-905a-475d-b654-7f591b129d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "name": "network-vif-unplugged", "status": "completed", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:06:17.735108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:17.735751 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:17.741890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:17.742396 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:17.743061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:17.743972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:17.744230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-440cb972-7470-4592-9e35-a48b38e325fd req-d451560b-905a-475d-b654-7f591b129d51 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:17.744459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:17.744708 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-440cb972-7470-4592-9e35-a48b38e325fd req-d451560b-905a-475d-b654-7f591b129d51 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:17.744910 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:17.745138 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-440cb972-7470-4592-9e35-a48b38e325fd req-d451560b-905a-475d-b654-7f591b129d51 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:17.759238 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-440cb972-7470-4592-9e35-a48b38e325fd req-d451560b-905a-475d-b654-7f591b129d51 service nova] Creating event network-vif-unplugged:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h1-836830-16 Sep 07 11:06:17.765017 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-440cb972-7470-4592-9e35-a48b38e325fd req-d451560b-905a-475d-b654-7f591b129d51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034608 Sep 07 11:06:17.765659 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3684/7430] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:06:17.882882 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:17.890980 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94f85a63-7b32-4663-b788-600ab9890cce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.160793 Sep 07 11:06:17.891556 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3747/7431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:17 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:18.765853 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-163f3b54-42d7-4b94-9faf-0021efd33aa9 req-fc388be9-b40c-48b7-8a2c-b502f2fb9040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:06:18.777583 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-163f3b54-42d7-4b94-9faf-0021efd33aa9 req-fc388be9-b40c-48b7-8a2c-b502f2fb9040 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:18.778068 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-163f3b54-42d7-4b94-9faf-0021efd33aa9 req-fc388be9-b40c-48b7-8a2c-b502f2fb9040 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:18.778694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-163f3b54-42d7-4b94-9faf-0021efd33aa9 req-fc388be9-b40c-48b7-8a2c-b502f2fb9040 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:18.791550 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-163f3b54-42d7-4b94-9faf-0021efd33aa9 req-fc388be9-b40c-48b7-8a2c-b502f2fb9040 service nova] Creating event network-changed:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h1-836830-16 Sep 07 11:06:18.796674 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-163f3b54-42d7-4b94-9faf-0021efd33aa9 req-fc388be9-b40c-48b7-8a2c-b502f2fb9040 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036832 Sep 07 11:06:18.797497 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3685/7432] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:06:18.915246 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:18.916592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:18.923684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:18.924111 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:18.924557 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:18.925279 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:18.925743 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:18.926181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:18.930290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:06:19.068850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:19.076901 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5276906d-a93b-410d-88ff-3323b3f1a421 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.165499 Sep 07 11:06:19.077512 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3748/7433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:18 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:20.104641 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:20.106578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:20.115106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:20.116342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:20.116936 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:20.117842 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:20.118366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:20.119430 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:20.285736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:20.294954 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3cd30dc4-c1a5-4eb2-99eb-aa5ae347f917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.197759 Sep 07 11:06:20.304415 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3686/7434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:20 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:21.320156 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:21.322893 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:21.330330 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:06:21.332920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:21.333627 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:21.334313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:21.335731 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:21.336652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:21.337517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:21.492129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:21.500472 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2285f345-61d3-40d3-b059-6fd9bf39b060 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.184268 Sep 07 11:06:21.501054 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3749/7435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:21 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:22.530158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:22.531442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:22.539333 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=33 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:06:22.542499 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:22.543282 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:22.543979 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:22.545046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:22.545757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:22.546234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:22.549730 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=89 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:06:22.710778 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:22.719336 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c30a6a34-8f3f-4a11-b54e-1f478788c9e9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.193484 Sep 07 11:06:22.720240 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3687/7436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:22 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:23.745117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:23.745769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:23.753069 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:23.753606 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:23.754059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:23.754774 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:23.755241 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:23.755680 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:23.907024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:23.914710 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e2395ee0-4623-4391-b513-63295ff124a7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.174439 Sep 07 11:06:23.915278 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3750/7437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:23 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:24.941403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:24.942633 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:24.950522 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:24.951016 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:24.951492 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:24.952205 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:24.952669 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:24.953101 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:25.099176 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:25.107977 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b5d20fe8-b013-4829-a556-940ed2c9c77a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.172201 Sep 07 11:06:25.108553 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3688/7438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:24 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:26.131844 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:26.132482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:26.140387 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:26.140872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:26.141352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:26.142068 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:26.142532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:26.142976 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:26.283616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:26.291940 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-318640db-0fb3-465a-8aff-07bd5f0a59e7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.163975 Sep 07 11:06:26.292524 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3751/7439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:26 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:27.316269 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:27.316899 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:27.324905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:27.325439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:27.325889 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:27.326593 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:27.327056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:27.327490 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:27.487622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:27.498043 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-41de367a-9bf8-4c17-8ab8-4b2683600023 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.185542 Sep 07 11:06:27.498853 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3689/7440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:27 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:28.522696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:28.523316 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:28.530985 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:28.531495 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:28.531952 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:28.532663 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:28.533140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:28.533619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:28.689939 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:28.698937 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2e0fcb81-cf81-4729-bccc-94be7e31e6f9 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.180047 Sep 07 11:06:28.699526 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3752/7441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:28 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:29.723475 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:29.724085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:29.731184 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:29.731941 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:29.732384 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:29.733083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:29.733574 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:29.734004 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:29.878521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:29.894472 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-90cc04e2-3cf3-40e1-bb08-685b6e259b12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.174760 Sep 07 11:06:29.907861 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3690/7442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:29 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:30.920367 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:30.921430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:30.929306 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:30.929810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:30.930263 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:30.930974 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:30.931750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:30.932349 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:31.070216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:31.078562 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aeaa0761-97a1-43c8-81c4-2745bc5f1b97 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.163915 Sep 07 11:06:31.079141 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3753/7443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:30 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:32.104343 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:32.104923 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:32.112172 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:32.112654 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:32.113088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:32.113802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:32.114261 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:32.114683 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:32.250225 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:32.258810 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88b033b6-8ad3-4e11-b67f-387bc31a5ea4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.159659 Sep 07 11:06:32.260173 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3691/7444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:32 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:33.290418 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:33.292073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:33.299000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:33.299501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:33.299961 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:33.300659 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:33.301129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:33.301592 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:33.439511 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:33.447347 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-423135a6-de71-4a5c-919a-ca89faff0465 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.160921 Sep 07 11:06:33.447933 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3754/7445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:33 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:34.470905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:34.471516 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:34.479080 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:34.479561 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:34.479997 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:34.480687 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:34.481144 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:34.481854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:34.614597 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:34.622635 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9cf27041-ce74-4d33-9975-6ebecfb9c928 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.155845 Sep 07 11:06:34.623215 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3692/7446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:34 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:35.646757 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:35.647395 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:35.654759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:35.655262 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:35.655723 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:35.656434 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:35.656911 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:35.657400 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:35.790153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:35.798043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2ca1913f-cbe9-406a-b895-3f87a337c62d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.155227 Sep 07 11:06:35.798616 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3755/7447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:35 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:36.818922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-bc45408f-312d-4dfb-af29-961748b23373 req-6a5a0ff0-fd95-4b08-8dfc-6325fcbd14c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "name": "network-vif-plugged", "status": "completed", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:06:36.821171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:36.822442 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:36.829660 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:36.830213 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:36.830668 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:36.831286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bc45408f-312d-4dfb-af29-961748b23373 req-6a5a0ff0-fd95-4b08-8dfc-6325fcbd14c3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:36.831700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:36.831819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bc45408f-312d-4dfb-af29-961748b23373 req-6a5a0ff0-fd95-4b08-8dfc-6325fcbd14c3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:36.832162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:36.832308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-bc45408f-312d-4dfb-af29-961748b23373 req-6a5a0ff0-fd95-4b08-8dfc-6325fcbd14c3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:36.832924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:36.848845 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-bc45408f-312d-4dfb-af29-961748b23373 req-6a5a0ff0-fd95-4b08-8dfc-6325fcbd14c3 service nova] Creating event network-vif-plugged:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h1-836830-16 Sep 07 11:06:36.857104 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-bc45408f-312d-4dfb-af29-961748b23373 req-6a5a0ff0-fd95-4b08-8dfc-6325fcbd14c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040787 Sep 07 11:06:36.859008 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3693/7448] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:06:36.993234 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:37.002886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b62a3ffa-a258-4484-a2c5-6ea61686fb78 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.185497 Sep 07 11:06:37.003478 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3756/7449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:36 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:06:38.028278 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:38.028985 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:38.035280 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:38.035773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:38.036217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:38.036927 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:38.037420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:38.037856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:38.174456 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:38.182835 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-40a86c3b-ec68-4cd9-9951-c402ec5c71c3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1685 microversion: 2.1 time: 0.159830 Sep 07 11:06:38.183407 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3694/7450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:38 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:06:39.206138 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:06:39.206809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:06:39.214465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:39.214967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:39.215431 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:39.216143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:06:39.216641 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:06:39.217073 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:06:39.356945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:06:39.364811 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dd15831b-59c3-46f7-910d-6dd70dba770b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1672 microversion: 2.1 time: 0.162721 Sep 07 11:06:39.365428 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3757/7451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:06:39 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:07:53.912909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=15 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:07:53.914044 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=43 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:07:53.915169 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:07:53.915363 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 11:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e (ip 10.222.0.60) !!! Sep 07 11:07:53.919497 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=17 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:07:53.920622 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:07:53.921137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:07:53.921638 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=58 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:07:53.924635 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:07:53.924958 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 07 11:07:53.943112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:53.943620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:53.944262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:53.945241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:53.945870 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:53.946479 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:53.977548 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Going to try to terminate instance {{(pid=128833) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:07:54.008704 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-0ccb763a-e7e7-4419-84f9-40a77a5b98c0 req-b13dd814-d6cf-4f1a-a348-d527e44f5c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:07:54.020441 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0ccb763a-e7e7-4419-84f9-40a77a5b98c0 req-b13dd814-d6cf-4f1a-a348-d527e44f5c84 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:54.020978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0ccb763a-e7e7-4419-84f9-40a77a5b98c0 req-b13dd814-d6cf-4f1a-a348-d527e44f5c84 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:54.021945 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-0ccb763a-e7e7-4419-84f9-40a77a5b98c0 req-b13dd814-d6cf-4f1a-a348-d527e44f5c84 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:54.036245 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-0ccb763a-e7e7-4419-84f9-40a77a5b98c0 req-b13dd814-d6cf-4f1a-a348-d527e44f5c84 service nova] Creating event network-changed:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h1-836830-16 Sep 07 11:07:54.042913 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-0ccb763a-e7e7-4419-84f9-40a77a5b98c0 req-b13dd814-d6cf-4f1a-a348-d527e44f5c84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127184 Sep 07 11:07:54.044178 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3758/7452] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:07:54.081963 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-52fb37df-c6a8-4367-962f-5dd458c03076 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 204 len: 0 microversion: 2.1 time: 0.171199 Sep 07 11:07:54.083149 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3695/7453] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:07:53 2022] DELETE /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:07:54.092607 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:07:54.093954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:07:54.104265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:54.105752 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:54.106725 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:54.107708 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:54.108401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:54.109536 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:54.265233 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:07:54.273649 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-cec2d2d8-0d15-41ce-9f4f-4c003f479859 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.186165 Sep 07 11:07:54.274378 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3759/7454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:07:54 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:07:55.299350 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:07:55.300056 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:07:55.306725 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:55.307210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:55.307644 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:55.308447 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:55.308902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:55.309360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:55.452220 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:07:55.460228 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-3a5a0572-2fcc-4a3d-9799-b8d9af62e2c7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1678 microversion: 2.1 time: 0.164968 Sep 07 11:07:55.460782 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3696/7455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:07:55 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:07:56.149082 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-36fc33c1-c699-48b3-8359-c9895d7ae0a2 req-db0fa112-005c-4e65-b28f-a7b45a389dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ef21f-c40a-4e63-96d1-996d8ea6596e", "name": "network-vif-deleted", "tag": "6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:07:56.160067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-36fc33c1-c699-48b3-8359-c9895d7ae0a2 req-db0fa112-005c-4e65-b28f-a7b45a389dc3 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:56.160568 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-36fc33c1-c699-48b3-8359-c9895d7ae0a2 req-db0fa112-005c-4e65-b28f-a7b45a389dc3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:56.161020 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-36fc33c1-c699-48b3-8359-c9895d7ae0a2 req-db0fa112-005c-4e65-b28f-a7b45a389dc3 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:56.173001 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-36fc33c1-c699-48b3-8359-c9895d7ae0a2 req-db0fa112-005c-4e65-b28f-a7b45a389dc3 service nova] Creating event network-vif-deleted:6e2e4795-e73c-43eb-a7ab-5a4ed1ffcbcb for instance c08ef21f-c40a-4e63-96d1-996d8ea6596e on n-h1-836830-16 Sep 07 11:07:56.178043 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-36fc33c1-c699-48b3-8359-c9895d7ae0a2 req-db0fa112-005c-4e65-b28f-a7b45a389dc3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094232 Sep 07 11:07:56.178655 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3760/7456] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:07:56.484782 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:07:56.485439 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:07:56.493115 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:56.493638 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:56.494083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:56.494789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:56.495252 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:56.495717 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:56.530810 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:56.531296 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:56.531743 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:56.532194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lazy-loading 'fault' on Instance uuid c08ef21f-c40a-4e63-96d1-996d8ea6596e {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:07:56.580563 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:07:56.588579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-8cdda966-25c7-4562-8252-6451f1ae9917 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 200 len: 1334 microversion: 2.1 time: 0.108502 Sep 07 11:07:56.589159 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3697/7457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:07:56 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:07:57.615373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:07:57.616089 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: c08ef21f-c40a-4e63-96d1-996d8ea6596e] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:07:57.622863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:57.623359 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:57.623813 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:57.624513 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:07:57.624986 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:07:57.625460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:07:57.641041 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] HTTP exception thrown: Instance c08ef21f-c40a-4e63-96d1-996d8ea6596e could not be found. Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Request method failure captured: Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e HTTP/1.1 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHqFBCWewqYtBTIG-wrFikYvTibkrNIf3YTRri6koAkiy9sBRcaKBQQWom_a6_kyLu8Nvik7tq8cUvjlloD2rHnWJWdYOInfGv_5GWm70TMpybuTtuv48QiUjyXQwhghK8FGhkSw2T8DONTZcKRg74IWBgzc_kKdKz_Qo91Ob6_ASnk Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e70148abf962420bbcbaeb2ad311e574 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestShelveInstance-1946841931 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70148abf962420bbcbaeb2ad311e574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70148abf962420bbcbaeb2ad311e574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70148abf962420bbcbaeb2ad311e574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70148abf962420bbcbaeb2ad311e574", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestShelveInstance-1946841931 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e70148abf962420bbcbaeb2ad311e574 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestShelveInstance-1946841931 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestShelveInstance-1946841931-project Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3f4cf7b2cefd478a9f41c45becc3acd8 Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestShelveInstance-1946841931-project Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance c08ef21f-c40a-4e63-96d1-996d8ea6596e could not be found. Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': 'c08ef21f-c40a-4e63-96d1-996d8ea6596e'} Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08ef21f-c40a-4e63-96d1-996d8ea6596e could not be found. Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08ef21f-c40a-4e63-96d1-996d8ea6596e could not be found. Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:07:57.643366 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08ef21f-c40a-4e63-96d1-996d8ea6596e could not be found. Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Returning 404 to user: Instance c08ef21f-c40a-4e63-96d1-996d8ea6596e could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88def981-5fe1-47b6-9b80-657bafa55a12 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e" status: 404 len: 111 microversion: 2.1 time: 0.034947 Sep 07 11:07:57.648685 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3761/7458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:07:57 2022] GET /compute/v2.1/servers/c08ef21f-c40a-4e63-96d1-996d8ea6596e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 11:07:57.820219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-51518b60-a6d9-4f39-ab7d-f7bf05cc48e8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '.version_select at 0x7f14b0a2d5e0>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:07:57.846073 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-51518b60-a6d9-4f39-ab7d-f7bf05cc48e8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-78201342" status: 202 len: 0 microversion: 2.1 time: 0.029721 Sep 07 11:07:57.847017 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3698/7459] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 7 11:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-78201342 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:07:57.868860 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-2af30aa3-21e8-43d0-9940-8521242018d0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'create', calling method: .version_select at 0x7f14b353c430>, body: {"keypair": {"name": "tempest-TestShelveInstance-113684068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMepMo2UJ63aQVRBX2n1543JYt/8QE3xC7W3l0hrzQf8pS+drf/ZDo5MxfDiVhvevJnC7j7OoBsK3qDSho6iZvMJ2WCLNEzsAP1tADCMeBsE6SYRrTpWrL3eMue4X+Ndgg=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:07:57.884883 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2af30aa3-21e8-43d0-9940-8521242018d0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for project e70148abf962420bbcbaeb2ad311e574. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:07:57.890609 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-2af30aa3-21e8-43d0-9940-8521242018d0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for user 3f4cf7b2cefd478a9f41c45becc3acd8 and project e70148abf962420bbcbaeb2ad311e574. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:07:57.919066 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-2af30aa3-21e8-43d0-9940-8521242018d0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054971 Sep 07 11:07:57.919680 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3762/7460] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 11:07:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:08:14.137503 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:14.138267 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:14.142419 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-749977252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-113684068", "security_groups": [{"name": "tempest-secgroup-smoke-868154538"}], "networks": [{"uuid": "d274e778-27e7-4994-966f-f61c16ea9ccd"}], "block_device_mapping_v2": [{"uuid": "53429473-30c1-4fcc-abfe-59d0b83cfe84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:08:14.263297 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] validate_networks() for [('d274e778-27e7-4994-966f-f61c16ea9ccd', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 11:08:15.108931 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 11:08:15.109494 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 11:08:15.110766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 11:08:15.111188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 11:08:15.111607 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 11:08:15.120684 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:15.121166 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:15.121762 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:15.123401 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:15.123864 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:15.124293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:15.142696 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for project e70148abf962420bbcbaeb2ad311e574. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:08:15.147978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Getting quotas for user 3f4cf7b2cefd478a9f41c45becc3acd8 and project e70148abf962420bbcbaeb2ad311e574. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:08:15.207122 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 11:08:15.209359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='53429473-30c1-4fcc-abfe-59d0b83cfe84',volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 11:08:15.338464 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-56281aa8-3962-4658-ae6e-382ad80bd463 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.202900 Sep 07 11:08:15.339132 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3699/7461] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 11:08:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 11:08:15.349131 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=12 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:15.350093 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=4 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:15.351110 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:15.355616 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-d19d63be-acb4-4385-869f-576a254fdcdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:15.357398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-d19d63be-acb4-4385-869f-576a254fdcdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:15.416000 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-d19d63be-acb4-4385-869f-576a254fdcdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:15.424084 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-d19d63be-acb4-4385-869f-576a254fdcdf tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1087 microversion: 2.1 time: 0.076735 Sep 07 11:08:15.424663 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3763/7462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:15 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:16.454286 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:16.454900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:16.462293 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:16.462785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:16.463217 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:16.464156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:16.464620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:16.465046 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:16.535330 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:16.543728 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b0817297-e0d3-4f27-b212-67e1750d0968 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1203 microversion: 2.1 time: 0.093781 Sep 07 11:08:16.557437 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3700/7463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:16 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1203 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:17.567959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:17.568721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:17.575823 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:17.576435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:17.578436 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:17.579272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:17.579849 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:17.580394 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:17.803231 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:17.814025 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-db33372f-0741-4453-97b6-0bea52944ea5 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1270 microversion: 2.1 time: 0.250130 Sep 07 11:08:17.814959 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3764/7464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:17 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:08:17.955665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-5b5488fd-4340-42e7-bb2b-497dc76187dd req-64dbad35-5728-4b4c-92b3-c966e79fc1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:08:17.969606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b5488fd-4340-42e7-bb2b-497dc76187dd req-64dbad35-5728-4b4c-92b3-c966e79fc1f2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:17.970662 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b5488fd-4340-42e7-bb2b-497dc76187dd req-64dbad35-5728-4b4c-92b3-c966e79fc1f2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:17.971264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-5b5488fd-4340-42e7-bb2b-497dc76187dd req-64dbad35-5728-4b4c-92b3-c966e79fc1f2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:17.983501 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-5b5488fd-4340-42e7-bb2b-497dc76187dd req-64dbad35-5728-4b4c-92b3-c966e79fc1f2 service nova] Creating event network-changed:de62e2b6-490b-4340-8230-e160ed3dfe9a for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f on n-h2-836830-16 Sep 07 11:08:17.989297 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-5b5488fd-4340-42e7-bb2b-497dc76187dd req-64dbad35-5728-4b4c-92b3-c966e79fc1f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037215 Sep 07 11:08:17.990299 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3701/7465] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:08:18.838146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:18.839273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:18.847141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:18.847647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:18.848099 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:18.848812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:18.849304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:18.849969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:19.079160 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:19.087439 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3470392b-7181-436a-966f-515ea93ee796 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1270 microversion: 2.1 time: 0.253282 Sep 07 11:08:19.088022 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3765/7466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:18 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:20.113775 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:20.114493 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:20.120800 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:20.121328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:20.121829 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:20.122530 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:20.122991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:20.123424 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:20.262606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:20.270622 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ecd67d3-e0aa-4e60-b8fe-08aac68a57da tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1270 microversion: 2.1 time: 0.162484 Sep 07 11:08:20.271204 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3702/7467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:20 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:08:21.293611 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:21.294969 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:21.302455 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:21.302960 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:21.303413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:21.304122 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:21.304595 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:21.305038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:21.466651 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:21.474715 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-aa403da6-27ea-4427-af2b-c42cee0e26c4 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1270 microversion: 2.1 time: 0.185137 Sep 07 11:08:21.475300 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3766/7468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:21 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:22.498559 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:22.499234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:22.506078 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:22.506568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:22.507006 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:22.507690 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:22.508151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:22.508576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:22.644670 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:22.653231 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e286866a-e33a-4200-aded-6af3d1bd203f tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.158597 Sep 07 11:08:22.653818 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3703/7469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:22 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:23.677489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:23.678120 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:23.684398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:23.684890 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:23.685374 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:23.686270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:23.686856 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:23.687276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:23.829943 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:23.837833 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c7a7a5b3-1117-4564-8e0b-31f07f1a6b8b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.164395 Sep 07 11:08:23.838414 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3767/7470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:23 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:24.864051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:24.864665 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:24.871431 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:24.871914 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:24.872347 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:24.873032 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:24.873529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:24.873957 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:25.010073 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:25.018457 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4e9d3dc3-b058-4df6-99aa-e5ccb51ba69c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.158665 Sep 07 11:08:25.019027 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3704/7471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:24 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:26.039185 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:26.043385 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:26.044209 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:26.051688 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:26.052203 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:26.052647 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:26.053423 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:26.053903 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:26.054350 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:26.190346 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:26.198603 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96f55427-2c3e-4c09-93ad-4b5f8993e9e3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.161067 Sep 07 11:08:26.199187 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3768/7472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:26 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:27.223152 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:27.223685 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:27.225686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:27.226345 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:08:27.233557 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:27.234048 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:27.234482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:27.235412 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:27.235873 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:27.236292 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:27.374151 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:27.381998 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-350dccbd-c5f9-4b74-9855-8163bf3e314b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.162889 Sep 07 11:08:27.382586 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3705/7473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:27 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:28.405452 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:28.406182 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:28.413140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:28.413674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:28.414130 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:28.414953 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:28.415334 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:28.415834 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:28.552155 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:28.559886 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-920b462d-3935-469b-b0b5-6ecc9e0a9af6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.158692 Sep 07 11:08:28.560458 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3769/7474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:28 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:29.587521 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:29.588132 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:29.595553 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:29.596049 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:29.596482 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:29.597202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:29.597652 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:29.598076 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:29.736453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:29.744402 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bf7d3c22-bf81-4d03-a6d4-dbcf93b9aaf0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.160754 Sep 07 11:08:29.744979 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3706/7475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:29 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:30.771036 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:30.771664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:30.778528 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:30.779024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:30.779476 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:30.780551 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:30.781028 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:30.781501 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:30.922190 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:30.929965 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a8c17682-773f-42a0-9d51-f782aaf188ce tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.162886 Sep 07 11:08:30.930543 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3770/7476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:30 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:08:31.954694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:31.955321 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:31.962219 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:31.962710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:31.963155 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:31.963850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:31.964313 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:31.964745 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:32.106650 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:32.115794 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-61da7846-fd1b-4f63-955a-a7fba7118cdc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.165429 Sep 07 11:08:32.116499 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3707/7477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:31 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:32.314770 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-fffbcb53-246e-4237-bd9b-8446cc9d06cb req-c994c9d0-1cf3-412d-8765-2348ea804c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "name": "network-vif-plugged", "status": "completed", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:08:32.325146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fffbcb53-246e-4237-bd9b-8446cc9d06cb req-c994c9d0-1cf3-412d-8765-2348ea804c7b service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:32.325810 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fffbcb53-246e-4237-bd9b-8446cc9d06cb req-c994c9d0-1cf3-412d-8765-2348ea804c7b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:32.326281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-fffbcb53-246e-4237-bd9b-8446cc9d06cb req-c994c9d0-1cf3-412d-8765-2348ea804c7b service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:32.338247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-fffbcb53-246e-4237-bd9b-8446cc9d06cb req-c994c9d0-1cf3-412d-8765-2348ea804c7b service nova] Creating event network-vif-plugged:de62e2b6-490b-4340-8230-e160ed3dfe9a for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f on n-h2-836830-16 Sep 07 11:08:32.343223 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-fffbcb53-246e-4237-bd9b-8446cc9d06cb req-c994c9d0-1cf3-412d-8765-2348ea804c7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 Sep 07 11:08:32.343833 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3771/7478] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:08:33.139780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:33.140328 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:33.148578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:33.149329 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:33.149774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:33.150565 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:33.151114 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:33.151578 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:33.287519 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:33.295287 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-88350387-5d78-48f8-a121-bab94be6dfdb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1258 microversion: 2.1 time: 0.159815 Sep 07 11:08:33.295864 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3708/7479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:33 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:34.321215 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:34.321930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:34.328174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:34.328761 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:34.329621 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:34.330709 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:34.331204 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:34.331672 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:34.472801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:34.480597 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-76e4298a-73b1-4087-b266-4ba42f00d129 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1443 microversion: 2.1 time: 0.164787 Sep 07 11:08:34.481173 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3772/7480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:34 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:08:34.503353 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:08:34.503978 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:08:34.510911 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:34.511398 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:34.511856 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:34.512524 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:34.512981 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:34.513442 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:34.654953 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:08:34.663692 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-05c31243-8450-4b12-824c-4987b6b6854e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1443 microversion: 2.1 time: 0.164393 Sep 07 11:08:34.664280 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3709/7481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:08:34 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:08:36.292001 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-9a2ea572-3268-400b-a113-d475873366ae req-c15fa26e-aebb-4986-8c0c-fa127f6c9b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:08:36.305401 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9a2ea572-3268-400b-a113-d475873366ae req-c15fa26e-aebb-4986-8c0c-fa127f6c9b07 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:08:36.306302 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9a2ea572-3268-400b-a113-d475873366ae req-c15fa26e-aebb-4986-8c0c-fa127f6c9b07 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:08:36.306867 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-9a2ea572-3268-400b-a113-d475873366ae req-c15fa26e-aebb-4986-8c0c-fa127f6c9b07 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:08:36.320744 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-9a2ea572-3268-400b-a113-d475873366ae req-c15fa26e-aebb-4986-8c0c-fa127f6c9b07 service nova] Creating event network-changed:de62e2b6-490b-4340-8230-e160ed3dfe9a for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f on n-h2-836830-16 Sep 07 11:08:36.326691 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-9a2ea572-3268-400b-a113-d475873366ae req-c15fa26e-aebb-4986-8c0c-fa127f6c9b07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037886 Sep 07 11:08:36.327302 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3773/7482] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:10:31.445621 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 11:10:31.446562 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 11:10:31.447137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:10:31.447882 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=58 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:10:31.513103 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:10:31.513757 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:31.519902 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:31.520273 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:31.520710 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:31.521425 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:31.521884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:31.522311 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:31.546180 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.objects.instance [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lazy-loading 'flavor' on Instance uuid 5947d600-f572-4c07-92c8-c2761f7f3e7f {{(pid=128833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:10:31.620432 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cbd4fe93-ce19-4abb-b54f-6f5848ae26b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f/action" status: 202 len: 0 microversion: 2.1 time: 0.180996 Sep 07 11:10:31.621066 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3710/7483] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:10:31 2022] POST /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:10:31.629566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=24 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:10:31.630281 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=52 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:10:31.631928 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:10:31.632089 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f (ip 10.222.0.60) !!! Sep 07 11:10:31.640445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:31.641171 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:31.652574 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:31.653076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:31.653564 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:31.654271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:31.654754 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:31.655197 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:31.858798 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:31.867155 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-e38a4485-8d62-4e42-9ac1-d975311230fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.240541 Sep 07 11:10:31.867741 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3774/7484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:31 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:32.891951 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:32.892667 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:32.906474 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37456. Sep 07 11:10:32.912097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:32.912619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:32.913063 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:32.913802 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:32.914262 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:32.914688 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:32.916311 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37454. Sep 07 11:10:33.095540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:33.104247 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ddc190a2-0f6d-47b5-9950-518f95faf34a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.216555 Sep 07 11:10:33.104824 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3711/7485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:32 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:34.127876 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:34.128488 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:34.137523 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:34.138021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:34.138481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:34.139191 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:34.139661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:34.140105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:34.275278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:34.283099 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-61b2819c-d049-4b00-a12c-c573bce543bb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.159189 Sep 07 11:10:34.283675 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3775/7486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:34 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:35.307746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:35.308378 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:35.315358 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:35.315848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:35.316290 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:35.316988 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:35.317473 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:35.317907 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:35.452197 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:35.460215 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-bd42cdd9-c64c-449c-a78a-1237d00231e6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.157047 Sep 07 11:10:35.460783 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3712/7487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:35 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:36.484778 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:36.485443 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:36.493532 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:36.494021 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:36.494481 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:36.495207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:36.495683 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:36.496133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:36.628819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:36.637387 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-7e65a263-808c-40b4-866e-a926b8b9b258 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.156492 Sep 07 11:10:36.637968 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3776/7488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:36 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:37.659969 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:37.660534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:37.667534 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:37.668017 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:37.668454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:37.669141 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:37.669619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:37.670041 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:37.806452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:37.814310 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-b6c814ac-683d-4230-92e4-7c977fa3676c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.158337 Sep 07 11:10:37.814875 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3713/7489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:37 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:38.839472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:38.840140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:38.847188 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:38.847691 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:38.848143 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:38.848850 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:38.849351 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:38.849794 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:38.984959 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:38.993381 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-26941773-38e4-4542-a48c-82579bca6336 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.158880 Sep 07 11:10:38.993957 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3777/7490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:38 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:40.017971 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:40.018586 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:40.025483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:40.025968 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:40.026404 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:40.027092 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:40.027545 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:40.027965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:40.176624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:40.185256 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-a46dfccc-a895-48bf-a101-f8cc6aec7694 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.172264 Sep 07 11:10:40.185835 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3714/7491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:40 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:41.208153 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:41.208700 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:41.215885 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:41.216380 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:41.216830 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:41.217547 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:41.218015 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:41.218450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:41.354964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:41.362737 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-12beeb96-4bcc-4a1d-bfae-5da71f9f2055 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.158638 Sep 07 11:10:41.363308 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3778/7492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:41 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:42.390999 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:42.391671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:42.399362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:42.399848 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:42.400294 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:42.400993 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:42.401469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:42.402237 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:42.541450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:42.550097 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cc7513e3-aac2-4320-8682-8088f64621bc tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.162832 Sep 07 11:10:42.550902 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3715/7493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:42 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:10:43.575295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:43.575933 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:43.582970 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:43.583472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:43.583928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:43.584640 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:43.585116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:43.586274 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:43.723397 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:43.731550 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5fb784b-416c-47a5-b647-4494ff992297 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.160206 Sep 07 11:10:43.732137 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3779/7494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:43 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:44.756758 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:44.757529 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:44.764636 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:44.765125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:44.765602 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:44.766309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:44.766765 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:44.767188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:44.911619 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:44.920688 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-7076720a-cace-493f-abd1-0a80ea828d88 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.168787 Sep 07 11:10:44.931053 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3716/7495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:44 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:10:45.943918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:45.944556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:45.952273 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:45.952735 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:45.953216 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:45.953930 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:45.954413 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:45.954916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:46.096026 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:46.104686 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-99dc8039-e86b-47c5-af04-b06c340ed4ad tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1569 microversion: 2.1 time: 0.164693 Sep 07 11:10:46.105282 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3780/7496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:45 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:46.128363 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:10:46.128973 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:46.136212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:46.136702 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:46.137374 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:46.138075 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:46.138539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:46.138966 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:46.182876 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128833) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 11:10:46.249865 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ad232bfb-a273-45eb-9117-b899f2e49eb6 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "POST /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f/action" status: 202 len: 0 microversion: 2.1 time: 0.125265 Sep 07 11:10:46.250500 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3717/7497] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:10:46 2022] POST /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:10:46.259473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:46.260270 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:46.266999 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:46.267508 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:46.267968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:46.268690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:46.269167 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:46.269642 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:46.450125 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:46.457973 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-94beb054-8881-4b35-9755-0da63d64404a tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1517 microversion: 2.1 time: 0.203233 Sep 07 11:10:46.458624 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3781/7498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:46 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:47.005283 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e18273cc-590e-4bbd-b68b-7bb37f429936 req-2a6f9b23-3c9b-49e4-b83d-793b1d0eabe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "name": "network-vif-unplugged", "status": "completed", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:10:47.018465 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e18273cc-590e-4bbd-b68b-7bb37f429936 req-2a6f9b23-3c9b-49e4-b83d-793b1d0eabe2 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:47.019367 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e18273cc-590e-4bbd-b68b-7bb37f429936 req-2a6f9b23-3c9b-49e4-b83d-793b1d0eabe2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:47.019816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e18273cc-590e-4bbd-b68b-7bb37f429936 req-2a6f9b23-3c9b-49e4-b83d-793b1d0eabe2 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:47.032480 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.compute.server_external_events [req-e18273cc-590e-4bbd-b68b-7bb37f429936 req-2a6f9b23-3c9b-49e4-b83d-793b1d0eabe2 service nova] Unable to find a host for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f. Dropping event network-vif-unplugged {{(pid=128833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 11:10:47.033452 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e18273cc-590e-4bbd-b68b-7bb37f429936 req-2a6f9b23-3c9b-49e4-b83d-793b1d0eabe2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032632 Sep 07 11:10:47.034050 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3718/7499] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 11:10:47.481278 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:47.481920 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:47.489696 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:47.490200 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:47.490654 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:47.491371 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:47.492382 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:47.492829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:47.962158 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:47.970310 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b052a8a3-a5c0-4441-a8f0-758e4f96099d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1519 microversion: 2.1 time: 0.493012 Sep 07 11:10:47.970885 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3782/7500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:47 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1519 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:48.998580 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:48.999208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:49.006453 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:49.006965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:49.007466 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:49.008335 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:49.008801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:49.009253 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:49.147308 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:49.155132 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-11ad1a38-7ebe-4c9f-979a-beed5605e500 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1519 microversion: 2.1 time: 0.160333 Sep 07 11:10:49.155734 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3719/7501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:48 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:50.178189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:50.178801 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:50.186807 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:50.187304 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:50.187785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:50.188496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:50.188975 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:50.189440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:50.326230 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:50.334225 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8394333f-0fc9-4c6c-ac6a-6a6663b561c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1519 microversion: 2.1 time: 0.160073 Sep 07 11:10:50.334808 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3783/7502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:50 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:51.358164 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:51.358789 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:51.366202 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:51.367251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:51.367774 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:51.368481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:51.368945 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:51.369429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:51.511721 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:51.520859 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-831b6b2e-b61f-44d7-9140-0e64c0e34f0d tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1519 microversion: 2.1 time: 0.166759 Sep 07 11:10:51.521505 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3720/7503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:51 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:52.546218 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:52.547440 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:52.555051 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:52.555717 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:52.556426 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:52.557284 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:52.557863 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:52.558542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:52.792809 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:52.800826 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-1e5a1754-6274-47db-8a5b-dabc57fb1991 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.259203 Sep 07 11:10:52.801365 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3784/7504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:52 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:53.828340 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:53.829272 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:53.838239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:53.838731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:53.839175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:53.839883 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:53.840342 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:53.840770 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:53.986083 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:53.994576 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-fbebae2f-f47d-4304-95a0-8b74bcc2a3d1 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.174452 Sep 07 11:10:53.995156 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3721/7505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:53 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:55.018447 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:55.019081 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:55.026305 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:55.026812 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:55.027272 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:55.027980 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:55.028459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:55.028905 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:55.166012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:55.173851 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b2794dd9-6e80-4e91-bc6d-0196835f577e tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.159298 Sep 07 11:10:55.174429 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3785/7506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:55 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:56.197866 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:56.198403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:56.205260 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:56.205741 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:56.206175 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:56.206859 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:56.207309 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:56.207731 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:56.342801 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:56.350761 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e58d027f-176a-4259-97bb-f7c7db46cce3 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.157651 Sep 07 11:10:56.351344 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3722/7507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:56 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:57.375507 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:57.376133 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:57.383633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:57.384129 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:57.384567 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:57.385290 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:57.385759 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:57.386196 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:57.524538 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:57.532314 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-82979b83-f150-4854-bdae-e887a61ccf87 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.160712 Sep 07 11:10:57.532880 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3786/7508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:57 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:58.555620 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:58.556264 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:58.563121 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:58.563608 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:58.564051 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:58.564749 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:58.565241 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:58.565673 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:58.700259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:58.708132 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-eadc8614-7d45-4f31-956e-38afd9f88910 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.156650 Sep 07 11:10:58.708707 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3723/7509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:58 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:10:59.732586 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:10:59.733267 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:10:59.740438 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:59.740938 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:59.741429 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:59.742140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:10:59.742619 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:10:59.743065 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:10:59.878935 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:10:59.887082 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-076fbac6-cd5c-48d1-876b-2052ea9a3740 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.158471 Sep 07 11:10:59.887663 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3787/7510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:10:59 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:11:00.910963 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:11:00.911575 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:11:00.919125 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:00.919611 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:00.920095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:00.920785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:00.921332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:00.921761 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:00.925783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:11:01.060468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:11:01.068324 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-15280ff0-3307-4e3e-b626-b62b2f3784b0 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.161254 Sep 07 11:11:01.068916 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3724/7511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:11:00 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:11:02.092117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:11:02.092741 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:11:02.095450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=29 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:11:02.101147 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:02.101918 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:02.102379 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:02.103146 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:02.103613 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:02.104054 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:02.106661 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=85 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:11:02.248365 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:11:02.256096 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0378e7a1-3a60-4f55-8c1a-b0d431a2c1fb tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.167992 Sep 07 11:11:02.256725 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3788/7512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:11:02 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:11:03.126676 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-fc740063-2c51-465a-9e44-cd2757c2e9d0 req-92750494-8cff-4e68-bfc7-77b9cff58d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "name": "network-vif-plugged", "status": "completed", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:11:03.132301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:11:03.141477 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fc740063-2c51-465a-9e44-cd2757c2e9d0 req-92750494-8cff-4e68-bfc7-77b9cff58d86 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:03.141962 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fc740063-2c51-465a-9e44-cd2757c2e9d0 req-92750494-8cff-4e68-bfc7-77b9cff58d86 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:03.142403 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-fc740063-2c51-465a-9e44-cd2757c2e9d0 req-92750494-8cff-4e68-bfc7-77b9cff58d86 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:03.154474 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-fc740063-2c51-465a-9e44-cd2757c2e9d0 req-92750494-8cff-4e68-bfc7-77b9cff58d86 service nova] Creating event network-vif-plugged:de62e2b6-490b-4340-8230-e160ed3dfe9a for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f on n-h2-836830-16 Sep 07 11:11:03.159513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-fc740063-2c51-465a-9e44-cd2757c2e9d0 req-92750494-8cff-4e68-bfc7-77b9cff58d86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036918 Sep 07 11:11:03.160511 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3725/7513] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:11:03.280674 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:11:03.281435 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:11:03.288318 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:03.288917 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:03.289462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:03.290260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:03.290800 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:03.291312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:03.496276 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:11:03.504162 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-5c183f6b-0e71-4c98-81c6-6d3772a88a77 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1575 microversion: 2.1 time: 0.227461 Sep 07 11:11:03.504738 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3789/7514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:11:03 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:11:04.532468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:11:04.533199 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:11:04.540646 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:04.541137 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:04.541604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:04.542305 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:11:04.542766 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:11:04.543198 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:11:04.683231 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:11:04.691113 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-20ecfe1f-f594-4efd-ac6e-c23c526c121b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1562 microversion: 2.1 time: 0.162994 Sep 07 11:11:04.691693 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3726/7515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:11:04 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:18.613159 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:18.614965 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=12 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:18.615782 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:18.617340 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:18.617535 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:12:18.617535 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 11:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 07 11:12:18.620875 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=3 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:18.621593 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=11 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:18.622692 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:12:18.622824 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f (ip 10.222.0.60) !!! Sep 07 11:12:18.622917 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-ff7564d6-12b1-4abe-9892-555f3be65b73 req-ec5328ce-c34e-4637-a55b-a28abb0e1f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:18.624743 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:12:18.624867 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f (ip 10.222.0.60) !!! Sep 07 11:12:18.636626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ff7564d6-12b1-4abe-9892-555f3be65b73 req-ec5328ce-c34e-4637-a55b-a28abb0e1f25 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:18.636626 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ff7564d6-12b1-4abe-9892-555f3be65b73 req-ec5328ce-c34e-4637-a55b-a28abb0e1f25 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:18.637208 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-ff7564d6-12b1-4abe-9892-555f3be65b73 req-ec5328ce-c34e-4637-a55b-a28abb0e1f25 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:18.648140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:18.649465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:18.649928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:18.650046 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-ff7564d6-12b1-4abe-9892-555f3be65b73 req-ec5328ce-c34e-4637-a55b-a28abb0e1f25 service nova] Creating event network-changed:de62e2b6-490b-4340-8230-e160ed3dfe9a for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f on n-h2-836830-16 Sep 07 11:12:18.652482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:18.652482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:18.652482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:18.655256 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-ff7564d6-12b1-4abe-9892-555f3be65b73 req-ec5328ce-c34e-4637-a55b-a28abb0e1f25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044096 Sep 07 11:12:18.656322 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3727/7516] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:12:18.680608 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:12:18.777686 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-60e03919-8d6a-4024-9fe7-5a231d012697 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 204 len: 0 microversion: 2.1 time: 0.167676 Sep 07 11:12:18.779428 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3790/7517] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:12:18 2022] DELETE /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:12:18.790364 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:18.791469 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:18.798693 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:18.799854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:18.800590 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:18.801531 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:18.802212 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:18.802651 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:18.968244 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:18.976513 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-21d9337f-5d76-45b3-9104-715ed0d86666 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.191853 Sep 07 11:12:18.977356 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3728/7518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:18 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:20.000424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:20.001135 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:20.008052 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:20.008544 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:20.008992 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:20.009721 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:20.010187 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:20.010620 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:20.231467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:20.239235 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-88570fd1-df08-4e73-b221-149fb6d7b203 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1568 microversion: 2.1 time: 0.243055 Sep 07 11:12:20.239987 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3791/7519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:19 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:20.970852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-e8b1804c-7c1b-4e17-8a9c-d0fc3cdfa930 req-c5571e12-15ce-47f2-95fa-b67cc47cb830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5947d600-f572-4c07-92c8-c2761f7f3e7f", "name": "network-vif-deleted", "tag": "de62e2b6-490b-4340-8230-e160ed3dfe9a"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:20.982000 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8b1804c-7c1b-4e17-8a9c-d0fc3cdfa930 req-c5571e12-15ce-47f2-95fa-b67cc47cb830 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:20.983112 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8b1804c-7c1b-4e17-8a9c-d0fc3cdfa930 req-c5571e12-15ce-47f2-95fa-b67cc47cb830 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:20.983551 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-e8b1804c-7c1b-4e17-8a9c-d0fc3cdfa930 req-c5571e12-15ce-47f2-95fa-b67cc47cb830 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:21.001537 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-e8b1804c-7c1b-4e17-8a9c-d0fc3cdfa930 req-c5571e12-15ce-47f2-95fa-b67cc47cb830 service nova] Creating event network-vif-deleted:de62e2b6-490b-4340-8230-e160ed3dfe9a for instance 5947d600-f572-4c07-92c8-c2761f7f3e7f on n-h2-836830-16 Sep 07 11:12:21.006519 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-e8b1804c-7c1b-4e17-8a9c-d0fc3cdfa930 req-c5571e12-15ce-47f2-95fa-b67cc47cb830 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039839 Sep 07 11:12:21.007357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3729/7520] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:12:21.263923 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:21.265289 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:21.274088 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:21.274941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:21.275489 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:21.276301 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:21.276841 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:21.277542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:21.356978 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:21.365668 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-95471af5-37ea-4bac-b4b8-c8a7dbf3a4c8 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1218 microversion: 2.1 time: 0.105575 Sep 07 11:12:21.366410 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3792/7521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:21 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:22.389888 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:22.390598 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:22.398351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:22.399216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:22.400021 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:22.401071 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:22.401891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:22.402627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:22.469376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:22.477627 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9d604058-069e-4645-92b2-1aaa8fc9881b tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1218 microversion: 2.1 time: 0.092057 Sep 07 11:12:22.478263 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3730/7522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:22 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:23.501499 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:23.502236 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:23.510029 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:23.510634 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:23.511168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:23.511973 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:23.512522 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:23.513038 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:23.579555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:23.588238 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-c99976ce-785a-4fad-8057-583691181ed7 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1218 microversion: 2.1 time: 0.090678 Sep 07 11:12:23.588820 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3793/7523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:23 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:24.611355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:24.611983 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:24.619884 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:24.620406 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:24.620847 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:24.621591 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:24.622050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:24.622478 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:24.685452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4cf7b2cefd478a9f41c45becc3acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70148abf962420bbcbaeb2ad311e574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:24.693372 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-197d6cb5-9028-46a4-87be-45e050a04813 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 200 len: 1218 microversion: 2.1 time: 0.086091 Sep 07 11:12:24.693952 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3731/7524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:24 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:25.716473 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:25.717108 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] [instance: 5947d600-f572-4c07-92c8-c2761f7f3e7f] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:25.724295 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:25.725090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:25.726189 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:25.727100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:25.727664 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:25.728152 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:25.743534 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.wsgi [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] HTTP exception thrown: Instance 5947d600-f572-4c07-92c8-c2761f7f3e7f could not be found. Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Request method failure captured: Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: request: GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f HTTP/1.1 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Accept: application/json Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Accept-Encoding: identity Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Connection: close Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Content-Length: 0 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Content-Type: application/json Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Host: 10.222.0.60 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: Openstack-System-Scope: None Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: User-Agent: python-urllib3/1.26.12 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Auth-Token: gAAAAABjGHqFBCWewqYtBTIG-wrFikYvTibkrNIf3YTRri6koAkiy9sBRcaKBQQWom_a6_kyLu8Nvik7tq8cUvjlloD2rHnWJWdYOInfGv_5GWm70TMpybuTtuv48QiUjyXQwhghK8FGhkSw2T8DONTZcKRg74IWBgzc_kKdKz_Qo91Ob6_ASnk Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Id: None Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Domain-Name: None Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Identity-Status: Confirmed Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Is-Admin-Project: True Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Id: default Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Domain-Name: Default Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Id: e70148abf962420bbcbaeb2ad311e574 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Project-Name: tempest-TestShelveInstance-1946841931 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Role: member,reader Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Roles: member,reader Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70148abf962420bbcbaeb2ad311e574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70148abf962420bbcbaeb2ad311e574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70148abf962420bbcbaeb2ad311e574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70148abf962420bbcbaeb2ad311e574", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant: tempest-TestShelveInstance-1946841931 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Id: e70148abf962420bbcbaeb2ad311e574 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-Tenant-Name: tempest-TestShelveInstance-1946841931 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-User: tempest-TestShelveInstance-1946841931-project Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Id: default Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Domain-Name: Default Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Id: 3f4cf7b2cefd478a9f41c45becc3acd8 Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: X-User-Name: tempest-TestShelveInstance-1946841931-project Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: method: > Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: exception: Instance 5947d600-f572-4c07-92c8-c2761f7f3e7f could not be found. Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: action_args: {'id': '5947d600-f572-4c07-92c8-c2761f7f3e7f'} Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5947d600-f572-4c07-92c8-c2761f7f3e7f could not be found. Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5947d600-f572-4c07-92c8-c2761f7f3e7f could not be found. Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:12:25.745254 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5947d600-f572-4c07-92c8-c2761f7f3e7f could not be found. Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: ERROR nova.api.openstack.wsgi Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Returning 404 to user: Instance 5947d600-f572-4c07-92c8-c2761f7f3e7f could not be found. {{(pid=128832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-bd53b47c-b386-4cc3-9823-3b9351a6c10c tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f" status: 404 len: 111 microversion: 2.1 time: 0.034245 Sep 07 11:12:25.750162 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3794/7525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:25 2022] GET /compute/v2.1/servers/5947d600-f572-4c07-92c8-c2761f7f3e7f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 11:12:25.917819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-4cdfac9e-91a3-4784-bce2-fff0abd53730 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] Calling method '.version_select at 0x7f14b0594790>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:25.951027 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-4cdfac9e-91a3-4784-bce2-fff0abd53730 tempest-TestShelveInstance-1946841931 tempest-TestShelveInstance-1946841931-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-113684068" status: 202 len: 0 microversion: 2.1 time: 0.037241 Sep 07 11:12:25.952974 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3732/7526] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 7 11:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-113684068 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 11:12:43.547631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:43.548785 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:43.776940 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-dbc633e3-829a-415e-9cab-722857c9ef20 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Action: 'create', calling method: .version_select at 0x7f14b07c9820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1499433117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm03C6hBoRjdyhHW79oUSfNBXjfG0Ul9sp4TdG4iSImqXob0F2W0cDbZwMdthRJA/xjb6K2nzh5KSV0iH2LQQFU5kBRMg9WvKBhzxxYUkrWpejfSsVU+kZbSCZi0e+6XA=="}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:43.794205 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dbc633e3-829a-415e-9cab-722857c9ef20 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Getting quotas for project 6ab40f24845949a28cb834943b1042b9. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:12:43.800633 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.quota [None req-dbc633e3-829a-415e-9cab-722857c9ef20 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Getting quotas for user ebb0ff0a2af1443abebd0baf11a1ed18 and project 6ab40f24845949a28cb834943b1042b9. Resources: {'key_pairs'} {{(pid=128832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:12:43.830969 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-dbc633e3-829a-415e-9cab-722857c9ef20 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.289235 Sep 07 11:12:43.831583 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3795/7527] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 7 11:12:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:12:44.789794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=22 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:44.790589 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:44.795918 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-773912372", "imageRef": "8aa3194e-7f8e-4ddc-8419-88dfe300e0f7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1499433117", "security_groups": [{"name": "tempest-secgroup-smoke-540959679"}], "networks": [{"uuid": "905ce1e8-549f-428a-b90b-e27ffeba22df"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:44.911491 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] validate_networks() for [('905ce1e8-549f-428a-b90b-e27ffeba22df', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 11:12:45.304341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 11:12:45.304795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 11:12:45.305298 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 11:12:45.305712 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 11:12:45.306127 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 11:12:45.315236 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:45.315716 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:45.316158 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:45.316895 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:45.317388 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:45.317823 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:45.336872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Getting quotas for project 6ab40f24845949a28cb834943b1042b9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:12:45.342558 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Getting quotas for user ebb0ff0a2af1443abebd0baf11a1ed18 and project 6ab40f24845949a28cb834943b1042b9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:12:45.356084 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 11:12:45.358395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8aa3194e-7f8e-4ddc-8419-88dfe300e0f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 11:12:45.404685 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-5fd9b592-706f-4c9e-b3b0-38b51639be79 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.617056 Sep 07 11:12:45.411607 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3733/7528] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 11:12:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 11:12:45.426618 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-6e6f74e0-e159-4b95-8549-f9b7bd89cbe1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:45.427271 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-6e6f74e0-e159-4b95-8549-f9b7bd89cbe1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:45.488421 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-6e6f74e0-e159-4b95-8549-f9b7bd89cbe1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:45.497936 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-6e6f74e0-e159-4b95-8549-f9b7bd89cbe1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1248 microversion: 2.1 time: 0.084355 Sep 07 11:12:45.499475 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3796/7529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:45 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:12:46.526613 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:46.527376 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:46.534207 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:46.534783 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:46.535224 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:46.535921 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:46.536402 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:46.537452 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:46.604334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:46.612150 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9c461fd1-47ed-405c-93c4-27c9b8a3f42b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1300 microversion: 2.1 time: 0.090384 Sep 07 11:12:46.612736 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3734/7530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:46 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:47.639226 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:47.640011 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:47.649025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:47.649556 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:47.650045 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:47.650768 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:47.651244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:47.651690 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:47.917496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:47.925254 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-96f10ff0-895a-4cae-b264-68961b57e84c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1373 microversion: 2.1 time: 0.290145 Sep 07 11:12:47.925833 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3797/7531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:47 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:48.305624 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-b05009f5-4591-4755-84d4-1613d15b5473 req-b0610169-e4bb-4281-afe5-764f3bbde187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:48.316395 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b05009f5-4591-4755-84d4-1613d15b5473 req-b0610169-e4bb-4281-afe5-764f3bbde187 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:48.316896 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b05009f5-4591-4755-84d4-1613d15b5473 req-b0610169-e4bb-4281-afe5-764f3bbde187 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:48.317366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-b05009f5-4591-4755-84d4-1613d15b5473 req-b0610169-e4bb-4281-afe5-764f3bbde187 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:48.329149 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-b05009f5-4591-4755-84d4-1613d15b5473 req-b0610169-e4bb-4281-afe5-764f3bbde187 service nova] Creating event network-changed:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:12:48.334149 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-b05009f5-4591-4755-84d4-1613d15b5473 req-b0610169-e4bb-4281-afe5-764f3bbde187 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033142 Sep 07 11:12:48.335026 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3735/7532] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:12:48.949669 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:48.950310 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:48.957650 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:48.958168 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:48.958631 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:48.959358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:48.959881 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:48.960853 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:49.112314 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:49.121825 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-ebeb1aaa-ec08-451c-99f4-a0de2e2d4d76 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1373 microversion: 2.1 time: 0.176016 Sep 07 11:12:49.122645 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3798/7533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:48 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:50.147065 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:50.147922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:50.154414 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:50.155185 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:50.155627 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:50.156332 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:50.156805 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:50.157251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:50.361020 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:50.369737 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-ab30f55b-be81-46ef-bc70-ee4ebf6000d9 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1373 microversion: 2.1 time: 0.227729 Sep 07 11:12:50.370319 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3736/7534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:50 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:51.392697 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:51.393358 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:51.401649 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:51.402150 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:51.402604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:51.403313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:51.403784 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:51.404223 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:51.546861 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:51.556620 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-0a955b1e-8cd4-4927-9612-cb4b6082f094 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1373 microversion: 2.1 time: 0.167720 Sep 07 11:12:51.557384 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3799/7535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:51 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:52.580538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:52.581156 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:52.589257 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:52.589748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:52.590193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:52.590892 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:52.591355 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:52.591785 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:52.730215 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:52.737982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9e449312-7c97-4c74-885a-8af60a06b0be tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1373 microversion: 2.1 time: 0.161367 Sep 07 11:12:52.738574 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3737/7536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:52 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:12:53.746997 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-25b8c20b-b375-4236-b577-ec3b8e26350e req-0a0ab596-df29-4fe7-8824-b7c294adfd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "name": "network-vif-plugged", "status": "completed", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:53.758183 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-25b8c20b-b375-4236-b577-ec3b8e26350e req-0a0ab596-df29-4fe7-8824-b7c294adfd92 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:53.759600 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-25b8c20b-b375-4236-b577-ec3b8e26350e req-0a0ab596-df29-4fe7-8824-b7c294adfd92 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:53.760539 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-25b8c20b-b375-4236-b577-ec3b8e26350e req-0a0ab596-df29-4fe7-8824-b7c294adfd92 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:53.765243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:53.766265 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:53.774289 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:53.774850 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:53.775012 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-25b8c20b-b375-4236-b577-ec3b8e26350e req-0a0ab596-df29-4fe7-8824-b7c294adfd92 service nova] Creating event network-vif-plugged:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:12:53.775444 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:53.776564 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:53.777028 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:53.777656 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:53.781314 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-25b8c20b-b375-4236-b577-ec3b8e26350e req-0a0ab596-df29-4fe7-8824-b7c294adfd92 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105905 Sep 07 11:12:53.782007 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3800/7537] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:12:53.976737 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:53.985272 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-e8063d34-8871-4e45-983b-ce17d428edda tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1373 microversion: 2.1 time: 0.224983 Sep 07 11:12:53.985962 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3738/7538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:53 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1373 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:12:55.011750 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:55.012482 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:55.018811 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:55.019335 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:55.019797 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:55.020517 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:55.020998 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:55.021519 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:55.160594 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:55.168591 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-b1a68194-2ae4-426e-8c3e-2579811816a3 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1559 microversion: 2.1 time: 0.162771 Sep 07 11:12:55.169172 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3801/7539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:55 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:55.190733 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:12:55.191351 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:12:55.199195 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:55.199686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:55.200123 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:55.200816 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:55.201302 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:55.201736 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:55.326930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:55.339211 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:12:55.348750 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d912642f-2b9b-457e-9928-bec162ae921e tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1559 microversion: 2.1 time: 0.161890 Sep 07 11:12:55.349357 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3739/7540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:12:55 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:12:57.070769 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=6 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:12:57.126339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-5c0e0206-c965-4f9d-bc3f-f61c4d44dde4 req-d21c79e8-e196-4c52-a177-d719bf25339d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:12:57.137035 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5c0e0206-c965-4f9d-bc3f-f61c4d44dde4 req-d21c79e8-e196-4c52-a177-d719bf25339d service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:12:57.137646 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5c0e0206-c965-4f9d-bc3f-f61c4d44dde4 req-d21c79e8-e196-4c52-a177-d719bf25339d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:12:57.138104 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-5c0e0206-c965-4f9d-bc3f-f61c4d44dde4 req-d21c79e8-e196-4c52-a177-d719bf25339d service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:12:57.149477 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-5c0e0206-c965-4f9d-bc3f-f61c4d44dde4 req-d21c79e8-e196-4c52-a177-d719bf25339d service nova] Creating event network-changed:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:12:57.154653 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-5c0e0206-c965-4f9d-bc3f-f61c4d44dde4 req-d21c79e8-e196-4c52-a177-d719bf25339d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089132 Sep 07 11:12:57.155274 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3802/7541] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:14:52.269062 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 11:14:52.270311 n-d-836830-16 devstack@n-api.service[128833]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 11:14:52.270660 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:14:52.271532 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:14:52.272483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=34 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:14:52.273939 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 11:14:52.274085 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 11:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64/action (ip 10.222.0.60) !!! Sep 07 11:14:52.279946 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2056266022"}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:14:52.282366 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:14:52.291998 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:14:52.292446 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:14:52.292891 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:14:52.294242 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:14:52.294755 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:14:52.295188 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:14:52.503526 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6357751d-a413-494f-9eda-0caab9b62b68 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "POST /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64/action" status: 202 len: 0 microversion: 2.1 time: 0.236144 Sep 07 11:14:52.504186 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3740/7542] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:14:52 2022] POST /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 11:14:58.417585 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 11:14:58.423482 n-d-836830-16 devstack@n-api.service[128832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 11:14:58.424386 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:14:58.425792 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=28 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:14:58.427788 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:14:58.427980 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:14:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 07 11:14:58.436207 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-ddcf28b1-e38c-4b1f-a31f-bf2be45549eb req-a34beb69-3b53-494f-a77c-55b4219f53e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "name": "network-vif-plugged", "status": "completed", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:14:58.447326 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ddcf28b1-e38c-4b1f-a31f-bf2be45549eb req-a34beb69-3b53-494f-a77c-55b4219f53e6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:14:58.448116 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ddcf28b1-e38c-4b1f-a31f-bf2be45549eb req-a34beb69-3b53-494f-a77c-55b4219f53e6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:14:58.448739 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-ddcf28b1-e38c-4b1f-a31f-bf2be45549eb req-a34beb69-3b53-494f-a77c-55b4219f53e6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:14:58.465828 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-ddcf28b1-e38c-4b1f-a31f-bf2be45549eb req-a34beb69-3b53-494f-a77c-55b4219f53e6 service nova] Creating event network-vif-plugged:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:14:58.471912 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-ddcf28b1-e38c-4b1f-a31f-bf2be45549eb req-a34beb69-3b53-494f-a77c-55b4219f53e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058010 Sep 07 11:14:58.473059 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3803/7543] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:15:06.081809 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1259762100", "imageRef": "a2ba8ebd-d567-4f25-81a1-38b340ebc00d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1499433117", "security_groups": [{"name": "tempest-secgroup-smoke-540959679"}], "networks": [{"uuid": "905ce1e8-549f-428a-b90b-e27ffeba22df"}]}} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:15:06.091815 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:15:06.092900 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:15:06.114659 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [71ac24f0-e6a5-471f-962a-f8eb5fd0fb17] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37938. Sep 07 11:15:06.115872 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] [77674869-25b5-4350-ae3d-1ad07501854a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37940. Sep 07 11:15:06.202556 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.network.neutron [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] validate_networks() for [('905ce1e8-549f-428a-b90b-e27ffeba22df', None, None, None, None, None)] {{(pid=128833) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 11:15:06.637539 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Flavor limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 11:15:06.638392 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Image limits 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 11:15:06.638910 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Flavor pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 11:15:06.639325 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Image pref 0:0:0 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 11:15:06.639742 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.virt.hardware [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 11:15:06.648645 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:06.649069 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:06.649537 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:06.650266 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:06.650723 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:06.651148 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:06.668955 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Getting quotas for project 6ab40f24845949a28cb834943b1042b9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 11:15:06.674375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.quota [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Getting quotas for user ebb0ff0a2af1443abebd0baf11a1ed18 and project 6ab40f24845949a28cb834943b1042b9. Resources: {'cores', 'instances', 'ram'} {{(pid=128833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 11:15:06.687201 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Going to run 1 instances... {{(pid=128833) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 11:15:06.689727 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2ba8ebd-d567-4f25-81a1-38b340ebc00d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 11:15:06.738579 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-69eaeaec-8417-4f39-9282-1288393a817c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.665521 Sep 07 11:15:06.739308 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3741/7544] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 7 11:15:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 11:15:06.753858 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4f14c316-cd28-49dd-942b-ff854505a58f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:06.754584 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4f14c316-cd28-49dd-942b-ff854505a58f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:06.766994 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [e87a7053-6727-4886-8996-2201ef27f487] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37954. Sep 07 11:15:06.767816 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d5dc7eb-45f8-40d0-99af-ae233c4f4ff1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37956. Sep 07 11:15:06.819684 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4f14c316-cd28-49dd-942b-ff854505a58f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:06.827209 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4f14c316-cd28-49dd-942b-ff854505a58f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1249 microversion: 2.1 time: 0.080096 Sep 07 11:15:06.828095 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3804/7545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:06 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:07.851457 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:07.852228 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:07.858773 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:07.859259 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:07.859694 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:07.860385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:07.860840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:07.861295 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:07.953686 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:07.962001 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0ee510aa-7136-4354-8852-9d9b8ff3cc38 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1309 microversion: 2.1 time: 0.115162 Sep 07 11:15:07.973218 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3742/7546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:07 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:08.987312 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:08.987941 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:09.002092 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:15:09.005220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:09.005965 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:09.006628 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:09.007894 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:09.008720 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:09.009566 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:09.168814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:09.178172 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-75554b91-a3d7-4ddc-8d20-f81475d1389b tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.194696 Sep 07 11:15:09.178763 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3805/7547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:08 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:10.202858 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:10.203594 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:10.210576 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:10.211142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:10.211769 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:10.212538 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:10.213062 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:10.213573 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:10.364085 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:10.373630 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c60b0e50-99e3-4d06-8060-fef3d0712999 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.174780 Sep 07 11:15:10.374858 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3743/7548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:10 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:15:10.457916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-318d9687-de2f-4e34-a175-e88ed21e3dc2 req-b5e1d0c0-6670-487f-8a09-4892d9d26455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "name": "network-vif-unplugged", "status": "completed", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:15:10.471220 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-318d9687-de2f-4e34-a175-e88ed21e3dc2 req-b5e1d0c0-6670-487f-8a09-4892d9d26455 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:10.472014 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-318d9687-de2f-4e34-a175-e88ed21e3dc2 req-b5e1d0c0-6670-487f-8a09-4892d9d26455 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:10.472657 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-318d9687-de2f-4e34-a175-e88ed21e3dc2 req-b5e1d0c0-6670-487f-8a09-4892d9d26455 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:10.488927 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-318d9687-de2f-4e34-a175-e88ed21e3dc2 req-b5e1d0c0-6670-487f-8a09-4892d9d26455 service nova] Creating event network-vif-unplugged:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:15:10.494469 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-318d9687-de2f-4e34-a175-e88ed21e3dc2 req-b5e1d0c0-6670-487f-8a09-4892d9d26455 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040392 Sep 07 11:15:10.495661 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3806/7549] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:15:11.398606 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:11.399142 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:11.406239 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:11.406738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:11.407181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:11.407897 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:11.408362 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:11.408794 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:11.562372 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:11.570408 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-d36185b2-6b57-48ad-8b17-71f94310bf2c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.175827 Sep 07 11:15:11.585266 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3744/7550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:11 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:12.596174 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:12.596901 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:12.603460 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:12.603967 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:12.604424 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:12.605137 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:12.606195 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:12.606652 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:12.764450 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:12.772345 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-48d28a9e-41c7-4bd3-8ce4-2d0b83652533 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.181445 Sep 07 11:15:12.782501 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3807/7551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:12 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:13.798827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:13.799470 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:13.806568 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:13.807066 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:13.807508 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:13.808216 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:13.809587 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:13.810210 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:13.962234 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:13.974630 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-6c24ffdb-e1c5-48f6-bf94-cbdca5ff3e86 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.179646 Sep 07 11:15:13.975502 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3745/7552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:13 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 11:15:15.002140 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:15.003404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:15.011470 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:15.012039 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:15.013445 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:15.014373 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:15.014916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:15.015555 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:15.514601 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:15.523680 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-821ad1df-24e2-4371-ae81-3a4702e674f0 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.528441 Sep 07 11:15:15.524273 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3808/7553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:14 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:16.547507 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:16.548097 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:16.554880 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:16.555360 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:16.555795 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:16.556481 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:16.556930 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:16.557385 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:16.659885 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=2 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:15:16.681540 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell0:SELECT=6 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:15:16.693840 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:16.702169 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-9f69fd48-41b6-4d79-bfd6-00cc86d696bc tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.158634 Sep 07 11:15:16.702747 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3746/7554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:16 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:17.582061 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-3e842850-e4e3-4cfe-b0fe-eb85e7cd2019 req-262e896e-b24e-41d3-858b-367fd4cbc4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e254ff1-caa8-4809-8e6e-e3445facef4d", "tag": "00a85362-bd00-4622-8fc6-896a93ee8b37"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:15:17.588670 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell0:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:15:17.595105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e842850-e4e3-4cfe-b0fe-eb85e7cd2019 req-262e896e-b24e-41d3-858b-367fd4cbc4d5 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:17.595596 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e842850-e4e3-4cfe-b0fe-eb85e7cd2019 req-262e896e-b24e-41d3-858b-367fd4cbc4d5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:17.596043 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-3e842850-e4e3-4cfe-b0fe-eb85e7cd2019 req-262e896e-b24e-41d3-858b-367fd4cbc4d5 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:17.607583 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-3e842850-e4e3-4cfe-b0fe-eb85e7cd2019 req-262e896e-b24e-41d3-858b-367fd4cbc4d5 service nova] Creating event network-changed:00a85362-bd00-4622-8fc6-896a93ee8b37 for instance 3e254ff1-caa8-4809-8e6e-e3445facef4d on n-h1-836830-16 Sep 07 11:15:17.612654 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-3e842850-e4e3-4cfe-b0fe-eb85e7cd2019 req-262e896e-b24e-41d3-858b-367fd4cbc4d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035060 Sep 07 11:15:17.613420 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3809/7555] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:15:17.725610 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:17.726334 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:17.733501 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:17.734099 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:17.734614 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:17.735413 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:17.735950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:17.736454 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:17.953043 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:17.960894 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-0a2d89e6-30b3-473f-a80c-d2f0633a192c tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.239257 Sep 07 11:15:17.961771 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3747/7556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:17 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:18.987076 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:18.987833 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:18.994100 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:18.994604 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:18.995059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:18.996018 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:18.996515 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:18.997025 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:19.175726 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:19.183538 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-8af7af31-fd14-47b1-8234-448f69127d6d tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.201515 Sep 07 11:15:19.184728 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3810/7557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:18 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:20.209827 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:20.210379 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:20.217341 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:20.217833 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:20.218277 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:20.218975 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:20.219438 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:20.219872 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:20.366318 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:20.375153 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-53ec2a1b-27a2-4d64-b93a-0e5fa8159dba tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.169461 Sep 07 11:15:20.375743 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3748/7558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:20 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:21.175553 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [req-20f719e1-5b49-45d3-8dae-5325c4cf6b82 req-a73ff40e-3f17-4d31-a0ac-7a9cbbdd8871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e254ff1-caa8-4809-8e6e-e3445facef4d", "name": "network-vif-plugged", "status": "completed", "tag": "00a85362-bd00-4622-8fc6-896a93ee8b37"}]} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:15:21.187453 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-20f719e1-5b49-45d3-8dae-5325c4cf6b82 req-a73ff40e-3f17-4d31-a0ac-7a9cbbdd8871 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:21.187954 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-20f719e1-5b49-45d3-8dae-5325c4cf6b82 req-a73ff40e-3f17-4d31-a0ac-7a9cbbdd8871 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:21.188404 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [req-20f719e1-5b49-45d3-8dae-5325c4cf6b82 req-a73ff40e-3f17-4d31-a0ac-7a9cbbdd8871 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:21.200301 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.compute.server_external_events [req-20f719e1-5b49-45d3-8dae-5325c4cf6b82 req-a73ff40e-3f17-4d31-a0ac-7a9cbbdd8871 service nova] Creating event network-vif-plugged:00a85362-bd00-4622-8fc6-896a93ee8b37 for instance 3e254ff1-caa8-4809-8e6e-e3445facef4d on n-h1-836830-16 Sep 07 11:15:21.205357 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [req-20f719e1-5b49-45d3-8dae-5325c4cf6b82 req-a73ff40e-3f17-4d31-a0ac-7a9cbbdd8871 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Sep 07 11:15:21.205959 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3811/7559] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 11:15:21.398535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:21.399179 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:21.406819 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:21.407306 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:21.407746 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:21.408450 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:21.408913 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:21.409386 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:21.545429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:21.554079 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-c89d2b08-f0d5-4e1b-8fdb-4fdbe1c511bd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.159410 Sep 07 11:15:21.564194 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3749/7560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:21 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:22.579790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:22.580496 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:22.587510 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:22.588012 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:22.588467 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:22.589529 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:22.590984 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:22.591581 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:22.764579 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:22.774780 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-a1ca4390-ef73-469c-91ad-b4368bb36521 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1374 microversion: 2.1 time: 0.200831 Sep 07 11:15:22.775376 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3812/7561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:22 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1374 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:23.801163 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:23.801797 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:23.808483 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:23.809050 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:23.809526 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:23.810209 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:23.810663 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:23.811088 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:23.945987 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:23.954587 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-2de8d8d4-1f19-4615-bbfa-fecb40370627 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1559 microversion: 2.1 time: 0.157383 Sep 07 11:15:23.955181 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3750/7562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:23 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:23.978178 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:15:23.978829 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:15:23.985831 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:23.986322 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:23.986766 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:23.987459 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:23.987924 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:23.988361 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:24.124873 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:15:24.132621 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f04a59be-24d9-421e-94d9-7d098f5ee084 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1559 microversion: 2.1 time: 0.158379 Sep 07 11:15:24.133206 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3813/7563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:15:23 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:15:25.850391 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-27c4fb20-62df-43c1-a134-953357304835 req-54ee81da-e0bf-480d-8475-e966a156b8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e254ff1-caa8-4809-8e6e-e3445facef4d", "tag": "00a85362-bd00-4622-8fc6-896a93ee8b37"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:15:25.860780 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-27c4fb20-62df-43c1-a134-953357304835 req-54ee81da-e0bf-480d-8475-e966a156b8b6 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:15:25.861301 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-27c4fb20-62df-43c1-a134-953357304835 req-54ee81da-e0bf-480d-8475-e966a156b8b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:15:25.861748 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-27c4fb20-62df-43c1-a134-953357304835 req-54ee81da-e0bf-480d-8475-e966a156b8b6 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:15:25.873915 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-27c4fb20-62df-43c1-a134-953357304835 req-54ee81da-e0bf-480d-8475-e966a156b8b6 service nova] Creating event network-changed:00a85362-bd00-4622-8fc6-896a93ee8b37 for instance 3e254ff1-caa8-4809-8e6e-e3445facef4d on n-h1-836830-16 Sep 07 11:15:25.878974 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-27c4fb20-62df-43c1-a134-953357304835 req-54ee81da-e0bf-480d-8475-e966a156b8b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094318 Sep 07 11:15:25.879812 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3751/7564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:16:53.878244 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1387338726"}} {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:16:53.881872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:16:53.887323 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=24 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:16:53.889277 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=42 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:16:53.890553 n-d-836830-16 devstack@n-api.service[128832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:16:53.892318 n-d-836830-16 devstack@n-api.service[128832]: Wed Sep 7 11:16:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d/action (ip 10.222.0.60) !!! Sep 07 11:16:53.899484 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:16:53.900084 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:16:53.900541 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:16:53.902067 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:16:53.903095 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:16:53.903542 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:16:54.324597 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-57132952-1135-4b37-8082-4641377053cd tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "POST /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d/action" status: 202 len: 0 microversion: 2.1 time: 0.451423 Sep 07 11:16:54.325421 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3814/7565] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 7 11:16:53 2022] POST /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 11:17:01.762852 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:17:01.763950 n-d-836830-16 devstack@n-api.service[128833]: DEBUG dbcounter [-] [128833] Writing DB stats nova_cell1:SELECT=58 {{(pid=128833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:17:01.766202 n-d-836830-16 devstack@n-api.service[128833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 11:17:01.766202 n-d-836830-16 devstack@n-api.service[128833]: Wed Sep 7 11:17:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 07 11:17:01.774349 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-787764b7-bbf8-493a-a906-3d5dd6308ec0 req-8aa4eeb8-eda6-4b2d-8d5c-b89adc60c49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e254ff1-caa8-4809-8e6e-e3445facef4d", "name": "network-vif-plugged", "status": "completed", "tag": "00a85362-bd00-4622-8fc6-896a93ee8b37"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:17:01.796678 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-787764b7-bbf8-493a-a906-3d5dd6308ec0 req-8aa4eeb8-eda6-4b2d-8d5c-b89adc60c49c service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:01.797643 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-787764b7-bbf8-493a-a906-3d5dd6308ec0 req-8aa4eeb8-eda6-4b2d-8d5c-b89adc60c49c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:01.798898 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-787764b7-bbf8-493a-a906-3d5dd6308ec0 req-8aa4eeb8-eda6-4b2d-8d5c-b89adc60c49c service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:01.812025 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-787764b7-bbf8-493a-a906-3d5dd6308ec0 req-8aa4eeb8-eda6-4b2d-8d5c-b89adc60c49c service nova] Creating event network-vif-plugged:00a85362-bd00-4622-8fc6-896a93ee8b37 for instance 3e254ff1-caa8-4809-8e6e-e3445facef4d on n-h1-836830-16 Sep 07 11:17:01.817724 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-787764b7-bbf8-493a-a906-3d5dd6308ec0 req-8aa4eeb8-eda6-4b2d-8d5c-b89adc60c49c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058300 Sep 07 11:17:01.818340 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3752/7566] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:17:09.006181 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_api:SELECT=2 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:17:09.007919 n-d-836830-16 devstack@n-api.service[128832]: DEBUG dbcounter [-] [128832] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 11:17:09.010429 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-15fb6910-3244-4920-96f7-9bc4b56e31a1 req-bcf8c9b7-c09f-4ebe-97a3-709f213bffce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e254ff1-caa8-4809-8e6e-e3445facef4d", "tag": "00a85362-bd00-4622-8fc6-896a93ee8b37"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:17:09.013319 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:09.014253 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:09.021465 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:09.022090 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:09.022248 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-15fb6910-3244-4920-96f7-9bc4b56e31a1 req-bcf8c9b7-c09f-4ebe-97a3-709f213bffce service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:09.022612 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-15fb6910-3244-4920-96f7-9bc4b56e31a1 req-bcf8c9b7-c09f-4ebe-97a3-709f213bffce service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:09.022836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:09.023243 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-15fb6910-3244-4920-96f7-9bc4b56e31a1 req-bcf8c9b7-c09f-4ebe-97a3-709f213bffce service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:09.023877 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:09.024454 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:09.025117 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:09.035623 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-15fb6910-3244-4920-96f7-9bc4b56e31a1 req-bcf8c9b7-c09f-4ebe-97a3-709f213bffce service nova] Creating event network-changed:00a85362-bd00-4622-8fc6-896a93ee8b37 for instance 3e254ff1-caa8-4809-8e6e-e3445facef4d on n-h1-836830-16 Sep 07 11:17:09.041000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-15fb6910-3244-4920-96f7-9bc4b56e31a1 req-bcf8c9b7-c09f-4ebe-97a3-709f213bffce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036230 Sep 07 11:17:09.041636 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3753/7567] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:17:09.059828 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:17:09.150565 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-3d78e0f8-bdd8-41e2-9dfd-6e3b6d47502f tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 204 len: 0 microversion: 2.1 time: 0.147100 Sep 07 11:17:09.155129 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3815/7568] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:17:09 2022] DELETE /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:17:09.161223 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:09.162072 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:09.174588 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:09.175375 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:09.175982 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:09.176871 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:09.177546 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:09.178157 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:09.385905 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:17:09.394677 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-48f584fc-6633-4dba-ae66-32c860896602 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1684 microversion: 2.1 time: 0.238051 Sep 07 11:17:09.395260 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3754/7569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:09 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1684 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:17:10.418909 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:10.419777 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:10.429398 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:10.429907 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:10.430362 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:10.431105 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:10.431582 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:10.432024 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:10.569644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:17:10.578020 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-4686d48c-6fda-4e1f-8f55-04479dbb584a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1684 microversion: 2.1 time: 0.163293 Sep 07 11:17:10.578568 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3816/7570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:10 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:17:11.469011 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-56fe0de4-edfe-49dc-92dd-287da1f41f48 req-6541f21b-f4aa-4f0d-9464-b51bf0dce1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e254ff1-caa8-4809-8e6e-e3445facef4d", "name": "network-vif-deleted", "tag": "00a85362-bd00-4622-8fc6-896a93ee8b37"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:17:11.484793 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-56fe0de4-edfe-49dc-92dd-287da1f41f48 req-6541f21b-f4aa-4f0d-9464-b51bf0dce1c8 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:11.485659 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-56fe0de4-edfe-49dc-92dd-287da1f41f48 req-6541f21b-f4aa-4f0d-9464-b51bf0dce1c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:11.486420 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-56fe0de4-edfe-49dc-92dd-287da1f41f48 req-6541f21b-f4aa-4f0d-9464-b51bf0dce1c8 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:11.504919 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-56fe0de4-edfe-49dc-92dd-287da1f41f48 req-6541f21b-f4aa-4f0d-9464-b51bf0dce1c8 service nova] Creating event network-vif-deleted:00a85362-bd00-4622-8fc6-896a93ee8b37 for instance 3e254ff1-caa8-4809-8e6e-e3445facef4d on n-h1-836830-16 Sep 07 11:17:11.511940 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-56fe0de4-edfe-49dc-92dd-287da1f41f48 req-6541f21b-f4aa-4f0d-9464-b51bf0dce1c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047143 Sep 07 11:17:11.512956 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3755/7571] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:17:11.603352 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:11.604047 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:11.611321 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:11.611819 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:11.612266 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:11.612964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:11.613451 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:11.613888 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:11.647866 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:11.648576 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:11.649258 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:11.649719 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lazy-loading 'fault' on Instance uuid 3e254ff1-caa8-4809-8e6e-e3445facef4d {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:17:11.693339 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:17:11.702154 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-52e94ca6-8329-4b33-b473-48402d7fca3a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 200 len: 1339 microversion: 2.1 time: 0.102720 Sep 07 11:17:11.702723 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3817/7572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:11 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:17:12.726571 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:12.727230 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 3e254ff1-caa8-4809-8e6e-e3445facef4d] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:12.733671 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:12.734161 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:12.734604 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:12.735299 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:12.735759 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:12.736193 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:12.749886 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] HTTP exception thrown: Instance 3e254ff1-caa8-4809-8e6e-e3445facef4d could not be found. Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Request method failure captured: Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d HTTP/1.1 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHymwMmFwzWwDri43nNoa0ym_0-po45UOyU1A7k2cXwbZN6cm5yCYRlPKgb6coJFhP6MyrYVDslKWSVLXdZE9bSiaOwZPaCJfu_L0qmE2NRZ4RtNoS2AqGYcewBgzUCXy2HyUS-NqWhp_GLXbRqHPYAmWoGqZYqoamQ4pQTBC8E2X8A Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 6ab40f24845949a28cb834943b1042b9 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestSnapshotPattern-1665091044 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ab40f24845949a28cb834943b1042b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ab40f24845949a28cb834943b1042b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ab40f24845949a28cb834943b1042b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ab40f24845949a28cb834943b1042b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestSnapshotPattern-1665091044 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 6ab40f24845949a28cb834943b1042b9 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestSnapshotPattern-1665091044 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestSnapshotPattern-1665091044-project Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: ebb0ff0a2af1443abebd0baf11a1ed18 Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestSnapshotPattern-1665091044-project Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 3e254ff1-caa8-4809-8e6e-e3445facef4d could not be found. Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '3e254ff1-caa8-4809-8e6e-e3445facef4d'} Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e254ff1-caa8-4809-8e6e-e3445facef4d could not be found. Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e254ff1-caa8-4809-8e6e-e3445facef4d could not be found. Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:17:12.751535 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e254ff1-caa8-4809-8e6e-e3445facef4d could not be found. Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Returning 404 to user: Instance 3e254ff1-caa8-4809-8e6e-e3445facef4d could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-72a780e5-35db-4151-93bb-4924c100c2a2 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d" status: 404 len: 111 microversion: 2.1 time: 0.031767 Sep 07 11:17:12.757254 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3756/7573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:12 2022] GET /compute/v2.1/servers/3e254ff1-caa8-4809-8e6e-e3445facef4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 11:17:14.449922 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-dc55494a-b683-468c-b920-33f4335f20e0 req-7c2db9cb-ade1-4e82-8419-f97e773e47ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:17:14.457644 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:14.458141 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:14.470753 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:14.471260 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:14.471712 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:14.472430 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:14.472895 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:14.473366 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:14.487194 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dc55494a-b683-468c-b920-33f4335f20e0 req-7c2db9cb-ade1-4e82-8419-f97e773e47ba service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:14.487672 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dc55494a-b683-468c-b920-33f4335f20e0 req-7c2db9cb-ade1-4e82-8419-f97e773e47ba service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:14.488106 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-dc55494a-b683-468c-b920-33f4335f20e0 req-7c2db9cb-ade1-4e82-8419-f97e773e47ba service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:14.500982 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-dc55494a-b683-468c-b920-33f4335f20e0 req-7c2db9cb-ade1-4e82-8419-f97e773e47ba service nova] Creating event network-changed:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:17:14.506138 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-dc55494a-b683-468c-b920-33f4335f20e0 req-7c2db9cb-ade1-4e82-8419-f97e773e47ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059797 Sep 07 11:17:14.506954 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3757/7574] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:17:14.527154 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Going to try to terminate instance {{(pid=128832) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 11:17:14.624247 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-900a226f-a2b1-42f6-bde2-90f29182195a tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 204 len: 0 microversion: 2.1 time: 0.178802 Sep 07 11:17:14.626091 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3818/7575] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 7 11:17:14 2022] DELETE /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 11:17:14.635854 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:14.636948 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:14.643649 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:14.644359 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:14.644991 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:14.645890 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:14.646514 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:14.647251 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:14.818023 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.policy [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128833) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:17:14.826928 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-cd0307a0-bb0b-4c63-a38a-4a6d54cf9b60 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1684 microversion: 2.1 time: 0.194729 Sep 07 11:17:14.827222 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3758/7576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:14 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:17:15.850836 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:15.851558 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:15.859313 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:15.859814 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:15.860265 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:15.860964 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:15.861472 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:15.861916 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:16.067058 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:17:16.074787 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f5f1ccef-5a91-494e-859d-a2b01e80a820 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1684 microversion: 2.1 time: 0.228289 Sep 07 11:17:16.075356 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3819/7577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:15 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1684 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:17:16.816170 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [req-3669f86f-1b76-4c9d-9305-fae9383e4ebc req-edad35a7-1c59-43f8-95c5-a27579c99257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528543e-a850-4479-a93c-163ec9636c64", "name": "network-vif-deleted", "tag": "7f43ca62-41eb-437d-9911-1e5459067f9c"}]} {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 11:17:16.828949 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3669f86f-1b76-4c9d-9305-fae9383e4ebc req-edad35a7-1c59-43f8-95c5-a27579c99257 service nova] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:16.829468 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3669f86f-1b76-4c9d-9305-fae9383e4ebc req-edad35a7-1c59-43f8-95c5-a27579c99257 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:16.830738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [req-3669f86f-1b76-4c9d-9305-fae9383e4ebc req-edad35a7-1c59-43f8-95c5-a27579c99257 service nova] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:16.843960 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.compute.server_external_events [req-3669f86f-1b76-4c9d-9305-fae9383e4ebc req-edad35a7-1c59-43f8-95c5-a27579c99257 service nova] Creating event network-vif-deleted:7f43ca62-41eb-437d-9911-1e5459067f9c for instance 8528543e-a850-4479-a93c-163ec9636c64 on n-h2-836830-16 Sep 07 11:17:16.850000 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [req-3669f86f-1b76-4c9d-9305-fae9383e4ebc req-edad35a7-1c59-43f8-95c5-a27579c99257 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037591 Sep 07 11:17:16.850606 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3759/7578] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 7 11:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 11:17:17.100032 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:17.100667 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.compute.api [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128832) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:17.108059 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:17.108589 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:17.109250 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:17.109968 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:17.110437 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:17.110872 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:17.144615 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:17.144972 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:17.145462 n-d-836830-16 devstack@n-api.service[128832]: DEBUG oslo_concurrency.lockutils [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:17.145928 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.objects.instance [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lazy-loading 'fault' on Instance uuid 8528543e-a850-4479-a93c-163ec9636c64 {{(pid=128832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 11:17:17.189790 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.policy [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb0ff0a2af1443abebd0baf11a1ed18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab40f24845949a28cb834943b1042b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128832) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 11:17:17.198012 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-f481d064-ad2c-47c6-b986-d9ddee634441 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 200 len: 1338 microversion: 2.1 time: 0.102016 Sep 07 11:17:17.198601 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3820/7579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:17 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 11:17:18.223382 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '>' {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:18.224095 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.compute.api [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] [instance: 8528543e-a850-4479-a93c-163ec9636c64] Fetching instance by UUID {{(pid=128833) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 11:17:18.231256 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:18.231738 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:18.232909 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:18.233724 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Acquiring lock "f6da09e8-203a-4fea-baad-b6e28ec12187" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 11:17:18.234181 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 11:17:18.234609 n-d-836830-16 devstack@n-api.service[128833]: DEBUG oslo_concurrency.lockutils [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Lock "f6da09e8-203a-4fea-baad-b6e28ec12187" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 11:17:18.248902 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.wsgi [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] HTTP exception thrown: Instance 8528543e-a850-4479-a93c-163ec9636c64 could not be found. Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Request method failure captured: Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: request: GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 HTTP/1.1 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Accept: application/json Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Accept-Encoding: identity Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Connection: close Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Content-Length: 0 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Content-Type: application/json Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Host: 10.222.0.60 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: Openstack-System-Scope: None Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: User-Agent: python-urllib3/1.26.12 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Auth-Token: gAAAAABjGHymwMmFwzWwDri43nNoa0ym_0-po45UOyU1A7k2cXwbZN6cm5yCYRlPKgb6coJFhP6MyrYVDslKWSVLXdZE9bSiaOwZPaCJfu_L0qmE2NRZ4RtNoS2AqGYcewBgzUCXy2HyUS-NqWhp_GLXbRqHPYAmWoGqZYqoamQ4pQTBC8E2X8A Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Id: None Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Domain-Name: None Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Identity-Status: Confirmed Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Is-Admin-Project: True Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Id: default Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Domain-Name: Default Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Id: 6ab40f24845949a28cb834943b1042b9 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Project-Name: tempest-TestSnapshotPattern-1665091044 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Role: member,reader Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Roles: member,reader Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ab40f24845949a28cb834943b1042b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ab40f24845949a28cb834943b1042b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ab40f24845949a28cb834943b1042b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ab40f24845949a28cb834943b1042b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant: tempest-TestSnapshotPattern-1665091044 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Id: 6ab40f24845949a28cb834943b1042b9 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-Tenant-Name: tempest-TestSnapshotPattern-1665091044 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-User: tempest-TestSnapshotPattern-1665091044-project Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Id: default Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-User-Domain-Name: Default Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-User-Id: ebb0ff0a2af1443abebd0baf11a1ed18 Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: X-User-Name: tempest-TestSnapshotPattern-1665091044-project Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: method: > Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: exception: Instance 8528543e-a850-4479-a93c-163ec9636c64 could not be found. Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: action_args: {'id': '8528543e-a850-4479-a93c-163ec9636c64'} Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: {{(pid=128833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528543e-a850-4479-a93c-163ec9636c64 could not be found. Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528543e-a850-4479-a93c-163ec9636c64 could not be found. Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 11:17:18.250719 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528543e-a850-4479-a93c-163ec9636c64 could not be found. Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: ERROR nova.api.openstack.wsgi Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: DEBUG nova.api.openstack.wsgi [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Returning 404 to user: Instance 8528543e-a850-4479-a93c-163ec9636c64 could not be found. {{(pid=128833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: INFO nova.api.openstack.requestlog [None req-770e0931-62c4-4a12-9be6-23801961bdb1 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64" status: 404 len: 111 microversion: 2.1 time: 0.033035 Sep 07 11:17:18.256315 n-d-836830-16 devstack@n-api.service[128833]: [pid: 128833|app: 0|req: 3760/7580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 7 11:17:18 2022] GET /compute/v2.1/servers/8528543e-a850-4479-a93c-163ec9636c64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 11:17:18.422676 n-d-836830-16 devstack@n-api.service[128832]: DEBUG nova.api.openstack.wsgi [None req-906d2dcd-1d82-42f0-9789-ed191b229311 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] Calling method '.version_select at 0x7f14b08114c0>' {{(pid=128832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 11:17:18.451249 n-d-836830-16 devstack@n-api.service[128832]: INFO nova.api.openstack.requestlog [None req-906d2dcd-1d82-42f0-9789-ed191b229311 tempest-TestSnapshotPattern-1665091044 tempest-TestSnapshotPattern-1665091044-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1499433117" status: 202 len: 0 microversion: 2.1 time: 0.033111 Sep 07 11:17:18.452245 n-d-836830-16 devstack@n-api.service[128832]: [pid: 128832|app: 0|req: 3821/7581] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 7 11:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1499433117 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)